2024-09-21T05:30:10.973 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T05:30:10.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T05:30:11.088 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913501 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsx}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913501' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.dir_split install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDQX1RrtADCPFT5JRvNyzBiS3WHjXkO/jLhk2TMLXOLIN3PSRclcJhq2zsQLqVQasWznJKr9j4RadOHK7hUhMZA= smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEl5SnkFRyG7c5N97CLgQON4onzSyw2o1C9SAVoKGLw/CGZIwjTt+P0ZyWEQGlc7PlaWRkz98F+5Rs+EO+IGr7A= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJgZF00z2MCQuzsd/+N3aZbo41GMTV+owyKxHxKWLClX6eB7xmozhC/f2xHut37vQweuLOH6PZ3Ai11f7G3H2eQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - quiescer: null - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T05:30:11.088 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T05:30:11.089 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T05:30:11.089 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T05:30:11.091 INFO:teuthology.task.internal:Checking packages... 2024-09-21T05:30:11.109 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T05:30:11.109 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T05:30:11.109 INFO:teuthology.packaging:ref: None 2024-09-21T05:30:11.109 INFO:teuthology.packaging:tag: None 2024-09-21T05:30:11.109 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:30:11.109 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:30:11.110 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:30:11.255 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T05:30:11.256 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T05:30:11.263 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T05:30:11.263 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T05:30:11.322 INFO:teuthology.task.internal:Saving configuration 2024-09-21T05:30:11.341 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T05:30:11.363 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T05:30:11.389 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913501', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:25:07.188354', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDQX1RrtADCPFT5JRvNyzBiS3WHjXkO/jLhk2TMLXOLIN3PSRclcJhq2zsQLqVQasWznJKr9j4RadOHK7hUhMZA='} 2024-09-21T05:30:11.412 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913501', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:25:07.190232', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEl5SnkFRyG7c5N97CLgQON4onzSyw2o1C9SAVoKGLw/CGZIwjTt+P0ZyWEQGlc7PlaWRkz98F+5Rs+EO+IGr7A='} 2024-09-21T05:30:11.435 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913501', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:25:07.191876', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJgZF00z2MCQuzsd/+N3aZbo41GMTV+owyKxHxKWLClX6eB7xmozhC/f2xHut37vQweuLOH6PZ3Ai11f7G3H2eQ='} 2024-09-21T05:30:11.435 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T05:30:11.442 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T05:30:11.442 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T05:30:11.442 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T05:30:11.442 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T05:30:11.603 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff0d852c160>, signals=[15]) 2024-09-21T05:30:11.603 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T05:30:11.610 INFO:teuthology.task.internal:Opening connections... 2024-09-21T05:30:11.610 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T05:30:11.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:30:11.689 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2024-09-21T05:30:11.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:30:11.762 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2024-09-21T05:30:11.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:30:11.838 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T05:30:11.845 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-09-21T05:30:11.863 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-09-21T05:30:11.863 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-09-21T05:30:11.920 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-09-21T05:30:11.920 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-09-21T05:30:11.920 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-09-21T05:30:11.920 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:30:11.920 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-09-21T05:30:11.920 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:30:11.921 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:30:11.921 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-09-21T05:30:11.921 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:30:11.921 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:30:11.921 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:30:11.921 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:30:11.921 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:30:11.921 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:30:11.922 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-09-21T05:30:11.942 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-09-21T05:30:11.960 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-09-21T05:30:11.960 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-09-21T05:30:12.017 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-09-21T05:30:12.018 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2024-09-21T05:30:12.018 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-09-21T05:30:12.018 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:30:12.018 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2024-09-21T05:30:12.018 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:30:12.018 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:30:12.018 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-09-21T05:30:12.018 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:30:12.018 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:30:12.018 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:30:12.018 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:30:12.018 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:30:12.019 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:30:12.019 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-09-21T05:30:12.042 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-09-21T05:30:12.060 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-09-21T05:30:12.061 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-09-21T05:30:12.119 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-09-21T05:30:12.119 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2024-09-21T05:30:12.119 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-09-21T05:30:12.119 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:30:12.119 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2024-09-21T05:30:12.119 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:30:12.120 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:30:12.120 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-09-21T05:30:12.120 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:30:12.120 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:30:12.120 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:30:12.120 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:30:12.120 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:30:12.120 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:30:12.120 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-09-21T05:30:12.142 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T05:30:12.152 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T05:30:12.199 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T05:30:12.199 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:30:12.201 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:30:12.203 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:30:12.220 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T05:30:12.270 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T05:30:12.270 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:30:12.272 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:30:12.274 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:30:12.361 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T05:30:12.436 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T05:30:12.454 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T05:30:12.454 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-21T05:30:12.454 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-21T05:30:12.455 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:30:12.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:30:12.472 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-21T05:30:12.624 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T05:30:12.624 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-21T05:30:12.624 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-21T05:30:12.641 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-503.el9.x86_64 2024-09-21T05:30:12.641 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T05:30:12.642 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-21T05:30:12.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum upgrade -y linux-firmware 2024-09-21T05:30:14.958 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.3 MB 00:00 2024-09-21T05:30:18.526 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 20 MB 00:02 2024-09-21T05:30:25.035 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-21T05:30:26.535 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 81 kB/s | 19 kB 00:00 2024-09-21T05:30:27.348 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-21T05:30:33.004 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-21T05:30:35.048 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-21T05:30:35.060 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-21T05:30:35.060 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-09-21T05:30:35.060 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-21T05:30:35.060 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-09-21T05:30:35.060 INFO:teuthology.orchestra.run.smithi037.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-21T05:30:35.060 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:30:35.060 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-21T05:30:35.060 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-21T05:30:35.061 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 1 Package 2024-09-21T05:30:35.061 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:30:35.061 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 388 M 2024-09-21T05:30:35.061 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-21T05:30:56.937 INFO:teuthology.orchestra.run.smithi037.stdout:linux-firmware-20240905-146.el9.noarch.rpm 18 MB/s | 388 MB 00:21 2024-09-21T05:30:56.937 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:30:56.937 INFO:teuthology.orchestra.run.smithi037.stdout:Total 18 MB/s | 388 MB 00:21 2024-09-21T05:31:00.209 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-21T05:31:00.298 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-21T05:31:00.298 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-21T05:31:03.713 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-21T05:31:03.714 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-21T05:31:13.812 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-21T05:31:14.047 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T05:31:14.132 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T05:31:14.601 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T05:31:14.601 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T05:31:15.366 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T05:31:15.366 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:31:15.366 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-09-21T05:31:15.366 INFO:teuthology.orchestra.run.smithi037.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-21T05:31:15.366 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:31:15.367 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-21T05:31:15.817 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T05:31:15.818 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T05:31:15.964 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-21T05:31:15.965 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-21T05:31:15.967 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi037.front.sepia.ceph.com to complete... 2024-09-21T05:31:22.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21 05:31:22 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-21T05:31:22.269 INFO:teuthology.orchestra.run.smithi037.stderr:FINISHED --2024-09-21 05:31:22-- 2024-09-21T05:31:22.269 INFO:teuthology.orchestra.run.smithi037.stderr:Total wall clock time: 6.3s 2024-09-21T05:31:22.269 INFO:teuthology.orchestra.run.smithi037.stderr:Downloaded: 1 files, 343M in 6.0s (57.3 MB/s) 2024-09-21T05:31:22.272 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T05:31:22.272 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-21T05:31:24.432 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying... ######################################## 2024-09-21T05:31:24.495 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing... ######################################## 2024-09-21T05:31:24.558 INFO:teuthology.orchestra.run.smithi037.stdout:Updating / installing... 2024-09-21T05:31:32.915 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-21T05:32:13.056 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-21T05:32:13.057 DEBUG:teuthology.orchestra.run.smithi037:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-21T05:32:13.151 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:32:13.151 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:32:13.151 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-21T05:32:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-21T05:32:13.153 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-21T05:32:13.154 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-21T05:32:13.154 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-21T05:32:13.154 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-21T05:32:13.154 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-21T05:32:13.154 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-21T05:32:13.154 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-21T05:32:13.154 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-21T05:32:13.154 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-21T05:32:13.154 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-21T05:32:13.154 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-21T05:32:13.155 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-21T05:32:13.155 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-21T05:32:13.155 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-21T05:32:13.155 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-21T05:32:13.155 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-21T05:32:13.155 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-21T05:32:13.156 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-21T05:32:13.156 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-21T05:32:13.156 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-21T05:32:13.156 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-21T05:32:13.156 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-21T05:32:13.156 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-21T05:32:13.157 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-21T05:32:13.157 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-21T05:32:13.157 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-21T05:32:13.157 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-21T05:32:13.157 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-21T05:32:13.157 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-21T05:32:13.157 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-21T05:32:13.158 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-21T05:32:13.158 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-21T05:32:13.158 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-21T05:32:13.158 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-21T05:32:13.158 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-21T05:32:13.158 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-21T05:32:13.158 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-21T05:32:13.159 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-21T05:32:13.159 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-21T05:32:13.159 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-21T05:32:13.159 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-21T05:32:13.159 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-21T05:32:13.159 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-21T05:32:13.159 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-21T05:32:13.160 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-21T05:32:13.160 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-21T05:32:13.160 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-21T05:32:13.160 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-21T05:32:13.160 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-21T05:32:13.160 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-21T05:32:13.160 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-21T05:32:13.161 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-21T05:32:13.161 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-21T05:32:13.161 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-21T05:32:13.161 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-21T05:32:13.161 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-21T05:32:13.161 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-21T05:32:13.161 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-21T05:32:13.161 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-21T05:32:13.162 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-21T05:32:13.162 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-21T05:32:13.162 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-21T05:32:13.162 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-21T05:32:13.162 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-21T05:32:13.162 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-21T05:32:13.163 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-21T05:32:13.163 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-21T05:32:13.163 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-21T05:32:13.163 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-21T05:32:13.163 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-21T05:32:13.164 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-21T05:32:13.164 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-21T05:32:13.164 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-21T05:32:13.164 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-21T05:32:13.164 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-21T05:32:13.164 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-21T05:32:13.165 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-21T05:32:13.165 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-21T05:32:13.165 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-21T05:32:13.165 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-21T05:32:13.165 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-21T05:32:13.165 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-21T05:32:13.166 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-21T05:32:13.166 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-21T05:32:13.166 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-21T05:32:13.166 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-21T05:32:13.166 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-21T05:32:13.167 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-21T05:32:13.167 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-21T05:32:13.167 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-21T05:32:13.167 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-21T05:32:13.167 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-21T05:32:13.167 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-21T05:32:13.167 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-21T05:32:13.167 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-21T05:32:13.168 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-21T05:32:13.168 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-21T05:32:13.168 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-21T05:32:13.168 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-21T05:32:13.168 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-21T05:32:13.168 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-21T05:32:13.168 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-21T05:32:13.169 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-21T05:32:13.169 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-21T05:32:13.169 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-21T05:32:13.169 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-21T05:32:13.169 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-21T05:32:13.169 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-21T05:32:13.169 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-21T05:32:13.170 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-21T05:32:13.170 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-21T05:32:13.170 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-21T05:32:13.170 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-21T05:32:13.170 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-21T05:32:13.170 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-21T05:32:13.170 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-21T05:32:13.171 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-21T05:32:13.171 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-21T05:32:13.171 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-21T05:32:13.171 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-21T05:32:13.171 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-21T05:32:13.171 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-21T05:32:13.172 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-21T05:32:13.172 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-21T05:32:13.172 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-21T05:32:13.172 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-21T05:32:13.172 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-21T05:32:13.172 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-21T05:32:13.172 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-21T05:32:13.173 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-21T05:32:13.173 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-21T05:32:13.173 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-21T05:32:13.173 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-21T05:32:13.173 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-21T05:32:13.173 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-21T05:32:13.173 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-21T05:32:13.173 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-21T05:32:13.174 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-21T05:32:13.175 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-21T05:32:13.176 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-21T05:32:13.177 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-21T05:32:13.177 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-21T05:32:13.177 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-21T05:32:13.177 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-21T05:32:13.177 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-21T05:32:13.177 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-21T05:32:13.177 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-21T05:32:13.177 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-21T05:32:13.177 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-21T05:32:13.177 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-21T05:32:13.177 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-21T05:32:13.177 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-21T05:32:13.177 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-21T05:32:13.178 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-21T05:32:13.179 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-21T05:32:13.180 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-21T05:32:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-21T05:32:13.182 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-21T05:32:13.183 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-21T05:32:13.183 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-21T05:32:13.183 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-21T05:32:13.183 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-21T05:32:13.183 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-21T05:32:13.183 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-21T05:32:13.183 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-21T05:32:13.183 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-21T05:32:13.183 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-21T05:32:13.183 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-21T05:32:13.183 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-21T05:32:13.183 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-21T05:32:13.184 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-21T05:32:13.184 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-21T05:32:13.184 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-21T05:32:13.184 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-21T05:32:13.184 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-21T05:32:13.184 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-21T05:32:13.185 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-21T05:32:13.185 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-21T05:32:13.185 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-21T05:32:13.185 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-21T05:32:13.185 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-21T05:32:13.185 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-21T05:32:13.185 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-21T05:32:13.186 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-21T05:32:13.186 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-21T05:32:13.186 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-21T05:32:13.186 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-21T05:32:13.186 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-21T05:32:13.186 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-21T05:32:13.186 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-21T05:32:13.187 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-21T05:32:13.187 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-21T05:32:13.187 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-21T05:32:13.187 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-21T05:32:13.187 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-21T05:32:13.187 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-21T05:32:13.187 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-21T05:32:13.188 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-21T05:32:13.188 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-21T05:32:13.188 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-21T05:32:13.188 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-21T05:32:13.188 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-21T05:32:13.188 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-21T05:32:13.188 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-21T05:32:13.188 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-21T05:32:13.189 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-21T05:32:13.189 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-21T05:32:13.189 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-21T05:32:13.189 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-21T05:32:13.189 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-21T05:32:13.189 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-21T05:32:13.189 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-21T05:32:13.190 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-21T05:32:13.190 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-21T05:32:13.190 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-21T05:32:13.190 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-21T05:32:13.190 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-21T05:32:13.190 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-21T05:32:13.190 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-21T05:32:13.191 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-21T05:32:13.191 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-21T05:32:13.191 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-21T05:32:13.191 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-21T05:32:13.191 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-21T05:32:13.191 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-21T05:32:13.191 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-21T05:32:13.191 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-21T05:32:13.192 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-21T05:32:13.192 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-21T05:32:13.193 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-21T05:32:13.193 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-21T05:32:13.193 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-21T05:32:13.194 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-21T05:32:13.194 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-21T05:32:13.194 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-21T05:32:13.194 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-21T05:32:13.194 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-21T05:32:13.194 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-21T05:32:13.194 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-21T05:32:13.195 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-21T05:32:13.195 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-21T05:32:13.195 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-21T05:32:13.195 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-21T05:32:13.195 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-21T05:32:13.195 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-21T05:32:13.195 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-21T05:32:13.196 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-21T05:32:13.196 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-21T05:32:13.196 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-21T05:32:13.196 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-21T05:32:13.196 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-21T05:32:13.196 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-21T05:32:13.197 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-21T05:32:13.197 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-21T05:32:13.197 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-21T05:32:13.197 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-21T05:32:13.197 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-21T05:32:13.197 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-21T05:32:13.197 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-21T05:32:13.198 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-21T05:32:13.198 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-21T05:32:13.198 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-21T05:32:13.198 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-21T05:32:13.198 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-21T05:32:13.198 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-21T05:32:13.198 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-21T05:32:13.198 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-21T05:32:13.199 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-21T05:32:13.199 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-21T05:32:13.199 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-21T05:32:13.199 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-21T05:32:13.199 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-21T05:32:13.199 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-21T05:32:13.199 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-21T05:32:13.200 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-21T05:32:13.200 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-21T05:32:13.200 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-21T05:32:13.200 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-21T05:32:13.200 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-21T05:32:13.200 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-21T05:32:13.200 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-21T05:32:13.201 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-21T05:32:13.201 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-21T05:32:13.201 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-21T05:32:13.201 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-21T05:32:13.201 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-21T05:32:13.201 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-21T05:32:13.202 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-21T05:32:13.202 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-21T05:32:13.202 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-21T05:32:13.202 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-21T05:32:13.202 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-21T05:32:13.202 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-21T05:32:13.202 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-21T05:32:13.203 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-21T05:32:13.203 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-21T05:32:13.203 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-21T05:32:13.203 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-21T05:32:13.203 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-21T05:32:13.203 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-21T05:32:13.204 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-21T05:32:13.204 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-21T05:32:13.204 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-21T05:32:13.204 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-21T05:32:13.204 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-21T05:32:13.204 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-21T05:32:13.204 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-21T05:32:13.204 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-21T05:32:13.204 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-21T05:32:13.205 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-21T05:32:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-21T05:32:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-21T05:32:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-21T05:32:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-21T05:32:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-21T05:32:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-21T05:32:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-21T05:32:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-21T05:32:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-21T05:32:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-21T05:32:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-21T05:32:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-21T05:32:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-21T05:32:13.207 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-21T05:32:13.208 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-21T05:32:13.209 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-21T05:32:13.210 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-21T05:32:13.211 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-21T05:32:13.212 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-21T05:32:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-21T05:32:13.214 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-21T05:32:13.214 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-21T05:32:13.214 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-21T05:32:13.214 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-21T05:32:13.214 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-21T05:32:13.214 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-21T05:32:13.214 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-21T05:32:13.214 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-21T05:32:13.214 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-21T05:32:13.214 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-21T05:32:13.214 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-21T05:32:13.214 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-21T05:32:13.215 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-21T05:32:13.215 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-21T05:32:13.215 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-21T05:32:13.215 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-21T05:32:13.215 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-21T05:32:13.215 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-21T05:32:13.215 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-21T05:32:13.216 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-21T05:32:13.216 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-21T05:32:13.216 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-21T05:32:13.216 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-21T05:32:13.216 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-21T05:32:13.216 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-21T05:32:13.216 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-21T05:32:13.217 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-21T05:32:13.217 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-21T05:32:13.217 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-21T05:32:13.217 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-21T05:32:13.217 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-21T05:32:13.217 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-21T05:32:13.217 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-21T05:32:13.217 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-21T05:32:13.218 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-21T05:32:13.218 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-21T05:32:13.218 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-21T05:32:13.218 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-21T05:32:13.218 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-21T05:32:13.218 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-21T05:32:13.218 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-21T05:32:13.219 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-21T05:32:13.219 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-21T05:32:13.219 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-21T05:32:13.219 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-21T05:32:13.219 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-21T05:32:13.219 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-21T05:32:13.219 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-21T05:32:13.220 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-21T05:32:13.220 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-21T05:32:13.220 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-21T05:32:13.220 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-21T05:32:13.220 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-21T05:32:13.220 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-21T05:32:13.220 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-21T05:32:13.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-21T05:32:13.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-21T05:32:13.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-21T05:32:13.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-21T05:32:13.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-21T05:32:13.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-21T05:32:13.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-21T05:32:13.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-21T05:32:13.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-21T05:32:13.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-21T05:32:13.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-21T05:32:13.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-21T05:32:13.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-21T05:32:13.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-21T05:32:13.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-21T05:32:13.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-21T05:32:13.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-21T05:32:13.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-21T05:32:13.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-21T05:32:13.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-21T05:32:13.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-21T05:32:13.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-21T05:32:13.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-21T05:32:13.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-21T05:32:13.224 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-21T05:32:13.224 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-21T05:32:13.224 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-21T05:32:13.224 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-21T05:32:13.224 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-21T05:32:13.224 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-21T05:32:13.225 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-21T05:32:13.225 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-21T05:32:13.225 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-21T05:32:13.225 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-21T05:32:13.225 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-21T05:32:13.225 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-21T05:32:13.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-21T05:32:13.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-21T05:32:13.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-21T05:32:13.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-21T05:32:13.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-21T05:32:13.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-21T05:32:13.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-21T05:32:13.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-21T05:32:13.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-21T05:32:13.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-21T05:32:13.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-21T05:32:13.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-21T05:32:13.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-21T05:32:13.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-21T05:32:13.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-21T05:32:13.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-21T05:32:13.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-21T05:32:13.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-21T05:32:13.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-21T05:32:13.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-21T05:32:13.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-21T05:32:13.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-21T05:32:13.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-21T05:32:13.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-21T05:32:13.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-21T05:32:13.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-21T05:32:13.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-21T05:32:13.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-21T05:32:13.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-21T05:32:13.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-21T05:32:13.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-21T05:32:13.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-21T05:32:13.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-21T05:32:13.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-21T05:32:13.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-21T05:32:13.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-21T05:32:13.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-21T05:32:13.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-21T05:32:13.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-21T05:32:13.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-21T05:32:13.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-21T05:32:13.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-21T05:32:13.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-21T05:32:13.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-21T05:32:13.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-21T05:32:13.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-21T05:32:13.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-21T05:32:13.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-21T05:32:13.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-21T05:32:13.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-21T05:32:13.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-21T05:32:13.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-21T05:32:13.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-21T05:32:13.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-21T05:32:13.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-21T05:32:13.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-21T05:32:13.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-21T05:32:13.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-21T05:32:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-21T05:32:13.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-21T05:32:13.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-21T05:32:13.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-21T05:32:13.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-21T05:32:13.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-21T05:32:13.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-21T05:32:13.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-21T05:32:13.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-21T05:32:13.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-21T05:32:13.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-21T05:32:13.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-21T05:32:13.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-21T05:32:13.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-21T05:32:13.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-21T05:32:13.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-21T05:32:13.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-21T05:32:13.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-21T05:32:13.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-21T05:32:13.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-21T05:32:13.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-21T05:32:13.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-21T05:32:13.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-21T05:32:13.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-21T05:32:13.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-21T05:32:13.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-21T05:32:13.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-21T05:32:13.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-21T05:32:13.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-21T05:32:13.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-21T05:32:13.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-21T05:32:13.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-21T05:32:13.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-21T05:32:13.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-21T05:32:13.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-21T05:32:13.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-21T05:32:13.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-21T05:32:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-21T05:32:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-21T05:32:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-21T05:32:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-21T05:32:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-21T05:32:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-21T05:32:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-21T05:32:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-21T05:32:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-21T05:32:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-21T05:32:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-21T05:32:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-21T05:32:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-21T05:32:13.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-21T05:32:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-21T05:32:13.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-21T05:32:13.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-21T05:32:13.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-21T05:32:13.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-21T05:32:13.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-21T05:32:13.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-21T05:32:13.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-21T05:32:13.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-21T05:32:13.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-21T05:32:13.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-21T05:32:13.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-21T05:32:13.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-21T05:32:13.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-21T05:32:13.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-21T05:32:13.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-21T05:32:13.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-21T05:32:13.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-21T05:32:13.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-21T05:32:13.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-21T05:32:13.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-21T05:32:13.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-21T05:32:13.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-21T05:32:13.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-21T05:32:13.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-21T05:32:13.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-21T05:32:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-21T05:32:13.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-21T05:32:13.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-21T05:32:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-21T05:32:13.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-21T05:32:13.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-21T05:32:13.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-21T05:32:13.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-21T05:32:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-21T05:32:13.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-21T05:32:13.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-21T05:32:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-21T05:32:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-21T05:32:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-21T05:32:13.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-21T05:32:13.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-21T05:32:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-21T05:32:13.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-21T05:32:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-21T05:32:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-21T05:32:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-21T05:32:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-21T05:32:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-21T05:32:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-21T05:32:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-21T05:32:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-21T05:32:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-21T05:32:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-21T05:32:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-21T05:32:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-21T05:32:13.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-21T05:32:13.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-21T05:32:13.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-21T05:32:13.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-21T05:32:13.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-21T05:32:13.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-21T05:32:13.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-21T05:32:13.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-21T05:32:13.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-21T05:32:13.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-21T05:32:13.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-21T05:32:13.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-21T05:32:13.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-21T05:32:13.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-21T05:32:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-21T05:32:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-21T05:32:13.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-21T05:32:13.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-21T05:32:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-21T05:32:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-21T05:32:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-21T05:32:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-21T05:32:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-21T05:32:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-21T05:32:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-21T05:32:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-21T05:32:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-21T05:32:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-21T05:32:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-21T05:32:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-21T05:32:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-21T05:32:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-21T05:32:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-21T05:32:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-21T05:32:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-21T05:32:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-21T05:32:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-21T05:32:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-21T05:32:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-21T05:32:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-21T05:32:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-21T05:32:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-21T05:32:13.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-21T05:32:13.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-21T05:32:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-21T05:32:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-21T05:32:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-21T05:32:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-21T05:32:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-21T05:32:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-21T05:32:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-21T05:32:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-21T05:32:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-21T05:32:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-21T05:32:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-21T05:32:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-21T05:32:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-21T05:32:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-21T05:32:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-21T05:32:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-21T05:32:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-21T05:32:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-21T05:32:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T05:32:13.323 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:32:13.323 DEBUG:teuthology.orchestra.run.smithi037:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-21T05:32:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:postinstall scriptlet (using /bin/sh): 2024-09-21T05:32:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T05:32:13.348 INFO:teuthology.orchestra.run.smithi037.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T05:32:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2024-09-21T05:32:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:for file in vmlinuz System.map config; do 2024-09-21T05:32:13.348 INFO:teuthology.orchestra.run.smithi037.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-21T05:32:13.348 INFO:teuthology.orchestra.run.smithi037.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T05:32:13.348 INFO:teuthology.orchestra.run.smithi037.stdout: fi 2024-09-21T05:32:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:done 2024-09-21T05:32:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-21T05:32:13.348 INFO:teuthology.orchestra.run.smithi037.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-21T05:32:13.348 INFO:teuthology.orchestra.run.smithi037.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T05:32:13.348 INFO:teuthology.orchestra.run.smithi037.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T05:32:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2024-09-21T05:32:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-21T05:32:13.349 INFO:teuthology.orchestra.run.smithi037.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:32:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2024-09-21T05:32:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-21T05:32:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T05:32:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:32:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2024-09-21T05:32:13.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2024-09-21T05:32:13.425 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2024-09-21T05:32:13.425 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2024-09-21T05:32:13.425 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2024-09-21T05:32:13.425 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 82.el9 2024-09-21T05:32:13.425 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8274670 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2024-09-21T05:32:13.426 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:32:13.427 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T05:32:13.427 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T05:32:13.427 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T05:32:13.427 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2024-09-21T05:32:13.427 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:32:13.427 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T05:32:13.428 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T05:32:13.428 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:32:13.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T05:32:14.083 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2024-09-21T05:32:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T05:32:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:done 2024-09-21T05:32:15.466 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-09-21T05:32:15.481 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.kdmtn5Xynf 2024-09-21T05:32:15.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kdmtn5Xynf 2024-09-21T05:32:15.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.kdmtn5Xynf 2024-09-21T05:32:15.764 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.kdmtn5Xynf is 6KB 2024-09-21T05:32:15.813 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.kdmtn5Xynf 2024-09-21T05:32:15.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T05:32:15.890 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T05:32:15.890 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T05:32:15.890 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T05:32:15.890 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-21T05:32:15.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:32:16.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2024-09-21T05:32:46.051 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T05:32:46.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-21T05:32:46.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:33:04.371 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-09-21T05:33:13.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-21T05:33:13.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:33:31.759 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-09-21T05:33:43.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-21T05:33:43.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:33:46.830 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-09-21T05:34:01.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-21T05:34:01.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:34:02.352 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-21T05:34:03.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-21T05:34:03.020 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-21T05:34:03.021 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-21T05:34:03.056 INFO:teuthology.orchestra.run.smithi037.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:34:03.056 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T05:34:03.056 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T05:34:03.056 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T05:34:04.057 DEBUG:teuthology.parallel:result is None 2024-09-21T05:34:04.057 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T05:34:04.068 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T05:34:04.068 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:34:04.072 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:34:04.075 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:34:04.103 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T05:34:04.131 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T05:34:04.155 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T05:34:04.156 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:34:04.160 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:34:04.162 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:34:04.274 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T05:34:04.280 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T05:34:04.280 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:34:04.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:34:04.298 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:34:04.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:34:04.316 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:34:04.320 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:34:04.341 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:34:04.387 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:34:04.405 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:34:04.414 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:34:04.432 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:34:04.571 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:34:04.628 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:34:04.631 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T05:34:04.644 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T05:34:04.644 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:34:04.648 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:34:04.650 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:34:04.705 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T05:34:04.713 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T05:34:04.714 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:34:04.718 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:34:04.720 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:34:04.748 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:34:04.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:34:04.929 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:34:04.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:34:05.062 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:34:05.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:34:05.116 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:34:05.160 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:34:05.215 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:34:05.300 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:34:05.344 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-21T05:34:05.344 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:34:05.413 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:34:05.457 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:34:05.516 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:34:05.599 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:34:05.645 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T05:34:05.646 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:34:05.714 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-09-21T05:34:05.718 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2024-09-21T05:34:05.720 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2024-09-21T05:34:05.771 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:34:05.798 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:34:05.800 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:34:06.223 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T05:34:06.231 INFO:teuthology.task.internal:Starting timer... 2024-09-21T05:34:06.231 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T05:34:06.248 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T05:34:06.255 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T05:34:06.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-09-21T05:34:06.329 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-09-21T05:34:06.332 DEBUG:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2024-09-21T05:34:06.392 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: 2024-09-21T05:34:06.394 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2024-09-21T05:34:06.447 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2024-09-21T05:34:06.449 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T05:34:06.449 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-09-21T05:34:06.490 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-09-21T05:34:06.490 DEBUG:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2024-09-21T05:34:06.514 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2024-09-21T05:34:06.514 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2024-09-21T05:34:06.535 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2024-09-21T05:34:06.535 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi067.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi144.front.sepia.ceph.com': 'permissive'} 2024-09-21T05:34:06.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:34:06.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:34:06.592 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:34:06.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:34:06.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:34:06.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:34:06.647 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T05:34:06.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:34:06.712 DEBUG:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:34:06.751 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:34:06.784 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T05:34:06.792 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T05:34:06.801 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T05:34:06.802 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi067.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T05:38:51.437 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2024-09-21T05:38:51.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-21T05:38:51.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:38:51.527 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-21T05:38:51.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-21T05:38:51.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-21T05:38:51.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:38:51.713 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-09-21T05:38:51.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-21T05:38:51.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-21T05:38:51.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:38:51.894 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-21T05:38:51.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-21T05:38:51.976 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T05:38:51.986 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T05:38:51.986 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T05:38:51.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:38:51.991 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T05:38:51.991 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:38:51.993 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T05:38:51.993 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:38:52.020 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T05:38:52.035 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T05:38:52.046 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T05:38:52.050 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T05:38:52.060 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2024-09-21T05:38:52.061 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T05:38:52.071 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2024-09-21T05:38:52.081 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T05:38:52.085 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T05:38:52.086 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2024-09-21T05:38:52.097 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2024-09-21T05:38:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T05:38:52.112 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T05:38:52.126 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T05:38:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-09-21T05:38:52.155 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-09-21T05:38:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:38:52.162 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:38:52.162 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-09-21T05:38:52.162 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:38:52.162 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:38:52.162 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:38:52.162 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:38:52.180 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:38:52.184 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:38:52.184 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-21T05:38:52.184 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:38:52.184 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:38:52.185 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:38:52.185 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:38:52.186 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T05:38:52.215 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T05:38:52.309 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:38:52.316 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:38:52.316 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-21T05:38:52.316 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:38:52.316 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:38:52.316 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:38:52.316 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:38:52.317 INFO:teuthology.run_tasks:Running task install... 2024-09-21T05:38:52.325 DEBUG:teuthology.task.install:project ceph 2024-09-21T05:38:52.325 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T05:38:52.325 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T05:38:52.326 INFO:teuthology.task.install:Using flavor: default 2024-09-21T05:38:52.331 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T05:38:52.331 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T05:38:52.331 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T05:38:52.332 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:38:52.333 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T05:38:52.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:38:52.334 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T05:38:52.334 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:38:52.480 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T05:38:52.480 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T05:38:52.489 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T05:38:52.489 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T05:38:52.496 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T05:38:52.496 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T05:38:52.588 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T05:38:52.588 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:38:52.588 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T05:38:52.597 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T05:38:52.597 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T05:38:52.597 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T05:38:52.600 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T05:38:52.600 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-21T05:38:52.600 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T05:38:52.623 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T05:38:52.624 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T05:38:52.626 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T05:38:52.626 DEBUG:teuthology.orchestra.run.smithi067:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T05:38:52.645 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T05:38:52.646 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T05:38:52.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T05:38:52.692 DEBUG:teuthology.orchestra.run.smithi067:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T05:38:52.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T05:38:52.765 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T05:38:52.767 DEBUG:teuthology.orchestra.run.smithi067:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T05:38:52.822 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T05:38:52.830 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2024-09-21T05:38:52.831 INFO:teuthology.orchestra.run.smithi067.stdout:check_obsoletes = 1 2024-09-21T05:38:52.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2024-09-21T05:38:52.833 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum clean all 2024-09-21T05:38:52.877 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-09-21T05:38:52.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-09-21T05:38:53.055 INFO:teuthology.orchestra.run.smithi144.stdout:45 files removed 2024-09-21T05:38:53.065 INFO:teuthology.orchestra.run.smithi067.stdout:45 files removed 2024-09-21T05:38:53.082 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T05:38:53.092 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T05:38:53.165 INFO:teuthology.orchestra.run.smithi037.stdout:45 files removed 2024-09-21T05:38:53.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T05:38:53.640 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-21T05:38:53.641 INFO:teuthology.orchestra.run.smithi067.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-21T05:38:53.895 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 291 kB/s | 84 kB 00:00 2024-09-21T05:38:53.916 INFO:teuthology.orchestra.run.smithi067.stdout:ceph noarch packages 105 kB/s | 24 kB 00:00 2024-09-21T05:38:53.966 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 85 kB/s | 24 kB 00:00 2024-09-21T05:38:54.175 INFO:teuthology.orchestra.run.smithi067.stdout:ceph source packages 8.6 kB/s | 1.9 kB 00:00 2024-09-21T05:38:54.187 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 99 kB/s | 24 kB 00:00 2024-09-21T05:38:54.242 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T05:38:54.454 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-21T05:38:54.817 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T05:38:56.059 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.3 MB 00:01 2024-09-21T05:38:56.821 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.3 MB 00:02 2024-09-21T05:38:58.705 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-21T05:38:59.335 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 20 MB 00:03 2024-09-21T05:39:01.692 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-21T05:39:04.027 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.5 MB 00:00 2024-09-21T05:39:04.689 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-21T05:39:05.486 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 92 kB/s | 19 kB 00:00 2024-09-21T05:39:06.249 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-21T05:39:06.310 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 6.5 MB 00:00 2024-09-21T05:39:06.340 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-21T05:39:07.211 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-21T05:39:07.944 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-21T05:39:08.856 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T05:39:12.038 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T05:39:13.767 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-21T05:39:14.308 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:39:14.308 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:39:14.320 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-09-21T05:39:14.321 INFO:teuthology.orchestra.run.smithi067.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T05:39:14.321 INFO:teuthology.orchestra.run.smithi067.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T05:39:14.322 INFO:teuthology.orchestra.run.smithi067.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T05:39:14.323 INFO:teuthology.orchestra.run.smithi067.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T05:39:14.325 INFO:teuthology.orchestra.run.smithi067.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T05:39:14.327 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T05:39:14.328 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T05:39:14.396 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-09-21T05:39:14.407 INFO:teuthology.orchestra.run.smithi067.stdout:======================================================================================= 2024-09-21T05:39:14.407 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-09-21T05:39:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:======================================================================================= 2024-09-21T05:39:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-09-21T05:39:14.408 INFO:teuthology.orchestra.run.smithi067.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T05:39:14.408 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T05:39:14.408 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T05:39:14.408 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T05:39:14.408 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:39:14.408 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T05:39:14.408 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T05:39:14.408 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T05:39:14.408 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T05:39:14.408 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T05:39:14.409 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T05:39:14.410 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T05:39:14.410 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T05:39:14.410 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T05:39:14.410 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T05:39:14.410 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T05:39:14.410 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T05:39:14.410 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T05:39:14.410 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T05:39:14.410 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T05:39:14.410 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T05:39:14.410 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T05:39:14.410 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T05:39:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T05:39:14.411 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T05:39:14.412 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T05:39:14.412 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T05:39:14.412 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T05:39:14.412 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T05:39:14.412 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T05:39:14.412 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T05:39:14.412 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T05:39:14.412 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T05:39:14.412 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T05:39:14.412 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T05:39:14.412 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T05:39:14.412 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T05:39:14.412 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T05:39:14.413 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T05:39:14.413 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T05:39:14.413 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T05:39:14.413 INFO:teuthology.orchestra.run.smithi067.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T05:39:14.413 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T05:39:14.413 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T05:39:14.413 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T05:39:14.413 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T05:39:14.413 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T05:39:14.413 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T05:39:14.413 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T05:39:14.413 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T05:39:14.413 INFO:teuthology.orchestra.run.smithi067.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T05:39:14.414 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T05:39:14.414 INFO:teuthology.orchestra.run.smithi067.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T05:39:14.414 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T05:39:14.414 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T05:39:14.414 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T05:39:14.414 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T05:39:14.414 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T05:39:14.414 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T05:39:14.414 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T05:39:14.414 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T05:39:14.414 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T05:39:14.414 INFO:teuthology.orchestra.run.smithi067.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T05:39:14.414 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T05:39:14.415 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T05:39:14.415 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T05:39:14.415 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T05:39:14.415 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:39:14.415 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T05:39:14.415 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T05:39:14.415 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T05:39:14.415 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T05:39:14.415 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T05:39:14.415 INFO:teuthology.orchestra.run.smithi067.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T05:39:14.415 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T05:39:14.416 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T05:39:14.417 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T05:39:14.418 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T05:39:14.419 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T05:39:14.420 INFO:teuthology.orchestra.run.smithi067.stdout:Installing weak dependencies: 2024-09-21T05:39:14.420 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T05:39:14.420 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:39:14.420 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-09-21T05:39:14.420 INFO:teuthology.orchestra.run.smithi067.stdout:======================================================================================= 2024-09-21T05:39:14.420 INFO:teuthology.orchestra.run.smithi067.stdout:Install 149 Packages 2024-09-21T05:39:14.420 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 8 Packages 2024-09-21T05:39:14.420 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:39:14.421 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 228 M 2024-09-21T05:39:14.421 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-09-21T05:39:14.873 INFO:teuthology.orchestra.run.smithi067.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-21T05:39:15.165 INFO:teuthology.orchestra.run.smithi067.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.9 MB/s | 873 kB 00:00 2024-09-21T05:39:15.265 INFO:teuthology.orchestra.run.smithi067.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-21T05:39:15.290 INFO:teuthology.orchestra.run.smithi067.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.2 MB/s | 148 kB 00:00 2024-09-21T05:39:15.399 INFO:teuthology.orchestra.run.smithi067.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 17 MB/s | 2.3 MB 00:00 2024-09-21T05:39:15.791 INFO:teuthology.orchestra.run.smithi067.stdout:(6/157): ceph-common-19.3.0-5120.g18432218.el9. 19 MB/s | 20 MB 00:01 2024-09-21T05:39:15.824 INFO:teuthology.orchestra.run.smithi067.stdout:(7/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 2.8 MB/s | 1.5 MB 00:00 2024-09-21T05:39:15.900 INFO:teuthology.orchestra.run.smithi067.stdout:(8/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 9.9 MB/s | 5.0 MB 00:00 2024-09-21T05:39:15.942 INFO:teuthology.orchestra.run.smithi067.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 609 kB/s | 25 kB 00:00 2024-09-21T05:39:16.364 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:39:16.365 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:39:16.380 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T05:39:16.381 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T05:39:16.382 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T05:39:16.383 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T05:39:16.385 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T05:39:16.389 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T05:39:16.390 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T05:39:16.425 INFO:teuthology.orchestra.run.smithi067.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 28 MB/s | 18 MB 00:00 2024-09-21T05:39:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-21T05:39:16.474 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:39:16.475 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:39:16.476 INFO:teuthology.orchestra.run.smithi067.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T05:39:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-09-21T05:39:16.481 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-21T05:39:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-09-21T05:39:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-21T05:39:16.481 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T05:39:16.481 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T05:39:16.481 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T05:39:16.481 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T05:39:16.481 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:39:16.481 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T05:39:16.482 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T05:39:16.482 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T05:39:16.482 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T05:39:16.482 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T05:39:16.482 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T05:39:16.482 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T05:39:16.482 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T05:39:16.482 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T05:39:16.482 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T05:39:16.482 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T05:39:16.482 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T05:39:16.483 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T05:39:16.484 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T05:39:16.484 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T05:39:16.484 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T05:39:16.484 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T05:39:16.484 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T05:39:16.484 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T05:39:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-09-21T05:39:16.484 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T05:39:16.484 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T05:39:16.484 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T05:39:16.484 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T05:39:16.484 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T05:39:16.484 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T05:39:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T05:39:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T05:39:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T05:39:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T05:39:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T05:39:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T05:39:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T05:39:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T05:39:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T05:39:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T05:39:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T05:39:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:39:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T05:39:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T05:39:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T05:39:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T05:39:16.489 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T05:39:16.489 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T05:39:16.489 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T05:39:16.489 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T05:39:16.489 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T05:39:16.489 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T05:39:16.489 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T05:39:16.489 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T05:39:16.489 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T05:39:16.489 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T05:39:16.489 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T05:39:16.489 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T05:39:16.489 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T05:39:16.490 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T05:39:16.490 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T05:39:16.490 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T05:39:16.490 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T05:39:16.490 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T05:39:16.490 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T05:39:16.490 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T05:39:16.490 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T05:39:16.490 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T05:39:16.490 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T05:39:16.490 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T05:39:16.490 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T05:39:16.490 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T05:39:16.491 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T05:39:16.491 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T05:39:16.491 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T05:39:16.491 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T05:39:16.491 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T05:39:16.491 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T05:39:16.491 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T05:39:16.491 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T05:39:16.491 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T05:39:16.491 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T05:39:16.491 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T05:39:16.491 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T05:39:16.492 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T05:39:16.492 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T05:39:16.492 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T05:39:16.492 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T05:39:16.492 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T05:39:16.492 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T05:39:16.492 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T05:39:16.492 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T05:39:16.492 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T05:39:16.492 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T05:39:16.492 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T05:39:16.492 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T05:39:16.492 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T05:39:16.493 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T05:39:16.493 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T05:39:16.493 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T05:39:16.493 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T05:39:16.493 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T05:39:16.493 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T05:39:16.493 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T05:39:16.493 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T05:39:16.493 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-09-21T05:39:16.493 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T05:39:16.494 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:39:16.494 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-21T05:39:16.494 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-09-21T05:39:16.494 INFO:teuthology.orchestra.run.smithi037.stdout:Install 149 Packages 2024-09-21T05:39:16.494 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 8 Packages 2024-09-21T05:39:16.494 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:39:16.495 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 228 M 2024-09-21T05:39:16.495 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-21T05:39:16.495 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T05:39:16.496 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T05:39:16.496 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T05:39:16.496 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T05:39:16.496 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T05:39:16.496 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T05:39:16.497 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T05:39:16.559 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-21T05:39:16.568 INFO:teuthology.orchestra.run.smithi067.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 295 kB/s | 27 kB 00:00 2024-09-21T05:39:16.577 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-09-21T05:39:16.577 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-21T05:39:16.577 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-09-21T05:39:16.577 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-21T05:39:16.577 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T05:39:16.577 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T05:39:16.577 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T05:39:16.577 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T05:39:16.577 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:39:16.578 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T05:39:16.578 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T05:39:16.578 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T05:39:16.578 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T05:39:16.578 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T05:39:16.578 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T05:39:16.578 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T05:39:16.578 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T05:39:16.578 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T05:39:16.578 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T05:39:16.578 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T05:39:16.578 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T05:39:16.578 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T05:39:16.579 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T05:39:16.580 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T05:39:16.580 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T05:39:16.580 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T05:39:16.580 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T05:39:16.580 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T05:39:16.580 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2024-09-21T05:39:16.580 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T05:39:16.580 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T05:39:16.580 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T05:39:16.580 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T05:39:16.580 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T05:39:16.580 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T05:39:16.580 INFO:teuthology.orchestra.run.smithi144.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T05:39:16.581 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T05:39:16.581 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-21T05:39:16.581 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T05:39:16.581 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T05:39:16.581 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T05:39:16.581 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T05:39:16.581 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T05:39:16.581 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T05:39:16.581 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T05:39:16.581 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T05:39:16.581 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T05:39:16.581 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T05:39:16.582 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T05:39:16.582 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T05:39:16.582 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T05:39:16.582 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T05:39:16.582 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T05:39:16.582 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T05:39:16.582 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T05:39:16.582 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T05:39:16.582 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T05:39:16.582 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T05:39:16.582 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T05:39:16.582 INFO:teuthology.orchestra.run.smithi144.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T05:39:16.583 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T05:39:16.583 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T05:39:16.583 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T05:39:16.583 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T05:39:16.583 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T05:39:16.583 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T05:39:16.583 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T05:39:16.583 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T05:39:16.583 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T05:39:16.583 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T05:39:16.583 INFO:teuthology.orchestra.run.smithi144.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T05:39:16.583 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T05:39:16.583 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T05:39:16.584 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T05:39:16.584 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T05:39:16.584 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T05:39:16.584 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T05:39:16.584 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T05:39:16.584 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T05:39:16.584 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T05:39:16.584 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T05:39:16.584 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T05:39:16.584 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T05:39:16.584 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T05:39:16.584 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T05:39:16.584 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:39:16.585 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T05:39:16.585 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T05:39:16.585 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T05:39:16.585 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T05:39:16.585 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T05:39:16.585 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T05:39:16.585 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T05:39:16.585 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T05:39:16.585 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T05:39:16.585 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T05:39:16.585 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T05:39:16.585 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T05:39:16.585 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T05:39:16.586 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T05:39:16.586 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T05:39:16.586 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T05:39:16.586 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T05:39:16.586 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T05:39:16.586 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T05:39:16.586 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T05:39:16.586 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T05:39:16.586 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T05:39:16.586 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T05:39:16.586 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T05:39:16.586 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T05:39:16.586 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T05:39:16.587 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T05:39:16.587 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T05:39:16.587 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T05:39:16.587 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T05:39:16.587 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T05:39:16.587 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T05:39:16.587 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T05:39:16.587 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T05:39:16.587 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T05:39:16.587 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T05:39:16.587 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T05:39:16.587 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T05:39:16.587 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T05:39:16.588 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout:Installing weak dependencies: 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-21T05:39:16.589 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-09-21T05:39:16.590 INFO:teuthology.orchestra.run.smithi144.stdout:Install 149 Packages 2024-09-21T05:39:16.590 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 8 Packages 2024-09-21T05:39:16.590 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:39:16.590 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 228 M 2024-09-21T05:39:16.590 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-21T05:39:16.618 INFO:teuthology.orchestra.run.smithi067.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 638 kB/s | 32 kB 00:00 2024-09-21T05:39:16.709 INFO:teuthology.orchestra.run.smithi067.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.2 MB/s | 766 kB 00:00 2024-09-21T05:39:16.785 INFO:teuthology.orchestra.run.smithi067.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.1 MB/s | 158 kB 00:00 2024-09-21T05:39:16.868 INFO:teuthology.orchestra.run.smithi067.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.5 MB/s | 127 kB 00:00 2024-09-21T05:39:16.968 INFO:teuthology.orchestra.run.smithi067.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 5.0 MB/s | 507 kB 00:00 2024-09-21T05:39:17.194 INFO:teuthology.orchestra.run.smithi067.stdout:(18/157): ceph-radosgw-19.3.0-5120.g18432218.el 7.6 MB/s | 10 MB 00:01 2024-09-21T05:39:17.205 INFO:teuthology.orchestra.run.smithi144.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-09-21T05:39:17.227 INFO:teuthology.orchestra.run.smithi067.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 1.3 MB/s | 45 kB 00:00 2024-09-21T05:39:17.285 INFO:teuthology.orchestra.run.smithi037.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-09-21T05:39:17.311 INFO:teuthology.orchestra.run.smithi067.stdout:(20/157): librgw2-19.3.0-5120.g18432218.el9.x86 15 MB/s | 5.3 MB 00:00 2024-09-21T05:39:17.336 INFO:teuthology.orchestra.run.smithi067.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 1.3 MB/s | 148 kB 00:00 2024-09-21T05:39:17.489 INFO:teuthology.orchestra.run.smithi144.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.0 MB/s | 873 kB 00:00 2024-09-21T05:39:17.597 INFO:teuthology.orchestra.run.smithi144.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 8.3 MB/s | 5.5 MB 00:00 2024-09-21T05:39:17.618 INFO:teuthology.orchestra.run.smithi037.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.6 MB/s | 873 kB 00:00 2024-09-21T05:39:17.622 INFO:teuthology.orchestra.run.smithi144.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.1 MB/s | 148 kB 00:00 2024-09-21T05:39:17.677 INFO:teuthology.orchestra.run.smithi037.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.5 MB/s | 148 kB 00:00 2024-09-21T05:39:17.695 INFO:teuthology.orchestra.run.smithi067.stdout:(22/157): ceph-test-19.3.0-5120.g18432218.el9.x 23 MB/s | 40 MB 00:01 2024-09-21T05:39:17.729 INFO:teuthology.orchestra.run.smithi067.stdout:(23/157): python3-cephfs-19.3.0-5120.g18432218. 387 kB/s | 161 kB 00:00 2024-09-21T05:39:17.740 INFO:teuthology.orchestra.run.smithi144.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 16 MB/s | 2.3 MB 00:00 2024-09-21T05:39:17.754 INFO:teuthology.orchestra.run.smithi067.stdout:(24/157): python3-rados-19.3.0-5120.g18432218.e 769 kB/s | 321 kB 00:00 2024-09-21T05:39:17.787 INFO:teuthology.orchestra.run.smithi067.stdout:(25/157): python3-rbd-19.3.0-5120.g18432218.el9 3.3 MB/s | 307 kB 00:00 2024-09-21T05:39:17.813 INFO:teuthology.orchestra.run.smithi067.stdout:(26/157): python3-rgw-19.3.0-5120.g18432218.el9 1.2 MB/s | 99 kB 00:00 2024-09-21T05:39:17.847 INFO:teuthology.orchestra.run.smithi067.stdout:(27/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 937 kB/s | 86 kB 00:00 2024-09-21T05:39:17.947 INFO:teuthology.orchestra.run.smithi067.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 343 kB/s | 34 kB 00:00 2024-09-21T05:39:18.030 INFO:teuthology.orchestra.run.smithi067.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.8 MB/s | 154 kB 00:00 2024-09-21T05:39:18.140 INFO:teuthology.orchestra.run.smithi144.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-21T05:39:18.147 INFO:teuthology.orchestra.run.smithi067.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 8.6 MB/s | 3.1 MB 00:00 2024-09-21T05:39:18.310 INFO:teuthology.orchestra.run.smithi037.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 3.6 MB/s | 2.3 MB 00:00 2024-09-21T05:39:18.332 INFO:teuthology.orchestra.run.smithi144.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 14 MB/s | 20 MB 00:01 2024-09-21T05:39:18.374 INFO:teuthology.orchestra.run.smithi144.stdout:(8/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 2.0 MB/s | 1.5 MB 00:00 2024-09-21T05:39:18.457 INFO:teuthology.orchestra.run.smithi144.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 301 kB/s | 25 kB 00:00 2024-09-21T05:39:18.481 INFO:teuthology.orchestra.run.smithi067.stdout:(31/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 255 kB/s | 170 kB 00:00 2024-09-21T05:39:18.764 INFO:teuthology.orchestra.run.smithi067.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-09-21T05:39:18.847 INFO:teuthology.orchestra.run.smithi067.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 594 kB/s | 49 kB 00:00 2024-09-21T05:39:18.903 INFO:teuthology.orchestra.run.smithi037.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 2.6 MB/s | 1.5 MB 00:00 2024-09-21T05:39:18.931 INFO:teuthology.orchestra.run.smithi067.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 198 kB/s | 16 kB 00:00 2024-09-21T05:39:18.978 INFO:teuthology.orchestra.run.smithi037.stdout:(6/157): ceph-base-19.3.0-5120.g18432218.el9.x8 3.0 MB/s | 5.5 MB 00:01 2024-09-21T05:39:19.006 INFO:teuthology.orchestra.run.smithi067.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 3.7 MB/s | 285 kB 00:00 2024-09-21T05:39:19.091 INFO:teuthology.orchestra.run.smithi144.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 14 MB/s | 10 MB 00:00 2024-09-21T05:39:19.098 INFO:teuthology.orchestra.run.smithi067.stdout:(36/157): ceph-mgr-modules-core-19.3.0-5120.g18 473 kB/s | 292 kB 00:00 2024-09-21T05:39:19.132 INFO:teuthology.orchestra.run.smithi067.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 6.1 MB/s | 784 kB 00:00 2024-09-21T05:39:19.149 INFO:teuthology.orchestra.run.smithi144.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T05:39:19.157 INFO:teuthology.orchestra.run.smithi067.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 315 kB/s | 18 kB 00:00 2024-09-21T05:39:19.191 INFO:teuthology.orchestra.run.smithi144.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 651 kB/s | 27 kB 00:00 2024-09-21T05:39:19.242 INFO:teuthology.orchestra.run.smithi144.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 634 kB/s | 32 kB 00:00 2024-09-21T05:39:19.299 INFO:teuthology.orchestra.run.smithi067.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 11 MB/s | 14 MB 00:01 2024-09-21T05:39:19.308 INFO:teuthology.orchestra.run.smithi144.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 11 MB/s | 766 kB 00:00 2024-09-21T05:39:19.332 INFO:teuthology.orchestra.run.smithi067.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 398 kB/s | 80 kB 00:00 2024-09-21T05:39:19.375 INFO:teuthology.orchestra.run.smithi144.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T05:39:19.433 INFO:teuthology.orchestra.run.smithi067.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-21T05:39:19.458 INFO:teuthology.orchestra.run.smithi067.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-21T05:39:19.500 INFO:teuthology.orchestra.run.smithi067.stdout:(43/157): libquadmath-11.5.0-2.el9.x86_64.rpm 954 kB/s | 191 kB 00:00 2024-09-21T05:39:19.550 INFO:teuthology.orchestra.run.smithi067.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-21T05:39:19.551 INFO:teuthology.orchestra.run.smithi144.stdout:(16/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 13 MB/s | 18 MB 00:01 2024-09-21T05:39:19.575 INFO:teuthology.orchestra.run.smithi067.stdout:(45/157): python3-ply-3.11-14.el9.noarch.rpm 910 kB/s | 106 kB 00:00 2024-09-21T05:39:19.576 INFO:teuthology.orchestra.run.smithi144.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 632 kB/s | 127 kB 00:00 2024-09-21T05:39:19.601 INFO:teuthology.orchestra.run.smithi144.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 9.9 MB/s | 507 kB 00:00 2024-09-21T05:39:19.609 INFO:teuthology.orchestra.run.smithi067.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-21T05:39:19.643 INFO:teuthology.orchestra.run.smithi067.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-21T05:39:19.660 INFO:teuthology.orchestra.run.smithi144.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 776 kB/s | 45 kB 00:00 2024-09-21T05:39:19.677 INFO:teuthology.orchestra.run.smithi067.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-09-21T05:39:19.686 INFO:teuthology.orchestra.run.smithi037.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 6.3 MB/s | 5.0 MB 00:00 2024-09-21T05:39:19.719 INFO:teuthology.orchestra.run.smithi144.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.5 MB/s | 148 kB 00:00 2024-09-21T05:39:19.794 INFO:teuthology.orchestra.run.smithi144.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.1 MB/s | 161 kB 00:00 2024-09-21T05:39:19.843 INFO:teuthology.orchestra.run.smithi067.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 642 kB/s | 107 kB 00:00 2024-09-21T05:39:19.869 INFO:teuthology.orchestra.run.smithi144.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 18 MB/s | 5.3 MB 00:00 2024-09-21T05:39:19.877 INFO:teuthology.orchestra.run.smithi067.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-09-21T05:39:19.895 INFO:teuthology.orchestra.run.smithi144.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 3.1 MB/s | 321 kB 00:00 2024-09-21T05:39:19.902 INFO:teuthology.orchestra.run.smithi067.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-21T05:39:19.928 INFO:teuthology.orchestra.run.smithi144.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T05:39:19.936 INFO:teuthology.orchestra.run.smithi067.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-21T05:39:19.954 INFO:teuthology.orchestra.run.smithi144.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T05:39:19.961 INFO:teuthology.orchestra.run.smithi067.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-09-21T05:39:19.981 INFO:teuthology.orchestra.run.smithi144.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.6 MB/s | 86 kB 00:00 2024-09-21T05:39:19.986 INFO:teuthology.orchestra.run.smithi067.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-21T05:39:20.003 INFO:teuthology.orchestra.run.smithi067.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-21T05:39:20.029 INFO:teuthology.orchestra.run.smithi067.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-21T05:39:20.040 INFO:teuthology.orchestra.run.smithi144.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-21T05:39:20.081 INFO:teuthology.orchestra.run.smithi144.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 828 kB/s | 34 kB 00:00 2024-09-21T05:39:20.087 INFO:teuthology.orchestra.run.smithi067.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2024-09-21T05:39:20.112 INFO:teuthology.orchestra.run.smithi067.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-21T05:39:20.138 INFO:teuthology.orchestra.run.smithi067.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-21T05:39:20.149 INFO:teuthology.orchestra.run.smithi144.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 16 MB/s | 3.1 MB 00:00 2024-09-21T05:39:20.163 INFO:teuthology.orchestra.run.smithi067.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-21T05:39:20.174 INFO:teuthology.orchestra.run.smithi144.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.6 MB/s | 154 kB 00:00 2024-09-21T05:39:20.196 INFO:teuthology.orchestra.run.smithi067.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-21T05:39:20.222 INFO:teuthology.orchestra.run.smithi067.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 420 kB/s | 24 kB 00:00 2024-09-21T05:39:20.255 INFO:teuthology.orchestra.run.smithi067.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-21T05:39:20.281 INFO:teuthology.orchestra.run.smithi067.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-21T05:39:20.306 INFO:teuthology.orchestra.run.smithi067.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-21T05:39:20.331 INFO:teuthology.orchestra.run.smithi067.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-21T05:39:20.356 INFO:teuthology.orchestra.run.smithi067.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-21T05:39:20.465 INFO:teuthology.orchestra.run.smithi067.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T05:39:20.540 INFO:teuthology.orchestra.run.smithi067.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 21 MB/s | 4.9 MB 00:00 2024-09-21T05:39:20.616 INFO:teuthology.orchestra.run.smithi067.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-21T05:39:20.624 INFO:teuthology.orchestra.run.smithi144.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-21T05:39:20.641 INFO:teuthology.orchestra.run.smithi067.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.3 MB/s | 137 kB 00:00 2024-09-21T05:39:20.666 INFO:teuthology.orchestra.run.smithi067.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.4 MB/s | 910 kB 00:00 2024-09-21T05:39:20.691 INFO:teuthology.orchestra.run.smithi144.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.3 MB/s | 292 kB 00:00 2024-09-21T05:39:20.717 INFO:teuthology.orchestra.run.smithi067.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-21T05:39:20.742 INFO:teuthology.orchestra.run.smithi067.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-21T05:39:20.750 INFO:teuthology.orchestra.run.smithi144.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 846 kB/s | 49 kB 00:00 2024-09-21T05:39:20.800 INFO:teuthology.orchestra.run.smithi144.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 331 kB/s | 16 kB 00:00 2024-09-21T05:39:20.800 INFO:teuthology.orchestra.run.smithi067.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-21T05:39:20.859 INFO:teuthology.orchestra.run.smithi144.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T05:39:20.876 INFO:teuthology.orchestra.run.smithi067.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-21T05:39:20.909 INFO:teuthology.orchestra.run.smithi067.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-21T05:39:20.934 INFO:teuthology.orchestra.run.smithi144.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 10 MB/s | 784 kB 00:00 2024-09-21T05:39:20.943 INFO:teuthology.orchestra.run.smithi067.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-21T05:39:20.968 INFO:teuthology.orchestra.run.smithi067.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-09-21T05:39:21.021 INFO:teuthology.orchestra.run.smithi144.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 369 kB/s | 18 kB 00:00 2024-09-21T05:39:21.021 INFO:teuthology.orchestra.run.smithi067.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-21T05:39:21.022 INFO:teuthology.orchestra.run.smithi067.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-21T05:39:21.102 INFO:teuthology.orchestra.run.smithi067.stdout:(82/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T05:39:21.126 INFO:teuthology.orchestra.run.smithi144.stdout:(38/157): ceph-mgr-dashboard-19.3.0-5120.g18432 15 MB/s | 14 MB 00:00 2024-09-21T05:39:21.127 INFO:teuthology.orchestra.run.smithi067.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 260 kB/s | 35 kB 00:00 2024-09-21T05:39:21.128 INFO:teuthology.orchestra.run.smithi037.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 5.0 MB/s | 20 MB 00:03 2024-09-21T05:39:21.161 INFO:teuthology.orchestra.run.smithi067.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-21T05:39:21.178 INFO:teuthology.orchestra.run.smithi037.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 507 kB/s | 25 kB 00:00 2024-09-21T05:39:21.186 INFO:teuthology.orchestra.run.smithi067.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T05:39:21.220 INFO:teuthology.orchestra.run.smithi067.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T05:39:21.226 INFO:teuthology.orchestra.run.smithi144.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 330 kB/s | 80 kB 00:00 2024-09-21T05:39:21.245 INFO:teuthology.orchestra.run.smithi067.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-09-21T05:39:21.279 INFO:teuthology.orchestra.run.smithi067.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-21T05:39:21.293 INFO:teuthology.orchestra.run.smithi144.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-21T05:39:21.304 INFO:teuthology.orchestra.run.smithi067.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-21T05:39:21.312 INFO:teuthology.orchestra.run.smithi037.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 6.4 MB/s | 10 MB 00:01 2024-09-21T05:39:21.318 INFO:teuthology.orchestra.run.smithi144.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-21T05:39:21.353 INFO:teuthology.orchestra.run.smithi144.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-21T05:39:21.379 INFO:teuthology.orchestra.run.smithi037.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.3 MB/s | 226 kB 00:00 2024-09-21T05:39:21.394 INFO:teuthology.orchestra.run.smithi144.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-21T05:39:21.428 INFO:teuthology.orchestra.run.smithi144.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-21T05:39:21.429 INFO:teuthology.orchestra.run.smithi037.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 541 kB/s | 27 kB 00:00 2024-09-21T05:39:21.453 INFO:teuthology.orchestra.run.smithi144.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-21T05:39:21.479 INFO:teuthology.orchestra.run.smithi144.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T05:39:21.479 INFO:teuthology.orchestra.run.smithi037.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 642 kB/s | 32 kB 00:00 2024-09-21T05:39:21.504 INFO:teuthology.orchestra.run.smithi144.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T05:39:21.504 INFO:teuthology.orchestra.run.smithi067.stdout:(90/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-21T05:39:21.530 INFO:teuthology.orchestra.run.smithi067.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 226 kB/s | 51 kB 00:00 2024-09-21T05:39:21.555 INFO:teuthology.orchestra.run.smithi067.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.0 MB/s | 279 kB 00:00 2024-09-21T05:39:21.580 INFO:teuthology.orchestra.run.smithi067.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-21T05:39:21.597 INFO:teuthology.orchestra.run.smithi067.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 997 kB/s | 42 kB 00:00 2024-09-21T05:39:21.639 INFO:teuthology.orchestra.run.smithi067.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 755 kB/s | 44 kB 00:00 2024-09-21T05:39:21.664 INFO:teuthology.orchestra.run.smithi067.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-21T05:39:21.680 INFO:teuthology.orchestra.run.smithi037.stdout:(14/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 6.6 MB/s | 18 MB 00:02 2024-09-21T05:39:21.690 INFO:teuthology.orchestra.run.smithi067.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-21T05:39:21.715 INFO:teuthology.orchestra.run.smithi067.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-21T05:39:21.722 INFO:teuthology.orchestra.run.smithi037.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 3.1 MB/s | 766 kB 00:00 2024-09-21T05:39:21.747 INFO:teuthology.orchestra.run.smithi037.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T05:39:21.754 INFO:teuthology.orchestra.run.smithi144.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-21T05:39:21.757 INFO:teuthology.orchestra.run.smithi067.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-09-21T05:39:21.772 INFO:teuthology.orchestra.run.smithi037.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T05:39:21.774 INFO:teuthology.orchestra.run.smithi067.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-09-21T05:39:21.805 INFO:teuthology.orchestra.run.smithi144.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-21T05:39:21.816 INFO:teuthology.orchestra.run.smithi067.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T05:39:21.830 INFO:teuthology.orchestra.run.smithi144.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-21T05:39:21.841 INFO:teuthology.orchestra.run.smithi067.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 950 kB/s | 64 kB 00:00 2024-09-21T05:39:21.847 INFO:teuthology.orchestra.run.smithi037.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 5.0 MB/s | 507 kB 00:00 2024-09-21T05:39:21.855 INFO:teuthology.orchestra.run.smithi144.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-21T05:39:21.875 INFO:teuthology.orchestra.run.smithi067.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-09-21T05:39:21.889 INFO:teuthology.orchestra.run.smithi144.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-21T05:39:21.898 INFO:teuthology.orchestra.run.smithi037.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 903 kB/s | 45 kB 00:00 2024-09-21T05:39:21.914 INFO:teuthology.orchestra.run.smithi144.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-21T05:39:21.933 INFO:teuthology.orchestra.run.smithi067.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-21T05:39:21.948 INFO:teuthology.orchestra.run.smithi037.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T05:39:21.964 INFO:teuthology.orchestra.run.smithi144.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-21T05:39:21.998 INFO:teuthology.orchestra.run.smithi037.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 3.2 MB/s | 161 kB 00:00 2024-09-21T05:39:22.006 INFO:teuthology.orchestra.run.smithi144.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-09-21T05:39:22.065 INFO:teuthology.orchestra.run.smithi037.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 4.7 MB/s | 321 kB 00:00 2024-09-21T05:39:22.073 INFO:teuthology.orchestra.run.smithi144.stdout:(56/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-21T05:39:22.099 INFO:teuthology.orchestra.run.smithi144.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.8 MB/s | 171 kB 00:00 2024-09-21T05:39:22.109 INFO:teuthology.orchestra.run.smithi067.stdout:(105/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-21T05:39:22.132 INFO:teuthology.orchestra.run.smithi037.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T05:39:22.133 INFO:teuthology.orchestra.run.smithi144.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-21T05:39:22.149 INFO:teuthology.orchestra.run.smithi144.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-21T05:39:22.150 INFO:teuthology.orchestra.run.smithi067.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 2.5 MB/s | 548 kB 00:00 2024-09-21T05:39:22.168 INFO:teuthology.orchestra.run.smithi067.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.3 MB/s | 19 kB 00:00 2024-09-21T05:39:22.183 INFO:teuthology.orchestra.run.smithi037.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 2.0 MB/s | 99 kB 00:00 2024-09-21T05:39:22.191 INFO:teuthology.orchestra.run.smithi144.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-21T05:39:22.201 INFO:teuthology.orchestra.run.smithi067.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 3.3 MB/s | 308 kB 00:00 2024-09-21T05:39:22.225 INFO:teuthology.orchestra.run.smithi144.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-21T05:39:22.227 INFO:teuthology.orchestra.run.smithi067.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-09-21T05:39:22.233 INFO:teuthology.orchestra.run.smithi037.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T05:39:22.250 INFO:teuthology.orchestra.run.smithi144.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-21T05:39:22.260 INFO:teuthology.orchestra.run.smithi067.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-09-21T05:39:22.275 INFO:teuthology.orchestra.run.smithi144.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-21T05:39:22.285 INFO:teuthology.orchestra.run.smithi067.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-09-21T05:39:22.309 INFO:teuthology.orchestra.run.smithi144.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-21T05:39:22.311 INFO:teuthology.orchestra.run.smithi067.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 581 kB/s | 49 kB 00:00 2024-09-21T05:39:22.335 INFO:teuthology.orchestra.run.smithi144.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-21T05:39:22.336 INFO:teuthology.orchestra.run.smithi067.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-21T05:39:22.360 INFO:teuthology.orchestra.run.smithi144.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-21T05:39:22.378 INFO:teuthology.orchestra.run.smithi067.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T05:39:22.403 INFO:teuthology.orchestra.run.smithi067.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T05:39:22.425 INFO:teuthology.orchestra.run.smithi037.stdout:(26/157): librgw2-19.3.0-5120.g18432218.el9.x86 8.1 MB/s | 5.3 MB 00:00 2024-09-21T05:39:22.428 INFO:teuthology.orchestra.run.smithi067.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T05:39:22.454 INFO:teuthology.orchestra.run.smithi067.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-21T05:39:22.475 INFO:teuthology.orchestra.run.smithi037.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.4 MB/s | 170 kB 00:00 2024-09-21T05:39:22.479 INFO:teuthology.orchestra.run.smithi067.stdout:(118/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-09-21T05:39:22.504 INFO:teuthology.orchestra.run.smithi067.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T05:39:22.525 INFO:teuthology.orchestra.run.smithi037.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 688 kB/s | 34 kB 00:00 2024-09-21T05:39:22.529 INFO:teuthology.orchestra.run.smithi067.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T05:39:22.535 INFO:teuthology.orchestra.run.smithi144.stdout:(67/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-09-21T05:39:22.563 INFO:teuthology.orchestra.run.smithi067.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-21T05:39:22.576 INFO:teuthology.orchestra.run.smithi037.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T05:39:22.588 INFO:teuthology.orchestra.run.smithi067.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T05:39:22.610 INFO:teuthology.orchestra.run.smithi144.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 18 MB/s | 4.9 MB 00:00 2024-09-21T05:39:22.622 INFO:teuthology.orchestra.run.smithi067.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T05:39:22.648 INFO:teuthology.orchestra.run.smithi067.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-21T05:39:22.673 INFO:teuthology.orchestra.run.smithi067.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-21T05:39:22.676 INFO:teuthology.orchestra.run.smithi037.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 7.0 MB/s | 3.1 MB 00:00 2024-09-21T05:39:22.677 INFO:teuthology.orchestra.run.smithi144.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T05:39:22.719 INFO:teuthology.orchestra.run.smithi144.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-21T05:39:22.745 INFO:teuthology.orchestra.run.smithi144.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T05:39:22.748 INFO:teuthology.orchestra.run.smithi067.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 309 kB/s | 23 kB 00:00 2024-09-21T05:39:22.773 INFO:teuthology.orchestra.run.smithi067.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 785 kB/s | 19 kB 00:00 2024-09-21T05:39:22.812 INFO:teuthology.orchestra.run.smithi144.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-21T05:39:22.840 INFO:teuthology.orchestra.run.smithi067.stdout:(128/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2024-09-21T05:39:22.865 INFO:teuthology.orchestra.run.smithi067.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-09-21T05:39:22.891 INFO:teuthology.orchestra.run.smithi067.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T05:39:22.916 INFO:teuthology.orchestra.run.smithi067.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T05:39:22.941 INFO:teuthology.orchestra.run.smithi067.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T05:39:22.975 INFO:teuthology.orchestra.run.smithi067.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T05:39:23.000 INFO:teuthology.orchestra.run.smithi067.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-21T05:39:23.034 INFO:teuthology.orchestra.run.smithi067.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-21T05:39:23.059 INFO:teuthology.orchestra.run.smithi067.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-21T05:39:23.101 INFO:teuthology.orchestra.run.smithi067.stdout:(137/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-21T05:39:23.126 INFO:teuthology.orchestra.run.smithi067.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 460 kB/s | 31 kB 00:00 2024-09-21T05:39:23.152 INFO:teuthology.orchestra.run.smithi067.stdout:(139/157): python3-pyperclip-1.8.2-2.el9.noarch 306 kB/s | 28 kB 00:00 2024-09-21T05:39:23.177 INFO:teuthology.orchestra.run.smithi067.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T05:39:23.202 INFO:teuthology.orchestra.run.smithi067.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-21T05:39:23.204 INFO:teuthology.orchestra.run.smithi144.stdout:(73/157): ceph-test-19.3.0-5120.g18432218.el9.x 8.4 MB/s | 40 MB 00:04 2024-09-21T05:39:23.227 INFO:teuthology.orchestra.run.smithi067.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T05:39:23.229 INFO:teuthology.orchestra.run.smithi144.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 210 kB/s | 87 kB 00:00 2024-09-21T05:39:23.253 INFO:teuthology.orchestra.run.smithi067.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-21T05:39:23.278 INFO:teuthology.orchestra.run.smithi067.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T05:39:23.279 INFO:teuthology.orchestra.run.smithi144.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T05:39:23.311 INFO:teuthology.orchestra.run.smithi067.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-21T05:39:23.328 INFO:teuthology.orchestra.run.smithi067.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-21T05:39:23.362 INFO:teuthology.orchestra.run.smithi067.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T05:39:23.371 INFO:teuthology.orchestra.run.smithi144.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 8.9 MB/s | 5.8 MB 00:00 2024-09-21T05:39:23.384 INFO:teuthology.orchestra.run.smithi037.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 10 MB/s | 7.4 MB 00:00 2024-09-21T05:39:23.387 INFO:teuthology.orchestra.run.smithi067.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-21T05:39:23.405 INFO:teuthology.orchestra.run.smithi144.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-21T05:39:23.430 INFO:teuthology.orchestra.run.smithi144.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-21T05:39:23.437 INFO:teuthology.orchestra.run.smithi067.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T05:39:23.464 INFO:teuthology.orchestra.run.smithi144.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-09-21T05:39:23.476 INFO:teuthology.orchestra.run.smithi037.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.1 MB/s | 292 kB 00:00 2024-09-21T05:39:23.489 INFO:teuthology.orchestra.run.smithi144.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-21T05:39:23.515 INFO:teuthology.orchestra.run.smithi144.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-21T05:39:23.527 INFO:teuthology.orchestra.run.smithi037.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 991 kB/s | 49 kB 00:00 2024-09-21T05:39:23.548 INFO:teuthology.orchestra.run.smithi144.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-21T05:39:23.577 INFO:teuthology.orchestra.run.smithi037.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 331 kB/s | 16 kB 00:00 2024-09-21T05:39:23.607 INFO:teuthology.orchestra.run.smithi144.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-21T05:39:23.630 INFO:teuthology.orchestra.run.smithi067.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T05:39:23.652 INFO:teuthology.orchestra.run.smithi037.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 3.7 MB/s | 285 kB 00:00 2024-09-21T05:39:23.665 INFO:teuthology.orchestra.run.smithi144.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T05:39:23.671 INFO:teuthology.orchestra.run.smithi067.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 10 MB/s | 2.3 MB 00:00 2024-09-21T05:39:23.739 INFO:teuthology.orchestra.run.smithi067.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 17 MB/s | 1.8 MB 00:00 2024-09-21T05:39:23.749 INFO:teuthology.orchestra.run.smithi144.stdout:(85/157): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-09-21T05:39:23.752 INFO:teuthology.orchestra.run.smithi037.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 7.7 MB/s | 784 kB 00:00 2024-09-21T05:39:23.763 INFO:teuthology.orchestra.run.smithi067.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 445 kB/s | 41 kB 00:00 2024-09-21T05:39:23.774 INFO:teuthology.orchestra.run.smithi144.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 710 kB/s | 77 kB 00:00 2024-09-21T05:39:23.803 INFO:teuthology.orchestra.run.smithi037.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 370 kB/s | 18 kB 00:00 2024-09-21T05:39:23.806 INFO:teuthology.orchestra.run.smithi067.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 3.6 MB/s | 249 kB 00:00 2024-09-21T05:39:23.841 INFO:teuthology.orchestra.run.smithi144.stdout:(87/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-21T05:39:23.858 INFO:teuthology.orchestra.run.smithi144.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 389 kB/s | 42 kB 00:00 2024-09-21T05:39:23.881 INFO:teuthology.orchestra.run.smithi067.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-21T05:39:23.883 INFO:teuthology.orchestra.run.smithi144.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-09-21T05:39:23.886 INFO:teuthology.orchestra.run.smithi037.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 963 kB/s | 80 kB 00:00 2024-09-21T05:39:23.909 INFO:teuthology.orchestra.run.smithi144.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-21T05:39:23.931 INFO:teuthology.orchestra.run.smithi067.stdout:(156/157): librbd1-19.3.0-5120.g18432218.el9.x8 5.8 MB/s | 3.2 MB 00:00 2024-09-21T05:39:23.942 INFO:teuthology.orchestra.run.smithi144.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-21T05:39:23.959 INFO:teuthology.orchestra.run.smithi144.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-21T05:39:23.976 INFO:teuthology.orchestra.run.smithi144.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 800 kB/s | 54 kB 00:00 2024-09-21T05:39:23.981 INFO:teuthology.orchestra.run.smithi067.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-21T05:39:23.988 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:39:23.988 INFO:teuthology.orchestra.run.smithi067.stdout:Total 24 MB/s | 228 MB 00:09 2024-09-21T05:39:24.026 INFO:teuthology.orchestra.run.smithi144.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 887 kB/s | 44 kB 00:00 2024-09-21T05:39:24.043 INFO:teuthology.orchestra.run.smithi144.stdout:(95/157): python3-toml-0.10.2-6.el9.noarch.rpm 623 kB/s | 42 kB 00:00 2024-09-21T05:39:24.085 INFO:teuthology.orchestra.run.smithi144.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T05:39:24.110 INFO:teuthology.orchestra.run.smithi144.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 536 kB/s | 36 kB 00:00 2024-09-21T05:39:24.112 INFO:teuthology.orchestra.run.smithi037.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 9.2 MB/s | 14 MB 00:01 2024-09-21T05:39:24.136 INFO:teuthology.orchestra.run.smithi144.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-21T05:39:24.154 INFO:teuthology.orchestra.run.smithi037.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-21T05:39:24.169 INFO:teuthology.orchestra.run.smithi144.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T05:39:24.195 INFO:teuthology.orchestra.run.smithi144.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-09-21T05:39:24.204 INFO:teuthology.orchestra.run.smithi037.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-21T05:39:24.228 INFO:teuthology.orchestra.run.smithi144.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T05:39:24.254 INFO:teuthology.orchestra.run.smithi144.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T05:39:24.271 INFO:teuthology.orchestra.run.smithi037.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-21T05:39:24.287 INFO:teuthology.orchestra.run.smithi144.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-09-21T05:39:24.313 INFO:teuthology.orchestra.run.smithi037.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-21T05:39:24.338 INFO:teuthology.orchestra.run.smithi037.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-21T05:39:24.364 INFO:teuthology.orchestra.run.smithi037.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T05:39:24.389 INFO:teuthology.orchestra.run.smithi037.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T05:39:24.414 INFO:teuthology.orchestra.run.smithi037.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T05:39:24.496 INFO:teuthology.orchestra.run.smithi144.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-21T05:39:24.521 INFO:teuthology.orchestra.run.smithi144.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-09-21T05:39:24.572 INFO:teuthology.orchestra.run.smithi144.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-21T05:39:24.590 INFO:teuthology.orchestra.run.smithi037.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-21T05:39:24.597 INFO:teuthology.orchestra.run.smithi144.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-09-21T05:39:24.622 INFO:teuthology.orchestra.run.smithi144.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-21T05:39:24.640 INFO:teuthology.orchestra.run.smithi037.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-21T05:39:24.647 INFO:teuthology.orchestra.run.smithi144.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T05:39:24.673 INFO:teuthology.orchestra.run.smithi144.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T05:39:24.673 INFO:teuthology.orchestra.run.smithi037.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-09-21T05:39:24.698 INFO:teuthology.orchestra.run.smithi144.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T05:39:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-21T05:39:24.732 INFO:teuthology.orchestra.run.smithi144.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-21T05:39:24.732 INFO:teuthology.orchestra.run.smithi037.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-09-21T05:39:24.750 INFO:teuthology.orchestra.run.smithi037.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-21T05:39:24.765 INFO:teuthology.orchestra.run.smithi144.stdout:(113/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-21T05:39:24.783 INFO:teuthology.orchestra.run.smithi037.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 549 kB/s | 18 kB 00:00 2024-09-21T05:39:24.807 INFO:teuthology.orchestra.run.smithi144.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-21T05:39:24.833 INFO:teuthology.orchestra.run.smithi144.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.9 MB/s | 43 kB 00:00 2024-09-21T05:39:24.850 INFO:teuthology.orchestra.run.smithi037.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 168 kB/s | 11 kB 00:00 2024-09-21T05:39:24.858 INFO:teuthology.orchestra.run.smithi144.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T05:39:24.883 INFO:teuthology.orchestra.run.smithi144.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-21T05:39:24.908 INFO:teuthology.orchestra.run.smithi144.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T05:39:24.909 INFO:teuthology.orchestra.run.smithi037.stdout:(56/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-09-21T05:39:24.934 INFO:teuthology.orchestra.run.smithi144.stdout:(119/157): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-09-21T05:39:24.934 INFO:teuthology.orchestra.run.smithi037.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-21T05:39:24.959 INFO:teuthology.orchestra.run.smithi144.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T05:39:24.959 INFO:teuthology.orchestra.run.smithi037.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T05:39:24.984 INFO:teuthology.orchestra.run.smithi037.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-09-21T05:39:24.985 INFO:teuthology.orchestra.run.smithi144.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T05:39:25.010 INFO:teuthology.orchestra.run.smithi144.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T05:39:25.026 INFO:teuthology.orchestra.run.smithi037.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-21T05:39:25.043 INFO:teuthology.orchestra.run.smithi144.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T05:39:25.060 INFO:teuthology.orchestra.run.smithi037.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-21T05:39:25.085 INFO:teuthology.orchestra.run.smithi037.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 420 kB/s | 24 kB 00:00 2024-09-21T05:39:25.110 INFO:teuthology.orchestra.run.smithi144.stdout:(124/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2024-09-21T05:39:25.111 INFO:teuthology.orchestra.run.smithi037.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-21T05:39:25.136 INFO:teuthology.orchestra.run.smithi144.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-09-21T05:39:25.144 INFO:teuthology.orchestra.run.smithi037.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-21T05:39:25.161 INFO:teuthology.orchestra.run.smithi144.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-21T05:39:25.170 INFO:teuthology.orchestra.run.smithi037.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-21T05:39:25.186 INFO:teuthology.orchestra.run.smithi144.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-21T05:39:25.195 INFO:teuthology.orchestra.run.smithi037.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-21T05:39:25.211 INFO:teuthology.orchestra.run.smithi144.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-21T05:39:25.237 INFO:teuthology.orchestra.run.smithi144.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-21T05:39:25.247 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-09-21T05:39:25.262 INFO:teuthology.orchestra.run.smithi144.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T05:39:25.287 INFO:teuthology.orchestra.run.smithi144.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T05:39:25.304 INFO:teuthology.orchestra.run.smithi144.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-21T05:39:25.320 INFO:teuthology.orchestra.run.smithi037.stdout:(67/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-21T05:39:25.346 INFO:teuthology.orchestra.run.smithi144.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-21T05:39:25.380 INFO:teuthology.orchestra.run.smithi144.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-21T05:39:25.405 INFO:teuthology.orchestra.run.smithi144.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 279 kB/s | 16 kB 00:00 2024-09-21T05:39:25.413 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-09-21T05:39:25.413 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-09-21T05:39:25.431 INFO:teuthology.orchestra.run.smithi144.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-21T05:39:25.456 INFO:teuthology.orchestra.run.smithi144.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 565 kB/s | 28 kB 00:00 2024-09-21T05:39:25.506 INFO:teuthology.orchestra.run.smithi144.stdout:(138/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-09-21T05:39:25.531 INFO:teuthology.orchestra.run.smithi144.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-09-21T05:39:25.557 INFO:teuthology.orchestra.run.smithi144.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T05:39:25.582 INFO:teuthology.orchestra.run.smithi144.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-21T05:39:25.607 INFO:teuthology.orchestra.run.smithi144.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-21T05:39:25.632 INFO:teuthology.orchestra.run.smithi144.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-21T05:39:25.658 INFO:teuthology.orchestra.run.smithi144.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 3.6 MB/s | 90 kB 00:00 2024-09-21T05:39:25.683 INFO:teuthology.orchestra.run.smithi144.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T05:39:25.708 INFO:teuthology.orchestra.run.smithi144.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-21T05:39:25.733 INFO:teuthology.orchestra.run.smithi144.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T05:39:25.759 INFO:teuthology.orchestra.run.smithi144.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T05:39:25.809 INFO:teuthology.orchestra.run.smithi144.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T05:39:25.871 INFO:teuthology.orchestra.run.smithi037.stdout:(68/157): ceph-test-19.3.0-5120.g18432218.el9.x 8.5 MB/s | 40 MB 00:04 2024-09-21T05:39:25.946 INFO:teuthology.orchestra.run.smithi037.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 6.4 MB/s | 4.9 MB 00:00 2024-09-21T05:39:25.988 INFO:teuthology.orchestra.run.smithi037.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 2.4 MB/s | 1.6 MB 00:00 2024-09-21T05:39:26.001 INFO:teuthology.orchestra.run.smithi144.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-21T05:39:26.013 INFO:teuthology.orchestra.run.smithi037.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T05:39:26.051 INFO:teuthology.orchestra.run.smithi144.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-21T05:39:26.071 INFO:teuthology.orchestra.run.smithi037.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-21T05:39:26.093 INFO:teuthology.orchestra.run.smithi144.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 20 MB/s | 1.8 MB 00:00 2024-09-21T05:39:26.144 INFO:teuthology.orchestra.run.smithi144.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 441 kB/s | 41 kB 00:00 2024-09-21T05:39:26.155 INFO:teuthology.orchestra.run.smithi037.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-09-21T05:39:26.180 INFO:teuthology.orchestra.run.smithi037.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 809 kB/s | 87 kB 00:00 2024-09-21T05:39:26.211 INFO:teuthology.orchestra.run.smithi144.stdout:(154/157): librados2-19.3.0-5120.g18432218.el9. 7.1 MB/s | 3.4 MB 00:00 2024-09-21T05:39:26.222 INFO:teuthology.orchestra.run.smithi037.stdout:(75/157): postgresql-contrib-13.16-1.el9.x86_64 2.5 MB/s | 910 kB 00:00 2024-09-21T05:39:26.236 INFO:teuthology.orchestra.run.smithi144.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.7 MB/s | 249 kB 00:00 2024-09-21T05:39:26.248 INFO:teuthology.orchestra.run.smithi037.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 913 kB/s | 61 kB 00:00 2024-09-21T05:39:26.273 INFO:teuthology.orchestra.run.smithi037.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.7 MB/s | 245 kB 00:00 2024-09-21T05:39:26.298 INFO:teuthology.orchestra.run.smithi037.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-21T05:39:26.311 INFO:teuthology.orchestra.run.smithi144.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-21T05:39:26.323 INFO:teuthology.orchestra.run.smithi037.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-21T05:39:26.348 INFO:teuthology.orchestra.run.smithi037.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 385 kB/s | 19 kB 00:00 2024-09-21T05:39:26.374 INFO:teuthology.orchestra.run.smithi037.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-21T05:39:26.399 INFO:teuthology.orchestra.run.smithi037.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-21T05:39:26.449 INFO:teuthology.orchestra.run.smithi037.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-21T05:39:26.461 INFO:teuthology.orchestra.run.smithi144.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 2.4 MB 00:00 2024-09-21T05:39:26.468 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:39:26.468 INFO:teuthology.orchestra.run.smithi144.stdout:Total 23 MB/s | 228 MB 00:09 2024-09-21T05:39:26.542 INFO:teuthology.orchestra.run.smithi037.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T05:39:26.583 INFO:teuthology.orchestra.run.smithi037.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-09-21T05:39:26.609 INFO:teuthology.orchestra.run.smithi037.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-21T05:39:26.634 INFO:teuthology.orchestra.run.smithi037.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-21T05:39:26.659 INFO:teuthology.orchestra.run.smithi037.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-21T05:39:26.685 INFO:teuthology.orchestra.run.smithi037.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T05:39:26.718 INFO:teuthology.orchestra.run.smithi037.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-21T05:39:26.735 INFO:teuthology.orchestra.run.smithi037.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T05:39:26.760 INFO:teuthology.orchestra.run.smithi037.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-21T05:39:26.835 INFO:teuthology.orchestra.run.smithi037.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-21T05:39:26.852 INFO:teuthology.orchestra.run.smithi037.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 454 kB/s | 42 kB 00:00 2024-09-21T05:39:26.869 INFO:teuthology.orchestra.run.smithi037.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-21T05:39:26.903 INFO:teuthology.orchestra.run.smithi037.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T05:39:26.920 INFO:teuthology.orchestra.run.smithi037.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-21T05:39:26.937 INFO:teuthology.orchestra.run.smithi037.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-21T05:39:26.970 INFO:teuthology.orchestra.run.smithi037.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T05:39:26.995 INFO:teuthology.orchestra.run.smithi037.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 991 kB/s | 58 kB 00:00 2024-09-21T05:39:27.012 INFO:teuthology.orchestra.run.smithi037.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.3 MB/s | 96 kB 00:00 2024-09-21T05:39:27.046 INFO:teuthology.orchestra.run.smithi037.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T05:39:27.071 INFO:teuthology.orchestra.run.smithi037.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-09-21T05:39:27.096 INFO:teuthology.orchestra.run.smithi037.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 447 kB/s | 22 kB 00:00 2024-09-21T05:39:27.155 INFO:teuthology.orchestra.run.smithi037.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T05:39:27.189 INFO:teuthology.orchestra.run.smithi037.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T05:39:27.214 INFO:teuthology.orchestra.run.smithi037.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-21T05:39:27.273 INFO:teuthology.orchestra.run.smithi037.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-09-21T05:39:27.323 INFO:teuthology.orchestra.run.smithi037.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 523 kB/s | 26 kB 00:00 2024-09-21T05:39:27.334 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-09-21T05:39:27.334 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-09-21T05:39:27.348 INFO:teuthology.orchestra.run.smithi037.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T05:39:27.374 INFO:teuthology.orchestra.run.smithi037.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-21T05:39:27.407 INFO:teuthology.orchestra.run.smithi037.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-21T05:39:27.483 INFO:teuthology.orchestra.run.smithi037.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-21T05:39:27.650 INFO:teuthology.orchestra.run.smithi037.stdout:(114/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-21T05:39:27.700 INFO:teuthology.orchestra.run.smithi037.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 2.5 MB/s | 548 kB 00:00 2024-09-21T05:39:27.713 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-21T05:39:27.725 INFO:teuthology.orchestra.run.smithi037.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 583 kB/s | 43 kB 00:00 2024-09-21T05:39:27.750 INFO:teuthology.orchestra.run.smithi037.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-21T05:39:27.776 INFO:teuthology.orchestra.run.smithi037.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T05:39:27.809 INFO:teuthology.orchestra.run.smithi037.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T05:39:27.843 INFO:teuthology.orchestra.run.smithi037.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T05:39:27.865 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-21T05:39:27.865 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-21T05:39:27.868 INFO:teuthology.orchestra.run.smithi037.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T05:39:27.943 INFO:teuthology.orchestra.run.smithi037.stdout:(122/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2024-09-21T05:39:27.968 INFO:teuthology.orchestra.run.smithi037.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 1.7 MB/s | 220 kB 00:00 2024-09-21T05:39:27.994 INFO:teuthology.orchestra.run.smithi037.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-21T05:39:28.019 INFO:teuthology.orchestra.run.smithi037.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-21T05:39:28.045 INFO:teuthology.orchestra.run.smithi037.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-21T05:39:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-21T05:39:28.095 INFO:teuthology.orchestra.run.smithi037.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 390 kB/s | 19 kB 00:00 2024-09-21T05:39:28.120 INFO:teuthology.orchestra.run.smithi037.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-21T05:39:28.145 INFO:teuthology.orchestra.run.smithi037.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T05:39:28.171 INFO:teuthology.orchestra.run.smithi037.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T05:39:28.196 INFO:teuthology.orchestra.run.smithi037.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T05:39:28.230 INFO:teuthology.orchestra.run.smithi037.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T05:39:28.263 INFO:teuthology.orchestra.run.smithi037.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 496 kB/s | 16 kB 00:00 2024-09-21T05:39:28.313 INFO:teuthology.orchestra.run.smithi037.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-21T05:39:28.339 INFO:teuthology.orchestra.run.smithi037.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T05:39:28.381 INFO:teuthology.orchestra.run.smithi037.stdout:(137/157): python3-kubernetes-26.1.0-2.el9.noar 3.6 MB/s | 1.0 MB 00:00 2024-09-21T05:39:28.406 INFO:teuthology.orchestra.run.smithi037.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 460 kB/s | 31 kB 00:00 2024-09-21T05:39:28.432 INFO:teuthology.orchestra.run.smithi037.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T05:39:28.448 INFO:teuthology.orchestra.run.smithi037.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-09-21T05:39:28.474 INFO:teuthology.orchestra.run.smithi037.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-09-21T05:39:28.499 INFO:teuthology.orchestra.run.smithi037.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T05:39:28.524 INFO:teuthology.orchestra.run.smithi037.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T05:39:28.608 INFO:teuthology.orchestra.run.smithi037.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-21T05:39:28.633 INFO:teuthology.orchestra.run.smithi037.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 816 kB/s | 20 kB 00:00 2024-09-21T05:39:28.667 INFO:teuthology.orchestra.run.smithi037.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-21T05:39:28.709 INFO:teuthology.orchestra.run.smithi037.stdout:(147/157): python3-grpcio-1.46.7-10.el9.x86_64. 2.4 MB/s | 2.0 MB 00:00 2024-09-21T05:39:28.734 INFO:teuthology.orchestra.run.smithi037.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.0 MB/s | 427 kB 00:00 2024-09-21T05:39:28.793 INFO:teuthology.orchestra.run.smithi037.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T05:39:28.985 INFO:teuthology.orchestra.run.smithi037.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-21T05:39:29.146 INFO:teuthology.orchestra.run.smithi037.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 11 MB/s | 1.8 MB 00:00 2024-09-21T05:39:29.210 INFO:teuthology.orchestra.run.smithi037.stdout:(152/157): librados2-19.3.0-5120.g18432218.el9. 6.8 MB/s | 3.4 MB 00:00 2024-09-21T05:39:29.243 INFO:teuthology.orchestra.run.smithi037.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 424 kB/s | 41 kB 00:00 2024-09-21T05:39:29.302 INFO:teuthology.orchestra.run.smithi037.stdout:(154/157): librbd1-19.3.0-5120.g18432218.el9.x8 5.6 MB/s | 3.2 MB 00:00 2024-09-21T05:39:29.352 INFO:teuthology.orchestra.run.smithi037.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-21T05:39:29.394 INFO:teuthology.orchestra.run.smithi037.stdout:(156/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.3 MB/s | 249 kB 00:00 2024-09-21T05:39:29.527 INFO:teuthology.orchestra.run.smithi037.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-21T05:39:29.534 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:39:29.534 INFO:teuthology.orchestra.run.smithi037.stdout:Total 17 MB/s | 228 MB 00:13 2024-09-21T05:39:29.675 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-21T05:39:29.676 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-21T05:39:31.661 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-21T05:39:31.858 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-21T05:39:31.858 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-21T05:39:34.021 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-09-21T05:39:34.135 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T05:39:34.174 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T05:39:34.228 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T05:39:34.270 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T05:39:34.295 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T05:39:34.347 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T05:39:34.420 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-21T05:39:34.421 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-21T05:39:34.704 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T05:39:34.812 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:39:34.941 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:39:34.971 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:39:35.064 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:39:35.093 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:39:35.122 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T05:39:35.287 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T05:39:35.341 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T05:39:35.368 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:39:35.476 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:39:35.503 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:39:35.565 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:39:35.587 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:39:35.612 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:39:35.805 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:39:35.933 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:39:35.981 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-21T05:39:36.052 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T05:39:36.090 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T05:39:36.168 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:39:36.221 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T05:39:36.245 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:39:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T05:39:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T05:39:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T05:39:36.460 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T05:39:36.477 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:39:36.594 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T05:39:36.632 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T05:39:36.671 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T05:39:36.755 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T05:39:36.822 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T05:39:36.858 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T05:39:36.862 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T05:39:36.905 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T05:39:36.925 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:39:36.938 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T05:39:36.965 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T05:39:37.038 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T05:39:37.050 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:39:37.085 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:39:37.106 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T05:39:37.135 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T05:39:37.170 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T05:39:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:39:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:39:37.235 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T05:39:37.254 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T05:39:37.290 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T05:39:37.333 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T05:39:37.361 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T05:39:37.394 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T05:39:37.437 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T05:39:37.445 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T05:39:37.474 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:39:37.486 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T05:39:37.572 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T05:39:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:39:37.608 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:39:37.670 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:39:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:39:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:39:37.717 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T05:39:37.772 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T05:39:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:39:38.036 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:39:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T05:39:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:39:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:39:38.334 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T05:39:38.419 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T05:39:38.453 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T05:39:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T05:39:38.535 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T05:39:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:39:38.577 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T05:39:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T05:39:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T05:39:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T05:39:38.754 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T05:39:38.803 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T05:39:38.825 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T05:39:38.869 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T05:39:38.901 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T05:39:38.906 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T05:39:38.944 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T05:39:38.968 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T05:39:38.977 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T05:39:39.013 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T05:39:39.043 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T05:39:39.081 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T05:39:39.082 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T05:39:39.116 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T05:39:39.135 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T05:39:39.164 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T05:39:39.166 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T05:39:39.202 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T05:39:39.207 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T05:39:39.258 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T05:39:39.284 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T05:39:39.301 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T05:39:39.338 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T05:39:39.380 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T05:39:39.410 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T05:39:39.444 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T05:39:39.486 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T05:39:39.487 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T05:39:39.528 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T05:39:39.541 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T05:39:39.615 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T05:39:39.635 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T05:39:39.747 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T05:39:39.801 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T05:39:39.827 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T05:39:39.876 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T05:39:39.917 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T05:39:39.942 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T05:39:40.023 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T05:39:40.157 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T05:39:40.199 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T05:39:40.236 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T05:39:40.270 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T05:39:40.310 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T05:39:40.319 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T05:39:40.349 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T05:39:40.379 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T05:39:40.396 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T05:39:40.413 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T05:39:40.429 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T05:39:40.446 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T05:39:40.471 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T05:39:40.489 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T05:39:40.510 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T05:39:40.523 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T05:39:40.551 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T05:39:40.613 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T05:39:40.670 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T05:39:40.701 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T05:39:40.711 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T05:39:40.779 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T05:39:40.808 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T05:39:40.862 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T05:39:40.872 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T05:39:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T05:39:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T05:39:41.050 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T05:39:41.086 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T05:39:41.133 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T05:39:41.169 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T05:39:41.212 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T05:39:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-21T05:39:41.254 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T05:39:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T05:39:41.399 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T05:39:41.448 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T05:39:41.490 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T05:39:41.609 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T05:39:41.625 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T05:39:41.634 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T05:39:41.640 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T05:39:41.680 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T05:39:41.682 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T05:39:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T05:39:41.724 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T05:39:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T05:39:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T05:39:41.804 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T05:39:41.827 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T05:39:41.844 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T05:39:41.875 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T05:39:41.880 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T05:39:41.925 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T05:39:41.932 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T05:39:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T05:39:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T05:39:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T05:39:42.016 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T05:39:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T05:39:42.051 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T05:39:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T05:39:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T05:39:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T05:39:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T05:39:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T05:39:42.242 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T05:39:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T05:39:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T05:39:42.350 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T05:39:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T05:39:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T05:39:42.446 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T05:39:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T05:39:42.467 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:39:42.528 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T05:39:42.568 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T05:39:42.604 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:39:42.616 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T05:39:42.659 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:39:42.773 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:39:42.807 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:39:42.847 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T05:39:43.067 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T05:39:43.130 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T05:39:43.156 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:39:43.213 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T05:39:43.289 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:39:43.315 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:39:43.337 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T05:39:43.350 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T05:39:43.396 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T05:39:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:39:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:39:43.430 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T05:39:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:39:43.529 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T05:39:43.577 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T05:39:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T05:39:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:39:43.718 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T05:39:43.766 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T05:39:43.867 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:39:43.952 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T05:39:43.989 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T05:39:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T05:39:44.066 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T05:39:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:39:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:39:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:39:44.651 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T05:39:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T05:39:44.707 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T05:39:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T05:39:44.745 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T05:39:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T05:39:44.773 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T05:39:44.806 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T05:39:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T05:39:44.871 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T05:39:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T05:39:44.949 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T05:39:45.012 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T05:39:45.050 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T05:39:45.083 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T05:39:45.164 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T05:39:45.193 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T05:39:45.262 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T05:39:45.277 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:39:45.295 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T05:39:45.346 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T05:39:45.440 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T05:39:45.474 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T05:39:45.511 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T05:39:45.521 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:39:45.538 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T05:39:45.550 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T05:39:45.586 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T05:39:45.631 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T05:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T05:39:45.777 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T05:39:45.948 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T05:39:46.011 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T05:39:46.090 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T05:39:46.111 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T05:39:46.147 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:39:46.177 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T05:39:46.201 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:39:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T05:39:46.232 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T05:39:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T05:39:46.571 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T05:39:46.684 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:39:46.690 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T05:39:46.776 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:39:46.789 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T05:39:46.806 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T05:39:46.830 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T05:39:46.841 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T05:39:46.896 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T05:39:46.937 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T05:39:46.991 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T05:39:47.175 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T05:39:47.240 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T05:39:47.341 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T05:39:47.348 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T05:39:47.370 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:39:47.421 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T05:39:47.441 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:39:47.472 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T05:39:47.504 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T05:39:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T05:39:47.594 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T05:39:47.653 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T05:39:47.719 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T05:39:47.765 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T05:39:47.815 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T05:39:47.994 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T05:39:48.039 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T05:39:48.082 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T05:39:48.203 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T05:39:48.255 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T05:39:48.302 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T05:39:48.335 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T05:39:48.360 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T05:39:48.506 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T05:39:48.618 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:39:48.653 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:39:48.679 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T05:39:48.721 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T05:39:48.761 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T05:39:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T05:39:48.842 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T05:39:48.880 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T05:39:48.918 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T05:39:48.952 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T05:39:48.985 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T05:39:49.048 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T05:39:49.086 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T05:39:49.188 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T05:39:49.245 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T05:39:49.251 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:39:49.289 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T05:39:49.290 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:39:49.384 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:39:49.385 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T05:39:49.385 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T05:39:49.385 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:39:49.415 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T05:39:49.416 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:39:49.479 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T05:39:49.743 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:39:49.777 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:39:50.342 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:39:50.380 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:39:50.419 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T05:39:50.471 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:39:50.472 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T05:39:50.472 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T05:39:50.472 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:39:50.479 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T05:39:50.498 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:39:50.512 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T05:39:50.630 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T05:39:50.697 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T05:39:50.758 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T05:39:50.867 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T05:39:50.906 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T05:39:51.156 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T05:39:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T05:39:51.299 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T05:39:52.150 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T05:39:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T05:39:53.958 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T05:39:54.067 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T05:39:54.103 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T05:39:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T05:39:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T05:39:54.555 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:39:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:39:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T05:39:54.760 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T05:39:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T05:39:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:39:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:39:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T05:39:58.144 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:39:58.181 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:39:58.873 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:39:58.926 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:39:59.074 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:39:59.074 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T05:39:59.074 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T05:39:59.074 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:39:59.118 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:40:01.679 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:40:01.679 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /sys 2024-09-21T05:40:01.679 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /proc 2024-09-21T05:40:01.679 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /mnt 2024-09-21T05:40:01.679 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /var/tmp 2024-09-21T05:40:01.679 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /home 2024-09-21T05:40:01.679 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /root 2024-09-21T05:40:01.679 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /tmp 2024-09-21T05:40:01.679 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:40:01.867 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:40:01.884 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:40:01.884 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:01.884 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T05:40:01.884 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:40:02.448 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:40:02.448 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2024-09-21T05:40:02.448 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2024-09-21T05:40:02.448 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2024-09-21T05:40:02.448 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2024-09-21T05:40:02.448 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2024-09-21T05:40:02.448 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /root 2024-09-21T05:40:02.448 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2024-09-21T05:40:02.448 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:40:02.627 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:40:02.645 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:40:02.645 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:02.645 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T05:40:02.645 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:40:03.528 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:40:03.555 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:40:03.555 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:03.555 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T05:40:03.555 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:40:03.556 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:40:03.556 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:40:03.796 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:40:03.821 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:40:03.821 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:03.821 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T05:40:03.821 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:40:03.822 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:40:03.822 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:40:04.230 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:40:04.257 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:40:04.257 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:04.257 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T05:40:04.257 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:40:04.257 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:40:04.257 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:40:04.313 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:40:04.337 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:40:04.337 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:04.337 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T05:40:04.337 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:40:04.337 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:40:04.337 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:40:04.444 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T05:40:04.482 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:40:04.502 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T05:40:04.504 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:40:04.504 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:04.504 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T05:40:04.504 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:40:04.504 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:40:04.504 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:40:04.566 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T05:40:04.760 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T05:40:04.806 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T05:40:04.886 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T05:40:04.981 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:40:04.984 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T05:40:05.005 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:40:05.005 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:05.005 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T05:40:05.005 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:40:05.005 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:40:05.005 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:40:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T05:40:05.136 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T05:40:05.181 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T05:40:05.185 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T05:40:05.213 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T05:40:05.240 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T05:40:05.240 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T05:40:05.426 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T05:40:05.482 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T05:40:05.568 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T05:40:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T05:40:05.683 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:40:05.722 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:40:05.755 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T05:40:05.813 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T05:40:05.823 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T05:40:05.853 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:40:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T05:40:05.898 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T05:40:05.926 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T05:40:06.328 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:40:06.366 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:40:06.398 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T05:40:06.464 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T05:40:06.488 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:40:09.263 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:40:09.317 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:40:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:40:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:40:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:40:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:40:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:40:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T05:40:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:40:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:40:10.702 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:10.702 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T05:40:10.702 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:40:10.702 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:40:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:40:10.723 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:40:10.754 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:40:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:40:10.766 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:40:10.868 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:40:10.877 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T05:40:10.928 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T05:40:11.046 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T05:40:11.081 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:40:11.105 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:40:11.105 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:11.105 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T05:40:11.105 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:40:11.105 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:40:11.105 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:40:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:40:11.168 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:40:11.267 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T05:40:11.313 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T05:40:11.954 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T05:40:11.989 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:40:12.013 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:40:12.013 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:12.013 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T05:40:12.013 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:40:12.013 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:40:12.014 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:40:12.057 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:40:12.080 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:40:12.080 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:12.080 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T05:40:12.080 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:40:12.124 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:40:12.147 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:40:12.147 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:12.147 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T05:40:12.147 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:40:12.148 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:40:12.148 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:40:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T05:40:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:40:12.324 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:40:12.324 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:12.325 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T05:40:12.325 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:40:12.325 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:40:12.325 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:40:12.368 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:40:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:40:12.393 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:12.393 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T05:40:12.393 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:40:12.452 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:40:12.475 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:40:12.475 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:12.476 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T05:40:12.476 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:40:12.476 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:40:12.476 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:40:12.483 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:40:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:40:12.507 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:12.507 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T05:40:12.507 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:40:12.507 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:40:12.507 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:40:12.523 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:40:12.523 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-09-21T05:40:12.524 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-09-21T05:40:12.524 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-09-21T05:40:12.524 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-09-21T05:40:12.524 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-09-21T05:40:12.524 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-09-21T05:40:12.524 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-09-21T05:40:12.524 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:40:12.737 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:40:12.774 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T05:40:12.774 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:12.774 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T05:40:12.774 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:40:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:40:12.835 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:40:12.835 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:12.835 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T05:40:12.835 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:40:12.835 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:40:12.835 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:40:14.571 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:40:14.630 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T05:40:14.630 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:14.630 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T05:40:14.630 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:40:14.630 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T05:40:14.630 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:40:14.888 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:40:14.940 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T05:40:14.940 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:14.940 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T05:40:14.940 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:40:14.940 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T05:40:14.940 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:40:15.480 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:40:15.533 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T05:40:15.533 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:15.533 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T05:40:15.533 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:40:15.533 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T05:40:15.533 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:40:15.664 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T05:40:15.725 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T05:40:15.807 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T05:40:16.044 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T05:40:16.102 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T05:40:16.192 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T05:40:16.310 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T05:40:16.487 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T05:40:16.534 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T05:40:16.574 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T05:40:16.607 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T05:40:16.721 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T05:40:16.763 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T05:40:16.803 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T05:40:16.835 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T05:40:16.862 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T05:40:16.949 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T05:40:16.990 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T05:40:17.030 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T05:40:17.063 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T05:40:17.068 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T05:40:17.090 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T05:40:17.108 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T05:40:17.139 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T05:40:17.168 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T05:40:17.243 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T05:40:17.276 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T05:40:17.329 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T05:40:17.359 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T05:40:17.388 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T05:40:17.389 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:40:17.423 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T05:40:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T05:40:17.458 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T05:40:17.542 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T05:40:17.571 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:40:17.898 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:40:17.937 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:40:17.957 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:40:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:40:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:40:18.128 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:40:18.846 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T05:40:18.933 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T05:40:18.951 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T05:40:18.975 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T05:40:19.029 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T05:40:19.058 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T05:40:19.070 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T05:40:19.086 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T05:40:19.111 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T05:40:19.137 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T05:40:19.137 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:40:19.149 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T05:40:19.199 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T05:40:19.221 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:40:19.221 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:40:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T05:40:19.250 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T05:40:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:40:19.314 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:40:19.318 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:40:19.318 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:40:19.347 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T05:40:19.352 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:40:19.353 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:40:19.394 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:40:19.419 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T05:40:19.424 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:40:19.424 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:40:19.541 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:40:19.541 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:40:19.612 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:40:19.613 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:40:19.633 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:40:19.699 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:40:19.705 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:40:19.768 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:40:21.462 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T05:40:21.535 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:40:22.694 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T05:40:22.719 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:40:22.880 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T05:40:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T05:40:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:40:23.148 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T05:40:23.148 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:23.148 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T05:40:23.148 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:40:23.149 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T05:40:23.149 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:40:23.196 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:40:23.224 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T05:40:23.336 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T05:40:23.407 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T05:40:24.517 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T05:40:24.556 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:40:24.610 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T05:40:24.610 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:24.610 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T05:40:24.610 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:40:24.610 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T05:40:24.610 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:40:24.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:40:24.708 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T05:40:24.708 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:24.708 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T05:40:24.708 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:40:24.766 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:40:24.818 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T05:40:24.818 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:24.819 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T05:40:24.819 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:40:24.819 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T05:40:24.819 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:40:25.192 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:40:25.244 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T05:40:25.244 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T05:40:25.244 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T05:40:25.244 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:40:25.244 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T05:40:25.244 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:40:25.891 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:40:25.892 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T05:40:25.892 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T05:40:25.892 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T05:40:25.892 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T05:40:25.892 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T05:40:25.892 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T05:40:25.892 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T05:40:25.892 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:40:25.892 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:40:25.892 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:40:25.892 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T05:40:25.892 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T05:40:25.892 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T05:40:25.893 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:40:25.893 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T05:40:25.893 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T05:40:25.893 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T05:40:25.893 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T05:40:25.893 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T05:40:25.893 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T05:40:25.893 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T05:40:25.893 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T05:40:25.893 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T05:40:25.893 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T05:40:25.893 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T05:40:25.893 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T05:40:25.894 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T05:40:25.894 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T05:40:25.894 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T05:40:25.894 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T05:40:25.894 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T05:40:25.894 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T05:40:25.894 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T05:40:25.894 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T05:40:25.894 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T05:40:25.894 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T05:40:25.894 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T05:40:25.894 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T05:40:25.895 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T05:40:25.895 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T05:40:25.895 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T05:40:25.895 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T05:40:25.895 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T05:40:25.895 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T05:40:25.895 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T05:40:25.895 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T05:40:25.895 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T05:40:25.895 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T05:40:25.895 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T05:40:25.895 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T05:40:25.895 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T05:40:25.896 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T05:40:25.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T05:40:25.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T05:40:25.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T05:40:25.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T05:40:25.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T05:40:25.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T05:40:25.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T05:40:25.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T05:40:25.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T05:40:25.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T05:40:25.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T05:40:25.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T05:40:25.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T05:40:25.898 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T05:40:25.899 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T05:40:25.900 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T05:40:25.901 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T05:40:25.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T05:40:25.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T05:40:25.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T05:40:25.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T05:40:25.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T05:40:25.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T05:40:25.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T05:40:25.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T05:40:25.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T05:40:25.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T05:40:25.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T05:40:25.902 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T05:40:25.903 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T05:40:25.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T05:40:25.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T05:40:25.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T05:40:25.904 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T05:40:26.203 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:40:26.203 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T05:40:26.203 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T05:40:26.203 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T05:40:26.203 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T05:40:26.204 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T05:40:26.205 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T05:40:26.205 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T05:40:26.205 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T05:40:26.205 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T05:40:26.205 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T05:40:26.205 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T05:40:26.205 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T05:40:26.205 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T05:40:26.205 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T05:40:26.205 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T05:40:26.205 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T05:40:26.216 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T05:40:26.217 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T05:40:26.217 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T05:40:26.217 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T05:40:26.217 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T05:40:26.217 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T05:40:26.217 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T05:40:26.217 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T05:40:26.217 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T05:40:26.217 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T05:40:26.217 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T05:40:26.217 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T05:40:26.217 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T05:40:26.218 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T05:40:26.218 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T05:40:26.218 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T05:40:26.218 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T05:40:26.218 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T05:40:26.218 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T05:40:26.218 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T05:40:26.218 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T05:40:26.218 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T05:40:26.218 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T05:40:26.218 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T05:40:26.218 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T05:40:26.218 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T05:40:26.219 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T05:40:26.220 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T05:40:26.221 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T05:40:26.222 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T05:40:26.223 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T05:40:26.224 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T05:40:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T05:40:26.226 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T05:40:26.226 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T05:40:26.226 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T05:40:26.226 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T05:40:26.226 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T05:40:26.226 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T05:40:26.226 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T05:40:26.226 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T05:40:26.226 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T05:40:26.226 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T05:40:28.229 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:40:28.230 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:40:28.230 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2024-09-21T05:40:28.230 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T05:40:28.230 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T05:40:28.230 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T05:40:28.230 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T05:40:28.230 INFO:teuthology.orchestra.run.smithi067.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.230 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.230 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T05:40:28.230 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T05:40:28.230 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-09-21T05:40:28.230 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T05:40:28.230 INFO:teuthology.orchestra.run.smithi067.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.231 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T05:40:28.232 INFO:teuthology.orchestra.run.smithi067.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T05:40:28.233 INFO:teuthology.orchestra.run.smithi067.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T05:40:28.234 INFO:teuthology.orchestra.run.smithi067.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T05:40:28.235 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T05:40:28.236 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T05:40:28.237 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T05:40:28.238 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T05:40:28.239 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T05:40:28.240 INFO:teuthology.orchestra.run.smithi067.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T05:40:28.241 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T05:40:28.241 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T05:40:28.241 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T05:40:28.241 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:40:28.241 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-09-21T05:40:28.734 DEBUG:teuthology.parallel:result is None 2024-09-21T05:40:28.924 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:40:28.925 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:40:28.925 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2024-09-21T05:40:28.925 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T05:40:28.925 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T05:40:28.925 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T05:40:28.925 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T05:40:28.925 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.925 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.925 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T05:40:28.925 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T05:40:28.926 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-21T05:40:28.926 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T05:40:28.926 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T05:40:28.926 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T05:40:28.926 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T05:40:28.926 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.926 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.926 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.926 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.926 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.926 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.926 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.926 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.927 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.927 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.927 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.927 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.927 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.927 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.927 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.927 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.927 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.927 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.927 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.927 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.927 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T05:40:28.928 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.929 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.929 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.929 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T05:40:28.929 INFO:teuthology.orchestra.run.smithi144.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T05:40:28.929 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T05:40:28.929 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T05:40:28.929 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T05:40:28.929 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T05:40:28.929 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.929 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.929 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T05:40:28.929 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.929 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T05:40:28.930 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T05:40:28.930 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T05:40:28.930 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T05:40:28.930 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T05:40:28.930 INFO:teuthology.orchestra.run.smithi144.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T05:40:28.930 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T05:40:28.930 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T05:40:28.930 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T05:40:28.930 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T05:40:28.930 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T05:40:28.930 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T05:40:28.930 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T05:40:28.930 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T05:40:28.931 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T05:40:28.931 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T05:40:28.931 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T05:40:28.931 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T05:40:28.931 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T05:40:28.931 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T05:40:28.931 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T05:40:28.931 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T05:40:28.931 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T05:40:28.931 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.931 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.931 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.931 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T05:40:28.932 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T05:40:28.933 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T05:40:28.933 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T05:40:28.933 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T05:40:28.933 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T05:40:28.933 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T05:40:28.933 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T05:40:28.933 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T05:40:28.933 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T05:40:28.933 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T05:40:28.933 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T05:40:28.933 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T05:40:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T05:40:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T05:40:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T05:40:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T05:40:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T05:40:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T05:40:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T05:40:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T05:40:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T05:40:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T05:40:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T05:40:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T05:40:28.934 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T05:40:28.935 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T05:40:28.936 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T05:40:28.936 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T05:40:28.936 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T05:40:28.936 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T05:40:28.936 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T05:40:28.936 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T05:40:28.936 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T05:40:28.936 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T05:40:28.936 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.936 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.936 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:28.936 INFO:teuthology.orchestra.run.smithi144.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T05:40:28.937 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T05:40:28.937 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T05:40:28.937 INFO:teuthology.orchestra.run.smithi144.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T05:40:28.937 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T05:40:28.937 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T05:40:28.937 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T05:40:28.937 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:40:28.938 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-21T05:40:29.361 DEBUG:teuthology.parallel:result is None 2024-09-21T05:40:29.881 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T05:40:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T05:40:29.966 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T05:40:30.002 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T05:40:30.037 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T05:40:30.309 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T05:40:30.359 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T05:40:30.388 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T05:40:30.420 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T05:40:30.464 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T05:40:31.261 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:40:31.303 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:40:31.346 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T05:40:32.738 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T05:40:32.834 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T05:40:32.890 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T05:40:33.000 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T05:40:33.037 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T05:40:33.062 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T05:40:33.099 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T05:40:33.099 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:40:33.214 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T05:40:33.214 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:40:33.315 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T05:40:33.339 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T05:40:33.356 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:40:33.356 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:40:33.600 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T05:40:33.600 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:40:33.710 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T05:40:33.787 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:40:34.006 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:40:34.006 INFO:teuthology.orchestra.run.smithi037.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-21T05:40:34.007 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:40:40.459 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T05:40:40.459 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T05:40:40.459 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T05:40:40.459 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T05:40:40.459 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T05:40:40.459 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T05:40:40.459 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T05:40:40.459 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:40:40.459 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:40:40.459 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T05:40:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T05:40:40.461 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T05:40:40.461 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T05:40:40.461 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T05:40:40.461 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T05:40:40.472 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T05:40:40.472 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T05:40:40.472 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T05:40:40.472 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T05:40:40.472 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T05:40:40.472 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T05:40:40.472 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T05:40:40.472 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T05:40:40.472 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T05:40:40.472 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T05:40:40.472 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T05:40:40.473 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T05:40:40.473 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T05:40:40.473 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T05:40:40.473 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T05:40:40.473 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T05:40:40.473 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T05:40:40.473 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T05:40:40.473 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T05:40:40.473 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T05:40:40.473 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T05:40:40.473 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T05:40:40.473 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T05:40:40.473 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T05:40:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T05:40:40.475 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T05:40:40.475 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T05:40:40.475 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T05:40:40.475 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T05:40:40.475 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T05:40:40.475 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T05:40:40.475 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T05:40:40.475 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T05:40:40.475 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T05:40:40.475 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T05:40:40.475 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T05:40:40.475 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T05:40:40.475 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T05:40:40.476 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T05:40:40.477 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T05:40:40.477 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T05:40:40.477 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T05:40:40.477 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T05:40:40.477 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T05:40:40.477 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T05:40:40.477 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T05:40:40.477 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T05:40:40.477 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T05:40:40.477 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T05:40:40.477 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T05:40:40.477 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T05:40:40.477 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T05:40:40.478 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T05:40:40.479 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T05:40:40.480 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T05:40:40.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T05:40:40.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T05:40:40.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T05:40:40.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T05:40:40.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T05:40:40.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T05:40:40.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T05:40:40.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T05:40:40.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T05:40:40.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T05:40:40.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T05:40:40.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T05:40:40.481 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T05:40:42.623 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T05:40:42.623 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:40:42.623 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-09-21T05:40:42.623 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T05:40:42.623 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T05:40:42.623 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.624 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T05:40:42.626 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T05:40:42.627 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T05:40:42.628 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T05:40:42.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T05:40:42.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T05:40:42.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T05:40:42.632 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.633 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T05:40:42.634 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T05:40:42.634 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T05:40:42.634 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T05:40:42.634 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T05:40:42.634 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T05:40:42.634 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T05:40:42.634 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T05:40:42.634 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:40:42.634 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-21T05:40:43.291 DEBUG:teuthology.parallel:result is None 2024-09-21T05:40:43.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:40:43.440 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T05:40:43.485 INFO:teuthology.orchestra.run.smithi037.stdout:19.3.0-5120.g18432218.el9 2024-09-21T05:40:43.486 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T05:40:43.486 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T05:40:43.487 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:40:43.627 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T05:40:43.653 INFO:teuthology.orchestra.run.smithi067.stdout:19.3.0-5120.g18432218.el9 2024-09-21T05:40:43.653 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T05:40:43.653 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T05:40:43.655 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:40:43.805 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T05:40:43.832 INFO:teuthology.orchestra.run.smithi144.stdout:19.3.0-5120.g18432218.el9 2024-09-21T05:40:43.832 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T05:40:43.832 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T05:40:43.834 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T05:40:43.834 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:40:43.834 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T05:40:43.892 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-21T05:40:43.892 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T05:40:43.924 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T05:40:43.925 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T05:40:43.958 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T05:40:43.958 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:40:43.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T05:40:44.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T05:40:44.112 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-21T05:40:44.112 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T05:40:44.141 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T05:40:44.210 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T05:40:44.210 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T05:40:44.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T05:40:44.302 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T05:40:44.302 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:40:44.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T05:40:44.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T05:40:44.457 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-21T05:40:44.457 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T05:40:44.482 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T05:40:44.547 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T05:40:44.547 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T05:40:44.572 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T05:40:44.637 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T05:40:44.638 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:40:44.638 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T05:40:44.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T05:40:44.793 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-21T05:40:44.793 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T05:40:44.817 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T05:40:44.881 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T05:40:44.882 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T05:40:44.906 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T05:40:44.970 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T05:40:45.070 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2}} 2024-09-21T05:40:45.070 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:40:45.071 INFO:tasks.cephadm:Cluster fsid is 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:40:45.071 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T05:40:45.071 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.37', 'mon.b': '172.21.15.67', 'mon.c': '172.21.15.144'} 2024-09-21T05:40:45.071 INFO:tasks.cephadm:First mon is mon.a on smithi037 2024-09-21T05:40:45.071 INFO:tasks.cephadm:First mgr is x 2024-09-21T05:40:45.072 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T05:40:45.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname $(hostname -s) 2024-09-21T05:40:45.128 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname $(hostname -s) 2024-09-21T05:40:45.152 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname $(hostname -s) 2024-09-21T05:40:45.178 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T05:40:45.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:40:45.323 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T05:40:45.467 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:40:45.469 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T05:40:45.469 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T05:40:45.469 DEBUG:teuthology.orchestra.run.smithi037:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T05:40:46.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 05:40 /home/ubuntu/cephtest/cephadm 2024-09-21T05:40:46.441 DEBUG:teuthology.orchestra.run.smithi067:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T05:40:47.370 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 05:40 /home/ubuntu/cephtest/cephadm 2024-09-21T05:40:47.370 DEBUG:teuthology.orchestra.run.smithi144:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T05:40:48.246 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 05:40 /home/ubuntu/cephtest/cephadm 2024-09-21T05:40:48.247 DEBUG:teuthology.orchestra.run.smithi037:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T05:40:48.286 DEBUG:teuthology.orchestra.run.smithi067:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T05:40:48.305 DEBUG:teuthology.orchestra.run.smithi144:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T05:40:48.340 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T05:40:48.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T05:40:48.344 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T05:40:48.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T05:40:49.945 INFO:teuthology.orchestra.run.smithi067.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:40:50.061 INFO:teuthology.orchestra.run.smithi144.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:40:50.302 INFO:teuthology.orchestra.run.smithi037.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:41:20.060 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T05:41:20.061 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T05:41:20.061 INFO:teuthology.orchestra.run.smithi144.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T05:41:20.061 INFO:teuthology.orchestra.run.smithi144.stdout: "repo_digests": [ 2024-09-21T05:41:20.061 INFO:teuthology.orchestra.run.smithi144.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T05:41:20.061 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-21T05:41:20.061 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T05:41:23.358 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-21T05:41:23.358 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T05:41:23.358 INFO:teuthology.orchestra.run.smithi067.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T05:41:23.358 INFO:teuthology.orchestra.run.smithi067.stdout: "repo_digests": [ 2024-09-21T05:41:23.358 INFO:teuthology.orchestra.run.smithi067.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T05:41:23.358 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-21T05:41:23.358 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-21T05:41:24.896 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:41:24.897 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T05:41:24.897 INFO:teuthology.orchestra.run.smithi037.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T05:41:24.897 INFO:teuthology.orchestra.run.smithi037.stdout: "repo_digests": [ 2024-09-21T05:41:24.897 INFO:teuthology.orchestra.run.smithi037.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T05:41:24.897 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T05:41:24.897 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:41:24.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph 2024-09-21T05:41:25.002 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph 2024-09-21T05:41:25.034 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph 2024-09-21T05:41:25.068 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /etc/ceph 2024-09-21T05:41:25.124 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /etc/ceph 2024-09-21T05:41:25.152 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /etc/ceph 2024-09-21T05:41:25.180 INFO:tasks.cephadm:Writing seed config... 2024-09-21T05:41:25.181 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T05:41:25.181 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T05:41:25.182 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T05:41:25.182 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T05:41:25.182 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T05:41:25.182 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T05:41:25.182 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T05:41:25.182 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T05:41:25.182 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T05:41:25.182 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T05:41:25.182 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T05:41:25.182 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T05:41:25.182 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T05:41:25.182 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T05:41:25.183 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T05:41:25.183 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T05:41:25.183 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T05:41:25.183 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T05:41:25.183 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T05:41:25.183 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T05:41:25.183 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T05:41:25.183 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-21T05:41:25.184 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:41:25.184 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T05:41:25.219 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 0c10cdda-77dc-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T05:41:25.219 DEBUG:teuthology.orchestra.run.smithi037:mon.a> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T05:41:25.263 DEBUG:teuthology.orchestra.run.smithi037:mgr.x> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T05:41:25.309 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T05:41:25.309 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.37 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:41:25.575 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:41:25.575 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.37', '--skip-admin-label'] 2024-09-21T05:41:25.575 INFO:teuthology.orchestra.run.smithi037.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T05:41:25.575 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying podman|docker is present... 2024-09-21T05:41:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 5.2.2 2024-09-21T05:41:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying lvm2 is present... 2024-09-21T05:41:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying time synchronization is in place... 2024-09-21T05:41:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T05:41:25.634 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T05:41:25.646 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T05:41:25.646 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-21T05:41:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-09-21T05:41:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-09-21T05:41:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-09-21T05:41:25.672 INFO:teuthology.orchestra.run.smithi037.stdout:Repeating the final host check... 2024-09-21T05:41:25.716 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 5.2.2 2024-09-21T05:41:25.716 INFO:teuthology.orchestra.run.smithi037.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T05:41:25.716 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl is present 2024-09-21T05:41:25.716 INFO:teuthology.orchestra.run.smithi037.stdout:lvcreate is present 2024-09-21T05:41:25.729 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T05:41:25.729 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T05:41:25.741 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T05:41:25.741 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-21T05:41:25.754 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-09-21T05:41:25.767 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-09-21T05:41:25.767 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-09-21T05:41:25.767 INFO:teuthology.orchestra.run.smithi037.stdout:Host looks OK 2024-09-21T05:41:25.767 INFO:teuthology.orchestra.run.smithi037.stdout:Cluster fsid: 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:41:25.767 INFO:teuthology.orchestra.run.smithi037.stdout:Acquiring lock 140286211185296 on /run/cephadm/0c10cdda-77dc-11ef-baf5-efdc52797490.lock 2024-09-21T05:41:25.768 INFO:teuthology.orchestra.run.smithi037.stdout:Lock 140286211185296 acquired on /run/cephadm/0c10cdda-77dc-11ef-baf5-efdc52797490.lock 2024-09-21T05:41:25.768 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 3300 ... 2024-09-21T05:41:25.768 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 6789 ... 2024-09-21T05:41:25.768 INFO:teuthology.orchestra.run.smithi037.stdout:Base mon IP(s) is [172.21.15.37:3300, 172.21.15.37:6789], mon addrv is [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-09-21T05:41:25.776 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.37 metric 100 2024-09-21T05:41:25.776 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.37 metric 100 2024-09-21T05:41:25.782 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T05:41:25.782 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T05:41:25.782 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1754sec hoplimit 64 pref medium 2024-09-21T05:41:25.788 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T05:41:25.788 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T05:41:25.788 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T05:41:25.789 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T05:41:25.789 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-09-21T05:41:25.789 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T05:41:25.789 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-09-21T05:41:25.789 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-09-21T05:41:25.789 INFO:teuthology.orchestra.run.smithi037.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T05:41:25.790 INFO:teuthology.orchestra.run.smithi037.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T05:41:25.791 INFO:teuthology.orchestra.run.smithi037.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:41:36.980 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T05:41:36.981 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T05:41:36.981 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T05:41:36.981 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T05:41:36.981 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T05:41:36.981 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T05:41:36.981 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T05:41:38.125 INFO:teuthology.orchestra.run.smithi037.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T05:41:38.125 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T05:41:38.125 INFO:teuthology.orchestra.run.smithi037.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T05:41:39.296 INFO:teuthology.orchestra.run.smithi037.stdout:stat: stdout 167 167 2024-09-21T05:41:39.296 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial keys... 2024-09-21T05:41:40.359 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQCTXO5mxKCxLhAAt4ekA0lf25/RIAk8pukeyA== 2024-09-21T05:41:41.397 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQCUXO5m1MwRLxAAxlioQBAJuVp1aRQjs6sSVg== 2024-09-21T05:41:42.864 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQCWXO5mrKkBABAA4EjNka8s4eSLuDe9dqNLEg== 2024-09-21T05:41:42.865 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial monmap... 2024-09-21T05:41:43.869 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T05:41:43.869 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T05:41:43.869 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:41:43.869 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T05:41:43.870 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool for a [v2:172.21.15.37:3300,v1:172.21.15.37:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T05:41:43.870 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-09-21T05:41:43.870 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: set fsid to 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:41:43.870 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T05:41:43.870 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:41:43.870 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mon... 2024-09-21T05:41:44.900 INFO:teuthology.orchestra.run.smithi037.stdout:create mon.a on 2024-09-21T05:41:45.247 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T05:41:45.476 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T05:41:45.741 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-0c10cdda-77dc-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-0c10cdda-77dc-11ef-baf5-efdc52797490.target. 2024-09-21T05:41:45.741 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-0c10cdda-77dc-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-0c10cdda-77dc-11ef-baf5-efdc52797490.target. 2024-09-21T05:41:46.073 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.a 2024-09-21T05:41:46.073 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T05:41:46.343 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0c10cdda-77dc-11ef-baf5-efdc52797490.target.wants/ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@.service. 2024-09-21T05:41:46.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:46 smithi037 podman[30254]: 2024-09-21 05:41:46.903575681 +0000 UTC m=+0.334958361 container start 0ee7f66f0fe1e81b1c6921f8b902c8a1766a124f544d82c2f860ada6c7471242 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T05:41:46.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:46 smithi037 bash[30254]: 0ee7f66f0fe1e81b1c6921f8b902c8a1766a124f544d82c2f860ada6c7471242 2024-09-21T05:41:47.004 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T05:41:47.004 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-21T05:41:47.018 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T05:41:47.018 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-21T05:41:47.018 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-21T05:41:47.018 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T05:41:47.019 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon to start... 2024-09-21T05:41:47.019 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon... 2024-09-21T05:41:47.298 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:46 smithi037 systemd[1]: Started Ceph mon.a for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:41:47.299 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:47 smithi037 ceph-mon[30273]: mkfs 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:41:47.299 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:47 smithi037 ceph-mon[30273]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T05:41:48.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:48 smithi037 ceph-mon[30273]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T05:41:48.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:48 smithi037 ceph-mon[30273]: monmap epoch 1 2024-09-21T05:41:48.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:48 smithi037 ceph-mon[30273]: fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:41:48.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:48 smithi037 ceph-mon[30273]: last_changed 2024-09-21T05:41:43.349837+0000 2024-09-21T05:41:48.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:48 smithi037 ceph-mon[30273]: created 2024-09-21T05:41:43.349837+0000 2024-09-21T05:41:48.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:48 smithi037 ceph-mon[30273]: min_mon_release 19 (squid) 2024-09-21T05:41:48.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:48 smithi037 ceph-mon[30273]: election_strategy: 1 2024-09-21T05:41:48.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:48 smithi037 ceph-mon[30273]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T05:41:48.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:48 smithi037 ceph-mon[30273]: fsmap 2024-09-21T05:41:48.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:48 smithi037 ceph-mon[30273]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T05:41:48.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:48 smithi037 ceph-mon[30273]: mgrmap e1: no daemons active 2024-09-21T05:41:48.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:48 smithi037 ceph-mon[30273]: from='client.? 172.21.15.37:0/1038517899' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T05:41:48.328 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T05:41:48.328 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout id: 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:41:48.328 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout services: 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.64519s) 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout data: 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:mon is available 2024-09-21T05:41:48.329 INFO:teuthology.orchestra.run.smithi037.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T05:41:49.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:49 smithi037 ceph-mon[30273]: from='client.? 172.21.15.37:0/4176839630' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T05:41:49.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:49 smithi037 ceph-mon[30273]: from='client.? 172.21.15.37:0/4176839630' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T05:41:49.605 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T05:41:49.605 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T05:41:49.605 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:41:49.605 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T05:41:49.605 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-09-21T05:41:49.605 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T05:41:49.605 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T05:41:49.605 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T05:41:49.605 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T05:41:49.605 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T05:41:49.605 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T05:41:49.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T05:41:49.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T05:41:49.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T05:41:49.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T05:41:49.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T05:41:49.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T05:41:49.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T05:41:49.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T05:41:49.606 INFO:teuthology.orchestra.run.smithi037.stdout:Generating new minimal ceph.conf... 2024-09-21T05:41:50.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:50 smithi037 ceph-mon[30273]: from='client.? 172.21.15.37:0/2350752441' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:50.897 INFO:teuthology.orchestra.run.smithi037.stdout:Restarting the monitor... 2024-09-21T05:41:51.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:50 smithi037 systemd[1]: Stopping Ceph mon.a for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:41:51.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:51 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a[30269]: 2024-09-21T05:41:51.287+0000 7f4a28a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T05:41:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:51 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a[30269]: 2024-09-21T05:41:51.287+0000 7f4a28a00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T05:41:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:51 smithi037 podman[30511]: 2024-09-21 05:41:51.452564126 +0000 UTC m=+0.318119945 container died 0ee7f66f0fe1e81b1c6921f8b902c8a1766a124f544d82c2f860ada6c7471242 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:41:52.070 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:51 smithi037 podman[30511]: 2024-09-21 05:41:51.817686244 +0000 UTC m=+0.683242070 container cleanup 0ee7f66f0fe1e81b1c6921f8b902c8a1766a124f544d82c2f860ada6c7471242 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T05:41:52.070 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:51 smithi037 bash[30511]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a 2024-09-21T05:41:52.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:52 smithi037 podman[30523]: 2024-09-21 05:41:52.068656189 +0000 UTC m=+0.612369198 container remove 0ee7f66f0fe1e81b1c6921f8b902c8a1766a124f544d82c2f860ada6c7471242 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T05:41:52.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:52 smithi037 systemd[1]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T05:41:52.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:52 smithi037 systemd[1]: Stopped Ceph mon.a for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:41:52.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:52 smithi037 systemd[1]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.a.service: Consumed 1.308s CPU time. 2024-09-21T05:41:52.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:52 smithi037 systemd[1]: Starting Ceph mon.a for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:41:52.829 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:52 smithi037 podman[30612]: 2024-09-21 05:41:52.43842068 +0000 UTC m=+0.027556411 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:41:52.829 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:52 smithi037 podman[30612]: 2024-09-21 05:41:52.828153271 +0000 UTC m=+0.417288990 container create c8ccf76dc4293257961473b10b93834ca60733a548f0473e7aec00a5c31588ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T05:41:53.107 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 podman[30612]: 2024-09-21 05:41:53.022556709 +0000 UTC m=+0.611692459 container init c8ccf76dc4293257961473b10b93834ca60733a548f0473e7aec00a5c31588ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T05:41:53.107 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 podman[30612]: 2024-09-21 05:41:53.029388133 +0000 UTC m=+0.618523853 container start c8ccf76dc4293257961473b10b93834ca60733a548f0473e7aec00a5c31588ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:41:53.116 INFO:teuthology.orchestra.run.smithi037.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T05:41:53.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 bash[30612]: c8ccf76dc4293257961473b10b93834ca60733a548f0473e7aec00a5c31588ca 2024-09-21T05:41:53.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 systemd[1]: Started Ceph mon.a for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:41:53.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T05:41:53.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T05:41:53.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: pidfile_write: ignore empty --pid-file 2024-09-21T05:41:53.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: load: jerasure load: lrc 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: RocksDB version: 7.9.2 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Git sha 0 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: DB SUMMARY 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: DB Session ID: TIR6GTIZC77HW31W57AV 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: CURRENT file: CURRENT 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 93716 ; 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.error_if_exists: 0 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.create_if_missing: 0 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.paranoid_checks: 1 2024-09-21T05:41:53.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.env: 0x5605202d0d60 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.info_log: 0x56055bfc7320 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.statistics: (nil) 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.use_fsync: 0 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_log_file_size: 0 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T05:41:53.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.allow_fallocate: 1 2024-09-21T05:41:53.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T05:41:53.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T05:41:53.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.use_direct_reads: 0 2024-09-21T05:41:53.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T05:41:53.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T05:41:53.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.db_log_dir: 2024-09-21T05:41:53.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.wal_dir: 2024-09-21T05:41:53.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T05:41:53.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T05:41:53.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T05:41:53.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T05:41:53.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T05:41:53.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T05:41:53.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T05:41:53.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T05:41:53.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.write_buffer_manager: 0x56055bfcbd60 2024-09-21T05:41:53.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T05:41:53.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T05:41:53.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T05:41:53.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T05:41:53.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T05:41:53.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T05:41:53.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T05:41:53.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T05:41:53.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.unordered_write: 0 2024-09-21T05:41:53.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T05:41:53.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T05:41:53.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T05:41:53.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T05:41:53.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.row_cache: None 2024-09-21T05:41:53.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.wal_filter: None 2024-09-21T05:41:53.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T05:41:53.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T05:41:53.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.two_write_queues: 0 2024-09-21T05:41:53.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T05:41:53.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.wal_compression: 0 2024-09-21T05:41:53.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.atomic_flush: 0 2024-09-21T05:41:53.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T05:41:53.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T05:41:53.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T05:41:53.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.log_readahead_size: 0 2024-09-21T05:41:53.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T05:41:53.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T05:41:53.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T05:41:53.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T05:41:53.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T05:41:53.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T05:41:53.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T05:41:53.422 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_background_jobs: 2 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_background_compactions: -1 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_subcompactions: 1 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_open_files: -1 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T05:41:53.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T05:41:53.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T05:41:53.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_background_flushes: -1 2024-09-21T05:41:53.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Compression algorithms supported: 2024-09-21T05:41:53.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: kZSTD supported: 0 2024-09-21T05:41:53.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: kXpressCompression supported: 0 2024-09-21T05:41:53.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: kBZip2Compression supported: 0 2024-09-21T05:41:53.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T05:41:53.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: kLZ4Compression supported: 1 2024-09-21T05:41:53.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: kZlibCompression supported: 1 2024-09-21T05:41:53.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T05:41:53.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: kSnappyCompression supported: 1 2024-09-21T05:41:53.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T05:41:53.424 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.merge_operator: 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compaction_filter: None 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56055bfc6f60) 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks: 1 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T05:41:53.425 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_top_level_index_and_filter: 1 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_type: 0 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_index_type: 0 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_shortening: 1 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: checksum: 4 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: no_block_cache: 0 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache: 0x560557f8b610 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_name: BinnedLRUCache 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_options: 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: capacity : 536870912 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_shard_bits : 4 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: strict_capacity_limit : 0 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: high_pri_pool_ratio: 0.000 2024-09-21T05:41:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_compressed: (nil) 2024-09-21T05:41:53.427 INFO:journalctl@ceph.mon.a.smithi037.stdout: persistent_cache: (nil) 2024-09-21T05:41:53.427 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size: 4096 2024-09-21T05:41:53.427 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size_deviation: 10 2024-09-21T05:41:53.427 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_restart_interval: 16 2024-09-21T05:41:53.427 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_block_restart_interval: 1 2024-09-21T05:41:53.427 INFO:journalctl@ceph.mon.a.smithi037.stdout: metadata_block_size: 4096 2024-09-21T05:41:53.427 INFO:journalctl@ceph.mon.a.smithi037.stdout: partition_filters: 0 2024-09-21T05:41:53.427 INFO:journalctl@ceph.mon.a.smithi037.stdout: use_delta_encoding: 1 2024-09-21T05:41:53.427 INFO:journalctl@ceph.mon.a.smithi037.stdout: filter_policy: bloomfilter 2024-09-21T05:41:53.427 INFO:journalctl@ceph.mon.a.smithi037.stdout: whole_key_filtering: 1 2024-09-21T05:41:53.427 INFO:journalctl@ceph.mon.a.smithi037.stdout: verify_compression: 0 2024-09-21T05:41:53.427 INFO:journalctl@ceph.mon.a.smithi037.stdout: read_amp_bytes_per_bit: 0 2024-09-21T05:41:53.427 INFO:journalctl@ceph.mon.a.smithi037.stdout: format_version: 5 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_index_compression: 1 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_align: 0 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout: max_auto_readahead_size: 262144 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout: prepopulate_block_cache: 0 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout: initial_auto_readahead_size: 8192 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compression: NoCompression 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.num_levels: 7 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T05:41:53.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T05:41:53.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T05:41:53.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:41:53.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T05:41:53.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T05:41:53.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T05:41:53.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T05:41:53.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T05:41:53.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T05:41:53.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T05:41:53.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T05:41:53.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T05:41:53.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T05:41:53.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T05:41:53.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.inplace_update_support: 0 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.bloom_locality: 0 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.max_successive_merges: 0 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T05:41:53.432 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.ttl: 2592000 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.enable_blob_files: false 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.min_blob_size: 0 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T05:41:53.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d7d8beac-2b34-4ed8-845f-8bbacb2fec3a 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897313142505, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897313145418, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 89985, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 279, "table_properties": {"data_size": 88055, "index_size": 250, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11333, "raw_average_key_size": 47, "raw_value_size": 81660, "raw_average_value_size": 343, "num_data_blocks": 11, "num_entries": 238, "num_filter_entries": 238, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726897313, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d7d8beac-2b34-4ed8-845f-8bbacb2fec3a", "db_session_id": "TIR6GTIZC77HW31W57AV", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897313145719, "job": 1, "event": "recovery_finished"} 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56055bfeca80 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: DB pointer 0x56055cd8e000 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T05:41:53.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** DB Stats ** 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: L0 2/0 89.74 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 48.7 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: Sum 2/0 89.74 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 48.7 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 48.7 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-21T05:41:53.435 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 48.7 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T05:41:53.436 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative compaction: 0.00 GB write, 8.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:41:53.437 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval compaction: 0.00 GB write, 8.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:41:53.437 INFO:journalctl@ceph.mon.a.smithi037.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T05:41:53.437 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache BinnedLRUCache@0x560557f8b610#2 capacity: 512.00 MB usage: 1.28 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-21T05:41:53.437 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-09-21T05:41:53.437 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-21T05:41:53.437 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T05:41:53.437 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: starting mon.a rank 0 at public addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] at bind addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:41:53.437 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: mon.a@-1(???) e1 preinit fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:41:53.437 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: mon.a@-1(???).mds e1 new map 2024-09-21T05:41:53.437 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: mon.a@-1(???).mds e1 print_map 2024-09-21T05:41:53.437 INFO:journalctl@ceph.mon.a.smithi037.stdout: e1 2024-09-21T05:41:53.437 INFO:journalctl@ceph.mon.a.smithi037.stdout: btime 2024-09-21T05:41:47:034913+0000 2024-09-21T05:41:53.437 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout: legacy client fscid: -1 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout: No filesystems configured 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: monmap epoch 1 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: last_changed 2024-09-21T05:41:43.349837+0000 2024-09-21T05:41:53.438 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: created 2024-09-21T05:41:43.349837+0000 2024-09-21T05:41:53.439 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: min_mon_release 19 (squid) 2024-09-21T05:41:53.439 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: election_strategy: 1 2024-09-21T05:41:53.439 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T05:41:53.439 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: fsmap 2024-09-21T05:41:53.439 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T05:41:53.439 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:53 smithi037 ceph-mon[30631]: mgrmap e1: no daemons active 2024-09-21T05:41:54.446 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T05:41:54.470 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:41:54.470 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mgr... 2024-09-21T05:41:54.471 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T05:41:54.471 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T05:41:54.822 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.x 2024-09-21T05:41:54.822 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T05:41:55.063 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0c10cdda-77dc-11ef-baf5-efdc52797490.target.wants/ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@.service. 2024-09-21T05:41:55.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:54 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1045031879' entity='client.admin' 2024-09-21T05:41:55.409 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:41:55 smithi037 systemd[1]: Starting Ceph mgr.x for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:41:55.665 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:41:55 smithi037 podman[30844]: 2024-09-21 05:41:55.325789062 +0000 UTC m=+0.027768003 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:41:55.665 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:41:55 smithi037 podman[30844]: 2024-09-21 05:41:55.446507365 +0000 UTC m=+0.148486285 container create 1ffbce206b29ac564c7b49aedf68d8b3dcebbe6dcb53b950f942d28c10d853fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T05:41:55.816 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T05:41:55.817 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-21T05:41:55.833 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T05:41:55.833 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-21T05:41:55.833 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-21T05:41:55.833 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T05:41:55.853 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T05:41:55.853 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-21T05:41:55.867 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T05:41:55.867 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-21T05:41:55.867 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-21T05:41:55.867 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T05:41:55.867 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr to start... 2024-09-21T05:41:55.867 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr... 2024-09-21T05:41:56.012 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:41:55 smithi037 podman[30844]: 2024-09-21 05:41:55.690565757 +0000 UTC m=+0.392544706 container init 1ffbce206b29ac564c7b49aedf68d8b3dcebbe6dcb53b950f942d28c10d853fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T05:41:56.012 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:41:55 smithi037 podman[30844]: 2024-09-21 05:41:55.697000999 +0000 UTC m=+0.398979928 container start 1ffbce206b29ac564c7b49aedf68d8b3dcebbe6dcb53b950f942d28c10d853fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:41:56.012 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:41:55 smithi037 bash[30844]: 1ffbce206b29ac564c7b49aedf68d8b3dcebbe6dcb53b950f942d28c10d853fd 2024-09-21T05:41:56.012 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:41:55 smithi037 systemd[1]: Started Ceph mgr.x for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:41:56.649 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:56 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1523573704' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T05:41:57.206 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T05:41:57.206 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:41:57.206 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "0c10cdda-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:41:57.206 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T05:41:57.206 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T05:41:57.207 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T05:41:57.208 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:41:57.208 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T05:41:57.208 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:41:57.208 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T05:41:57.208 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T05:41:57.208 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T05:41:57.208 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T05:41:57.208 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T05:41:57.208 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T05:41:57.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:41:57.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T05:41:57.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T05:41:57.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T05:41:57.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T05:41:57.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T05:41:57.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T05:41:57.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T05:41:57.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T05:41:57.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T05:41:57.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:41:57.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T05:41:57.212 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T05:41:47:034913+0000", 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:41:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T05:41:57.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:41:57.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T05:41:47.036037+0000", 2024-09-21T05:41:57.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:41:57.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:41:57.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T05:41:57.214 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:41:57.214 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (1/15)... 2024-09-21T05:41:59.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:41:59 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/613722511' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T05:42:00.397 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T05:42:00.398 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:42:00.398 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "0c10cdda-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:42:00.398 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T05:42:00.398 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T05:42:00.398 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T05:42:00.398 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T05:42:00.398 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:00.398 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T05:42:00.398 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:42:00.399 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T05:42:00.400 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T05:42:00.400 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T05:42:00.400 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T05:42:00.400 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T05:42:00.400 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T05:42:00.403 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:00.403 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T05:42:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T05:42:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T05:42:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T05:42:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T05:42:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T05:42:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T05:42:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T05:42:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T05:42:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T05:42:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:42:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T05:41:47:034913+0000", 2024-09-21T05:42:00.404 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T05:41:47.036037+0000", 2024-09-21T05:42:00.405 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:42:00.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:00.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T05:42:00.406 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:42:00.406 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (2/15)... 2024-09-21T05:42:02.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:02 smithi037 ceph-mon[30631]: Activating manager daemon x 2024-09-21T05:42:02.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:02 smithi037 ceph-mon[30631]: mgrmap e2: x(active, starting, since 0.00500904s) 2024-09-21T05:42:02.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:02 smithi037 ceph-mon[30631]: from='mgr.14100 172.21.15.37:0/1655902821' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T05:42:02.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:02 smithi037 ceph-mon[30631]: from='mgr.14100 172.21.15.37:0/1655902821' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T05:42:02.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:02 smithi037 ceph-mon[30631]: from='mgr.14100 172.21.15.37:0/1655902821' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T05:42:02.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:02 smithi037 ceph-mon[30631]: from='mgr.14100 172.21.15.37:0/1655902821' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:42:02.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:02 smithi037 ceph-mon[30631]: from='mgr.14100 172.21.15.37:0/1655902821' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T05:42:02.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:02 smithi037 ceph-mon[30631]: Manager daemon x is now available 2024-09-21T05:42:02.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:02 smithi037 ceph-mon[30631]: from='mgr.14100 172.21.15.37:0/1655902821' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T05:42:02.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:02 smithi037 ceph-mon[30631]: from='mgr.14100 172.21.15.37:0/1655902821' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T05:42:02.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:02 smithi037 ceph-mon[30631]: from='mgr.14100 172.21.15.37:0/1655902821' entity='mgr.x' 2024-09-21T05:42:02.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:02 smithi037 ceph-mon[30631]: from='mgr.14100 172.21.15.37:0/1655902821' entity='mgr.x' 2024-09-21T05:42:02.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:02 smithi037 ceph-mon[30631]: from='mgr.14100 172.21.15.37:0/1655902821' entity='mgr.x' 2024-09-21T05:42:03.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:03 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/528570191' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T05:42:03.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:03 smithi037 ceph-mon[30631]: mgrmap e3: x(active, since 1.01136s) 2024-09-21T05:42:03.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T05:42:03.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:42:03.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "0c10cdda-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:42:03.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T05:42:03.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T05:42:03.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T05:42:03.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T05:42:03.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:03.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T05:42:03.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T05:42:03.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-09-21T05:42:03.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:42:03.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T05:42:03.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T05:42:03.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:42:03.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T05:42:03.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T05:42:03.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:42:03.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T05:42:03.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T05:42:03.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:03.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T05:42:03.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:42:03.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T05:42:03.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T05:42:03.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T05:42:03.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T05:42:03.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T05:42:03.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T05:42:03.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:03.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T05:41:47:034913+0000", 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T05:42:03.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:42:03.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T05:41:47.036037+0000", 2024-09-21T05:42:03.659 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:42:03.659 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:03.659 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T05:42:03.659 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:42:03.659 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (3/15)... 2024-09-21T05:42:05.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:05 smithi037 ceph-mon[30631]: mgrmap e4: x(active, since 2s) 2024-09-21T05:42:06.884 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:06 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/4005650213' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T05:42:07.215 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "0c10cdda-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:42:07.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T05:42:07.217 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:07.218 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T05:42:07.218 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T05:42:07.218 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T05:42:07.220 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T05:42:07.221 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T05:42:07.221 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T05:42:07.221 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T05:42:07.221 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T05:42:07.221 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T05:42:07.221 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:07.221 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T05:42:07.221 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:42:07.221 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T05:41:47:034913+0000", 2024-09-21T05:42:07.221 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T05:42:07.221 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T05:42:07.221 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:07.221 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T05:41:47.036037+0000", 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T05:42:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:42:07.223 INFO:teuthology.orchestra.run.smithi037.stdout:mgr is available 2024-09-21T05:42:08.283 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:08 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1849423143' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T05:42:08.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T05:42:08.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T05:42:08.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:42:08.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T05:42:08.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-09-21T05:42:08.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T05:42:08.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T05:42:08.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T05:42:08.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T05:42:08.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T05:42:08.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T05:42:08.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T05:42:08.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T05:42:08.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T05:42:08.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T05:42:08.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T05:42:08.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T05:42:08.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T05:42:08.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T05:42:08.791 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling cephadm module... 2024-09-21T05:42:09.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:09 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/987736299' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T05:42:09.914 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:09 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: ignoring --setuser ceph since I am not root 2024-09-21T05:42:09.914 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:09 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: ignoring --setgroup ceph since I am not root 2024-09-21T05:42:10.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:10 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/987736299' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T05:42:10.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:10 smithi037 ceph-mon[30631]: mgrmap e5: x(active, since 7s) 2024-09-21T05:42:11.773 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:11 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2364301721' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T05:42:11.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:42:11.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T05:42:11.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T05:42:11.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T05:42:11.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T05:42:11.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:42:11.802 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-09-21T05:42:11.802 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 5... 2024-09-21T05:42:16.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:16 smithi037 ceph-mon[30631]: Active manager daemon x restarted 2024-09-21T05:42:16.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:16 smithi037 ceph-mon[30631]: Activating manager daemon x 2024-09-21T05:42:16.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:16 smithi037 ceph-mon[30631]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T05:42:16.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:16 smithi037 ceph-mon[30631]: mgrmap e6: x(active, starting, since 0.00468402s) 2024-09-21T05:42:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:16 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:42:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:16 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T05:42:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:16 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T05:42:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:16 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T05:42:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:16 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T05:42:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:16 smithi037 ceph-mon[30631]: Manager daemon x is now available 2024-09-21T05:42:17.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:42:17.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T05:42:17.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T05:42:17.925 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:42:17.925 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 5 is available 2024-09-21T05:42:17.925 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying orchestrator module is enabled... 2024-09-21T05:42:18.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:18 smithi037 ceph-mon[30631]: mgrmap e7: x(active, since 1.00828s) 2024-09-21T05:42:18.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:18 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' 2024-09-21T05:42:18.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:18 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' 2024-09-21T05:42:18.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:18 smithi037 ceph-mon[30631]: Found migration_current of "None". Setting to last migration. 2024-09-21T05:42:18.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:18 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' 2024-09-21T05:42:18.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:18 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' 2024-09-21T05:42:18.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:18 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:18.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:18 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:18.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:18 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T05:42:18.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:18 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T05:42:19.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-mon[30631]: mgrmap e8: x(active, since 2s) 2024-09-21T05:42:19.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1273071393' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T05:42:19.826 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: 2024-09-21T05:42:19.685+0000 7f1284c00640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:05:42:19] ENGINE Error in HTTPServer.serve 2024-09-21T05:42:19.826 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: Traceback (most recent call last): 2024-09-21T05:42:19.826 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:42:19.826 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: self._connections.run(self.expiration_interval) 2024-09-21T05:42:19.826 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:42:19.826 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: self._run(expiration_interval) 2024-09-21T05:42:19.826 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:42:19.826 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:42:19.826 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:42:19.826 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:42:19.826 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:42:19.826 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: s = self.context.wrap_socket( 2024-09-21T05:42:19.826 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:42:19.827 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: return self.sslsocket_class._create( 2024-09-21T05:42:19.827 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:42:19.827 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: self.do_handshake() 2024-09-21T05:42:19.827 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:42:19.827 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: self._sslobj.do_handshake() 2024-09-21T05:42:19.827 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:42:19.827 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: 2024-09-21T05:42:20.096 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T05:42:20.097 INFO:teuthology.orchestra.run.smithi037.stdout:Setting orchestrator backend to cephadm... 2024-09-21T05:42:20.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:20 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1273071393' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T05:42:20.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:20 smithi037 ceph-mon[30631]: mgrmap e9: x(active, since 3s) 2024-09-21T05:42:20.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:20 smithi037 ceph-mon[30631]: [21/Sep/2024:05:42:19] ENGINE Bus STARTING 2024-09-21T05:42:20.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:20 smithi037 ceph-mon[30631]: [21/Sep/2024:05:42:19] ENGINE Serving on https://172.21.15.37:7150 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:20 smithi037 ceph-mon[30631]: [21/Sep/2024:05:42:19] ENGINE Error in HTTPServer.serve 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: Traceback (most recent call last): 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._connections.run(self.expiration_interval) 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._run(expiration_interval) 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: s = self.context.wrap_socket( 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: return self.sslsocket_class._create( 2024-09-21T05:42:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:42:20.666 INFO:journalctl@ceph.mon.a.smithi037.stdout: self.do_handshake() 2024-09-21T05:42:20.666 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:42:20.666 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._sslobj.do_handshake() 2024-09-21T05:42:20.666 INFO:journalctl@ceph.mon.a.smithi037.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:42:20.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:20 smithi037 ceph-mon[30631]: [21/Sep/2024:05:42:19] ENGINE Serving on http://172.21.15.37:8765 2024-09-21T05:42:20.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:20 smithi037 ceph-mon[30631]: [21/Sep/2024:05:42:19] ENGINE Bus STARTED 2024-09-21T05:42:20.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:20 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:22.112 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:21 smithi037 ceph-mon[30631]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:22.113 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:21 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' 2024-09-21T05:42:22.113 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:21 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:22.902 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T05:42:22.902 INFO:teuthology.orchestra.run.smithi037.stdout:Generating ssh key... 2024-09-21T05:42:23.161 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:22 smithi037 ceph-mon[30631]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:24.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-mon[30631]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:24.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-mon[30631]: Generating ssh key... 2024-09-21T05:42:24.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' 2024-09-21T05:42:24.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' 2024-09-21T05:42:24.165 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: Generating public/private rsa key pair. 2024-09-21T05:42:24.165 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: Your identification has been saved in /tmp/tmpv1lb03zm/key 2024-09-21T05:42:24.165 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: Your public key has been saved in /tmp/tmpv1lb03zm/key.pub 2024-09-21T05:42:24.165 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: The key fingerprint is: 2024-09-21T05:42:24.166 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: SHA256:mfxQFkS+Ct4rtxIzBSIttPP4y7BztYBX57PoU3oq6J0 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:42:24.166 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: The key's randomart image is: 2024-09-21T05:42:24.166 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: +---[RSA 3072]----+ 2024-09-21T05:42:24.166 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: | ... o+ | 2024-09-21T05:42:24.166 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: | o.o . . . | 2024-09-21T05:42:24.166 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: | oo . . + | 2024-09-21T05:42:24.166 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: | + ..o= . | 2024-09-21T05:42:24.166 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: | .....+S . | 2024-09-21T05:42:24.166 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: | ..o.=o++ | 2024-09-21T05:42:24.166 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: | .o.o.Ooo. | 2024-09-21T05:42:24.166 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: | o=ooB +. | 2024-09-21T05:42:24.166 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: | .ooEooBo. | 2024-09-21T05:42:24.166 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: +----[SHA256]-----+ 2024-09-21T05:42:25.853 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjvzIdj8vNKt4LhOT84QiEL7P2Ip8dCzmJdx6Ok6J/2M1VWnizyyuwrlSepLmKiD17UVeS+sMPrsLfWFIPh90UrRKmbE4YPkjE/rOOal4RG9cutmXViwv18RkU0u7TJN9pVPJZu/2djeEjBwe2YCXmaRcLxDKJXhoAEg/AG/PtVThtHSbDHmWJ09D3lwFPmsvXCN05J6C3Ti0g3aHgbe3E+5bTy3RnHApjhRVZbW8FMuN3fFayR6qpbdbbllmO4pnAqMWY8TH0FEGs40+Dp6n45SiFkFLHCdv2DpUKaIrQt+2PdHGXhYulrJEhiegbUKDvUKFwMkEoPFY7t6EQ4T/TKItp/BPUFlE7k899hGagXldjfXQOjI6MbO//q2RRVMBL2MLMRvO+jIGP3DVd9iPrev5LOSW2qr7jMwyS/wHoXTEe4huxdaD/s4cZQPxiy8JomYBxjxrzsXioJZJJF7BZrs6md54E2a8PGvdRs/5CIWcxc0S3TnmYGXdGXz1ncPE= ceph-0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:42:25.854 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T05:42:25.854 INFO:teuthology.orchestra.run.smithi037.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T05:42:25.863 INFO:teuthology.orchestra.run.smithi037.stdout:Adding host smithi037... 2024-09-21T05:42:26.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:25 smithi037 ceph-mon[30631]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:27.077 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:26 smithi037 ceph-mon[30631]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi037", "addr": "172.21.15.37", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:29.086 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:28 smithi037 ceph-mon[30631]: Deploying cephadm binary to smithi037 2024-09-21T05:42:31.635 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Added host 'smithi037' with addr '172.21.15.37' 2024-09-21T05:42:31.635 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mon service... 2024-09-21T05:42:32.343 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:31 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' 2024-09-21T05:42:32.343 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:31 smithi037 ceph-mon[30631]: Added host smithi037 2024-09-21T05:42:32.343 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:31 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:33.674 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T05:42:33.674 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mgr service... 2024-09-21T05:42:33.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:33 smithi037 ceph-mon[30631]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:33.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:33 smithi037 ceph-mon[30631]: Saving service mon spec with placement count:5 2024-09-21T05:42:33.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:33 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' 2024-09-21T05:42:35.211 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T05:42:35.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:35 smithi037 ceph-mon[30631]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:35.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:35 smithi037 ceph-mon[30631]: Saving service mgr spec with placement count:2 2024-09-21T05:42:35.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:35 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' 2024-09-21T05:42:35.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:35 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' 2024-09-21T05:42:35.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:35 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' 2024-09-21T05:42:37.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:36 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3982618752' entity='client.admin' 2024-09-21T05:42:37.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:36 smithi037 ceph-mon[30631]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:42:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling the dashboard module... 2024-09-21T05:42:38.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:38 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2584911400' entity='client.admin' 2024-09-21T05:42:40.051 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:39 smithi037 ceph-mon[30631]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:42:40.052 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:39 smithi037 ceph-mon[30631]: from='mgr.14120 172.21.15.37:0/688047224' entity='mgr.x' 2024-09-21T05:42:40.052 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:39 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/459553748' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T05:42:40.052 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:39 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: ignoring --setuser ceph since I am not root 2024-09-21T05:42:40.052 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:39 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: ignoring --setgroup ceph since I am not root 2024-09-21T05:42:40.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:40 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/459553748' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T05:42:40.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:40 smithi037 ceph-mon[30631]: mgrmap e10: x(active, since 23s) 2024-09-21T05:42:41.732 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:41 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1921157286' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T05:42:41.740 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:42:41.741 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 10, 2024-09-21T05:42:41.741 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T05:42:41.741 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T05:42:41.741 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T05:42:41.741 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:42:41.741 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-09-21T05:42:41.741 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 10... 2024-09-21T05:42:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:46 smithi037 ceph-mon[30631]: Active manager daemon x restarted 2024-09-21T05:42:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:46 smithi037 ceph-mon[30631]: Activating manager daemon x 2024-09-21T05:42:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:46 smithi037 ceph-mon[30631]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T05:42:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:46 smithi037 ceph-mon[30631]: mgrmap e11: x(active, starting, since 0.004816s) 2024-09-21T05:42:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:42:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T05:42:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T05:42:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T05:42:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T05:42:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:46 smithi037 ceph-mon[30631]: Manager daemon x is now available 2024-09-21T05:42:47.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:47.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T05:42:47.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T05:42:47.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:47 smithi037 ceph-mon[30631]: mgrmap e12: x(active, since 1.00806s) 2024-09-21T05:42:47.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T05:42:47.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 12, 2024-09-21T05:42:47.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T05:42:47.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T05:42:47.777 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 10 is available 2024-09-21T05:42:47.777 INFO:teuthology.orchestra.run.smithi037.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T05:42:48.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-mon[30631]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T05:42:48.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-mon[30631]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T05:42:48.415 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: 2024-09-21T05:42:48.193+0000 7fcad1c00640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:05:42:48] ENGINE Error in HTTPServer.serve 2024-09-21T05:42:48.415 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: Traceback (most recent call last): 2024-09-21T05:42:48.415 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:42:48.415 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: self._connections.run(self.expiration_interval) 2024-09-21T05:42:48.415 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:42:48.415 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: self._run(expiration_interval) 2024-09-21T05:42:48.415 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:42:48.415 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:42:48.416 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:42:48.416 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:42:48.416 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:42:48.416 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: s = self.context.wrap_socket( 2024-09-21T05:42:48.416 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:42:48.416 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: return self.sslsocket_class._create( 2024-09-21T05:42:48.416 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:42:48.416 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: self.do_handshake() 2024-09-21T05:42:48.416 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:42:48.417 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: self._sslobj.do_handshake() 2024-09-21T05:42:48.417 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:42:48.417 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:42:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: 2024-09-21T05:42:49.497 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:49 smithi037 ceph-mon[30631]: [21/Sep/2024:05:42:47] ENGINE Bus STARTING 2024-09-21T05:42:49.497 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:49 smithi037 ceph-mon[30631]: [21/Sep/2024:05:42:48] ENGINE Serving on http://172.21.15.37:8765 2024-09-21T05:42:49.497 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:49 smithi037 ceph-mon[30631]: mgrmap e13: x(active, since 2s) 2024-09-21T05:42:49.497 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:49 smithi037 ceph-mon[30631]: [21/Sep/2024:05:42:48] ENGINE Serving on https://172.21.15.37:7150 2024-09-21T05:42:49.497 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:49 smithi037 ceph-mon[30631]: [21/Sep/2024:05:42:48] ENGINE Bus STARTED 2024-09-21T05:42:49.497 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:49 smithi037 ceph-mon[30631]: [21/Sep/2024:05:42:48] ENGINE Error in HTTPServer.serve 2024-09-21T05:42:49.497 INFO:journalctl@ceph.mon.a.smithi037.stdout: Traceback (most recent call last): 2024-09-21T05:42:49.498 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:42:49.498 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._connections.run(self.expiration_interval) 2024-09-21T05:42:49.498 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:42:49.498 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._run(expiration_interval) 2024-09-21T05:42:49.498 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:42:49.498 INFO:journalctl@ceph.mon.a.smithi037.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:42:49.498 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:42:49.498 INFO:journalctl@ceph.mon.a.smithi037.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:42:49.498 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:42:49.498 INFO:journalctl@ceph.mon.a.smithi037.stdout: s = self.context.wrap_socket( 2024-09-21T05:42:49.498 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:42:49.498 INFO:journalctl@ceph.mon.a.smithi037.stdout: return self.sslsocket_class._create( 2024-09-21T05:42:49.498 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:42:49.499 INFO:journalctl@ceph.mon.a.smithi037.stdout: self.do_handshake() 2024-09-21T05:42:49.499 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:42:49.499 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._sslobj.do_handshake() 2024-09-21T05:42:49.499 INFO:journalctl@ceph.mon.a.smithi037.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:42:49.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:49 smithi037 ceph-mon[30631]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:49.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:42:49.762 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUYtwBIBkglgauxioKfhvXb6bmrRYwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA1NDI0OVoXDTM0\nMDkyMjA1NDI0OVowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjM3MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEA3KrtM/jhXSNP9dKQG11p+P4O/uhjz1O1ggn3\ncZIhgfqPHgzqA1BhaU5ajm+mLE7GXkhyb9YmVkP5E6NJJ97Xgg7haWIxmiU8LQQM\nIzTR+BPwndZp/WcD0hW2V2Cu5NieZ3ps+CAySWoJI5RbNGtYROJb2G0Kv4ZVfEnd\nrAOIBrwPJYRpols5XUgw2J96n7Futgehglp2oJp9mKJsEqT5TkLbTzyN6uRVvUAe\nhWHHfN6HkPoTkNrrvOqsO7aOcUU7P4GK7Z0UaKAWmp+rx868zWBm4LJhAAE+cTvL\nsQ9j49SrbwJZfKizpw6QtK8vvPDyDJNKkObG+fRYzh1clNv09XKv+plnWZmmGxVh\nr1QTTKZoqrXEjxZ4CCy4NIP8zJqb9iGNDL+qZCMYG6bqg78o19zrzE+Z3rmfSauh\ns6yXZEeofydA8otkemlmqNJ5VlZXJIRpyEslusez358X8Ku3jUpz4+W1IZngOY99\nhttUdqJ9a5L5XtAcRR6xo19ghDTCxBX4UGViM9v5wlddDmE2CckL639anHd7Cvh2\n/dRRvvFDY/6tV+DNjU7oGLw4RJaXVtoswpsvM3M5TEULX9GYO6Oz4v/8MzIPbgGQ\ne0UdpXok+ahHTPqmZyymiPeSy8MJ/h/tXBaTxZhVJS6yy3JbPwoKptTsG0qwRhvK\nhBLANKcCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDM3ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPJTAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQBm\nTRILjPRwWALZoS1fvCNKnZNS2E8msFbSqRk90HPYgLvPD5d4lOcGNCiNOxuGKwZE\nCB/0Fvrf6LX1H9Hu0M5LEn7KleYbz5uI871Ba4tSK3YVGGP7VxPg5+CXQGlN4Hti\nHc0UsiGuGNxJs/nBrjLJodccgFNwQivVu55euQGHfnHVEL16zxi+61c/3iAWH+KR\nl6Eom4foOIIS2BwJ7taFH24Gkj7r5NSzGEiToP0eVqe8csTFWV/fqc3JjdHla2FW\nfnOcth2NTCBe/IAVBuZy7u5t1YRlTW+kHZEpxYKdpbIs1juAu4whZJfgYrbnzQ4B\ne32PyVv1B+p0VNTQaBLIq3gfPOmelxUDklpahXYigYDd4xu9PF1a1tc+MW0szxzw\nPs3BmWYYJhzjsWy33Zn/9MnvPuSlFO9hqWUwkGKEPczxbfJByFEho6QMrFdfa8w/\nS57isEBy9d6MovVsMOlrTgWXVLaWvpOo/VWu+aAzk+ApP7chIHj8WodLxwJlaX3P\nVYTzDAHb5Kl1mw3WQxpKkz9SpczY3mTYgbTBP+yvItlP5PN4vadZpNCzQZHBL6GZ\nP31r5/3VPUOHk8E4FCrsJ2cM5oTF23ETS1vfQ727ah7/EZj6zvuaJj0PFnpuIlHM\nisx8VgCduiG+50K2gWeCNGHJA1zcalAV6KKq9U13KA==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEA3KrtM/jhXSNP9dKQG11p+P4O/uhjz1O1ggn3cZIhgfqPHgzq\nA1BhaU5ajm+mLE7GXkhyb9YmVkP5E6NJJ97Xgg7haWIxmiU8LQQMIzTR+BPwndZp\n/WcD0hW2V2Cu5NieZ3ps+CAySWoJI5RbNGtYROJb2G0Kv4ZVfEndrAOIBrwPJYRp\nols5XUgw2J96n7Futgehglp2oJp9mKJsEqT5TkLbTzyN6uRVvUAehWHHfN6HkPoT\nkNrrvOqsO7aOcUU7P4GK7Z0UaKAWmp+rx868zWBm4LJhAAE+cTvLsQ9j49SrbwJZ\nfKizpw6QtK8vvPDyDJNKkObG+fRYzh1clNv09XKv+plnWZmmGxVhr1QTTKZoqrXE\njxZ4CCy4NIP8zJqb9iGNDL+qZCMYG6bqg78o19zrzE+Z3rmfSauhs6yXZEeofydA\n8otkemlmqNJ5VlZXJIRpyEslusez358X8Ku3jUpz4+W1IZngOY99httUdqJ9a5L5\nXtAcRR6xo19ghDTCxBX4UGViM9v5wlddDmE2CckL639anHd7Cvh2/dRRvvFDY/6t\nV+DNjU7oGLw4RJaXVtoswpsvM3M5TEULX9GYO6Oz4v/8MzIPbgGQe0UdpXok+ahH\nTPqmZyymiPeSy8MJ/h/tXBaTxZhVJS6yy3JbPwoKptTsG0qwRhvKhBLANKcCAwEA\nAQKCAgABg3ScCiV1j5PxUi/l2CatbASrT+m7Vs4kZbAaSc/MBe1sXddPDYKVh9GM\nL4zaufGXXPTX+oaJye6P6WtLiDY/MJ3wLJm9fmrivifdJ/QWuQBJ/Nn+QHIgw0Bc\nag/ZBvlTKV5M91+Q7FbCtTZI7kGNO2Y43kqYFLJKZ3FLSDzrGugZsEZPNEP49VFM\ncw+Sv9NMEVJUxA0TPewFm3uVRydkl4XMjdRFW6qQ4Ts0W/7Txuz0HBr9P9slERD8\nWdyxPzHQVjGfPpgQvaRaDCVP+gWGfRZHjUGoD9ofSbM0dDARtHg2izQU7E1LJIju\njFMN/zMRzgLRapvLxBbF1yK27KlJ8GxGi3zwJ1EY4QyPGdZ62VqCTRum6BQCKa1i\nzOi5N8dsr34ztEeJrlkEs2U+7aMYhoAKwCJ4axsDrN5r7xTuI+Uk5m2JbjVKTCsf\nIiqYw5kY7wlyp/k6Y9QTgx3aYmAJ8A8C7PUOOhrGsRusd+MBzpE28zESdHeFoEuN\ngITQ7VwvE9NjH+5wb5OOJug9hRtP2AgRa733C7g+oBSqVKZxN5EqzfSOvMyyC33t\ndyIBFcT+XnbfgrhPHByRUqSfUz5iedPWPSmfjfWBIpso/VEprOawSqs31YupqSCe\n3+qBx1SiK9suQJgS2m4OcCUeJEFyHuexHsjBxsew9rpEJRFw6QKCAQEA7hfSkT8Z\nT+Dt6kqKJsA1IC/4J3gthw7vwg470Z1k1infCcVjxyUE2EAY6xjWFhM8arX2udq/\nat/PyCmrBSiUCpeNJ5f5RDFKblqY9/SrmILR5fVvrDMhalnI7zDKCBDe7dBfWAr+\nn/NOEbjqsa+36LFkB8HS9oVy/kgT/6JcCpEB1Dd39nMthg/j2VDmGcZpKnYt/WlC\n+Yn03HOnP4ZsKNHFN5mP+ypEbmPXRgoSjg1pcMngmVtulCjC6R7ZqlH1dtlqp5jA\nafrXwatLRdot9rWm1qbHa/nGlyIGiQWN4+DGe2tNUT9LV+0jmZ5d5DGa6wN/igzY\n5a73WhmUe50qyQKCAQEA7UOZyTwajfhSY4IhP8m7EmeYSo1MW1kC9Cz5Yg52AQTD\nIqo3pYSKWz8RBVFaAeqECoTa5RGsOJMto6CVCgmYz0V1O37o6D+2sjHDX6e7bnXD\nl7AJN6U4zG2LC2NOYDTiIgHIWCPoyzkRJUiyDgknwpy/1mGbfVb7PIB02blYwjGC\ndwYSDu7QyqupQ3K2djuLWgH5/CuPxqzU/6f6/kj6gHcalC8CEdBdjs5RX7Ofy44e\nswBerezsyHeoRyrnni9eQlEtdBa5WvvCUxdAPdL9mXBaTcb2dQwwgf5izXHLNKOp\n1mzscWy2VYewmHcTpJvmjjD/uW3j1Tggq+sZi2mr7wKCAQBibmrZLXLzeRQi5koT\nFydfdTVsa9y2l1A7s9K7KAzGFW1mBrrnW8CS/nzOxOfNHIq/uxaTY4H7Vyf5onBX\no50AfAMZOVUOAiq5UK8o43gFhx/rp/pRAJpx80iEynDbwM3JF3ozVehKjDXcUcyF\nRRYNFzk5k8H5tNYDlhzedGsE20ocSApKUvehEvSppS5bvZFAwrbkqx3LOGOIuC+O\nra4NehvEjrHdrm24DYK0K/nbzGOpA2zdOdWPXwKlieGG7ndCeUQEobv6lH+aS4zF\nBhw2gIbG+xA67XpShPiasTcl3IlyALxoOHiXkyxCmBxM+M0JF9skYYdR/XG5SBYA\nvMsxAoIBAAjSm7Rc9MvUsROcMipSEQ/FJGeZS36WF8MGrRtVWFP/XlY6qCkSfaaY\n+MQO21743oIZoJ4mAxZzep38Ca6+3pzOg2Z7+KMyQ1Pq/83dyd14qZZJaH5WOX94\nj1QUFEUFkmcbU9zbMPvlmlqdkmltM7pL4+JP7N1DT8JXMIEsID3QY36TjjZZ8Q+o\nRHoKmPhajHsDWc1jvUvw/1amY3HzOsVuKGHcQaJx8hiuWV5KqqWCGmgjmmGzTrbB\npFNJKCW8sy+aHyuS8L+OXxKB6dSitOVwxRrhTCbcFi2vTPNAyQKjF1yu3jf1h+40\nRn/U5bkYRwGAlvHJQVCbbrOV4XRKsKcCggEBAL7Qko4NB/C55xS5UpjD3esEC2bp\nL/TDgEqe9l+HlV3u6UuyeagaC9Ekjp1V9t6SNHqzvYDt4XdeUlLH+7gkGdMd+BNE\nZOYVEM2LT3ZcekLDmJE+jWO+d/aIK+E2L1L/altDUIgGWmd3TIPz5D+J5FIN638v\n5iix4/Xow1yLFsaeL0hAXI8QzAAQV4MyrZucAT7GSj+eBTfIQupaYle4PrZuPc73\nfvn97Rn5nVkYyAyv2CUUZA7Im0I2rCPBh4VJpyT9bud8g1Bsg/QSnGhV+ar3rf4W\nNLTMnOFScY/nF2057JZmdpRKL0oJ/yQSjSo4F29kwtHDdzMXkQ47v0E5EdI=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T05:42:51.216 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T05:42:51.464 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:42:51.464 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:51 smithi037 ceph-mon[30631]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:51.464 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:42:53.122 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T05:42:53.122 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial admin user... 2024-09-21T05:42:53.385 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:53 smithi037 ceph-mon[30631]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:53.386 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:42:54.769 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$0OVVcYP3ksxVcrFcBMHogeOD96Yk3QEmuwlgeealFccruIBom9ztq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726897374, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T05:42:54.770 INFO:teuthology.orchestra.run.smithi037.stdout:Fetching dashboard port number... 2024-09-21T05:42:55.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:55 smithi037 ceph-mon[30631]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:55.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:42:56.116 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T05:42:56.135 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T05:42:56.135 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-21T05:42:56.149 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T05:42:56.149 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-21T05:42:56.149 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-21T05:42:56.149 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T05:42:56.151 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph Dashboard is now available at: 2024-09-21T05:42:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:42:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: URL: https://smithi037.front.sepia.ceph.com:8443/ 2024-09-21T05:42:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: User: admin 2024-09-21T05:42:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: Password: znpelg37an 2024-09-21T05:42:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:42:56.151 INFO:teuthology.orchestra.run.smithi037.stdout:Saving cluster configuration to /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config directory 2024-09-21T05:42:56.389 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:56 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1869600160' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T05:42:57.691 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T05:42:57.691 INFO:teuthology.orchestra.run.smithi037.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T05:42:57.691 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:42:57.691 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:42:57.691 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:42:57.691 INFO:teuthology.orchestra.run.smithi037.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T05:42:57.691 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:42:57.691 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T05:42:57.691 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:42:57.691 INFO:teuthology.orchestra.run.smithi037.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T05:42:57.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:42:57.692 INFO:teuthology.orchestra.run.smithi037.stdout: ceph telemetry on 2024-09-21T05:42:57.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:42:57.692 INFO:teuthology.orchestra.run.smithi037.stdout:For more information see: 2024-09-21T05:42:57.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:42:57.692 INFO:teuthology.orchestra.run.smithi037.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T05:42:57.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:42:57.692 INFO:teuthology.orchestra.run.smithi037.stdout:Bootstrap complete. 2024-09-21T05:42:57.749 INFO:tasks.cephadm:Fetching config... 2024-09-21T05:42:57.750 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:42:57.750 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T05:42:57.785 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T05:42:57.785 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:42:57.785 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T05:42:57.863 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T05:42:57.863 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:42:57.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T05:42:57.961 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T05:42:57.961 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:42:57.961 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T05:42:58.038 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T05:42:58.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjvzIdj8vNKt4LhOT84QiEL7P2Ip8dCzmJdx6Ok6J/2M1VWnizyyuwrlSepLmKiD17UVeS+sMPrsLfWFIPh90UrRKmbE4YPkjE/rOOal4RG9cutmXViwv18RkU0u7TJN9pVPJZu/2djeEjBwe2YCXmaRcLxDKJXhoAEg/AG/PtVThtHSbDHmWJ09D3lwFPmsvXCN05J6C3Ti0g3aHgbe3E+5bTy3RnHApjhRVZbW8FMuN3fFayR6qpbdbbllmO4pnAqMWY8TH0FEGs40+Dp6n45SiFkFLHCdv2DpUKaIrQt+2PdHGXhYulrJEhiegbUKDvUKFwMkEoPFY7t6EQ4T/TKItp/BPUFlE7k899hGagXldjfXQOjI6MbO//q2RRVMBL2MLMRvO+jIGP3DVd9iPrev5LOSW2qr7jMwyS/wHoXTEe4huxdaD/s4cZQPxiy8JomYBxjxrzsXioJZJJF7BZrs6md54E2a8PGvdRs/5CIWcxc0S3TnmYGXdGXz1ncPE= ceph-0c10cdda-77dc-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T05:42:58.161 INFO:teuthology.orchestra.run.smithi037.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjvzIdj8vNKt4LhOT84QiEL7P2Ip8dCzmJdx6Ok6J/2M1VWnizyyuwrlSepLmKiD17UVeS+sMPrsLfWFIPh90UrRKmbE4YPkjE/rOOal4RG9cutmXViwv18RkU0u7TJN9pVPJZu/2djeEjBwe2YCXmaRcLxDKJXhoAEg/AG/PtVThtHSbDHmWJ09D3lwFPmsvXCN05J6C3Ti0g3aHgbe3E+5bTy3RnHApjhRVZbW8FMuN3fFayR6qpbdbbllmO4pnAqMWY8TH0FEGs40+Dp6n45SiFkFLHCdv2DpUKaIrQt+2PdHGXhYulrJEhiegbUKDvUKFwMkEoPFY7t6EQ4T/TKItp/BPUFlE7k899hGagXldjfXQOjI6MbO//q2RRVMBL2MLMRvO+jIGP3DVd9iPrev5LOSW2qr7jMwyS/wHoXTEe4huxdaD/s4cZQPxiy8JomYBxjxrzsXioJZJJF7BZrs6md54E2a8PGvdRs/5CIWcxc0S3TnmYGXdGXz1ncPE= ceph-0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:42:58.185 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjvzIdj8vNKt4LhOT84QiEL7P2Ip8dCzmJdx6Ok6J/2M1VWnizyyuwrlSepLmKiD17UVeS+sMPrsLfWFIPh90UrRKmbE4YPkjE/rOOal4RG9cutmXViwv18RkU0u7TJN9pVPJZu/2djeEjBwe2YCXmaRcLxDKJXhoAEg/AG/PtVThtHSbDHmWJ09D3lwFPmsvXCN05J6C3Ti0g3aHgbe3E+5bTy3RnHApjhRVZbW8FMuN3fFayR6qpbdbbllmO4pnAqMWY8TH0FEGs40+Dp6n45SiFkFLHCdv2DpUKaIrQt+2PdHGXhYulrJEhiegbUKDvUKFwMkEoPFY7t6EQ4T/TKItp/BPUFlE7k899hGagXldjfXQOjI6MbO//q2RRVMBL2MLMRvO+jIGP3DVd9iPrev5LOSW2qr7jMwyS/wHoXTEe4huxdaD/s4cZQPxiy8JomYBxjxrzsXioJZJJF7BZrs6md54E2a8PGvdRs/5CIWcxc0S3TnmYGXdGXz1ncPE= ceph-0c10cdda-77dc-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T05:42:58.221 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:42:58 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2149590430' entity='client.admin' 2024-09-21T05:42:58.225 INFO:teuthology.orchestra.run.smithi067.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjvzIdj8vNKt4LhOT84QiEL7P2Ip8dCzmJdx6Ok6J/2M1VWnizyyuwrlSepLmKiD17UVeS+sMPrsLfWFIPh90UrRKmbE4YPkjE/rOOal4RG9cutmXViwv18RkU0u7TJN9pVPJZu/2djeEjBwe2YCXmaRcLxDKJXhoAEg/AG/PtVThtHSbDHmWJ09D3lwFPmsvXCN05J6C3Ti0g3aHgbe3E+5bTy3RnHApjhRVZbW8FMuN3fFayR6qpbdbbllmO4pnAqMWY8TH0FEGs40+Dp6n45SiFkFLHCdv2DpUKaIrQt+2PdHGXhYulrJEhiegbUKDvUKFwMkEoPFY7t6EQ4T/TKItp/BPUFlE7k899hGagXldjfXQOjI6MbO//q2RRVMBL2MLMRvO+jIGP3DVd9iPrev5LOSW2qr7jMwyS/wHoXTEe4huxdaD/s4cZQPxiy8JomYBxjxrzsXioJZJJF7BZrs6md54E2a8PGvdRs/5CIWcxc0S3TnmYGXdGXz1ncPE= ceph-0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:42:58.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjvzIdj8vNKt4LhOT84QiEL7P2Ip8dCzmJdx6Ok6J/2M1VWnizyyuwrlSepLmKiD17UVeS+sMPrsLfWFIPh90UrRKmbE4YPkjE/rOOal4RG9cutmXViwv18RkU0u7TJN9pVPJZu/2djeEjBwe2YCXmaRcLxDKJXhoAEg/AG/PtVThtHSbDHmWJ09D3lwFPmsvXCN05J6C3Ti0g3aHgbe3E+5bTy3RnHApjhRVZbW8FMuN3fFayR6qpbdbbllmO4pnAqMWY8TH0FEGs40+Dp6n45SiFkFLHCdv2DpUKaIrQt+2PdHGXhYulrJEhiegbUKDvUKFwMkEoPFY7t6EQ4T/TKItp/BPUFlE7k899hGagXldjfXQOjI6MbO//q2RRVMBL2MLMRvO+jIGP3DVd9iPrev5LOSW2qr7jMwyS/wHoXTEe4huxdaD/s4cZQPxiy8JomYBxjxrzsXioJZJJF7BZrs6md54E2a8PGvdRs/5CIWcxc0S3TnmYGXdGXz1ncPE= ceph-0c10cdda-77dc-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T05:42:58.281 INFO:teuthology.orchestra.run.smithi144.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjvzIdj8vNKt4LhOT84QiEL7P2Ip8dCzmJdx6Ok6J/2M1VWnizyyuwrlSepLmKiD17UVeS+sMPrsLfWFIPh90UrRKmbE4YPkjE/rOOal4RG9cutmXViwv18RkU0u7TJN9pVPJZu/2djeEjBwe2YCXmaRcLxDKJXhoAEg/AG/PtVThtHSbDHmWJ09D3lwFPmsvXCN05J6C3Ti0g3aHgbe3E+5bTy3RnHApjhRVZbW8FMuN3fFayR6qpbdbbllmO4pnAqMWY8TH0FEGs40+Dp6n45SiFkFLHCdv2DpUKaIrQt+2PdHGXhYulrJEhiegbUKDvUKFwMkEoPFY7t6EQ4T/TKItp/BPUFlE7k899hGagXldjfXQOjI6MbO//q2RRVMBL2MLMRvO+jIGP3DVd9iPrev5LOSW2qr7jMwyS/wHoXTEe4huxdaD/s4cZQPxiy8JomYBxjxrzsXioJZJJF7BZrs6md54E2a8PGvdRs/5CIWcxc0S3TnmYGXdGXz1ncPE= ceph-0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:42:58.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T05:42:58.668 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:00.054 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:00 smithi037 ceph-mon[30631]: mgrmap e14: x(active, since 12s) 2024-09-21T05:43:00.054 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:00 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3953815394' entity='client.admin' 2024-09-21T05:43:00.092 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T05:43:00.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T05:43:00.521 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:01.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:01.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:01.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:01.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:01.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:01.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:01.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:01.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:01.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:01.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:02.009 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi067 2024-09-21T05:43:02.009 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-21T05:43:02.010 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/etc/ceph/ceph.conf 2024-09-21T05:43:02.030 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-21T05:43:02.030 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:02.087 INFO:tasks.cephadm:Adding host smithi067 to orchestrator... 2024-09-21T05:43:02.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch host add smithi067 2024-09-21T05:43:02.468 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:02.708 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:02 smithi037 ceph-mon[30631]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:02.708 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:02 smithi037 ceph-mon[30631]: Updating smithi037:/etc/ceph/ceph.conf 2024-09-21T05:43:02.708 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:02 smithi037 ceph-mon[30631]: Updating smithi037:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:43:02.708 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:02 smithi037 ceph-mon[30631]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:02.708 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:02.708 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:02.709 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:03.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:03 smithi037 ceph-mon[30631]: Updating smithi037:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:43:04.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:04 smithi037 ceph-mon[30631]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi067", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:05.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:05 smithi037 ceph-mon[30631]: Deploying cephadm binary to smithi067 2024-09-21T05:43:07.145 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi067' with addr '172.21.15.67' 2024-09-21T05:43:07.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:07 smithi037 ceph-mon[30631]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:07.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:07.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:07.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:08.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T05:43:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:08.809 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:08 smithi037 ceph-mon[30631]: Added host smithi067 2024-09-21T05:43:08.809 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:08 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:08.809 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:08 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:09.199 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:43:09.199 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.67", "hostname": "smithi067", "labels": [], "status": ""}] 2024-09-21T05:43:09.804 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:09 smithi037 ceph-mon[30631]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:09.843 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi144 2024-09-21T05:43:09.843 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T05:43:09.843 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/etc/ceph/ceph.conf 2024-09-21T05:43:09.861 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T05:43:09.862 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:09.920 INFO:tasks.cephadm:Adding host smithi144 to orchestrator... 2024-09-21T05:43:09.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch host add smithi144 2024-09-21T05:43:10.288 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:11.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:10 smithi037 ceph-mon[30631]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:43:11.878 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:11 smithi037 ceph-mon[30631]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:11.878 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:11.878 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:11.878 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:11.878 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:11.878 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:11.878 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:11.878 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:13.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:12 smithi037 ceph-mon[30631]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi144", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:13.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:12 smithi037 ceph-mon[30631]: Updating smithi067:/etc/ceph/ceph.conf 2024-09-21T05:43:13.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:12 smithi037 ceph-mon[30631]: Updating smithi067:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:43:13.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:12 smithi037 ceph-mon[30631]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:13.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:12 smithi037 ceph-mon[30631]: Updating smithi067:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:43:13.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:12 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:13.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:12 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:13.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:12 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:14.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:13 smithi037 ceph-mon[30631]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:14.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:13 smithi037 ceph-mon[30631]: Deploying cephadm binary to smithi144 2024-09-21T05:43:14.862 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi144' with addr '172.21.15.144' 2024-09-21T05:43:15.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T05:43:15.893 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:16.133 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:15 smithi037 ceph-mon[30631]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:16.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:15 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:16.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:15 smithi037 ceph-mon[30631]: Added host smithi144 2024-09-21T05:43:16.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:15 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:16.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:15 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:16.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:15 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:16.673 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:43:16.673 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.67", "hostname": "smithi067", "labels": [], "status": ""}, {"addr": "172.21.15.144", "hostname": "smithi144", "labels": [], "status": ""}] 2024-09-21T05:43:17.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:17 smithi037 ceph-mon[30631]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:17.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:17 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:17.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:17 smithi037 ceph-mon[30631]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:43:17.332 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T05:43:17.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T05:43:17.694 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:19.192 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-09-21T05:43:19.540 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:19 smithi037 ceph-mon[30631]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:19.540 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:19 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2853003008' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T05:43:19.540 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:19.540 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:19.540 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:19.540 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:19.541 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:19.541 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:19.541 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:19.869 INFO:tasks.cephadm:Adding mon.a on smithi037 2024-09-21T05:43:19.869 INFO:tasks.cephadm:Adding mon.b on smithi067 2024-09-21T05:43:19.869 INFO:tasks.cephadm:Adding mon.c on smithi144 2024-09-21T05:43:19.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi037:172.21.15.37=a;smithi067:172.21.15.67=b;smithi144:172.21.15.144=c' 2024-09-21T05:43:20.100 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:43:20.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:20 smithi037 ceph-mon[30631]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-21T05:43:20.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:20 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2853003008' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T05:43:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:20 smithi037 ceph-mon[30631]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:43:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:20 smithi037 ceph-mon[30631]: Updating smithi144:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:43:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:20 smithi037 ceph-mon[30631]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:20 smithi037 ceph-mon[30631]: Updating smithi144:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:43:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:20 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:20 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:20.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:20 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:20.712 INFO:teuthology.orchestra.run.smithi144.stdout:Scheduled mon update... 2024-09-21T05:43:21.328 DEBUG:teuthology.orchestra.run.smithi067:mon.b> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T05:43:21.330 DEBUG:teuthology.orchestra.run.smithi144:mon.c> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T05:43:21.333 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T05:43:21.333 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T05:43:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:43:22.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:21 smithi037 ceph-mon[30631]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:21 smithi037 ceph-mon[30631]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi067:172.21.15.67=b;smithi144:172.21.15.144=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:21 smithi037 ceph-mon[30631]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi067:172.21.15.67=b;smithi144:172.21.15.144=c;count:3 2024-09-21T05:43:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:22.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:22.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:43:22.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:22.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:21 smithi037 ceph-mon[30631]: Deploying daemon mon.c on smithi144 2024-09-21T05:43:23.090 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:43:23.090 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":1,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","modified":"2024-09-21T05:41:43.349837Z","created":"2024-09-21T05:41:43.349837Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T05:43:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 1 2024-09-21T05:43:24.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:23 smithi037 ceph-mon[30631]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:24.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:23 smithi037 ceph-mon[30631]: from='client.? 172.21.15.144:0/1182318287' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:43:25.289 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T05:43:25.290 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T05:43:25.566 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:43:25.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:25 smithi144 systemd[1]: Started Ceph mon.c for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:43:30.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: mon.a calling monitor election 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: mon.c calling monitor election 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: monmap epoch 2 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:30.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: last_changed 2024-09-21T05:43:25.459856+0000 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: created 2024-09-21T05:41:43.349837+0000 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: min_mon_release 19 (squid) 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: election_strategy: 1 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: fsmap 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: mgrmap e14: x(active, since 44s) 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: overall HEALTH_OK 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:43:30.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:30.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:43:30.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: mon.a calling monitor election 2024-09-21T05:43:30.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:30.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:30.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:30.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:30.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: mon.c calling monitor election 2024-09-21T05:43:30.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:30.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:30.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:30.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:30.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:43:30.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: monmap epoch 2 2024-09-21T05:43:30.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:30.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: last_changed 2024-09-21T05:43:25.459856+0000 2024-09-21T05:43:30.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: created 2024-09-21T05:41:43.349837+0000 2024-09-21T05:43:30.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: min_mon_release 19 (squid) 2024-09-21T05:43:30.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: election_strategy: 1 2024-09-21T05:43:30.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T05:43:30.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T05:43:30.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: fsmap 2024-09-21T05:43:30.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:43:30.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: mgrmap e14: x(active, since 44s) 2024-09-21T05:43:30.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: overall HEALTH_OK 2024-09-21T05:43:30.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:30.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:30.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:30.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:43:30.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:31.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:31 smithi144 ceph-mon[34351]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:31.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:31 smithi144 ceph-mon[34351]: Deploying daemon mon.b on smithi067 2024-09-21T05:43:31.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:31 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:31.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:31 smithi037 ceph-mon[30631]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:31.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:31 smithi037 ceph-mon[30631]: Deploying daemon mon.b on smithi067 2024-09-21T05:43:31.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:31 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:43:32.315 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":2,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","modified":"2024-09-21T05:43:25.459856Z","created":"2024-09-21T05:41:43.349837Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T05:43:32.315 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 2 2024-09-21T05:43:32.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:32 smithi144 ceph-mon[34351]: from='client.? 172.21.15.144:0/1441635056' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:43:32.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:32 smithi037 ceph-mon[30631]: from='client.? 172.21.15.144:0/1441635056' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:43:33.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:33 smithi144 ceph-mon[34351]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:33.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:33 smithi037 ceph-mon[30631]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:33.917 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T05:43:33.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T05:43:34.171 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:43:34.342 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_log_file_size: 0 2024-09-21T05:43:34.342 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T05:43:34.342 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T05:43:34.342 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T05:43:34.342 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T05:43:34.342 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.allow_fallocate: 1 2024-09-21T05:43:34.342 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T05:43:34.343 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T05:43:34.343 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.use_direct_reads: 0 2024-09-21T05:43:34.343 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T05:43:34.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T05:43:34.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.db_log_dir: 2024-09-21T05:43:34.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.wal_dir: 2024-09-21T05:43:34.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T05:43:34.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T05:43:34.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T05:43:34.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T05:43:34.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T05:43:34.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T05:43:34.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T05:43:34.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T05:43:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.write_buffer_manager: 0x55b0d2b59d60 2024-09-21T05:43:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T05:43:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T05:43:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T05:43:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T05:43:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T05:43:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T05:43:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T05:43:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T05:43:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.unordered_write: 0 2024-09-21T05:43:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T05:43:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T05:43:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.row_cache: None 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.wal_filter: None 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.two_write_queues: 0 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.wal_compression: 0 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.atomic_flush: 0 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.log_readahead_size: 0 2024-09-21T05:43:34.749 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T05:43:34.750 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T05:43:34.751 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T05:43:34.751 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T05:43:34.751 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T05:43:34.751 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T05:43:34.751 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T05:43:34.751 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_background_jobs: 2 2024-09-21T05:43:34.751 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_background_compactions: -1 2024-09-21T05:43:34.751 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_subcompactions: 1 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_open_files: -1 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_background_flushes: -1 2024-09-21T05:43:34.752 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Compression algorithms supported: 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: kZSTD supported: 0 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: kXpressCompression supported: 0 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: kBZip2Compression supported: 0 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: kLZ4Compression supported: 1 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: kZlibCompression supported: 1 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: kSnappyCompression supported: 1 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T05:43:34.753 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.merge_operator: 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compaction_filter: None 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b0d2b54fa0) 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout: cache_index_and_filter_blocks: 1 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout: pin_top_level_index_and_filter: 1 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout: index_type: 0 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout: data_block_index_type: 0 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout: index_shortening: 1 2024-09-21T05:43:34.754 INFO:journalctl@ceph.mon.b.smithi067.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: checksum: 4 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: no_block_cache: 0 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: block_cache: 0x55b0ceb19610 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: block_cache_name: BinnedLRUCache 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: block_cache_options: 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: capacity : 536870912 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: num_shard_bits : 4 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: strict_capacity_limit : 0 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: high_pri_pool_ratio: 0.000 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: block_cache_compressed: (nil) 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: persistent_cache: (nil) 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: block_size: 4096 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: block_size_deviation: 10 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: block_restart_interval: 16 2024-09-21T05:43:34.755 INFO:journalctl@ceph.mon.b.smithi067.stdout: index_block_restart_interval: 1 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: metadata_block_size: 4096 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: partition_filters: 0 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: use_delta_encoding: 1 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: filter_policy: bloomfilter 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: whole_key_filtering: 1 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: verify_compression: 0 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: read_amp_bytes_per_bit: 0 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: format_version: 5 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: enable_index_compression: 1 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: block_align: 0 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: max_auto_readahead_size: 262144 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: prepopulate_block_cache: 0 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: initial_auto_readahead_size: 8192 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T05:43:34.756 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compression: NoCompression 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.num_levels: 7 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T05:43:34.757 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T05:43:34.758 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T05:43:34.759 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T05:43:34.760 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.inplace_update_support: 0 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.bloom_locality: 0 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.max_successive_merges: 0 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.ttl: 2592000 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T05:43:34.761 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.enable_blob_files: false 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.min_blob_size: 0 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 610de4af-de24-4f93-b2cb-9bfe4ed744f4 2024-09-21T05:43:34.762 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897414341189, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T05:43:34.763 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T05:43:34.763 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897414341795, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726897414, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "610de4af-de24-4f93-b2cb-9bfe4ed744f4", "db_session_id": "6CYQBJMID74SFOLY66AV", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T05:43:34.763 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726897414341922, "job": 1, "event": "recovery_finished"} 2024-09-21T05:43:34.763 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T05:43:34.763 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T05:43:34.763 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b0d2b78a80 2024-09-21T05:43:34.763 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: DB pointer 0x55b0d391e000 2024-09-21T05:43:34.763 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T05:43:34.763 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T05:43:34.763 INFO:journalctl@ceph.mon.b.smithi067.stdout: ** DB Stats ** 2024-09-21T05:43:34.763 INFO:journalctl@ceph.mon.b.smithi067.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:43:34.763 INFO:journalctl@ceph.mon.b.smithi067.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T05:43:34.763 INFO:journalctl@ceph.mon.b.smithi067.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: ** Compaction Stats [default] ** 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: ** Compaction Stats [default] ** 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:43:34.764 INFO:journalctl@ceph.mon.b.smithi067.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: Cumulative compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: Interval compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T05:43:34.765 INFO:journalctl@ceph.mon.b.smithi067.stdout: Block cache BinnedLRUCache@0x55b0ceb19610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout: 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: using public_addr v2:172.21.15.67:0/0 -> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: starting mon.b rank -1 at public addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] at bind addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(???) e0 preinit fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(synchronizing).mds e1 new map 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout: e1 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout: btime 2024-09-21T05:41:47:034913+0000 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:43:34.766 INFO:journalctl@ceph.mon.b.smithi067.stdout: legacy client fscid: -1 2024-09-21T05:43:34.767 INFO:journalctl@ceph.mon.b.smithi067.stdout: 2024-09-21T05:43:34.767 INFO:journalctl@ceph.mon.b.smithi067.stdout: No filesystems configured 2024-09-21T05:43:34.767 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T05:43:34.767 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T05:43:34.767 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T05:43:34.767 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T05:43:34.767 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T05:43:34.767 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T05:43:34.767 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T05:43:34.767 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:43:34.767 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:43:34.767 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Added host smithi067 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:34.768 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi144", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Updating smithi067:/etc/ceph/ceph.conf 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Updating smithi067:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Updating smithi067:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Deploying cephadm binary to smithi144 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Added host smithi144 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.769 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2853003008' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"} : dispatch 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-21T05:43:34.770 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2853003008' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T05:43:34.771 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:43:34.771 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Updating smithi144:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:43:34.771 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:34.771 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Updating smithi144:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:43:34.771 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.771 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.771 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.771 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:34.771 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi067:172.21.15.67=b;smithi144:172.21.15.144=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:34.771 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi067:172.21.15.67=b;smithi144:172.21.15.144=c;count:3 2024-09-21T05:43:34.771 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.771 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:34.771 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Deploying daemon mon.c on smithi144 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='client.? 172.21.15.144:0/1182318287' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.a calling monitor election 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:34.772 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.c calling monitor election 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: monmap epoch 2 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: last_changed 2024-09-21T05:43:25.459856+0000 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: created 2024-09-21T05:41:43.349837+0000 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: min_mon_release 19 (squid) 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: election_strategy: 1 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T05:43:34.773 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: fsmap 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mgrmap e14: x(active, since 44s) 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: overall HEALTH_OK 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: Deploying daemon mon.b on smithi067 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: from='client.? 172.21.15.144:0/1441635056' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 ceph-mon[34443]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T05:43:34.774 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 bash[34423]: 149ddd59da5c6b5473e46356f73c5ec4a587df7733f7414fa57fd516f76c1bcb 2024-09-21T05:43:34.775 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:34 smithi067 systemd[1]: Started Ceph mon.b for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:43:39.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:39.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:43:39.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: mon.c calling monitor election 2024-09-21T05:43:39.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: mon.a calling monitor election 2024-09-21T05:43:39.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:39.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:39.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:39.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:39.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:39.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:39.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:39.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:39.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:39.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: monmap epoch 3 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: last_changed 2024-09-21T05:43:34.372825+0000 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: created 2024-09-21T05:41:43.349837+0000 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: min_mon_release 19 (squid) 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: election_strategy: 1 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: 2: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.b 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: fsmap 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: mgrmap e14: x(active, since 53s) 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: overall HEALTH_OK 2024-09-21T05:43:39.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:39.876 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:39.876 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:39.876 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:39.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:39.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:43:39.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: mon.c calling monitor election 2024-09-21T05:43:39.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: mon.a calling monitor election 2024-09-21T05:43:39.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:39.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:39.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:39.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: monmap epoch 3 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: last_changed 2024-09-21T05:43:34.372825+0000 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: created 2024-09-21T05:41:43.349837+0000 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: min_mon_release 19 (squid) 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: election_strategy: 1 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T05:43:39.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: 2: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.b 2024-09-21T05:43:39.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: fsmap 2024-09-21T05:43:39.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:43:39.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: mgrmap e14: x(active, since 53s) 2024-09-21T05:43:39.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: overall HEALTH_OK 2024-09-21T05:43:39.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:39.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:39.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:39.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:40.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:40 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:40.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:40 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:40.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:40 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:40.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:40 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:40.882 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:43:40.882 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":3,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","modified":"2024-09-21T05:43:34.372825Z","created":"2024-09-21T05:41:43.349837Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T05:43:40.882 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 3 2024-09-21T05:43:41.490 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T05:43:41.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T05:43:41.724 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:41.724 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: mon.c calling monitor election 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: mon.a calling monitor election 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: monmap epoch 3 2024-09-21T05:43:41.725 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: last_changed 2024-09-21T05:43:34.372825+0000 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: created 2024-09-21T05:41:43.349837+0000 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: min_mon_release 19 (squid) 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: election_strategy: 1 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: 2: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.b 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: fsmap 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: mgrmap e14: x(active, since 53s) 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: overall HEALTH_OK 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:41.726 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:41.727 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:41.727 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:42.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: mon.b calling monitor election 2024-09-21T05:43:42.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: Updating smithi037:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:43:42.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T05:43:42.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: Reconfiguring daemon mon.a on smithi037 2024-09-21T05:43:42.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: mon.b calling monitor election 2024-09-21T05:43:42.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: mon.c calling monitor election 2024-09-21T05:43:42.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: mon.a calling monitor election 2024-09-21T05:43:42.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T05:43:42.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: monmap epoch 3 2024-09-21T05:43:42.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:42.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: last_changed 2024-09-21T05:43:34.372825+0000 2024-09-21T05:43:42.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: created 2024-09-21T05:41:43.349837+0000 2024-09-21T05:43:42.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: min_mon_release 19 (squid) 2024-09-21T05:43:42.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: election_strategy: 1 2024-09-21T05:43:42.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T05:43:42.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T05:43:42.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: 2: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.b 2024-09-21T05:43:42.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: fsmap 2024-09-21T05:43:42.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:43:42.379 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: mgrmap e14: x(active, since 55s) 2024-09-21T05:43:42.379 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: overall HEALTH_OK 2024-09-21T05:43:42.379 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:42.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: mon.b calling monitor election 2024-09-21T05:43:42.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: Updating smithi037:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:43:42.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T05:43:42.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: Reconfiguring daemon mon.a on smithi037 2024-09-21T05:43:42.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: mon.b calling monitor election 2024-09-21T05:43:42.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: mon.c calling monitor election 2024-09-21T05:43:42.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: mon.a calling monitor election 2024-09-21T05:43:42.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T05:43:42.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: monmap epoch 3 2024-09-21T05:43:42.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:42.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: last_changed 2024-09-21T05:43:34.372825+0000 2024-09-21T05:43:42.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: created 2024-09-21T05:41:43.349837+0000 2024-09-21T05:43:42.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: min_mon_release 19 (squid) 2024-09-21T05:43:42.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: election_strategy: 1 2024-09-21T05:43:42.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T05:43:42.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T05:43:42.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: 2: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.b 2024-09-21T05:43:42.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: fsmap 2024-09-21T05:43:42.625 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:43:42.625 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: mgrmap e14: x(active, since 55s) 2024-09-21T05:43:42.625 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: overall HEALTH_OK 2024-09-21T05:43:42.625 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: mon.b calling monitor election 2024-09-21T05:43:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: Updating smithi037:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:43:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T05:43:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: Reconfiguring daemon mon.a on smithi037 2024-09-21T05:43:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: mon.b calling monitor election 2024-09-21T05:43:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: mon.c calling monitor election 2024-09-21T05:43:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: mon.a calling monitor election 2024-09-21T05:43:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T05:43:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: monmap epoch 3 2024-09-21T05:43:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:42.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: last_changed 2024-09-21T05:43:34.372825+0000 2024-09-21T05:43:42.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: created 2024-09-21T05:41:43.349837+0000 2024-09-21T05:43:42.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: min_mon_release 19 (squid) 2024-09-21T05:43:42.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: election_strategy: 1 2024-09-21T05:43:42.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T05:43:42.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T05:43:42.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: 2: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.b 2024-09-21T05:43:42.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: fsmap 2024-09-21T05:43:42.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T05:43:42.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: mgrmap e14: x(active, since 55s) 2024-09-21T05:43:42.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: overall HEALTH_OK 2024-09-21T05:43:42.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:42.797 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:43.383 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:43 smithi067 ceph-mon[34443]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:43.384 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:43.384 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:43.384 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:43.384 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:43 smithi067 ceph-mon[34443]: Reconfiguring mon.b (monmap changed)... 2024-09-21T05:43:43.384 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:43:43.384 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:43:43.384 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:43.384 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:43 smithi067 ceph-mon[34443]: Reconfiguring daemon mon.b on smithi067 2024-09-21T05:43:43.564 INFO:teuthology.orchestra.run.smithi037.stdout:# minimal ceph.conf for 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:43.564 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-09-21T05:43:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:43:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: mon_host = [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-09-21T05:43:43.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:43 smithi037 ceph-mon[30631]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:43 smithi037 ceph-mon[30631]: Reconfiguring mon.b (monmap changed)... 2024-09-21T05:43:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:43:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:43:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:43.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:43 smithi037 ceph-mon[30631]: Reconfiguring daemon mon.b on smithi067 2024-09-21T05:43:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:43 smithi144 ceph-mon[34351]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:43:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:43 smithi144 ceph-mon[34351]: Reconfiguring mon.b (monmap changed)... 2024-09-21T05:43:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:43:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:43:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:43.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:43 smithi144 ceph-mon[34351]: Reconfiguring daemon mon.b on smithi067 2024-09-21T05:43:44.197 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T05:43:44.197 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:43:44.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T05:43:44.256 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:43:44.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:44.352 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-21T05:43:44.352 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T05:43:44.382 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-21T05:43:44.382 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:44.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:44 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3143794017' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:44.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:44.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:44.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:43:44.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:43:44.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:44.450 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T05:43:44.450 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T05:43:44.477 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T05:43:44.477 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:44.540 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:44 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3143794017' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:44.540 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:44.540 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:44.540 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:43:44.540 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:43:44.540 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:44.553 INFO:tasks.cephadm:Adding mgr.x on smithi037 2024-09-21T05:43:44.553 INFO:tasks.cephadm:Adding mgr.y on smithi067 2024-09-21T05:43:44.553 INFO:tasks.cephadm:Adding mgr.z on smithi144 2024-09-21T05:43:44.553 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi037=x;smithi067=y;smithi144=z' 2024-09-21T05:43:44.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:44 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3143794017' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:44.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:44.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:44.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:43:44.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:43:44.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:45.018 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:43:45.424 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:45 smithi144 ceph-mon[34351]: Reconfiguring mon.c (monmap changed)... 2024-09-21T05:43:45.424 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:45 smithi144 ceph-mon[34351]: Reconfiguring daemon mon.c on smithi144 2024-09-21T05:43:45.424 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:45 smithi144 ceph-mon[34351]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:45.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:45 smithi037 ceph-mon[30631]: Reconfiguring mon.c (monmap changed)... 2024-09-21T05:43:45.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:45 smithi037 ceph-mon[30631]: Reconfiguring daemon mon.c on smithi144 2024-09-21T05:43:45.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:45 smithi037 ceph-mon[30631]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:45.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:45 smithi067 ceph-mon[34443]: Reconfiguring mon.c (monmap changed)... 2024-09-21T05:43:45.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:45 smithi067 ceph-mon[34443]: Reconfiguring daemon mon.c on smithi144 2024-09-21T05:43:45.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:45 smithi067 ceph-mon[34443]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:45.993 INFO:teuthology.orchestra.run.smithi144.stdout:Scheduled mgr update... 2024-09-21T05:43:46.603 DEBUG:teuthology.orchestra.run.smithi067:mgr.y> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T05:43:46.605 DEBUG:teuthology.orchestra.run.smithi144:mgr.z> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T05:43:46.608 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T05:43:46.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T05:43:46.612 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T05:43:46.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T05:43:46.658 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T05:43:46.659 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T05:43:46.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:46.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:46.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:46.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:46.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:46.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:46.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:43:46.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:43:46.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:43:46.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:46.666 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T05:43:46.666 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T05:43:46.711 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T05:43:46.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T05:43:46.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:43:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:43:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:43:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:46.758 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T05:43:46.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T05:43:46.805 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T05:43:46.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T05:43:46.818 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.818 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.818 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:46.818 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:46.819 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:46.819 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.819 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.819 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:46.819 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:46.819 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:46.819 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:46.819 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:43:46.819 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:43:46.819 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:43:46.819 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:46.852 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T05:43:46.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T05:43:46.904 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T05:43:46.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T05:43:46.960 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T05:43:46.960 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T05:43:47.012 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T05:43:47.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T05:43:47.070 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T05:43:47.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T05:43:47.122 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T05:43:47.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T05:43:47.174 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T05:43:47.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T05:43:47.224 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T05:43:47.224 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T05:43:47.290 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T05:43:47.290 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T05:43:47.345 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T05:43:47.345 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T05:43:47.408 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T05:43:47.408 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T05:43:47.450 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:47.466 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T05:43:47.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T05:43:47.467 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:47.467 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:47.479 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T05:43:47.479 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T05:43:47.543 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T05:43:47.543 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T05:43:47.598 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T05:43:47.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T05:43:47.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:47 smithi037 ceph-mon[30631]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi067=y;smithi144=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:47.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:47 smithi037 ceph-mon[30631]: Saving service mgr spec with placement smithi037=x;smithi067=y;smithi144=z;count:3 2024-09-21T05:43:47.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:47 smithi037 ceph-mon[30631]: Deploying daemon mgr.z on smithi144 2024-09-21T05:43:47.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:47 smithi037 ceph-mon[30631]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:47.661 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T05:43:47.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T05:43:47.662 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:47.718 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T05:43:47.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T05:43:47.724 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:47 smithi144 ceph-mon[34351]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi067=y;smithi144=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:47.725 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:47 smithi144 ceph-mon[34351]: Saving service mgr spec with placement smithi037=x;smithi067=y;smithi144=z;count:3 2024-09-21T05:43:47.725 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:47 smithi144 ceph-mon[34351]: Deploying daemon mgr.z on smithi144 2024-09-21T05:43:47.725 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:47 smithi144 ceph-mon[34351]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:47.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:47 smithi067 ceph-mon[34443]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi067=y;smithi144=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:47.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:47 smithi067 ceph-mon[34443]: Saving service mgr spec with placement smithi037=x;smithi067=y;smithi144=z;count:3 2024-09-21T05:43:47.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:47 smithi067 ceph-mon[34443]: Deploying daemon mgr.z on smithi144 2024-09-21T05:43:47.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:47 smithi067 ceph-mon[34443]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:47.782 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T05:43:47.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T05:43:47.837 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T05:43:47.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T05:43:47.898 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T05:43:47.898 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi037') 2024-09-21T05:43:48.842 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:48.873 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 05:43:48 smithi144 systemd[1]: Started Ceph mgr.z for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:43:49.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:49.588+0000 7f3bb1000640 1 -- 172.21.15.37:0/1921806113 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3b9003fb20 msgr2=0x7f3b90042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:49.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:49.588+0000 7f3bb1000640 1 --2- 172.21.15.37:0/1921806113 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3b9003fb20 0x7f3b90042030 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009bd0 tx=0x7f3b98005f90 comp rx=0 tx=0).stop 2024-09-21T05:43:49.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:49.588+0000 7f3bb1000640 1 -- 172.21.15.37:0/1921806113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bac103570 msgr2=0x7f3bac19b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:49.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:49.588+0000 7f3bb1000640 1 --2- 172.21.15.37:0/1921806113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bac103570 0x7f3bac19b4a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c02aa70 tx=0x7f3b9c0045b0 comp rx=0 tx=0).stop 2024-09-21T05:43:49.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:49.588+0000 7f3bb1000640 1 -- 172.21.15.37:0/1921806113 shutdown_connections 2024-09-21T05:43:49.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:49.588+0000 7f3bb1000640 1 --2- 172.21.15.37:0/1921806113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bac104fa0 0x7f3bac19c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:49.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:49.588+0000 7f3bb1000640 1 --2- 172.21.15.37:0/1921806113 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3b9003fb20 0x7f3b90042030 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:49.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:49.588+0000 7f3bb1000640 1 --2- 172.21.15.37:0/1921806113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bac104600 0x7f3bac19bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:49.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:49.588+0000 7f3bb1000640 1 --2- 172.21.15.37:0/1921806113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bac103570 0x7f3bac19b4a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:49.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:49.588+0000 7f3bb1000640 1 -- 172.21.15.37:0/1921806113 >> 172.21.15.37:0/1921806113 conn(0x7f3bac0feec0 msgr2=0x7f3bac0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:49.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:49.589+0000 7f3bb1000640 1 -- 172.21.15.37:0/1921806113 shutdown_connections 2024-09-21T05:43:49.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:49.589+0000 7f3bb1000640 1 -- 172.21.15.37:0/1921806113 wait complete. 2024-09-21T05:43:49.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:49 smithi037 ceph-mon[30631]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:49.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:49.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:49.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:49.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:43:49.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:43:49.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:43:49.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:49.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:49 smithi037 ceph-mon[30631]: Deploying daemon mgr.y on smithi067 2024-09-21T05:43:49.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:49 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/40186597' entity='client.admin' 2024-09-21T05:43:49.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:49 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1921806113' entity='client.admin' 2024-09-21T05:43:49.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:49 smithi067 ceph-mon[34443]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:43:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:43:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:43:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:49 smithi067 ceph-mon[34443]: Deploying daemon mgr.y on smithi067 2024-09-21T05:43:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:49 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/40186597' entity='client.admin' 2024-09-21T05:43:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:49 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1921806113' entity='client.admin' 2024-09-21T05:43:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:49 smithi144 ceph-mon[34351]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:43:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T05:43:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:43:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:49 smithi144 ceph-mon[34351]: Deploying daemon mgr.y on smithi067 2024-09-21T05:43:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:49 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/40186597' entity='client.admin' 2024-09-21T05:43:50.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:49 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1921806113' entity='client.admin' 2024-09-21T05:43:50.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.401+0000 7ff91e400640 1 -- 172.21.15.37:0/1035929930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff91810b750 msgr2=0x7ff91810db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.401+0000 7ff91e400640 1 --2- 172.21.15.37:0/1035929930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff91810b750 0x7ff91810db90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff910009900 tx=0x7ff91002a410 comp rx=0 tx=0).stop 2024-09-21T05:43:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.401+0000 7ff91e400640 1 -- 172.21.15.37:0/1035929930 shutdown_connections 2024-09-21T05:43:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.401+0000 7ff91e400640 1 --2- 172.21.15.37:0/1035929930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff91810b750 0x7ff91810db90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.401+0000 7ff91e400640 1 --2- 172.21.15.37:0/1035929930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff918075c90 0x7ff9180760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.401+0000 7ff91e400640 1 --2- 172.21.15.37:0/1035929930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff918077080 0x7ff918075750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.401+0000 7ff91e400640 1 -- 172.21.15.37:0/1035929930 >> 172.21.15.37:0/1035929930 conn(0x7ff9180ff0e0 msgr2=0x7ff918101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.401+0000 7ff91e400640 1 -- 172.21.15.37:0/1035929930 shutdown_connections 2024-09-21T05:43:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.401+0000 7ff91e400640 1 -- 172.21.15.37:0/1035929930 wait complete. 2024-09-21T05:43:50.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.402+0000 7ff91e400640 1 Processor -- start 2024-09-21T05:43:50.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.402+0000 7ff91e400640 1 -- start start 2024-09-21T05:43:50.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.402+0000 7ff91e400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff918075c90 0x7ff91819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:50.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.402+0000 7ff91e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff918077080 0x7ff91819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:50.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.402+0000 7ff91e400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff91810b750 0x7ff91819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:50.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.402+0000 7ff91e400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9181109d0 con 0x7ff91810b750 2024-09-21T05:43:50.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.402+0000 7ff91e400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff918110850 con 0x7ff918075c90 2024-09-21T05:43:50.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.402+0000 7ff91e400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff918110b50 con 0x7ff918077080 2024-09-21T05:43:50.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.403+0000 7ff917400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff918075c90 0x7ff91819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:50.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.403+0000 7ff917400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff918075c90 0x7ff91819b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:45238/0 (socket says 172.21.15.37:45238) 2024-09-21T05:43:50.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.403+0000 7ff917400640 1 -- 172.21.15.37:0/4237146291 learned_addr learned my addr 172.21.15.37:0/4237146291 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:43:50.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.403+0000 7ff916a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff918077080 0x7ff91819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:50.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.403+0000 7ff917e00640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff91810b750 0x7ff91819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:50.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.403+0000 7ff917400640 1 -- 172.21.15.37:0/4237146291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff918077080 msgr2=0x7ff91819bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:50.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.403+0000 7ff917400640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff918077080 0x7ff91819bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.403+0000 7ff917400640 1 -- 172.21.15.37:0/4237146291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff91810b750 msgr2=0x7ff91819c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:50.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.403+0000 7ff917400640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff91810b750 0x7ff91819c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.403+0000 7ff917400640 1 -- 172.21.15.37:0/4237146291 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91819d0b0 con 0x7ff918075c90 2024-09-21T05:43:50.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.403+0000 7ff916a00640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff918077080 0x7ff91819bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:43:50.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.404+0000 7ff917400640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff918075c90 0x7ff91819b680 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff90800ebc0 tx=0x7ff90800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:50.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.404+0000 7ff90fe00640 1 -- 172.21.15.37:0/4237146291 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908010630 con 0x7ff918075c90 2024-09-21T05:43:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.404+0000 7ff90fe00640 1 -- 172.21.15.37:0/4237146291 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(23 keys) ==== 1008+0+0 (secure 0 0 0) 0x7ff908010c20 con 0x7ff918075c90 2024-09-21T05:43:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.404+0000 7ff91e400640 1 -- 172.21.15.37:0/4237146291 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91819d3a0 con 0x7ff918075c90 2024-09-21T05:43:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.404+0000 7ff90fe00640 1 -- 172.21.15.37:0/4237146291 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9080188d0 con 0x7ff918075c90 2024-09-21T05:43:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.404+0000 7ff91e400640 1 -- 172.21.15.37:0/4237146291 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9181a3aa0 con 0x7ff918075c90 2024-09-21T05:43:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.405+0000 7ff91e400640 1 -- 172.21.15.37:0/4237146291 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9180760a0 con 0x7ff918075c90 2024-09-21T05:43:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.406+0000 7ff90fe00640 1 -- 172.21.15.37:0/4237146291 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7ff9080107d0 con 0x7ff918075c90 2024-09-21T05:43:50.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.406+0000 7ff90fe00640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff8fc03fb20 0x7ff8fc042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:50.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.406+0000 7ff90fe00640 1 -- 172.21.15.37:0/4237146291 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff908054c80 con 0x7ff918075c90 2024-09-21T05:43:50.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.407+0000 7ff916a00640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff8fc03fb20 0x7ff8fc042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:50.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.407+0000 7ff916a00640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff8fc03fb20 0x7ff8fc042030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff904009fc0 tx=0x7ff904005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:50.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.416+0000 7ff90fe00640 1 -- 172.21.15.37:0/4237146291 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff90800f3c0 con 0x7ff918075c90 2024-09-21T05:43:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.579+0000 7f03bb800640 1 -- 172.21.15.37:0/1987959036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b4106a10 msgr2=0x7f03b4106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.579+0000 7f03bb800640 1 --2- 172.21.15.37:0/1987959036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b4106a10 0x7f03b4106e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009900 tx=0x7f03a002a480 comp rx=0 tx=0).stop 2024-09-21T05:43:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.579+0000 7f03bb800640 1 -- 172.21.15.37:0/1987959036 shutdown_connections 2024-09-21T05:43:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.579+0000 7f03bb800640 1 --2- 172.21.15.37:0/1987959036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b41073b0 0x7f03b410dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.579+0000 7f03bb800640 1 --2- 172.21.15.37:0/1987959036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b4106a10 0x7f03b4106e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.579+0000 7f03bb800640 1 --2- 172.21.15.37:0/1987959036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03b4105980 0x7f03b4105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.579+0000 7f03bb800640 1 -- 172.21.15.37:0/1987959036 >> 172.21.15.37:0/1987959036 conn(0x7f03b41012f0 msgr2=0x7f03b41037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.579+0000 7f03bb800640 1 -- 172.21.15.37:0/1987959036 shutdown_connections 2024-09-21T05:43:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.579+0000 7f03bb800640 1 -- 172.21.15.37:0/1987959036 wait complete. 2024-09-21T05:43:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.580+0000 7f03bb800640 1 Processor -- start 2024-09-21T05:43:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.580+0000 7f03bb800640 1 -- start start 2024-09-21T05:43:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.581+0000 7f03bb800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03b4105980 0x7f03b419b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.581+0000 7f03bb800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b4106a10 0x7f03b419bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.581+0000 7f03bb800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b41073b0 0x7f03b419c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.581+0000 7f03bb800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03b41109e0 con 0x7f03b4106a10 2024-09-21T05:43:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.581+0000 7f03bb800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f03b4110860 con 0x7f03b41073b0 2024-09-21T05:43:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.581+0000 7f03bb800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f03b4110b60 con 0x7f03b4105980 2024-09-21T05:43:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.581+0000 7f03b8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03b4105980 0x7f03b419b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.581+0000 7f03b9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b41073b0 0x7f03b419c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.581+0000 7f03b8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03b4105980 0x7f03b419b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:42438/0 (socket says 172.21.15.37:42438) 2024-09-21T05:43:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.581+0000 7f03b8e00640 1 -- 172.21.15.37:0/2853647458 learned_addr learned my addr 172.21.15.37:0/2853647458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:43:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.581+0000 7f03b3e00640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b4106a10 0x7f03b419bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.582+0000 7f03b8e00640 1 -- 172.21.15.37:0/2853647458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b41073b0 msgr2=0x7f03b419c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.582+0000 7f03b8e00640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b41073b0 0x7f03b419c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.582+0000 7f03b8e00640 1 -- 172.21.15.37:0/2853647458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b4106a10 msgr2=0x7f03b419bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.582+0000 7f03b8e00640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b4106a10 0x7f03b419bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.582+0000 7f03b8e00640 1 -- 172.21.15.37:0/2853647458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b419d1b0 con 0x7f03b4105980 2024-09-21T05:43:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.582+0000 7f03b9800640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b41073b0 0x7f03b419c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:43:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.582+0000 7f03b8e00640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03b4105980 0x7f03b419b780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f03a800e9f0 tx=0x7f03a800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.582+0000 7f03b1600640 1 -- 172.21.15.37:0/2853647458 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a800ccc0 con 0x7f03b4105980 2024-09-21T05:43:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.582+0000 7f03b1600640 1 -- 172.21.15.37:0/2853647458 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(23 keys) ==== 1008+0+0 (secure 0 0 0) 0x7f03a800ce60 con 0x7f03b4105980 2024-09-21T05:43:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.582+0000 7f03bb800640 1 -- 172.21.15.37:0/2853647458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b419d4a0 con 0x7f03b4105980 2024-09-21T05:43:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.582+0000 7f03b1600640 1 -- 172.21.15.37:0/2853647458 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8004dd0 con 0x7f03b4105980 2024-09-21T05:43:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.583+0000 7f03bb800640 1 -- 172.21.15.37:0/2853647458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b41a3ba0 con 0x7f03b4105980 2024-09-21T05:43:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.584+0000 7f03bb800640 1 -- 172.21.15.37:0/2853647458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b4105df0 con 0x7f03b4105980 2024-09-21T05:43:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.584+0000 7f03b1600640 1 -- 172.21.15.37:0/2853647458 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7f03a8021440 con 0x7f03b4105980 2024-09-21T05:43:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.584+0000 7f03b1600640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f039c03fb20 0x7f039c042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.584+0000 7f03b1600640 1 -- 172.21.15.37:0/2853647458 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f03a8054880 con 0x7f03b4105980 2024-09-21T05:43:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.585+0000 7f03b3e00640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f039c03fb20 0x7f039c042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.585+0000 7f03b3e00640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f039c03fb20 0x7f039c042030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f03a0000c00 tx=0x7f03a0004ef0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.590+0000 7f03b1600640 1 -- 172.21.15.37:0/2853647458 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f03a8005570 con 0x7f03b4105980 2024-09-21T05:43:50.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.628+0000 7ff91e400640 1 -- 172.21.15.37:0/4237146291 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7ff918063fc0 con 0x7ff918075c90 2024-09-21T05:43:50.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.636+0000 7f03b1600640 1 -- 172.21.15.37:0/2853647458 <== mon.1 v2:172.21.15.144:3300/0 7 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f03a80046c0 con 0x7f03b4105980 2024-09-21T05:43:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.636+0000 7ff90fe00640 1 -- 172.21.15.37:0/4237146291 <== mon.2 v2:172.21.15.67:3300/0 7 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7ff90805a080 con 0x7ff918075c90 2024-09-21T05:43:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.636+0000 7ff90fe00640 1 -- 172.21.15.37:0/4237146291 <== mon.2 v2:172.21.15.67:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7ff90800f740 con 0x7ff918075c90 2024-09-21T05:43:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.639+0000 7ff91e400640 1 -- 172.21.15.37:0/4237146291 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff8fc03fb20 msgr2=0x7ff8fc042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.639+0000 7ff91e400640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff8fc03fb20 0x7ff8fc042030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff904009fc0 tx=0x7ff904005f90 comp rx=0 tx=0).stop 2024-09-21T05:43:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.639+0000 7ff91e400640 1 -- 172.21.15.37:0/4237146291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff918075c90 msgr2=0x7ff91819b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.639+0000 7ff91e400640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff918075c90 0x7ff91819b680 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff90800ebc0 tx=0x7ff90800c6a0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.639+0000 7ff91e400640 1 -- 172.21.15.37:0/4237146291 shutdown_connections 2024-09-21T05:43:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.639+0000 7ff91e400640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff91810b750 0x7ff91819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.639+0000 7ff91e400640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff918077080 0x7ff91819bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.639+0000 7ff91e400640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff8fc03fb20 0x7ff8fc042030 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.639+0000 7ff91e400640 1 --2- 172.21.15.37:0/4237146291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff918075c90 0x7ff91819b680 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.639+0000 7ff91e400640 1 -- 172.21.15.37:0/4237146291 >> 172.21.15.37:0/4237146291 conn(0x7ff9180ff0e0 msgr2=0x7ff918101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.640+0000 7ff91e400640 1 -- 172.21.15.37:0/4237146291 shutdown_connections 2024-09-21T05:43:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.640+0000 7ff91e400640 1 -- 172.21.15.37:0/4237146291 wait complete. 2024-09-21T05:43:50.747 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 05:43:50 smithi067 systemd[1]: Starting Ceph mgr.y for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:43:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.815+0000 7f03bb800640 1 -- 172.21.15.37:0/2853647458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f03b4063fc0 con 0x7f03b4105980 2024-09-21T05:43:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.820+0000 7f03b1600640 1 -- 172.21.15.37:0/2853647458 <== mon.1 v2:172.21.15.144:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f03a8007d10 con 0x7f03b4105980 2024-09-21T05:43:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.820+0000 7f03b1600640 1 -- 172.21.15.37:0/2853647458 <== mon.1 v2:172.21.15.144:3300/0 9 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f03a80203a0 con 0x7f03b4105980 2024-09-21T05:43:50.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.823+0000 7f03bb800640 1 -- 172.21.15.37:0/2853647458 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f039c03fb20 msgr2=0x7f039c042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.823+0000 7f03bb800640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f039c03fb20 0x7f039c042030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f03a0000c00 tx=0x7f03a0004ef0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.823+0000 7f03bb800640 1 -- 172.21.15.37:0/2853647458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03b4105980 msgr2=0x7f03b419b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.823+0000 7f03bb800640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03b4105980 0x7f03b419b780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f03a800e9f0 tx=0x7f03a800edf0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.823+0000 7f03bb800640 1 -- 172.21.15.37:0/2853647458 shutdown_connections 2024-09-21T05:43:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.823+0000 7f03bb800640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f039c03fb20 0x7f039c042030 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.823+0000 7f03bb800640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03b41073b0 0x7f03b419c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.823+0000 7f03bb800640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b4106a10 0x7f03b419bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.823+0000 7f03bb800640 1 --2- 172.21.15.37:0/2853647458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03b4105980 0x7f03b419b780 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.823+0000 7f03bb800640 1 -- 172.21.15.37:0/2853647458 >> 172.21.15.37:0/2853647458 conn(0x7f03b41012f0 msgr2=0x7f03b4109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.823+0000 7f03bb800640 1 -- 172.21.15.37:0/2853647458 shutdown_connections 2024-09-21T05:43:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:50.823+0000 7f03bb800640 1 -- 172.21.15.37:0/2853647458 wait complete. 2024-09-21T05:43:51.017 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 05:43:50 smithi067 podman[35262]: 2024-09-21 05:43:50.663090648 +0000 UTC m=+0.016031911 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:43:51.017 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 05:43:50 smithi067 podman[35262]: 2024-09-21 05:43:50.910236025 +0000 UTC m=+0.263177312 container create 36b1bb4f4b85789ed617eb99fbc50bfaa35432b670095f68c3d4d73dbaa03dfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T05:43:51.496 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 05:43:51 smithi067 podman[35262]: 2024-09-21 05:43:51.112594192 +0000 UTC m=+0.465535434 container init 36b1bb4f4b85789ed617eb99fbc50bfaa35432b670095f68c3d4d73dbaa03dfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-y, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T05:43:51.497 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 05:43:51 smithi067 podman[35262]: 2024-09-21 05:43:51.115896357 +0000 UTC m=+0.468837599 container start 36b1bb4f4b85789ed617eb99fbc50bfaa35432b670095f68c3d4d73dbaa03dfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:43:51.497 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 05:43:51 smithi067 ceph-mgr[35281]: -- 172.21.15.67:0/1719077323 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556cbf7f50e0 con 0x556cc4598000 2024-09-21T05:43:51.497 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 05:43:51 smithi067 bash[35262]: 36b1bb4f4b85789ed617eb99fbc50bfaa35432b670095f68c3d4d73dbaa03dfc 2024-09-21T05:43:51.497 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 05:43:51 smithi067 systemd[1]: Started Ceph mgr.y for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:43:51.537 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi037') 2024-09-21T05:43:51.537 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi037') 2024-09-21T05:43:51.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:51 smithi037 ceph-mon[30631]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:51.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:51 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:43:51.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:51 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:43:51.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:51.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.910 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:51 smithi144 ceph-mon[34351]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:51.910 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:51 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:43:51.910 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:51 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:43:51.910 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.910 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.910 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.910 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.910 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:51.910 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.911 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:51 smithi067 ceph-mon[34443]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:51.911 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:51 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:43:51.911 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:51 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:43:51.911 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.911 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.911 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.911 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:51.911 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:43:51.911 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:52.347 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-09-21T05:43:52.347 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-09-21T05:43:52.958 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:53.001 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:53.033 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.030+0000 7f8e97c00640 1 -- 172.21.15.37:0/806853947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e90104810 msgr2=0x7f8e90104c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.030+0000 7f8e97c00640 1 --2- 172.21.15.37:0/806853947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e90104810 0x7f8e90104c20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009900 tx=0x7f8e7802a4b0 comp rx=0 tx=0).stop 2024-09-21T05:43:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.031+0000 7f8e97c00640 1 -- 172.21.15.37:0/806853947 shutdown_connections 2024-09-21T05:43:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.031+0000 7f8e97c00640 1 --2- 172.21.15.37:0/806853947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e901051b0 0x7f8e9010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.031+0000 7f8e97c00640 1 --2- 172.21.15.37:0/806853947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e90104810 0x7f8e90104c20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.031+0000 7f8e97c00640 1 --2- 172.21.15.37:0/806853947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e90103780 0x7f8e90103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.031+0000 7f8e97c00640 1 -- 172.21.15.37:0/806853947 >> 172.21.15.37:0/806853947 conn(0x7f8e900ff0f0 msgr2=0x7f8e901015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.031+0000 7f8e97c00640 1 -- 172.21.15.37:0/806853947 shutdown_connections 2024-09-21T05:43:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.031+0000 7f8e97c00640 1 -- 172.21.15.37:0/806853947 wait complete. 2024-09-21T05:43:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:53.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.033+0000 7f8e97c00640 1 Processor -- start 2024-09-21T05:43:53.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.036+0000 7f8e97c00640 1 -- start start 2024-09-21T05:43:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.038+0000 7f8e97c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e90103780 0x7f8e90113050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.039+0000 7f8e97c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e90104810 0x7f8e901136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:53.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.040+0000 7f8e97c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e901051b0 0x7f8e90114260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:53.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.040+0000 7f8e8fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e90104810 0x7f8e901136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.040+0000 7f8e97c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e90075f00 con 0x7f8e90104810 2024-09-21T05:43:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.040+0000 7f8e8fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e90104810 0x7f8e901136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60422/0 (socket says 172.21.15.37:60422) 2024-09-21T05:43:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.040+0000 7f8e8fe00640 1 -- 172.21.15.37:0/18886592 learned_addr learned my addr 172.21.15.37:0/18886592 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:43:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.040+0000 7f8e95200640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e90103780 0x7f8e90113050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.040+0000 7f8e97c00640 1 -- 172.21.15.37:0/18886592 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8e90075d80 con 0x7f8e901051b0 2024-09-21T05:43:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.040+0000 7f8e97c00640 1 -- 172.21.15.37:0/18886592 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8e90076080 con 0x7f8e90103780 2024-09-21T05:43:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.040+0000 7f8e95c00640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e901051b0 0x7f8e90114260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:53.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.041+0000 7f8e95c00640 1 -- 172.21.15.37:0/18886592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e90103780 msgr2=0x7f8e90113050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:53.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.041+0000 7f8e95c00640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e90103780 0x7f8e90113050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:53.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.041+0000 7f8e95c00640 1 -- 172.21.15.37:0/18886592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e90104810 msgr2=0x7f8e901136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:53.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.042+0000 7f8e95c00640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e90104810 0x7f8e901136c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:53.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.042+0000 7f8e95c00640 1 -- 172.21.15.37:0/18886592 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e901147a0 con 0x7f8e901051b0 2024-09-21T05:43:53.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.042+0000 7f8e8fe00640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e90104810 0x7f8e901136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:43:53.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.043+0000 7f8e95c00640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e901051b0 0x7f8e90114260 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800e940 tx=0x7f8e8800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.043+0000 7f8e8d600640 1 -- 172.21.15.37:0/18886592 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e88004d20 con 0x7f8e901051b0 2024-09-21T05:43:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.043+0000 7f8e8d600640 1 -- 172.21.15.37:0/18886592 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8e88005020 con 0x7f8e901051b0 2024-09-21T05:43:53.048 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:53.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.043+0000 7f8e97c00640 1 -- 172.21.15.37:0/18886592 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e90114a90 con 0x7f8e901051b0 2024-09-21T05:43:53.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.044+0000 7f8e97c00640 1 -- 172.21.15.37:0/18886592 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e901b1380 con 0x7f8e901051b0 2024-09-21T05:43:53.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.044+0000 7f8e8d600640 1 -- 172.21.15.37:0/18886592 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e880116d0 con 0x7f8e901051b0 2024-09-21T05:43:53.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.048+0000 7f8e8d600640 1 -- 172.21.15.37:0/18886592 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7f8e88011870 con 0x7f8e901051b0 2024-09-21T05:43:53.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.048+0000 7f8e97c00640 1 -- 172.21.15.37:0/18886592 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6c0052c0 con 0x7f8e901051b0 2024-09-21T05:43:53.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.049+0000 7f8e8d600640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8e7403fb60 0x7f8e74042070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:53.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.049+0000 7f8e8d600640 1 -- 172.21.15.37:0/18886592 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8e88055880 con 0x7f8e901051b0 2024-09-21T05:43:53.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.050+0000 7f8e95200640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8e7403fb60 0x7f8e74042070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:53.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.051+0000 7f8e95200640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8e7403fb60 0x7f8e74042070 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8e80006fd0 tx=0x7f8e80008040 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:53.054 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:53.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.055+0000 7f8e8d600640 1 -- 172.21.15.37:0/18886592 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e88016030 con 0x7f8e901051b0 2024-09-21T05:43:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:53.219 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:53.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.371+0000 7f8e97c00640 1 -- 172.21.15.37:0/18886592 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f8e6c0055b0 con 0x7f8e901051b0 2024-09-21T05:43:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.376+0000 7f8e8d600640 1 -- 172.21.15.37:0/18886592 <== mon.2 v2:172.21.15.67:3300/0 7 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e88022e40 con 0x7f8e901051b0 2024-09-21T05:43:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.377+0000 7f8e8d600640 1 -- 172.21.15.37:0/18886592 <== mon.2 v2:172.21.15.67:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7f8e8800fdd0 con 0x7f8e901051b0 2024-09-21T05:43:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.380+0000 7f8e97c00640 1 -- 172.21.15.37:0/18886592 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8e7403fb60 msgr2=0x7f8e74042070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.380+0000 7f8e97c00640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8e7403fb60 0x7f8e74042070 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8e80006fd0 tx=0x7f8e80008040 comp rx=0 tx=0).stop 2024-09-21T05:43:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.380+0000 7f8e97c00640 1 -- 172.21.15.37:0/18886592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e901051b0 msgr2=0x7f8e90114260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.380+0000 7f8e97c00640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e901051b0 0x7f8e90114260 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800e940 tx=0x7f8e8800ee00 comp rx=0 tx=0).stop 2024-09-21T05:43:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.380+0000 7f8e97c00640 1 -- 172.21.15.37:0/18886592 shutdown_connections 2024-09-21T05:43:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.380+0000 7f8e97c00640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8e7403fb60 0x7f8e74042070 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.380+0000 7f8e97c00640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e901051b0 0x7f8e90114260 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.380+0000 7f8e97c00640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e90104810 0x7f8e901136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.380+0000 7f8e97c00640 1 --2- 172.21.15.37:0/18886592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e90103780 0x7f8e90113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.380+0000 7f8e97c00640 1 -- 172.21.15.37:0/18886592 >> 172.21.15.37:0/18886592 conn(0x7f8e900ff0f0 msgr2=0x7f8e90100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.380+0000 7f8e97c00640 1 -- 172.21.15.37:0/18886592 shutdown_connections 2024-09-21T05:43:53.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:53.380+0000 7f8e97c00640 1 -- 172.21.15.37:0/18886592 wait complete. 2024-09-21T05:43:53.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:53.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:53.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:53.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T05:43:53.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:43:53.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:43:53.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:53.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: Reconfiguring daemon mgr.x on smithi037 2024-09-21T05:43:53.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:53 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:43:53.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T05:43:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:43:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:43:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: Reconfiguring daemon mgr.x on smithi037 2024-09-21T05:43:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:53 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:43:53.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:53.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:53.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:43:53.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:43:53.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T05:43:53.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T05:43:53.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T05:43:53.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:43:53.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: Reconfiguring daemon mgr.x on smithi037 2024-09-21T05:43:53.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:53 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:43:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.057+0000 7f6a4c800640 1 -- 172.21.15.37:0/3899428085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a44103750 msgr2=0x7f6a44103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.057+0000 7f6a4c800640 1 --2- 172.21.15.37:0/3899428085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a44103750 0x7f6a44103bc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009900 tx=0x7f6a3802a480 comp rx=0 tx=0).stop 2024-09-21T05:43:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.057+0000 7f6a4c800640 1 -- 172.21.15.37:0/3899428085 shutdown_connections 2024-09-21T05:43:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.057+0000 7f6a4c800640 1 --2- 172.21.15.37:0/3899428085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a44105180 0x7f6a4410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.057+0000 7f6a4c800640 1 --2- 172.21.15.37:0/3899428085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a441047e0 0x7f6a44104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.057+0000 7f6a4c800640 1 --2- 172.21.15.37:0/3899428085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a44103750 0x7f6a44103bc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.057+0000 7f6a4c800640 1 -- 172.21.15.37:0/3899428085 >> 172.21.15.37:0/3899428085 conn(0x7f6a440ff0c0 msgr2=0x7f6a44101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.057+0000 7f6a4c800640 1 -- 172.21.15.37:0/3899428085 shutdown_connections 2024-09-21T05:43:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.057+0000 7f6a4c800640 1 -- 172.21.15.37:0/3899428085 wait complete. 2024-09-21T05:43:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.058+0000 7f6a4c800640 1 Processor -- start 2024-09-21T05:43:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.058+0000 7f6a4c800640 1 -- start start 2024-09-21T05:43:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4c800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a44103750 0x7f6a4419c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4c800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a441047e0 0x7f6a4419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4c800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a44105180 0x7f6a4419d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4c800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4410f3c0 con 0x7f6a44103750 2024-09-21T05:43:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4c800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4410f240 con 0x7f6a44105180 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4c800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4410f540 con 0x7f6a441047e0 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a49e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a44103750 0x7f6a4419c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a44105180 0x7f6a4419d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a44105180 0x7f6a4419d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:58806/0 (socket says 172.21.15.37:58806) 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a49e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a44103750 0x7f6a4419c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60446/0 (socket says 172.21.15.37:60446) 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4a800640 1 -- 172.21.15.37:0/1021176909 learned_addr learned my addr 172.21.15.37:0/1021176909 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a49400640 1 --2- 172.21.15.37:0/1021176909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a441047e0 0x7f6a4419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4a800640 1 -- 172.21.15.37:0/1021176909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a441047e0 msgr2=0x7f6a4419c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4a800640 1 --2- 172.21.15.37:0/1021176909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a441047e0 0x7f6a4419c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4a800640 1 -- 172.21.15.37:0/1021176909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a44103750 msgr2=0x7f6a4419c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4a800640 1 --2- 172.21.15.37:0/1021176909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a44103750 0x7f6a4419c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.059+0000 7f6a4a800640 1 -- 172.21.15.37:0/1021176909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4419dc70 con 0x7f6a44105180 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.060+0000 7f6a4a800640 1 --2- 172.21.15.37:0/1021176909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a44105180 0x7f6a4419d450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000efd0 tx=0x7f6a4000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.060+0000 7f6a3ea00640 1 -- 172.21.15.37:0/1021176909 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40003b70 con 0x7f6a44105180 2024-09-21T05:43:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.060+0000 7f6a3ea00640 1 -- 172.21.15.37:0/1021176909 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a40003d10 con 0x7f6a44105180 2024-09-21T05:43:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.060+0000 7f6a4c800640 1 -- 172.21.15.37:0/1021176909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4419df60 con 0x7f6a44105180 2024-09-21T05:43:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.060+0000 7f6a3ea00640 1 -- 172.21.15.37:0/1021176909 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a400108a0 con 0x7f6a44105180 2024-09-21T05:43:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.060+0000 7f6a4c800640 1 -- 172.21.15.37:0/1021176909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a441a4660 con 0x7f6a44105180 2024-09-21T05:43:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.061+0000 7f6a4c800640 1 -- 172.21.15.37:0/1021176909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a441a4830 con 0x7f6a44105180 2024-09-21T05:43:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.061+0000 7f6a3ea00640 1 -- 172.21.15.37:0/1021176909 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 14) ==== 51898+0+0 (secure 0 0 0) 0x7f6a40004020 con 0x7f6a44105180 2024-09-21T05:43:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.062+0000 7f6a3ea00640 1 --2- 172.21.15.37:0/1021176909 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6a2c03fb20 0x7f6a2c042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.062+0000 7f6a3ea00640 1 -- 172.21.15.37:0/1021176909 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6a40054990 con 0x7f6a44105180 2024-09-21T05:43:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.062+0000 7f6a49e00640 1 --2- 172.21.15.37:0/1021176909 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6a2c03fb20 0x7f6a2c042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.063+0000 7f6a49e00640 1 --2- 172.21.15.37:0/1021176909 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6a2c03fb20 0x7f6a2c042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6a38004770 tx=0x7f6a380314a0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.067+0000 7f6a3ea00640 1 -- 172.21.15.37:0/1021176909 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6a40004310 con 0x7f6a44105180 2024-09-21T05:43:54.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.277+0000 7f6a4c800640 1 -- 172.21.15.37:0/1021176909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f6a441a4a00 con 0x7f6a44105180 2024-09-21T05:43:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.283+0000 7f6a3ea00640 1 -- 172.21.15.37:0/1021176909 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7f6a40004560 con 0x7f6a44105180 2024-09-21T05:43:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.285+0000 7f6a4c800640 1 -- 172.21.15.37:0/1021176909 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6a2c03fb20 msgr2=0x7f6a2c042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.285+0000 7f6a4c800640 1 --2- 172.21.15.37:0/1021176909 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6a2c03fb20 0x7f6a2c042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6a38004770 tx=0x7f6a380314a0 comp rx=0 tx=0).stop 2024-09-21T05:43:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.285+0000 7f6a4c800640 1 -- 172.21.15.37:0/1021176909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a44105180 msgr2=0x7f6a4419d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.285+0000 7f6a4c800640 1 --2- 172.21.15.37:0/1021176909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a44105180 0x7f6a4419d450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000efd0 tx=0x7f6a4000c6a0 comp rx=0 tx=0).stop 2024-09-21T05:43:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.286+0000 7f6a4c800640 1 -- 172.21.15.37:0/1021176909 shutdown_connections 2024-09-21T05:43:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.286+0000 7f6a4c800640 1 --2- 172.21.15.37:0/1021176909 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6a2c03fb20 0x7f6a2c042030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.286+0000 7f6a4c800640 1 --2- 172.21.15.37:0/1021176909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a44105180 0x7f6a4419d450 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.286+0000 7f6a4c800640 1 --2- 172.21.15.37:0/1021176909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a441047e0 0x7f6a4419c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:54.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.286+0000 7f6a4c800640 1 --2- 172.21.15.37:0/1021176909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a44103750 0x7f6a4419c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:54.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.286+0000 7f6a4c800640 1 -- 172.21.15.37:0/1021176909 >> 172.21.15.37:0/1021176909 conn(0x7f6a440ff0c0 msgr2=0x7f6a440755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:54.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.286+0000 7f6a4c800640 1 -- 172.21.15.37:0/1021176909 shutdown_connections 2024-09-21T05:43:54.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.286+0000 7f6a4c800640 1 -- 172.21.15.37:0/1021176909 wait complete. 2024-09-21T05:43:54.642 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:54 smithi037 ceph-mon[30631]: Standby manager daemon z started 2024-09-21T05:43:54.642 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:54 smithi037 ceph-mon[30631]: from='mgr.? 172.21.15.144:0/1307003829' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T05:43:54.643 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:54 smithi037 ceph-mon[30631]: from='mgr.? 172.21.15.144:0/1307003829' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:43:54.643 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:54 smithi037 ceph-mon[30631]: from='mgr.? 172.21.15.144:0/1307003829' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T05:43:54.643 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:54 smithi037 ceph-mon[30631]: from='mgr.? 172.21.15.144:0/1307003829' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:43:54.643 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:54 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:43:54.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:54 smithi067 ceph-mon[34443]: Standby manager daemon z started 2024-09-21T05:43:54.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:54 smithi067 ceph-mon[34443]: from='mgr.? 172.21.15.144:0/1307003829' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T05:43:54.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:54 smithi067 ceph-mon[34443]: from='mgr.? 172.21.15.144:0/1307003829' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:43:54.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:54 smithi067 ceph-mon[34443]: from='mgr.? 172.21.15.144:0/1307003829' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T05:43:54.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:54 smithi067 ceph-mon[34443]: from='mgr.? 172.21.15.144:0/1307003829' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:43:54.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:54 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:43:54.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:54 smithi144 ceph-mon[34351]: Standby manager daemon z started 2024-09-21T05:43:54.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:54 smithi144 ceph-mon[34351]: from='mgr.? 172.21.15.144:0/1307003829' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T05:43:54.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:54 smithi144 ceph-mon[34351]: from='mgr.? 172.21.15.144:0/1307003829' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:43:54.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:54 smithi144 ceph-mon[34351]: from='mgr.? 172.21.15.144:0/1307003829' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T05:43:54.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:54 smithi144 ceph-mon[34351]: from='mgr.? 172.21.15.144:0/1307003829' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:43:54.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:54 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:43:55.113 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi037') 2024-09-21T05:43:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.371+0000 7f6efbe00640 1 -- 172.21.15.37:0/1050560843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6efc0770e0 msgr2=0x7f6efc0757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.371+0000 7f6efbe00640 1 --2- 172.21.15.37:0/1050560843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6efc0770e0 0x7f6efc0757b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009930 tx=0x7f6eec02a420 comp rx=0 tx=0).stop 2024-09-21T05:43:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.371+0000 7f6efbe00640 1 -- 172.21.15.37:0/1050560843 shutdown_connections 2024-09-21T05:43:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.371+0000 7f6efbe00640 1 --2- 172.21.15.37:0/1050560843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6efc10fd00 0x7f6efc112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.371+0000 7f6efbe00640 1 --2- 172.21.15.37:0/1050560843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6efc075cf0 0x7f6efc076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.371+0000 7f6efbe00640 1 --2- 172.21.15.37:0/1050560843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6efc0770e0 0x7f6efc0757b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.371+0000 7f6efbe00640 1 -- 172.21.15.37:0/1050560843 >> 172.21.15.37:0/1050560843 conn(0x7f6efc0feec0 msgr2=0x7f6efc101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.371+0000 7f6efbe00640 1 -- 172.21.15.37:0/1050560843 shutdown_connections 2024-09-21T05:43:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.372+0000 7f6efbe00640 1 -- 172.21.15.37:0/1050560843 wait complete. 2024-09-21T05:43:55.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.373+0000 7f6efbe00640 1 Processor -- start 2024-09-21T05:43:55.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.373+0000 7f6efbe00640 1 -- start start 2024-09-21T05:43:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.373+0000 7f6efbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6efc075cf0 0x7f6efc1a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.373+0000 7f6efbe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6efc0770e0 0x7f6efc1a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.373+0000 7f6efbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6efc10fd00 0x7f6efc1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.373+0000 7f6efbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc1157b0 con 0x7f6efc075cf0 2024-09-21T05:43:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.373+0000 7f6efbe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc115630 con 0x7f6efc0770e0 2024-09-21T05:43:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.373+0000 7f6efbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc115930 con 0x7f6efc10fd00 2024-09-21T05:43:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.373+0000 7f6ef3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6efc0770e0 0x7f6efc1a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.374+0000 7f6efaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6efc075cf0 0x7f6efc1a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.374+0000 7f6ef3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6efc0770e0 0x7f6efc1a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:58830/0 (socket says 172.21.15.37:58830) 2024-09-21T05:43:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.374+0000 7f6ef3e00640 1 -- 172.21.15.37:0/2133921760 learned_addr learned my addr 172.21.15.37:0/2133921760 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:43:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.374+0000 7f6efb400640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6efc10fd00 0x7f6efc1a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.374+0000 7f6ef3e00640 1 -- 172.21.15.37:0/2133921760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6efc10fd00 msgr2=0x7f6efc1a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.374+0000 7f6ef3e00640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6efc10fd00 0x7f6efc1a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.374+0000 7f6ef3e00640 1 -- 172.21.15.37:0/2133921760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6efc075cf0 msgr2=0x7f6efc1a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.374+0000 7f6ef3e00640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6efc075cf0 0x7f6efc1a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.374+0000 7f6ef3e00640 1 -- 172.21.15.37:0/2133921760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6efc1a1e30 con 0x7f6efc0770e0 2024-09-21T05:43:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.374+0000 7f6efb400640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6efc10fd00 0x7f6efc1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:43:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.374+0000 7f6ef3e00640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6efc0770e0 0x7f6efc1a0a70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400ea60 tx=0x7f6ee400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.374+0000 7f6ef3400640 1 -- 172.21.15.37:0/2133921760 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee400cde0 con 0x7f6efc0770e0 2024-09-21T05:43:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.374+0000 7f6ef3400640 1 -- 172.21.15.37:0/2133921760 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee40035f0 con 0x7f6efc0770e0 2024-09-21T05:43:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.375+0000 7f6ef3400640 1 -- 172.21.15.37:0/2133921760 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4010690 con 0x7f6efc0770e0 2024-09-21T05:43:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.375+0000 7f6efbe00640 1 -- 172.21.15.37:0/2133921760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6efc1a2120 con 0x7f6efc0770e0 2024-09-21T05:43:55.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.375+0000 7f6efbe00640 1 -- 172.21.15.37:0/2133921760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6efc1a8820 con 0x7f6efc0770e0 2024-09-21T05:43:55.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.376+0000 7f6efbe00640 1 -- 172.21.15.37:0/2133921760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6efc105d90 con 0x7f6efc0770e0 2024-09-21T05:43:55.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.377+0000 7f6ef3400640 1 -- 172.21.15.37:0/2133921760 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7f6ee40037a0 con 0x7f6efc0770e0 2024-09-21T05:43:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.378+0000 7f6ef3400640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6ee007afd0 0x7f6ee007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.378+0000 7f6ef3400640 1 -- 172.21.15.37:0/2133921760 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6ee409d080 con 0x7f6efc0770e0 2024-09-21T05:43:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.378+0000 7f6efaa00640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6ee007afd0 0x7f6ee007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:55.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.379+0000 7f6efaa00640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6ee007afd0 0x7f6ee007d4e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009900 tx=0x7f6eec000bc0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:55.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.383+0000 7f6ef3400640 1 -- 172.21.15.37:0/2133921760 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ee40656e0 con 0x7f6efc0770e0 2024-09-21T05:43:55.449 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:55.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.601+0000 7f6efbe00640 1 -- 172.21.15.37:0/2133921760 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f6efc063fc0 con 0x7f6efc0770e0 2024-09-21T05:43:55.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.607+0000 7f6ef3400640 1 -- 172.21.15.37:0/2133921760 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v17)=0 v17) ==== 127+0+0 (secure 0 0 0) 0x7f6ee4069ac0 con 0x7f6efc0770e0 2024-09-21T05:43:55.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.610+0000 7f6efbe00640 1 -- 172.21.15.37:0/2133921760 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6ee007afd0 msgr2=0x7f6ee007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:55.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.610+0000 7f6efbe00640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6ee007afd0 0x7f6ee007d4e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009900 tx=0x7f6eec000bc0 comp rx=0 tx=0).stop 2024-09-21T05:43:55.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.610+0000 7f6efbe00640 1 -- 172.21.15.37:0/2133921760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6efc0770e0 msgr2=0x7f6efc1a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.610+0000 7f6efbe00640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6efc0770e0 0x7f6efc1a0a70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400ea60 tx=0x7f6ee400ef20 comp rx=0 tx=0).stop 2024-09-21T05:43:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.610+0000 7f6efbe00640 1 -- 172.21.15.37:0/2133921760 shutdown_connections 2024-09-21T05:43:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.610+0000 7f6efbe00640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6efc10fd00 0x7f6efc1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.610+0000 7f6efbe00640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6ee007afd0 0x7f6ee007d4e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.610+0000 7f6efbe00640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6efc0770e0 0x7f6efc1a0a70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.610+0000 7f6efbe00640 1 --2- 172.21.15.37:0/2133921760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6efc075cf0 0x7f6efc1a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.610+0000 7f6efbe00640 1 -- 172.21.15.37:0/2133921760 >> 172.21.15.37:0/2133921760 conn(0x7f6efc0feec0 msgr2=0x7f6efc102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.610+0000 7f6efbe00640 1 -- 172.21.15.37:0/2133921760 shutdown_connections 2024-09-21T05:43:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:55.610+0000 7f6efbe00640 1 -- 172.21.15.37:0/2133921760 wait complete. 2024-09-21T05:43:55.633 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:55 smithi037 ceph-mon[30631]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:55.633 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:55 smithi037 ceph-mon[30631]: mgrmap e15: x(active, since 68s), standbys: z 2024-09-21T05:43:55.633 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T05:43:55.633 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:55 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:43:55.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:55 smithi067 ceph-mon[34443]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:55.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:55 smithi067 ceph-mon[34443]: mgrmap e15: x(active, since 68s), standbys: z 2024-09-21T05:43:55.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T05:43:55.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:55 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:43:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:55 smithi144 ceph-mon[34351]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:55 smithi144 ceph-mon[34351]: mgrmap e15: x(active, since 68s), standbys: z 2024-09-21T05:43:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T05:43:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:55 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:43:56.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.270+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2162136879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a98104600 msgr2=0x7f1a98104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:56.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.270+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/2162136879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a98104600 0x7f1a98104a10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009900 tx=0x7f1a8402a480 comp rx=0 tx=0).stop 2024-09-21T05:43:56.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.270+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2162136879 shutdown_connections 2024-09-21T05:43:56.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.270+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/2162136879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a98104fa0 0x7f1a9810b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:56.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.270+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/2162136879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a98104600 0x7f1a98104a10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:56.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.270+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/2162136879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a98103570 0x7f1a981039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:56.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.270+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2162136879 >> 172.21.15.37:0/2162136879 conn(0x7f1a980feec0 msgr2=0x7f1a98101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:56.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.270+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2162136879 shutdown_connections 2024-09-21T05:43:56.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.270+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2162136879 wait complete. 2024-09-21T05:43:56.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.271+0000 7f1a9ee00640 1 Processor -- start 2024-09-21T05:43:56.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.271+0000 7f1a9ee00640 1 -- start start 2024-09-21T05:43:56.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9ee00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a98103570 0x7f1a9819c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:56.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9ee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a98104600 0x7f1a9819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:56.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9ee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a98104fa0 0x7f1a9819d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:56.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9ee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9810f220 con 0x7f1a98104600 2024-09-21T05:43:56.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9ee00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9810f0a0 con 0x7f1a98103570 2024-09-21T05:43:56.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9ee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9810f3a0 con 0x7f1a98104fa0 2024-09-21T05:43:56.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9da00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a98103570 0x7f1a9819c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:56.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9da00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a98103570 0x7f1a9819c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:58860/0 (socket says 172.21.15.37:58860) 2024-09-21T05:43:56.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9da00640 1 -- 172.21.15.37:0/3907867496 learned_addr learned my addr 172.21.15.37:0/3907867496 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:43:56.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9d000640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a98104600 0x7f1a9819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:56.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9e400640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a98104fa0 0x7f1a9819d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:56.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9da00640 1 -- 172.21.15.37:0/3907867496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a98104fa0 msgr2=0x7f1a9819d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:56.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9da00640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a98104fa0 0x7f1a9819d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:56.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9da00640 1 -- 172.21.15.37:0/3907867496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a98104600 msgr2=0x7f1a9819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:56.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9da00640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a98104600 0x7f1a9819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:56.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9da00640 1 -- 172.21.15.37:0/3907867496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9819da80 con 0x7f1a98103570 2024-09-21T05:43:56.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.272+0000 7f1a9e400640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a98104fa0 0x7f1a9819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:43:56.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.273+0000 7f1a9da00640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a98103570 0x7f1a9819c050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00ea60 tx=0x7f1a8c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:56.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.273+0000 7f1a96000640 1 -- 172.21.15.37:0/3907867496 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00cde0 con 0x7f1a98103570 2024-09-21T05:43:56.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.273+0000 7f1a96000640 1 -- 172.21.15.37:0/3907867496 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a8c0035f0 con 0x7f1a98103570 2024-09-21T05:43:56.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.273+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3907867496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a9819dd70 con 0x7f1a98103570 2024-09-21T05:43:56.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.273+0000 7f1a96000640 1 -- 172.21.15.37:0/3907867496 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c010690 con 0x7f1a98103570 2024-09-21T05:43:56.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.273+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3907867496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a981a4470 con 0x7f1a98103570 2024-09-21T05:43:56.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.275+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3907867496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a981039e0 con 0x7f1a98103570 2024-09-21T05:43:56.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.275+0000 7f1a96000640 1 -- 172.21.15.37:0/3907867496 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7f1a8c004020 con 0x7f1a98103570 2024-09-21T05:43:56.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.276+0000 7f1a96000640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1a8007afd0 0x7f1a8007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:56.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.276+0000 7f1a96000640 1 -- 172.21.15.37:0/3907867496 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1a8c09d0b0 con 0x7f1a98103570 2024-09-21T05:43:56.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.277+0000 7f1a9d000640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1a8007afd0 0x7f1a8007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:56.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.277+0000 7f1a9d000640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1a8007afd0 0x7f1a8007d4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a84004770 tx=0x7f1a840314a0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:56.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.281+0000 7f1a96000640 1 -- 172.21.15.37:0/3907867496 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1a8c065690 con 0x7f1a98103570 2024-09-21T05:43:56.377 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:56.380 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:56.381 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:56.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.528+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3907867496 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f1a981a4640 con 0x7f1a98103570 2024-09-21T05:43:56.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.533+0000 7f1a96000640 1 -- 172.21.15.37:0/3907867496 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v19)=0 v19) ==== 122+0+0 (secure 0 0 0) 0x7f1a8c069a70 con 0x7f1a98103570 2024-09-21T05:43:56.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.535+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3907867496 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1a8007afd0 msgr2=0x7f1a8007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:56.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.535+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1a8007afd0 0x7f1a8007d4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a84004770 tx=0x7f1a840314a0 comp rx=0 tx=0).stop 2024-09-21T05:43:56.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.535+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3907867496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a98103570 msgr2=0x7f1a9819c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:56.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.535+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a98103570 0x7f1a9819c050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00ea60 tx=0x7f1a8c00ef20 comp rx=0 tx=0).stop 2024-09-21T05:43:56.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.535+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3907867496 shutdown_connections 2024-09-21T05:43:56.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.535+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a98104fa0 0x7f1a9819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.535+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a98104600 0x7f1a9819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.536+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1a8007afd0 0x7f1a8007d4e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.536+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/3907867496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a98103570 0x7f1a9819c050 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.536+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3907867496 >> 172.21.15.37:0/3907867496 conn(0x7f1a980feec0 msgr2=0x7f1a980755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.536+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3907867496 shutdown_connections 2024-09-21T05:43:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.536+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3907867496 wait complete. 2024-09-21T05:43:56.865 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:56 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:43:56.865 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:56 smithi037 ceph-mon[30631]: Standby manager daemon y started 2024-09-21T05:43:56.865 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:56 smithi037 ceph-mon[30631]: from='mgr.? 172.21.15.67:0/26584916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T05:43:56.865 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:56 smithi037 ceph-mon[30631]: from='mgr.? 172.21.15.67:0/26584916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:43:56.865 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:56 smithi037 ceph-mon[30631]: from='mgr.? 172.21.15.67:0/26584916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T05:43:56.865 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:56 smithi037 ceph-mon[30631]: from='mgr.? 172.21.15.67:0/26584916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:43:56.865 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:56 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:43:56.865 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:56 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:43:56.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:56 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:43:56.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:56 smithi144 ceph-mon[34351]: Standby manager daemon y started 2024-09-21T05:43:56.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:56 smithi144 ceph-mon[34351]: from='mgr.? 172.21.15.67:0/26584916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T05:43:56.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:56 smithi144 ceph-mon[34351]: from='mgr.? 172.21.15.67:0/26584916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:43:56.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:56 smithi144 ceph-mon[34351]: from='mgr.? 172.21.15.67:0/26584916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T05:43:56.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:56 smithi144 ceph-mon[34351]: from='mgr.? 172.21.15.67:0/26584916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:43:56.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:56 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:43:56.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:56 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:43:56.906 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi037') 2024-09-21T05:43:56.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:56 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:43:56.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:56 smithi067 ceph-mon[34443]: Standby manager daemon y started 2024-09-21T05:43:56.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:56 smithi067 ceph-mon[34443]: from='mgr.? 172.21.15.67:0/26584916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T05:43:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:56 smithi067 ceph-mon[34443]: from='mgr.? 172.21.15.67:0/26584916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T05:43:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:56 smithi067 ceph-mon[34443]: from='mgr.? 172.21.15.67:0/26584916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T05:43:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:56 smithi067 ceph-mon[34443]: from='mgr.? 172.21.15.67:0/26584916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T05:43:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:56 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:43:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:56 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:43:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.186+0000 7fe3f4000640 1 -- 172.21.15.37:0/1387066970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec077080 msgr2=0x7fe3ec075750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.186+0000 7fe3f4000640 1 --2- 172.21.15.37:0/1387066970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec077080 0x7fe3ec075750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009900 tx=0x7fe3e002a3f0 comp rx=0 tx=0).stop 2024-09-21T05:43:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.186+0000 7fe3f4000640 1 -- 172.21.15.37:0/1387066970 shutdown_connections 2024-09-21T05:43:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.186+0000 7fe3f4000640 1 --2- 172.21.15.37:0/1387066970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3ec10b780 0x7fe3ec10dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.186+0000 7fe3f4000640 1 --2- 172.21.15.37:0/1387066970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3ec075c90 0x7fe3ec0760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.186+0000 7fe3f4000640 1 --2- 172.21.15.37:0/1387066970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec077080 0x7fe3ec075750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.186+0000 7fe3f4000640 1 -- 172.21.15.37:0/1387066970 >> 172.21.15.37:0/1387066970 conn(0x7fe3ec0ff0f0 msgr2=0x7fe3ec1015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.186+0000 7fe3f4000640 1 -- 172.21.15.37:0/1387066970 shutdown_connections 2024-09-21T05:43:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.187+0000 7fe3f4000640 1 -- 172.21.15.37:0/1387066970 wait complete. 2024-09-21T05:43:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.188+0000 7fe3f4000640 1 Processor -- start 2024-09-21T05:43:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.188+0000 7fe3f4000640 1 -- start start 2024-09-21T05:43:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f4000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3ec075c90 0x7fe3ec19c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f4000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3ec077080 0x7fe3ec19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f4000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec10b780 0x7fe3ec19d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f4000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec111610 con 0x7fe3ec10b780 2024-09-21T05:43:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f4000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec111490 con 0x7fe3ec075c90 2024-09-21T05:43:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f4000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec111790 con 0x7fe3ec077080 2024-09-21T05:43:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f1600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3ec075c90 0x7fe3ec19c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f1600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3ec075c90 0x7fe3ec19c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:58842/0 (socket says 172.21.15.37:58842) 2024-09-21T05:43:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f1600640 1 -- 172.21.15.37:0/2974041145 learned_addr learned my addr 172.21.15.37:0/2974041145 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:43:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f2000640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec10b780 0x7fe3ec19d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f0c00640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3ec077080 0x7fe3ec19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f1600640 1 -- 172.21.15.37:0/2974041145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3ec077080 msgr2=0x7fe3ec19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f1600640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3ec077080 0x7fe3ec19c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f1600640 1 -- 172.21.15.37:0/2974041145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec10b780 msgr2=0x7fe3ec19d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.189+0000 7fe3f1600640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec10b780 0x7fe3ec19d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.190+0000 7fe3f1600640 1 -- 172.21.15.37:0/2974041145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ec19dc90 con 0x7fe3ec075c90 2024-09-21T05:43:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.190+0000 7fe3f0c00640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3ec077080 0x7fe3ec19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:43:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.190+0000 7fe3f1600640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3ec075c90 0x7fe3ec19c260 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0031440 tx=0x7fe3e0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.190+0000 7fe3ea000640 1 -- 172.21.15.37:0/2974041145 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e003f070 con 0x7fe3ec075c90 2024-09-21T05:43:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.190+0000 7fe3ea000640 1 -- 172.21.15.37:0/2974041145 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3e0031c50 con 0x7fe3ec075c90 2024-09-21T05:43:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.190+0000 7fe3f4000640 1 -- 172.21.15.37:0/2974041145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3ec19df20 con 0x7fe3ec075c90 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.190+0000 7fe3ea000640 1 -- 172.21.15.37:0/2974041145 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0035030 con 0x7fe3ec075c90 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.190+0000 7fe3f4000640 1 -- 172.21.15.37:0/2974041145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3ec1a44b0 con 0x7fe3ec075c90 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.191+0000 7fe3f4000640 1 -- 172.21.15.37:0/2974041145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3ec10a590 con 0x7fe3ec075c90 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.194+0000 7fe3ea000640 1 -- 172.21.15.37:0/2974041145 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7fe3e0042070 con 0x7fe3ec075c90 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.195+0000 7fe3ea000640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe3d407afd0 0x7fe3d407d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.195+0000 7fe3ea000640 1 -- 172.21.15.37:0/2974041145 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe3e00bd5a0 con 0x7fe3ec075c90 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.195+0000 7fe3f0c00640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe3d407afd0 0x7fe3d407d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.195+0000 7fe3f0c00640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe3d407afd0 0x7fe3d407d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009c20 tx=0x7fe3d8005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.200+0000 7fe3ea000640 1 -- 172.21.15.37:0/2974041145 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe3e008a020 con 0x7fe3ec075c90 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.432+0000 7fe3f4000640 1 -- 172.21.15.37:0/2974041145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fe3ec02e640 con 0x7fe3ec075c90 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.438+0000 7fe3ea000640 1 -- 172.21.15.37:0/2974041145 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v18)=0 v18) ==== 116+0+0 (secure 0 0 0) 0x7fe3e008c020 con 0x7fe3ec075c90 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.441+0000 7fe3f4000640 1 -- 172.21.15.37:0/2974041145 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe3d407afd0 msgr2=0x7fe3d407d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.441+0000 7fe3f4000640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe3d407afd0 0x7fe3d407d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009c20 tx=0x7fe3d8005f90 comp rx=0 tx=0).stop 2024-09-21T05:43:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.441+0000 7fe3f4000640 1 -- 172.21.15.37:0/2974041145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3ec075c90 msgr2=0x7fe3ec19c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.441+0000 7fe3f4000640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3ec075c90 0x7fe3ec19c260 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0031440 tx=0x7fe3e0003c10 comp rx=0 tx=0).stop 2024-09-21T05:43:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.441+0000 7fe3f4000640 1 -- 172.21.15.37:0/2974041145 shutdown_connections 2024-09-21T05:43:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.441+0000 7fe3f4000640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec10b780 0x7fe3ec19d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.441+0000 7fe3f4000640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3ec077080 0x7fe3ec19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.441+0000 7fe3f4000640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe3d407afd0 0x7fe3d407d4e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.441+0000 7fe3f4000640 1 --2- 172.21.15.37:0/2974041145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3ec075c90 0x7fe3ec19c260 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.441+0000 7fe3f4000640 1 -- 172.21.15.37:0/2974041145 >> 172.21.15.37:0/2974041145 conn(0x7fe3ec0ff0f0 msgr2=0x7fe3ec107760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.441+0000 7fe3f4000640 1 -- 172.21.15.37:0/2974041145 shutdown_connections 2024-09-21T05:43:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:56.441+0000 7fe3f4000640 1 -- 172.21.15.37:0/2974041145 wait complete. 2024-09-21T05:43:57.411 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:57.411 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:57.411 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:57.781 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:57 smithi037 ceph-mon[30631]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:57.781 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:57 smithi037 ceph-mon[30631]: mgrmap e16: x(active, since 70s), standbys: z, y 2024-09-21T05:43:57.781 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:57 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T05:43:57.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:57 smithi144 ceph-mon[34351]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:57.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:57 smithi144 ceph-mon[34351]: mgrmap e16: x(active, since 70s), standbys: z, y 2024-09-21T05:43:57.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:57 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T05:43:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:57 smithi067 ceph-mon[34443]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:57 smithi067 ceph-mon[34443]: mgrmap e16: x(active, since 70s), standbys: z, y 2024-09-21T05:43:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:57 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T05:43:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.430+0000 7fda0b200640 1 -- 172.21.15.37:0/4231770328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda0c103570 msgr2=0x7fda0c1039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.430+0000 7fda0b200640 1 --2- 172.21.15.37:0/4231770328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda0c103570 0x7fda0c1039e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009900 tx=0x7fd9fc02a480 comp rx=0 tx=0).stop 2024-09-21T05:43:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.430+0000 7fda0b200640 1 -- 172.21.15.37:0/4231770328 shutdown_connections 2024-09-21T05:43:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.430+0000 7fda0b200640 1 --2- 172.21.15.37:0/4231770328 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda0c104fa0 0x7fda0c10b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.430+0000 7fda0b200640 1 --2- 172.21.15.37:0/4231770328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda0c104600 0x7fda0c104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.430+0000 7fda0b200640 1 --2- 172.21.15.37:0/4231770328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda0c103570 0x7fda0c1039e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.430+0000 7fda0b200640 1 -- 172.21.15.37:0/4231770328 >> 172.21.15.37:0/4231770328 conn(0x7fda0c0feec0 msgr2=0x7fda0c101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.430+0000 7fda0b200640 1 -- 172.21.15.37:0/4231770328 shutdown_connections 2024-09-21T05:43:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.430+0000 7fda0b200640 1 -- 172.21.15.37:0/4231770328 wait complete. 2024-09-21T05:43:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.431+0000 7fda0b200640 1 Processor -- start 2024-09-21T05:43:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.431+0000 7fda0b200640 1 -- start start 2024-09-21T05:43:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.431+0000 7fda0b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda0c103570 0x7fda0c19c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.431+0000 7fda0b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda0c104600 0x7fda0c19c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.431+0000 7fda0b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda0c104fa0 0x7fda0c19d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.431+0000 7fda0b200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c10f210 con 0x7fda0c104600 2024-09-21T05:43:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.431+0000 7fda0b200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c10f090 con 0x7fda0c104fa0 2024-09-21T05:43:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.431+0000 7fda0b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c10f390 con 0x7fda0c103570 2024-09-21T05:43:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.432+0000 7fda0a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda0c104fa0 0x7fda0c19d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.432+0000 7fda09400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda0c104600 0x7fda0c19c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.432+0000 7fda09e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda0c103570 0x7fda0c19c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.432+0000 7fda0a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda0c104fa0 0x7fda0c19d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:58812/0 (socket says 172.21.15.37:58812) 2024-09-21T05:43:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.432+0000 7fda0a800640 1 -- 172.21.15.37:0/2408188494 learned_addr learned my addr 172.21.15.37:0/2408188494 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:43:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.432+0000 7fda09e00640 1 -- 172.21.15.37:0/2408188494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda0c104fa0 msgr2=0x7fda0c19d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.432+0000 7fda09e00640 1 --2- 172.21.15.37:0/2408188494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda0c104fa0 0x7fda0c19d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.432+0000 7fda09e00640 1 -- 172.21.15.37:0/2408188494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda0c104600 msgr2=0x7fda0c19c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.432+0000 7fda09e00640 1 --2- 172.21.15.37:0/2408188494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda0c104600 0x7fda0c19c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.432+0000 7fda09e00640 1 -- 172.21.15.37:0/2408188494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0c19daa0 con 0x7fda0c103570 2024-09-21T05:43:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.432+0000 7fda0a800640 1 --2- 172.21.15.37:0/2408188494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda0c104fa0 0x7fda0c19d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:43:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.432+0000 7fda09e00640 1 --2- 172.21.15.37:0/2408188494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda0c103570 0x7fda0c19c070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc02aa70 tx=0x7fd9fc003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.433+0000 7fda02a00640 1 -- 172.21.15.37:0/2408188494 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc03f070 con 0x7fda0c103570 2024-09-21T05:43:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.433+0000 7fda02a00640 1 -- 172.21.15.37:0/2408188494 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9fc031c50 con 0x7fda0c103570 2024-09-21T05:43:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.433+0000 7fda02a00640 1 -- 172.21.15.37:0/2408188494 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc035030 con 0x7fda0c103570 2024-09-21T05:43:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.433+0000 7fda0b200640 1 -- 172.21.15.37:0/2408188494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0c19dd30 con 0x7fda0c103570 2024-09-21T05:43:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.433+0000 7fda0b200640 1 -- 172.21.15.37:0/2408188494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda0c1a42c0 con 0x7fda0c103570 2024-09-21T05:43:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.434+0000 7fda0b200640 1 -- 172.21.15.37:0/2408188494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda0c1a45e0 con 0x7fda0c103570 2024-09-21T05:43:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.435+0000 7fda02a00640 1 -- 172.21.15.37:0/2408188494 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 15) ==== 103177+0+0 (secure 0 0 0) 0x7fd9fc042070 con 0x7fda0c103570 2024-09-21T05:43:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.436+0000 7fda02a00640 1 --2- 172.21.15.37:0/2408188494 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd9f007afd0 0x7fd9f007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:43:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.436+0000 7fda02a00640 1 -- 172.21.15.37:0/2408188494 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd9fc0bd460 con 0x7fda0c103570 2024-09-21T05:43:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.436+0000 7fda09400640 1 --2- 172.21.15.37:0/2408188494 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd9f007afd0 0x7fd9f007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:43:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.437+0000 7fda09400640 1 --2- 172.21.15.37:0/2408188494 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd9f007afd0 0x7fd9f007d4e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009bd0 tx=0x7fd9f8005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:43:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.441+0000 7fda02a00640 1 -- 172.21.15.37:0/2408188494 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9fc089ea0 con 0x7fda0c103570 2024-09-21T05:43:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.650+0000 7fda0b200640 1 -- 172.21.15.37:0/2408188494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fda0c1a47b0 con 0x7fda0c103570 2024-09-21T05:43:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.655+0000 7fda02a00640 1 -- 172.21.15.37:0/2408188494 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v16)=0 v16) ==== 120+0+0 (secure 0 0 0) 0x7fd9fc08ed50 con 0x7fda0c103570 2024-09-21T05:43:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.658+0000 7fda0b200640 1 -- 172.21.15.37:0/2408188494 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd9f007afd0 msgr2=0x7fd9f007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.658+0000 7fda0b200640 1 --2- 172.21.15.37:0/2408188494 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd9f007afd0 0x7fd9f007d4e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009bd0 tx=0x7fd9f8005f90 comp rx=0 tx=0).stop 2024-09-21T05:43:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.658+0000 7fda0b200640 1 -- 172.21.15.37:0/2408188494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda0c103570 msgr2=0x7fda0c19c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:43:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.658+0000 7fda0b200640 1 --2- 172.21.15.37:0/2408188494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda0c103570 0x7fda0c19c070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc02aa70 tx=0x7fd9fc003c10 comp rx=0 tx=0).stop 2024-09-21T05:43:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.658+0000 7fda0b200640 1 -- 172.21.15.37:0/2408188494 shutdown_connections 2024-09-21T05:43:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.658+0000 7fda0b200640 1 --2- 172.21.15.37:0/2408188494 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd9f007afd0 0x7fd9f007d4e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.658+0000 7fda0b200640 1 --2- 172.21.15.37:0/2408188494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda0c104fa0 0x7fda0c19d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.658+0000 7fda0b200640 1 --2- 172.21.15.37:0/2408188494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda0c104600 0x7fda0c19c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.658+0000 7fda0b200640 1 --2- 172.21.15.37:0/2408188494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda0c103570 0x7fda0c19c070 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:43:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.658+0000 7fda0b200640 1 -- 172.21.15.37:0/2408188494 >> 172.21.15.37:0/2408188494 conn(0x7fda0c0feec0 msgr2=0x7fda0c0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:43:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.658+0000 7fda0b200640 1 -- 172.21.15.37:0/2408188494 shutdown_connections 2024-09-21T05:43:58.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:54.658+0000 7fda0b200640 1 -- 172.21.15.37:0/2408188494 wait complete. 2024-09-21T05:43:58.710 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:59.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:43:59 smithi037 ceph-mon[30631]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:59.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:43:59 smithi144 ceph-mon[34351]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:43:59.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:43:59 smithi067 ceph-mon[34443]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.590+0000 7fd8e9200640 1 -- 172.21.15.37:0/467643240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e4106840 msgr2=0x7fd8e4106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.590+0000 7fd8e9200640 1 --2- 172.21.15.37:0/467643240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e4106840 0x7fd8e4106c50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009900 tx=0x7fd8d002a480 comp rx=0 tx=0).stop 2024-09-21T05:44:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.590+0000 7fd8e9200640 1 -- 172.21.15.37:0/467643240 shutdown_connections 2024-09-21T05:44:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.590+0000 7fd8e9200640 1 --2- 172.21.15.37:0/467643240 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8e41071e0 0x7fd8e410db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.590+0000 7fd8e9200640 1 --2- 172.21.15.37:0/467643240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e4106840 0x7fd8e4106c50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.590+0000 7fd8e9200640 1 --2- 172.21.15.37:0/467643240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e41057b0 0x7fd8e4105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.590+0000 7fd8e9200640 1 -- 172.21.15.37:0/467643240 >> 172.21.15.37:0/467643240 conn(0x7fd8e4101120 msgr2=0x7fd8e41035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.590+0000 7fd8e9200640 1 -- 172.21.15.37:0/467643240 shutdown_connections 2024-09-21T05:44:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.590+0000 7fd8e9200640 1 -- 172.21.15.37:0/467643240 wait complete. 2024-09-21T05:44:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.592+0000 7fd8e9200640 1 Processor -- start 2024-09-21T05:44:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.592+0000 7fd8e9200640 1 -- start start 2024-09-21T05:44:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.592+0000 7fd8e9200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8e41057b0 0x7fd8e419c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.592+0000 7fd8e9200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e4106840 0x7fd8e419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.592+0000 7fd8e9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e41071e0 0x7fd8e419d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.592+0000 7fd8e9200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e4111400 con 0x7fd8e4106840 2024-09-21T05:44:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.592+0000 7fd8e9200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e4111280 con 0x7fd8e41057b0 2024-09-21T05:44:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.592+0000 7fd8e9200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e4111580 con 0x7fd8e41071e0 2024-09-21T05:44:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.593+0000 7fd8e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e4106840 0x7fd8e419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.593+0000 7fd8e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e4106840 0x7fd8e419c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60556/0 (socket says 172.21.15.37:60556) 2024-09-21T05:44:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.593+0000 7fd8e2a00640 1 -- 172.21.15.37:0/1152143865 learned_addr learned my addr 172.21.15.37:0/1152143865 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.593+0000 7fd8e3400640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8e41057b0 0x7fd8e419c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.593+0000 7fd8e3e00640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e41071e0 0x7fd8e419d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.593+0000 7fd8e2a00640 1 -- 172.21.15.37:0/1152143865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e41071e0 msgr2=0x7fd8e419d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.593+0000 7fd8e2a00640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e41071e0 0x7fd8e419d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.593+0000 7fd8e2a00640 1 -- 172.21.15.37:0/1152143865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8e41057b0 msgr2=0x7fd8e419c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.593+0000 7fd8e2a00640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8e41057b0 0x7fd8e419c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.593+0000 7fd8e2a00640 1 -- 172.21.15.37:0/1152143865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e419daa0 con 0x7fd8e4106840 2024-09-21T05:44:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.593+0000 7fd8e2a00640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e4106840 0x7fd8e419c6e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0006010 tx=0x7fd8d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.594+0000 7fd8dbe00640 1 -- 172.21.15.37:0/1152143865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d003f030 con 0x7fd8e4106840 2024-09-21T05:44:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.594+0000 7fd8dbe00640 1 -- 172.21.15.37:0/1152143865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8d0031910 con 0x7fd8e4106840 2024-09-21T05:44:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.594+0000 7fd8dbe00640 1 -- 172.21.15.37:0/1152143865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0035070 con 0x7fd8e4106840 2024-09-21T05:44:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.594+0000 7fd8e9200640 1 -- 172.21.15.37:0/1152143865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e419dd30 con 0x7fd8e4106840 2024-09-21T05:44:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.594+0000 7fd8e9200640 1 -- 172.21.15.37:0/1152143865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e41a42c0 con 0x7fd8e4106840 2024-09-21T05:44:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.595+0000 7fd8e9200640 1 -- 172.21.15.37:0/1152143865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e410c990 con 0x7fd8e4106840 2024-09-21T05:44:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.598+0000 7fd8dbe00640 1 -- 172.21.15.37:0/1152143865 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fd8d0042030 con 0x7fd8e4106840 2024-09-21T05:44:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.601+0000 7fd8dbe00640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd8c80b6480 0x7fd8c80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.601+0000 7fd8dbe00640 1 -- 172.21.15.37:0/1152143865 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd8d0106280 con 0x7fd8e4106840 2024-09-21T05:44:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.601+0000 7fd8e3400640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd8c80b6480 0x7fd8c80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.602+0000 7fd8e3400640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd8c80b6480 0x7fd8c80b8990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009bd0 tx=0x7fd8d4005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.604+0000 7fd8dbe00640 1 -- 172.21.15.37:0/1152143865 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8d00ce740 con 0x7fd8e4106840 2024-09-21T05:44:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.826+0000 7fd8e9200640 1 -- 172.21.15.37:0/1152143865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fd8e402e640 con 0x7fd8e4106840 2024-09-21T05:44:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.827+0000 7fd8dbe00640 1 -- 172.21.15.37:0/1152143865 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v19)=0 v19) ==== 108+0+0 (secure 0 0 0) 0x7fd8d00d2b20 con 0x7fd8e4106840 2024-09-21T05:44:00.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.829+0000 7fd8e9200640 1 -- 172.21.15.37:0/1152143865 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd8c80b6480 msgr2=0x7fd8c80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.829+0000 7fd8e9200640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd8c80b6480 0x7fd8c80b8990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009bd0 tx=0x7fd8d4005f90 comp rx=0 tx=0).stop 2024-09-21T05:44:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.829+0000 7fd8e9200640 1 -- 172.21.15.37:0/1152143865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e4106840 msgr2=0x7fd8e419c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.829+0000 7fd8e9200640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e4106840 0x7fd8e419c6e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0006010 tx=0x7fd8d00042f0 comp rx=0 tx=0).stop 2024-09-21T05:44:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.829+0000 7fd8e9200640 1 -- 172.21.15.37:0/1152143865 shutdown_connections 2024-09-21T05:44:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.829+0000 7fd8e9200640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8e41071e0 0x7fd8e419d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.829+0000 7fd8e9200640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e4106840 0x7fd8e419c6e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.829+0000 7fd8e9200640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd8c80b6480 0x7fd8c80b8990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.829+0000 7fd8e9200640 1 --2- 172.21.15.37:0/1152143865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8e41057b0 0x7fd8e419c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.829+0000 7fd8e9200640 1 -- 172.21.15.37:0/1152143865 >> 172.21.15.37:0/1152143865 conn(0x7fd8e4101120 msgr2=0x7fd8e4109b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.830+0000 7fd8e9200640 1 -- 172.21.15.37:0/1152143865 shutdown_connections 2024-09-21T05:44:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.830+0000 7fd8e9200640 1 -- 172.21.15.37:0/1152143865 wait complete. 2024-09-21T05:44:01.092 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:01.094 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:01.096 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:01.099 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:01.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:01 smithi037 ceph-mon[30631]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:01.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:01 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1488566300' entity='client.admin' 2024-09-21T05:44:01.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:01 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3617542426' entity='client.admin' 2024-09-21T05:44:01.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:01 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/311657063' entity='client.admin' 2024-09-21T05:44:01.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:01 smithi067 ceph-mon[34443]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:01.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:01 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1488566300' entity='client.admin' 2024-09-21T05:44:01.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:01 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3617542426' entity='client.admin' 2024-09-21T05:44:01.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:01 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/311657063' entity='client.admin' 2024-09-21T05:44:01.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:01 smithi144 ceph-mon[34351]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:01.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:01 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1488566300' entity='client.admin' 2024-09-21T05:44:01.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:01 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3617542426' entity='client.admin' 2024-09-21T05:44:01.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:01 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/311657063' entity='client.admin' 2024-09-21T05:44:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.884+0000 7f71d0000640 1 -- 172.21.15.37:0/747339593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71c80770e0 msgr2=0x7f71c80757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.884+0000 7f71d0000640 1 --2- 172.21.15.37:0/747339593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71c80770e0 0x7f71c80757b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009900 tx=0x7f71bc02a3f0 comp rx=0 tx=0).stop 2024-09-21T05:44:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.884+0000 7f71d0000640 1 -- 172.21.15.37:0/747339593 shutdown_connections 2024-09-21T05:44:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.884+0000 7f71d0000640 1 --2- 172.21.15.37:0/747339593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c810b700 0x7f71c810dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.884+0000 7f71d0000640 1 --2- 172.21.15.37:0/747339593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71c8075cf0 0x7f71c8076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.884+0000 7f71d0000640 1 --2- 172.21.15.37:0/747339593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71c80770e0 0x7f71c80757b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.884+0000 7f71d0000640 1 -- 172.21.15.37:0/747339593 >> 172.21.15.37:0/747339593 conn(0x7f71c80ff0b0 msgr2=0x7f71c8101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.885+0000 7f71d0000640 1 -- 172.21.15.37:0/747339593 shutdown_connections 2024-09-21T05:44:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.885+0000 7f71d0000640 1 -- 172.21.15.37:0/747339593 wait complete. 2024-09-21T05:44:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.886+0000 7f71d0000640 1 Processor -- start 2024-09-21T05:44:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.886+0000 7f71d0000640 1 -- start start 2024-09-21T05:44:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71d0000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71c8075cf0 0x7f71c81a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71d0000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71c80770e0 0x7f71c81a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71d0000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c810b700 0x7f71c81a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71d0000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f71c81115e0 con 0x7f71c80770e0 2024-09-21T05:44:01.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71d0000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f71c8111460 con 0x7f71c8075cf0 2024-09-21T05:44:01.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71d0000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f71c8111760 con 0x7f71c810b700 2024-09-21T05:44:01.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71cd600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71c8075cf0 0x7f71c81a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:01.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71cd600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71c8075cf0 0x7f71c81a0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:48986/0 (socket says 172.21.15.37:48986) 2024-09-21T05:44:01.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71cd600640 1 -- 172.21.15.37:0/289912046 learned_addr learned my addr 172.21.15.37:0/289912046 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:01.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71ccc00640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71c80770e0 0x7f71c81a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:01.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71ce000640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c810b700 0x7f71c81a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71cd600640 1 -- 172.21.15.37:0/289912046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c810b700 msgr2=0x7f71c81a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71cd600640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c810b700 0x7f71c81a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71cd600640 1 -- 172.21.15.37:0/289912046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71c80770e0 msgr2=0x7f71c81a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71cd600640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71c80770e0 0x7f71c81a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.887+0000 7f71cd600640 1 -- 172.21.15.37:0/289912046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c81a1fa0 con 0x7f71c8075cf0 2024-09-21T05:44:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.888+0000 7f71cd600640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71c8075cf0 0x7f71c81a0570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f71bc031440 tx=0x7f71bc003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.888+0000 7f71c6000640 1 -- 172.21.15.37:0/289912046 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc03f070 con 0x7f71c8075cf0 2024-09-21T05:44:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.888+0000 7f71c6000640 1 -- 172.21.15.37:0/289912046 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71bc031c50 con 0x7f71c8075cf0 2024-09-21T05:44:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.888+0000 7f71c6000640 1 -- 172.21.15.37:0/289912046 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc035030 con 0x7f71c8075cf0 2024-09-21T05:44:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.888+0000 7f71d0000640 1 -- 172.21.15.37:0/289912046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c81a2230 con 0x7f71c8075cf0 2024-09-21T05:44:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.888+0000 7f71d0000640 1 -- 172.21.15.37:0/289912046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c81a87c0 con 0x7f71c8075cf0 2024-09-21T05:44:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.889+0000 7f71d0000640 1 -- 172.21.15.37:0/289912046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c8106100 con 0x7f71c8075cf0 2024-09-21T05:44:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.892+0000 7f71c6000640 1 -- 172.21.15.37:0/289912046 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f71bc042070 con 0x7f71c8075cf0 2024-09-21T05:44:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.893+0000 7f71c6000640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f71b00b6580 0x7f71b00b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.894+0000 7f71c6000640 1 -- 172.21.15.37:0/289912046 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f71bc1061b0 con 0x7f71c8075cf0 2024-09-21T05:44:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.894+0000 7f71ccc00640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f71b00b6580 0x7f71b00b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.895+0000 7f71ccc00640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f71b00b6580 0x7f71b00b8a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009bd0 tx=0x7f71b4005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.895+0000 7f71c6000640 1 -- 172.21.15.37:0/289912046 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71bc0d2a50 con 0x7f71c8075cf0 2024-09-21T05:44:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.094+0000 7f71d0000640 1 -- 172.21.15.37:0/289912046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f71c802e640 con 0x7f71c8075cf0 2024-09-21T05:44:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.100+0000 7f71c6000640 1 -- 172.21.15.37:0/289912046 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7f71bc0d7990 con 0x7f71c8075cf0 2024-09-21T05:44:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.102+0000 7f71d0000640 1 -- 172.21.15.37:0/289912046 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f71b00b6580 msgr2=0x7f71b00b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.102+0000 7f71d0000640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f71b00b6580 0x7f71b00b8a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009bd0 tx=0x7f71b4005f90 comp rx=0 tx=0).stop 2024-09-21T05:44:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.102+0000 7f71d0000640 1 -- 172.21.15.37:0/289912046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71c8075cf0 msgr2=0x7f71c81a0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.102+0000 7f71d0000640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71c8075cf0 0x7f71c81a0570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f71bc031440 tx=0x7f71bc003c10 comp rx=0 tx=0).stop 2024-09-21T05:44:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.102+0000 7f71d0000640 1 -- 172.21.15.37:0/289912046 shutdown_connections 2024-09-21T05:44:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.102+0000 7f71d0000640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71c810b700 0x7f71c81a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.102+0000 7f71d0000640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71c80770e0 0x7f71c81a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.102+0000 7f71d0000640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f71b00b6580 0x7f71b00b8a90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.102+0000 7f71d0000640 1 --2- 172.21.15.37:0/289912046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71c8075cf0 0x7f71c81a0570 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.102+0000 7f71d0000640 1 -- 172.21.15.37:0/289912046 >> 172.21.15.37:0/289912046 conn(0x7f71c80ff0b0 msgr2=0x7f71c81032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.103+0000 7f71d0000640 1 -- 172.21.15.37:0/289912046 shutdown_connections 2024-09-21T05:44:02.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:02.103+0000 7f71d0000640 1 -- 172.21.15.37:0/289912046 wait complete. 2024-09-21T05:44:02.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.041+0000 7feeed000640 1 -- 172.21.15.37:0/1869215821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee81035b0 msgr2=0x7feee8103a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:02.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.041+0000 7feeed000640 1 --2- 172.21.15.37:0/1869215821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee81035b0 0x7feee8103a20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feed8009900 tx=0x7feed802a480 comp rx=0 tx=0).stop 2024-09-21T05:44:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.041+0000 7feeed000640 1 -- 172.21.15.37:0/1869215821 shutdown_connections 2024-09-21T05:44:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.041+0000 7feeed000640 1 --2- 172.21.15.37:0/1869215821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feee8104fe0 0x7feee810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.041+0000 7feeed000640 1 --2- 172.21.15.37:0/1869215821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feee8104640 0x7feee8104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.041+0000 7feeed000640 1 --2- 172.21.15.37:0/1869215821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee81035b0 0x7feee8103a20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.041+0000 7feeed000640 1 -- 172.21.15.37:0/1869215821 >> 172.21.15.37:0/1869215821 conn(0x7feee80fef20 msgr2=0x7feee81013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.041+0000 7feeed000640 1 -- 172.21.15.37:0/1869215821 shutdown_connections 2024-09-21T05:44:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.042+0000 7feeed000640 1 -- 172.21.15.37:0/1869215821 wait complete. 2024-09-21T05:44:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.043+0000 7feeed000640 1 Processor -- start 2024-09-21T05:44:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.043+0000 7feeed000640 1 -- start start 2024-09-21T05:44:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.043+0000 7feeed000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feee81035b0 0x7feee8076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.043+0000 7feeed000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8104640 0x7feee8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.043+0000 7feeed000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feee8104fe0 0x7feee8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.043+0000 7feeed000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feee810f220 con 0x7feee8104640 2024-09-21T05:44:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.043+0000 7feeed000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feee810f0a0 con 0x7feee8104fe0 2024-09-21T05:44:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.043+0000 7feeed000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feee810f3a0 con 0x7feee81035b0 2024-09-21T05:44:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.043+0000 7feedfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8104640 0x7feee8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.043+0000 7feedfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8104640 0x7feee8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34230/0 (socket says 172.21.15.37:34230) 2024-09-21T05:44:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.043+0000 7feedfe00640 1 -- 172.21.15.37:0/311657063 learned_addr learned my addr 172.21.15.37:0/311657063 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.044+0000 7feee7400640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feee81035b0 0x7feee8076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.044+0000 7feee7e00640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feee8104fe0 0x7feee8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.044+0000 7feedfe00640 1 -- 172.21.15.37:0/311657063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feee81035b0 msgr2=0x7feee8076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.044+0000 7feedfe00640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feee81035b0 0x7feee8076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.044+0000 7feedfe00640 1 -- 172.21.15.37:0/311657063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feee8104fe0 msgr2=0x7feee8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.044+0000 7feedfe00640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feee8104fe0 0x7feee8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.044+0000 7feedfe00640 1 -- 172.21.15.37:0/311657063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee8076350 con 0x7feee8104640 2024-09-21T05:44:02.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.044+0000 7feedfe00640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8104640 0x7feee8075710 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feed000e9f0 tx=0x7feed000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:02.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.044+0000 7feee4c00640 1 -- 172.21.15.37:0/311657063 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed000cd80 con 0x7feee8104640 2024-09-21T05:44:02.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.044+0000 7feee4c00640 1 -- 172.21.15.37:0/311657063 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feed00108e0 con 0x7feee8104640 2024-09-21T05:44:02.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.045+0000 7feeed000640 1 -- 172.21.15.37:0/311657063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee81a3eb0 con 0x7feee8104640 2024-09-21T05:44:02.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.045+0000 7feee4c00640 1 -- 172.21.15.37:0/311657063 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0018980 con 0x7feee8104640 2024-09-21T05:44:02.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.045+0000 7feeed000640 1 -- 172.21.15.37:0/311657063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee81a4250 con 0x7feee8104640 2024-09-21T05:44:02.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.046+0000 7feeed000640 1 -- 172.21.15.37:0/311657063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee8103a20 con 0x7feee8104640 2024-09-21T05:44:02.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.048+0000 7feee4c00640 1 -- 172.21.15.37:0/311657063 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7feed0010430 con 0x7feee8104640 2024-09-21T05:44:02.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.050+0000 7feee4c00640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7feecc0b6480 0x7feecc0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:02.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.051+0000 7feee4c00640 1 -- 172.21.15.37:0/311657063 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7feed00e5e70 con 0x7feee8104640 2024-09-21T05:44:02.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.051+0000 7feee7400640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7feecc0b6480 0x7feecc0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:02.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.051+0000 7feee7400640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7feecc0b6480 0x7feecc0b8990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feed8004770 tx=0x7feed80314a0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:02.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.051+0000 7feee4c00640 1 -- 172.21.15.37:0/311657063 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feed00b2710 con 0x7feee8104640 2024-09-21T05:44:02.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.291+0000 7feeed000640 1 -- 172.21.15.37:0/311657063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7feee810a790 con 0x7feee8104640 2024-09-21T05:44:02.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.296+0000 7feee4c00640 1 -- 172.21.15.37:0/311657063 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v22)=0 v22) ==== 115+0+0 (secure 0 0 0) 0x7feee810a790 con 0x7feee8104640 2024-09-21T05:44:02.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.298+0000 7feeed000640 1 -- 172.21.15.37:0/311657063 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7feecc0b6480 msgr2=0x7feecc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:02.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.298+0000 7feeed000640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7feecc0b6480 0x7feecc0b8990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feed8004770 tx=0x7feed80314a0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.298+0000 7feeed000640 1 -- 172.21.15.37:0/311657063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8104640 msgr2=0x7feee8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:02.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.298+0000 7feeed000640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8104640 0x7feee8075710 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feed000e9f0 tx=0x7feed000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.298+0000 7feeed000640 1 -- 172.21.15.37:0/311657063 shutdown_connections 2024-09-21T05:44:02.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.298+0000 7feeed000640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7feecc0b6480 0x7feecc0b8990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.298+0000 7feeed000640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feee8104fe0 0x7feee8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.298+0000 7feeed000640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8104640 0x7feee8075710 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.298+0000 7feeed000640 1 --2- 172.21.15.37:0/311657063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feee81035b0 0x7feee8076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:02.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.298+0000 7feeed000640 1 -- 172.21.15.37:0/311657063 >> 172.21.15.37:0/311657063 conn(0x7feee80fef20 msgr2=0x7feee8107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:02.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.298+0000 7feeed000640 1 -- 172.21.15.37:0/311657063 shutdown_connections 2024-09-21T05:44:02.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.299+0000 7feeed000640 1 -- 172.21.15.37:0/311657063 wait complete. 2024-09-21T05:44:02.944 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:02 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:44:02.944 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:02 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:44:03.061 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:02 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:44:03.061 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:02 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:44:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.207+0000 7fc6ce000640 1 -- 172.21.15.37:0/2029980795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6c8104600 msgr2=0x7fc6c8104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.207+0000 7fc6ce000640 1 --2- 172.21.15.37:0/2029980795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6c8104600 0x7fc6c8104a10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009900 tx=0x7fc6b402a480 comp rx=0 tx=0).stop 2024-09-21T05:44:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.207+0000 7fc6ce000640 1 -- 172.21.15.37:0/2029980795 shutdown_connections 2024-09-21T05:44:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.207+0000 7fc6ce000640 1 --2- 172.21.15.37:0/2029980795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c8104fa0 0x7fc6c810b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.207+0000 7fc6ce000640 1 --2- 172.21.15.37:0/2029980795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6c8104600 0x7fc6c8104a10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.207+0000 7fc6ce000640 1 --2- 172.21.15.37:0/2029980795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c8103570 0x7fc6c81039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.207+0000 7fc6ce000640 1 -- 172.21.15.37:0/2029980795 >> 172.21.15.37:0/2029980795 conn(0x7fc6c80feec0 msgr2=0x7fc6c8101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.207+0000 7fc6ce000640 1 -- 172.21.15.37:0/2029980795 shutdown_connections 2024-09-21T05:44:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.207+0000 7fc6ce000640 1 -- 172.21.15.37:0/2029980795 wait complete. 2024-09-21T05:44:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.209+0000 7fc6ce000640 1 Processor -- start 2024-09-21T05:44:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.209+0000 7fc6ce000640 1 -- start start 2024-09-21T05:44:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.209+0000 7fc6ce000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c8103570 0x7fc6c8076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.209+0000 7fc6ce000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6c8104600 0x7fc6c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.209+0000 7fc6ce000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c8104fa0 0x7fc6c8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.209+0000 7fc6ce000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810f1c0 con 0x7fc6c8103570 2024-09-21T05:44:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.209+0000 7fc6ce000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810f040 con 0x7fc6c8104600 2024-09-21T05:44:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.209+0000 7fc6ce000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810f340 con 0x7fc6c8104fa0 2024-09-21T05:44:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.209+0000 7fc6ccc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c8103570 0x7fc6c8076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.209+0000 7fc6ccc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c8103570 0x7fc6c8076e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60606/0 (socket says 172.21.15.37:60606) 2024-09-21T05:44:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.210+0000 7fc6ccc00640 1 -- 172.21.15.37:0/1488566300 learned_addr learned my addr 172.21.15.37:0/1488566300 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.210+0000 7fc6c7e00640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6c8104600 0x7fc6c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.210+0000 7fc6cd600640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c8104fa0 0x7fc6c8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.210+0000 7fc6ccc00640 1 -- 172.21.15.37:0/1488566300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c8104fa0 msgr2=0x7fc6c8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.210+0000 7fc6ccc00640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c8104fa0 0x7fc6c8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.210+0000 7fc6ccc00640 1 -- 172.21.15.37:0/1488566300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6c8104600 msgr2=0x7fc6c8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.210+0000 7fc6ccc00640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6c8104600 0x7fc6c8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.210+0000 7fc6ccc00640 1 -- 172.21.15.37:0/1488566300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c8076350 con 0x7fc6c8103570 2024-09-21T05:44:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.210+0000 7fc6c7e00640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6c8104600 0x7fc6c8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:44:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.210+0000 7fc6ccc00640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c8103570 0x7fc6c8076e40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00e9f0 tx=0x7fc6bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.211+0000 7fc6c5600640 1 -- 172.21.15.37:0/1488566300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc00cd80 con 0x7fc6c8103570 2024-09-21T05:44:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.211+0000 7fc6c5600640 1 -- 172.21.15.37:0/1488566300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6bc0108e0 con 0x7fc6c8103570 2024-09-21T05:44:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.211+0000 7fc6ce000640 1 -- 172.21.15.37:0/1488566300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c81a3e80 con 0x7fc6c8103570 2024-09-21T05:44:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.211+0000 7fc6c5600640 1 -- 172.21.15.37:0/1488566300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc018980 con 0x7fc6c8103570 2024-09-21T05:44:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.211+0000 7fc6ce000640 1 -- 172.21.15.37:0/1488566300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c81a4270 con 0x7fc6c8103570 2024-09-21T05:44:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.212+0000 7fc6ce000640 1 -- 172.21.15.37:0/1488566300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c81039e0 con 0x7fc6c8103570 2024-09-21T05:44:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.215+0000 7fc6c5600640 1 -- 172.21.15.37:0/1488566300 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fc6bc010430 con 0x7fc6c8103570 2024-09-21T05:44:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.217+0000 7fc6c5600640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc6b00b6500 0x7fc6b00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.217+0000 7fc6c5600640 1 -- 172.21.15.37:0/1488566300 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc6bc0e5940 con 0x7fc6c8103570 2024-09-21T05:44:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.217+0000 7fc6c7e00640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc6b00b6500 0x7fc6b00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.218+0000 7fc6c7e00640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc6b00b6500 0x7fc6b00b8a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4000c00 tx=0x7fc6b4031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.221+0000 7fc6c5600640 1 -- 172.21.15.37:0/1488566300 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc6bc0b21e0 con 0x7fc6c8103570 2024-09-21T05:44:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.438+0000 7fc6ce000640 1 -- 172.21.15.37:0/1488566300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fc6c8063fc0 con 0x7fc6c8103570 2024-09-21T05:44:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.443+0000 7fc6c5600640 1 -- 172.21.15.37:0/1488566300 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7fc6bc0b7120 con 0x7fc6c8103570 2024-09-21T05:44:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.446+0000 7fc6ce000640 1 -- 172.21.15.37:0/1488566300 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc6b00b6500 msgr2=0x7fc6b00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.446+0000 7fc6ce000640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc6b00b6500 0x7fc6b00b8a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4000c00 tx=0x7fc6b4031400 comp rx=0 tx=0).stop 2024-09-21T05:44:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.446+0000 7fc6ce000640 1 -- 172.21.15.37:0/1488566300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c8103570 msgr2=0x7fc6c8076e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.446+0000 7fc6ce000640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c8103570 0x7fc6c8076e40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00e9f0 tx=0x7fc6bc00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.447+0000 7fc6ce000640 1 -- 172.21.15.37:0/1488566300 shutdown_connections 2024-09-21T05:44:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.447+0000 7fc6ce000640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c8104fa0 0x7fc6c8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.447+0000 7fc6ce000640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc6b00b6500 0x7fc6b00b8a10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.447+0000 7fc6ce000640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6c8104600 0x7fc6c8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.447+0000 7fc6ce000640 1 --2- 172.21.15.37:0/1488566300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6c8103570 0x7fc6c8076e40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.447+0000 7fc6ce000640 1 -- 172.21.15.37:0/1488566300 >> 172.21.15.37:0/1488566300 conn(0x7fc6c80feec0 msgr2=0x7fc6c8107900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.447+0000 7fc6ce000640 1 -- 172.21.15.37:0/1488566300 shutdown_connections 2024-09-21T05:44:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.447+0000 7fc6ce000640 1 -- 172.21.15.37:0/1488566300 wait complete. 2024-09-21T05:44:03.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:02 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:44:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:02 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:44:03.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.309+0000 7f863ee00640 1 -- 172.21.15.37:0/3810639653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86380770e0 msgr2=0x7f86380757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:03.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.309+0000 7f863ee00640 1 --2- 172.21.15.37:0/3810639653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86380770e0 0x7f86380757b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f862c009860 tx=0x7f862c02a340 comp rx=0 tx=0).stop 2024-09-21T05:44:03.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.309+0000 7f863ee00640 1 -- 172.21.15.37:0/3810639653 shutdown_connections 2024-09-21T05:44:03.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.309+0000 7f863ee00640 1 --2- 172.21.15.37:0/3810639653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f863810b510 0x7f863810d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.309+0000 7f863ee00640 1 --2- 172.21.15.37:0/3810639653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8638075cf0 0x7f8638076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.309+0000 7f863ee00640 1 --2- 172.21.15.37:0/3810639653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86380770e0 0x7f86380757b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.309+0000 7f863ee00640 1 -- 172.21.15.37:0/3810639653 >> 172.21.15.37:0/3810639653 conn(0x7f86380feec0 msgr2=0x7f8638101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.309+0000 7f863ee00640 1 -- 172.21.15.37:0/3810639653 shutdown_connections 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.309+0000 7f863ee00640 1 -- 172.21.15.37:0/3810639653 wait complete. 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.310+0000 7f863ee00640 1 Processor -- start 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.310+0000 7f863ee00640 1 -- start start 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.310+0000 7f863ee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8638075cf0 0x7f863819bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.310+0000 7f863ee00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86380770e0 0x7f863819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.310+0000 7f863ee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f863810b510 0x7f863819d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.310+0000 7f863ee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8638111380 con 0x7f8638075cf0 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.310+0000 7f863ee00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8638111200 con 0x7f86380770e0 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.310+0000 7f863ee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8638111500 con 0x7f863810b510 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.311+0000 7f863da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8638075cf0 0x7f863819bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:03.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.311+0000 7f863d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86380770e0 0x7f863819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.311+0000 7f863da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8638075cf0 0x7f863819bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60634/0 (socket says 172.21.15.37:60634) 2024-09-21T05:44:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.311+0000 7f863d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86380770e0 0x7f863819c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:58948/0 (socket says 172.21.15.37:58948) 2024-09-21T05:44:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.311+0000 7f863da00640 1 -- 172.21.15.37:0/3617542426 learned_addr learned my addr 172.21.15.37:0/3617542426 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.311+0000 7f863e400640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f863810b510 0x7f863819d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.311+0000 7f863da00640 1 -- 172.21.15.37:0/3617542426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f863810b510 msgr2=0x7f863819d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.311+0000 7f863da00640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f863810b510 0x7f863819d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.311+0000 7f863da00640 1 -- 172.21.15.37:0/3617542426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86380770e0 msgr2=0x7f863819c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.311+0000 7f863da00640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86380770e0 0x7f863819c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.311+0000 7f863da00640 1 -- 172.21.15.37:0/3617542426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863819da00 con 0x7f8638075cf0 2024-09-21T05:44:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.311+0000 7f863e400640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f863810b510 0x7f863819d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:44:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.311+0000 7f863d000640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86380770e0 0x7f863819c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:44:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.312+0000 7f863da00640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8638075cf0 0x7f863819bfd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f862c032d50 tx=0x7f862c032d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:03.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.312+0000 7f8636000640 1 -- 172.21.15.37:0/3617542426 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c037040 con 0x7f8638075cf0 2024-09-21T05:44:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.312+0000 7f863ee00640 1 -- 172.21.15.37:0/3617542426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863819dc90 con 0x7f8638075cf0 2024-09-21T05:44:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.312+0000 7f8636000640 1 -- 172.21.15.37:0/3617542426 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f862c030c90 con 0x7f8638075cf0 2024-09-21T05:44:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.312+0000 7f8636000640 1 -- 172.21.15.37:0/3617542426 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c003850 con 0x7f8638075cf0 2024-09-21T05:44:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.312+0000 7f863ee00640 1 -- 172.21.15.37:0/3617542426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86381a4220 con 0x7f8638075cf0 2024-09-21T05:44:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.313+0000 7f863ee00640 1 -- 172.21.15.37:0/3617542426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863810a320 con 0x7f8638075cf0 2024-09-21T05:44:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.316+0000 7f8636000640 1 -- 172.21.15.37:0/3617542426 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f862c043020 con 0x7f8638075cf0 2024-09-21T05:44:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.317+0000 7f8636000640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f86200b6500 0x7f86200b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.317+0000 7f8636000640 1 -- 172.21.15.37:0/3617542426 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f862c104a10 con 0x7f8638075cf0 2024-09-21T05:44:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.317+0000 7f863d000640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f86200b6500 0x7f86200b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.320+0000 7f863d000640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f86200b6500 0x7f86200b8a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f86240058c0 tx=0x7f862400a2d0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.323+0000 7f8636000640 1 -- 172.21.15.37:0/3617542426 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f862c0cced0 con 0x7f8638075cf0 2024-09-21T05:44:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.557+0000 7f863ee00640 1 -- 172.21.15.37:0/3617542426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f863802e640 con 0x7f8638075cf0 2024-09-21T05:44:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.561+0000 7f8636000640 1 -- 172.21.15.37:0/3617542426 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v21)=0 v21) ==== 106+0+0 (secure 0 0 0) 0x7f862c0d12b0 con 0x7f8638075cf0 2024-09-21T05:44:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.564+0000 7f863ee00640 1 -- 172.21.15.37:0/3617542426 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f86200b6500 msgr2=0x7f86200b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.564+0000 7f863ee00640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f86200b6500 0x7f86200b8a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f86240058c0 tx=0x7f862400a2d0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.564+0000 7f863ee00640 1 -- 172.21.15.37:0/3617542426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8638075cf0 msgr2=0x7f863819bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.564+0000 7f863ee00640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8638075cf0 0x7f863819bfd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f862c032d50 tx=0x7f862c032d80 comp rx=0 tx=0).stop 2024-09-21T05:44:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.564+0000 7f863ee00640 1 -- 172.21.15.37:0/3617542426 shutdown_connections 2024-09-21T05:44:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.564+0000 7f863ee00640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f863810b510 0x7f863819d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.564+0000 7f863ee00640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f86200b6500 0x7f86200b8a10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.564+0000 7f863ee00640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f86380770e0 0x7f863819c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.564+0000 7f863ee00640 1 --2- 172.21.15.37:0/3617542426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8638075cf0 0x7f863819bfd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.564+0000 7f863ee00640 1 -- 172.21.15.37:0/3617542426 >> 172.21.15.37:0/3617542426 conn(0x7f86380feec0 msgr2=0x7f86381074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.564+0000 7f863ee00640 1 -- 172.21.15.37:0/3617542426 shutdown_connections 2024-09-21T05:44:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:00.564+0000 7f863ee00640 1 -- 172.21.15.37:0/3617542426 wait complete. 2024-09-21T05:44:03.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:03 smithi037 ceph-mon[30631]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:03.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:03 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/378630558' entity='client.admin' 2024-09-21T05:44:04.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:03 smithi144 ceph-mon[34351]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:04.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:03 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/378630558' entity='client.admin' 2024-09-21T05:44:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:03 smithi067 ceph-mon[34443]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:04.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:03 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/378630558' entity='client.admin' 2024-09-21T05:44:04.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.240+0000 7ff177a00640 1 -- 172.21.15.37:0/3179815063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170105970 msgr2=0x7ff170105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.240+0000 7ff177a00640 1 --2- 172.21.15.37:0/3179815063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170105970 0x7ff170105de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff164009900 tx=0x7ff16402a480 comp rx=0 tx=0).stop 2024-09-21T05:44:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.240+0000 7ff177a00640 1 -- 172.21.15.37:0/3179815063 shutdown_connections 2024-09-21T05:44:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.240+0000 7ff177a00640 1 --2- 172.21.15.37:0/3179815063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1701073a0 0x7ff17010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.240+0000 7ff177a00640 1 --2- 172.21.15.37:0/3179815063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff170106a00 0x7ff170106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.240+0000 7ff177a00640 1 --2- 172.21.15.37:0/3179815063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170105970 0x7ff170105de0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.240+0000 7ff177a00640 1 -- 172.21.15.37:0/3179815063 >> 172.21.15.37:0/3179815063 conn(0x7ff1701012c0 msgr2=0x7ff170103790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.240+0000 7ff177a00640 1 -- 172.21.15.37:0/3179815063 shutdown_connections 2024-09-21T05:44:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.240+0000 7ff177a00640 1 -- 172.21.15.37:0/3179815063 wait complete. 2024-09-21T05:44:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.241+0000 7ff177a00640 1 Processor -- start 2024-09-21T05:44:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.241+0000 7ff177a00640 1 -- start start 2024-09-21T05:44:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff177a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff170105970 0x7ff17019c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff177a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170106a00 0x7ff17019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff177a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1701073a0 0x7ff17019d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:04.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff177a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff170111590 con 0x7ff170106a00 2024-09-21T05:44:04.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff177a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff170111410 con 0x7ff1701073a0 2024-09-21T05:44:04.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff177a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff170111710 con 0x7ff170105970 2024-09-21T05:44:04.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff16fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170106a00 0x7ff17019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:04.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff175000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff170105970 0x7ff17019c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:04.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff16fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170106a00 0x7ff17019c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34288/0 (socket says 172.21.15.37:34288) 2024-09-21T05:44:04.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff16fe00640 1 -- 172.21.15.37:0/378630558 learned_addr learned my addr 172.21.15.37:0/378630558 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:04.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff175a00640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1701073a0 0x7ff17019d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:04.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff175000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff170105970 0x7ff17019c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:33786/0 (socket says 172.21.15.37:33786) 2024-09-21T05:44:04.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff16fe00640 1 -- 172.21.15.37:0/378630558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff170105970 msgr2=0x7ff17019c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:04.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff16fe00640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff170105970 0x7ff17019c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff16fe00640 1 -- 172.21.15.37:0/378630558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1701073a0 msgr2=0x7ff17019d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff16fe00640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1701073a0 0x7ff17019d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff16fe00640 1 -- 172.21.15.37:0/378630558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17019dbe0 con 0x7ff170106a00 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.242+0000 7ff175a00640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1701073a0 0x7ff17019d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.243+0000 7ff16fe00640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170106a00 0x7ff17019c820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00e9f0 tx=0x7ff15c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.243+0000 7ff16d600640 1 -- 172.21.15.37:0/378630558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c00cd80 con 0x7ff170106a00 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.243+0000 7ff16d600640 1 -- 172.21.15.37:0/378630558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff15c0108e0 con 0x7ff170106a00 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.243+0000 7ff177a00640 1 -- 172.21.15.37:0/378630558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17019ded0 con 0x7ff170106a00 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.243+0000 7ff16d600640 1 -- 172.21.15.37:0/378630558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c018980 con 0x7ff170106a00 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.243+0000 7ff177a00640 1 -- 172.21.15.37:0/378630558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1701a45d0 con 0x7ff170106a00 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.244+0000 7ff177a00640 1 -- 172.21.15.37:0/378630558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff17010cb50 con 0x7ff170106a00 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.247+0000 7ff16d600640 1 -- 172.21.15.37:0/378630558 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7ff15c010430 con 0x7ff170106a00 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.250+0000 7ff16d600640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff1580b6500 0x7ff1580b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:04.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.250+0000 7ff16d600640 1 -- 172.21.15.37:0/378630558 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff15c0e5df0 con 0x7ff170106a00 2024-09-21T05:44:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.250+0000 7ff175000640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff1580b6500 0x7ff1580b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.251+0000 7ff175000640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff1580b6500 0x7ff1580b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff164000c00 tx=0x7ff164031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.252+0000 7ff16d600640 1 -- 172.21.15.37:0/378630558 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff15c0b2690 con 0x7ff170106a00 2024-09-21T05:44:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.454+0000 7ff177a00640 1 -- 172.21.15.37:0/378630558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7ff17002e640 con 0x7ff170106a00 2024-09-21T05:44:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.459+0000 7ff16d600640 1 -- 172.21.15.37:0/378630558 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7ff15c0b75d0 con 0x7ff170106a00 2024-09-21T05:44:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.461+0000 7ff177a00640 1 -- 172.21.15.37:0/378630558 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff1580b6500 msgr2=0x7ff1580b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.462+0000 7ff177a00640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff1580b6500 0x7ff1580b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff164000c00 tx=0x7ff164031400 comp rx=0 tx=0).stop 2024-09-21T05:44:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.462+0000 7ff177a00640 1 -- 172.21.15.37:0/378630558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170106a00 msgr2=0x7ff17019c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.462+0000 7ff177a00640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170106a00 0x7ff17019c820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00e9f0 tx=0x7ff15c00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.462+0000 7ff177a00640 1 -- 172.21.15.37:0/378630558 shutdown_connections 2024-09-21T05:44:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.462+0000 7ff177a00640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff1580b6500 0x7ff1580b8a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.462+0000 7ff177a00640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1701073a0 0x7ff17019d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.462+0000 7ff177a00640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170106a00 0x7ff17019c820 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.462+0000 7ff177a00640 1 --2- 172.21.15.37:0/378630558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff170105970 0x7ff17019c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:04.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.462+0000 7ff177a00640 1 -- 172.21.15.37:0/378630558 >> 172.21.15.37:0/378630558 conn(0x7ff1701012c0 msgr2=0x7ff170109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:04.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.462+0000 7ff177a00640 1 -- 172.21.15.37:0/378630558 shutdown_connections 2024-09-21T05:44:04.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:03.462+0000 7ff177a00640 1 -- 172.21.15.37:0/378630558 wait complete. 2024-09-21T05:44:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.664+0000 7fe947200640 1 -- 172.21.15.37:0/1333975644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe948104600 msgr2=0x7fe948104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.664+0000 7fe947200640 1 --2- 172.21.15.37:0/1333975644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe948104600 0x7fe948104a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe934009900 tx=0x7fe93402a480 comp rx=0 tx=0).stop 2024-09-21T05:44:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.664+0000 7fe947200640 1 -- 172.21.15.37:0/1333975644 shutdown_connections 2024-09-21T05:44:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.664+0000 7fe947200640 1 --2- 172.21.15.37:0/1333975644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe948104fa0 0x7fe94810b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.664+0000 7fe947200640 1 --2- 172.21.15.37:0/1333975644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe948104600 0x7fe948104a10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.664+0000 7fe947200640 1 --2- 172.21.15.37:0/1333975644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe948103570 0x7fe9481039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.664+0000 7fe947200640 1 -- 172.21.15.37:0/1333975644 >> 172.21.15.37:0/1333975644 conn(0x7fe9480feec0 msgr2=0x7fe948101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.664+0000 7fe947200640 1 -- 172.21.15.37:0/1333975644 shutdown_connections 2024-09-21T05:44:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.664+0000 7fe947200640 1 -- 172.21.15.37:0/1333975644 wait complete. 2024-09-21T05:44:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.665+0000 7fe947200640 1 Processor -- start 2024-09-21T05:44:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.665+0000 7fe947200640 1 -- start start 2024-09-21T05:44:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.666+0000 7fe947200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe948103570 0x7fe94819c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.666+0000 7fe947200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe948104600 0x7fe94819c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.666+0000 7fe947200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe948104fa0 0x7fe94819d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.666+0000 7fe947200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe94810f1c0 con 0x7fe948104600 2024-09-21T05:44:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.666+0000 7fe947200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe94810f040 con 0x7fe948103570 2024-09-21T05:44:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.666+0000 7fe947200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe94810f340 con 0x7fe948104fa0 2024-09-21T05:44:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.666+0000 7fe945400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe948104600 0x7fe94819c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.666+0000 7fe945400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe948104600 0x7fe94819c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60588/0 (socket says 172.21.15.37:60588) 2024-09-21T05:44:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.666+0000 7fe945400640 1 -- 172.21.15.37:0/1661586055 learned_addr learned my addr 172.21.15.37:0/1661586055 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.666+0000 7fe945e00640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe948103570 0x7fe94819c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.666+0000 7fe946800640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe948104fa0 0x7fe94819d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.667+0000 7fe945400640 1 -- 172.21.15.37:0/1661586055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe948104fa0 msgr2=0x7fe94819d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.667+0000 7fe945400640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe948104fa0 0x7fe94819d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.667+0000 7fe945400640 1 -- 172.21.15.37:0/1661586055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe948103570 msgr2=0x7fe94819c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.667+0000 7fe945400640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe948103570 0x7fe94819c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.667+0000 7fe945400640 1 -- 172.21.15.37:0/1661586055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94819da50 con 0x7fe948104600 2024-09-21T05:44:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.667+0000 7fe946800640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe948104fa0 0x7fe94819d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:44:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.667+0000 7fe945400640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe948104600 0x7fe94819c690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe934006010 tx=0x7fe9340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.667+0000 7fe93ea00640 1 -- 172.21.15.37:0/1661586055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93403f030 con 0x7fe948104600 2024-09-21T05:44:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.667+0000 7fe947200640 1 -- 172.21.15.37:0/1661586055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe94819dce0 con 0x7fe948104600 2024-09-21T05:44:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.667+0000 7fe93ea00640 1 -- 172.21.15.37:0/1661586055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe934031910 con 0x7fe948104600 2024-09-21T05:44:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.667+0000 7fe947200640 1 -- 172.21.15.37:0/1661586055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9481a4440 con 0x7fe948104600 2024-09-21T05:44:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.668+0000 7fe93ea00640 1 -- 172.21.15.37:0/1661586055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe934049060 con 0x7fe948104600 2024-09-21T05:44:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.669+0000 7fe947200640 1 -- 172.21.15.37:0/1661586055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9481039e0 con 0x7fe948104600 2024-09-21T05:44:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.671+0000 7fe93ea00640 1 -- 172.21.15.37:0/1661586055 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fe934042030 con 0x7fe948104600 2024-09-21T05:44:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.673+0000 7fe93ea00640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe92c0b6480 0x7fe92c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.674+0000 7fe93ea00640 1 -- 172.21.15.37:0/1661586055 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe934105f60 con 0x7fe948104600 2024-09-21T05:44:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.674+0000 7fe945e00640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe92c0b6480 0x7fe92c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.675+0000 7fe945e00640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe92c0b6480 0x7fe92c0b8990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe9380095f0 tx=0x7fe938005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.677+0000 7fe93ea00640 1 -- 172.21.15.37:0/1661586055 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe9340d2800 con 0x7fe948104600 2024-09-21T05:44:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.904+0000 7fe947200640 1 -- 172.21.15.37:0/1661586055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fe9481a46b0 con 0x7fe948104600 2024-09-21T05:44:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.904+0000 7fe93ea00640 1 -- 172.21.15.37:0/1661586055 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v19)=0 v19) ==== 106+0+0 (secure 0 0 0) 0x7fe9340d7740 con 0x7fe948104600 2024-09-21T05:44:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.906+0000 7fe947200640 1 -- 172.21.15.37:0/1661586055 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe92c0b6480 msgr2=0x7fe92c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.906+0000 7fe947200640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe92c0b6480 0x7fe92c0b8990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe9380095f0 tx=0x7fe938005f90 comp rx=0 tx=0).stop 2024-09-21T05:44:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.906+0000 7fe947200640 1 -- 172.21.15.37:0/1661586055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe948104600 msgr2=0x7fe94819c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.906+0000 7fe947200640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe948104600 0x7fe94819c690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe934006010 tx=0x7fe9340042f0 comp rx=0 tx=0).stop 2024-09-21T05:44:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.906+0000 7fe947200640 1 -- 172.21.15.37:0/1661586055 shutdown_connections 2024-09-21T05:44:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.906+0000 7fe947200640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe948104fa0 0x7fe94819d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.906+0000 7fe947200640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe948104600 0x7fe94819c690 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.906+0000 7fe947200640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe92c0b6480 0x7fe92c0b8990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.906+0000 7fe947200640 1 --2- 172.21.15.37:0/1661586055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe948103570 0x7fe94819c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.906+0000 7fe947200640 1 -- 172.21.15.37:0/1661586055 >> 172.21.15.37:0/1661586055 conn(0x7fe9480feec0 msgr2=0x7fe9480755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.907+0000 7fe947200640 1 -- 172.21.15.37:0/1661586055 shutdown_connections 2024-09-21T05:44:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:43:59.907+0000 7fe947200640 1 -- 172.21.15.37:0/1661586055 wait complete. 2024-09-21T05:44:05.965 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:05 smithi037 ceph-mon[30631]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:05.966 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:05.966 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:05.966 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:05.966 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:05.966 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:05.966 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:06.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:05 smithi144 ceph-mon[34351]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:06.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:06.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:06.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:06.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:06.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:06.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:05 smithi067 ceph-mon[34443]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:06.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:06.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.285+0000 7fe428400640 1 -- 172.21.15.37:0/3941759504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4201073a0 msgr2=0x7fe42010dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.285+0000 7fe428400640 1 --2- 172.21.15.37:0/3941759504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4201073a0 0x7fe42010dd40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe418009ca0 tx=0x7fe41802a950 comp rx=0 tx=0).stop 2024-09-21T05:44:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.285+0000 7fe428400640 1 -- 172.21.15.37:0/3941759504 shutdown_connections 2024-09-21T05:44:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.285+0000 7fe428400640 1 --2- 172.21.15.37:0/3941759504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4201073a0 0x7fe42010dd40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.285+0000 7fe428400640 1 --2- 172.21.15.37:0/3941759504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe420106a00 0x7fe420106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.285+0000 7fe428400640 1 --2- 172.21.15.37:0/3941759504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe420105970 0x7fe420105de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.285+0000 7fe428400640 1 -- 172.21.15.37:0/3941759504 >> 172.21.15.37:0/3941759504 conn(0x7fe4201012c0 msgr2=0x7fe420103790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.285+0000 7fe428400640 1 -- 172.21.15.37:0/3941759504 shutdown_connections 2024-09-21T05:44:06.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.285+0000 7fe428400640 1 -- 172.21.15.37:0/3941759504 wait complete. 2024-09-21T05:44:06.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.287+0000 7fe428400640 1 Processor -- start 2024-09-21T05:44:06.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.287+0000 7fe428400640 1 -- start start 2024-09-21T05:44:06.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.287+0000 7fe428400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe420105970 0x7fe42019c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:06.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.287+0000 7fe428400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe420106a00 0x7fe42019c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:06.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.287+0000 7fe428400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4201073a0 0x7fe42019d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:06.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.287+0000 7fe428400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe4201115e0 con 0x7fe420105970 2024-09-21T05:44:06.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.287+0000 7fe428400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe420111460 con 0x7fe420106a00 2024-09-21T05:44:06.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.287+0000 7fe428400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe420111760 con 0x7fe4201073a0 2024-09-21T05:44:06.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.288+0000 7fe425a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe420105970 0x7fe42019c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:06.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.288+0000 7fe425a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe420105970 0x7fe42019c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34308/0 (socket says 172.21.15.37:34308) 2024-09-21T05:44:06.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.288+0000 7fe425a00640 1 -- 172.21.15.37:0/4226227420 learned_addr learned my addr 172.21.15.37:0/4226227420 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:06.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.288+0000 7fe425000640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe420106a00 0x7fe42019c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:06.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.288+0000 7fe426400640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4201073a0 0x7fe42019d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:06.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.288+0000 7fe426400640 1 -- 172.21.15.37:0/4226227420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe420106a00 msgr2=0x7fe42019c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:06.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.288+0000 7fe426400640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe420106a00 0x7fe42019c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.288+0000 7fe426400640 1 -- 172.21.15.37:0/4226227420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe420105970 msgr2=0x7fe42019c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:06.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.288+0000 7fe426400640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe420105970 0x7fe42019c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.288+0000 7fe426400640 1 -- 172.21.15.37:0/4226227420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42019dba0 con 0x7fe4201073a0 2024-09-21T05:44:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.288+0000 7fe425a00640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe420105970 0x7fe42019c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:44:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.289+0000 7fe426400640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4201073a0 0x7fe42019d380 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe418006010 tx=0x7fe41802fc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.289+0000 7fe41e000640 1 -- 172.21.15.37:0/4226227420 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418034040 con 0x7fe4201073a0 2024-09-21T05:44:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.289+0000 7fe41e000640 1 -- 172.21.15.37:0/4226227420 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4180308f0 con 0x7fe4201073a0 2024-09-21T05:44:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.289+0000 7fe428400640 1 -- 172.21.15.37:0/4226227420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42019de30 con 0x7fe4201073a0 2024-09-21T05:44:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.289+0000 7fe41e000640 1 -- 172.21.15.37:0/4226227420 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418004820 con 0x7fe4201073a0 2024-09-21T05:44:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.289+0000 7fe428400640 1 -- 172.21.15.37:0/4226227420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4201a43c0 con 0x7fe4201073a0 2024-09-21T05:44:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.290+0000 7fe428400640 1 -- 172.21.15.37:0/4226227420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42010cb50 con 0x7fe4201073a0 2024-09-21T05:44:06.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.292+0000 7fe41e000640 1 -- 172.21.15.37:0/4226227420 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fe418037020 con 0x7fe4201073a0 2024-09-21T05:44:06.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.294+0000 7fe41e000640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe4080b6480 0x7fe4080b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:06.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.294+0000 7fe41e000640 1 -- 172.21.15.37:0/4226227420 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe418106940 con 0x7fe4201073a0 2024-09-21T05:44:06.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.294+0000 7fe425a00640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe4080b6480 0x7fe4080b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:06.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.295+0000 7fe425a00640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe4080b6480 0x7fe4080b8990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe414011500 tx=0x7fe414005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:06.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.296+0000 7fe41e000640 1 -- 172.21.15.37:0/4226227420 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4180cee00 con 0x7fe4201073a0 2024-09-21T05:44:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.501+0000 7f28ccc00640 1 -- 172.21.15.37:0/3361030340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c8104600 msgr2=0x7f28c8104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.501+0000 7f28ccc00640 1 --2- 172.21.15.37:0/3361030340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c8104600 0x7f28c8104a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009900 tx=0x7f28b002a480 comp rx=0 tx=0).stop 2024-09-21T05:44:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.501+0000 7f28ccc00640 1 -- 172.21.15.37:0/3361030340 shutdown_connections 2024-09-21T05:44:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.501+0000 7f28ccc00640 1 --2- 172.21.15.37:0/3361030340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28c8104fa0 0x7f28c810b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.501+0000 7f28ccc00640 1 --2- 172.21.15.37:0/3361030340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c8104600 0x7f28c8104a10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.501+0000 7f28ccc00640 1 --2- 172.21.15.37:0/3361030340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c8103570 0x7f28c81039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.501+0000 7f28ccc00640 1 -- 172.21.15.37:0/3361030340 >> 172.21.15.37:0/3361030340 conn(0x7f28c80feec0 msgr2=0x7f28c8101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.501+0000 7f28ccc00640 1 -- 172.21.15.37:0/3361030340 shutdown_connections 2024-09-21T05:44:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.501+0000 7f28ccc00640 1 -- 172.21.15.37:0/3361030340 wait complete. 2024-09-21T05:44:06.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.502+0000 7f28ccc00640 1 Processor -- start 2024-09-21T05:44:06.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.502+0000 7f28ccc00640 1 -- start start 2024-09-21T05:44:06.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.503+0000 7f28ccc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c8103570 0x7f28c8076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:06.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.503+0000 7f28ccc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28c8104600 0x7f28c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:06.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.503+0000 7f28ccc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c8104fa0 0x7f28c8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:06.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.503+0000 7f28ccc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f28c810f200 con 0x7f28c8103570 2024-09-21T05:44:06.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.503+0000 7f28ccc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f28c810f080 con 0x7f28c8104600 2024-09-21T05:44:06.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.503+0000 7f28ccc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f28c810f380 con 0x7f28c8104fa0 2024-09-21T05:44:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.503+0000 7f28c7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c8103570 0x7f28c8076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.503+0000 7f28c7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c8103570 0x7f28c8076e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34326/0 (socket says 172.21.15.37:34326) 2024-09-21T05:44:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.503+0000 7f28c7400640 1 -- 172.21.15.37:0/1398706644 learned_addr learned my addr 172.21.15.37:0/1398706644 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.503+0000 7f28c7e00640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c8104fa0 0x7f28c8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.503+0000 7f28bfe00640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28c8104600 0x7f28c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.504+0000 7f28c7e00640 1 -- 172.21.15.37:0/1398706644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28c8104600 msgr2=0x7f28c8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.504+0000 7f28c7e00640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28c8104600 0x7f28c8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.504+0000 7f28c7e00640 1 -- 172.21.15.37:0/1398706644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c8103570 msgr2=0x7f28c8076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.504+0000 7f28c7e00640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c8103570 0x7f28c8076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.504+0000 7f28c7e00640 1 -- 172.21.15.37:0/1398706644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c8076350 con 0x7f28c8104fa0 2024-09-21T05:44:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.504+0000 7f28c7400640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c8103570 0x7f28c8076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:44:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.504+0000 7f28c7e00640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c8104fa0 0x7f28c8075c50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f28c000ec50 tx=0x7f28c000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:06.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.504+0000 7f28c4c00640 1 -- 172.21.15.37:0/1398706644 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0003b70 con 0x7f28c8104fa0 2024-09-21T05:44:06.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.504+0000 7f28c4c00640 1 -- 172.21.15.37:0/1398706644 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28c0003d10 con 0x7f28c8104fa0 2024-09-21T05:44:06.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.504+0000 7f28ccc00640 1 -- 172.21.15.37:0/1398706644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c81a3eb0 con 0x7f28c8104fa0 2024-09-21T05:44:06.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.504+0000 7f28c4c00640 1 -- 172.21.15.37:0/1398706644 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0010830 con 0x7f28c8104fa0 2024-09-21T05:44:06.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.505+0000 7f28ccc00640 1 -- 172.21.15.37:0/1398706644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c81a4250 con 0x7f28c8104fa0 2024-09-21T05:44:06.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.506+0000 7f28ccc00640 1 -- 172.21.15.37:0/1398706644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a40052c0 con 0x7f28c8104fa0 2024-09-21T05:44:06.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.508+0000 7f28c4c00640 1 -- 172.21.15.37:0/1398706644 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f28c0003ec0 con 0x7f28c8104fa0 2024-09-21T05:44:06.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.509+0000 7f28c4c00640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f28ac0b6480 0x7f28ac0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:06.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.510+0000 7f28c4c00640 1 -- 172.21.15.37:0/1398706644 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f28c00e5ac0 con 0x7f28c8104fa0 2024-09-21T05:44:06.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.510+0000 7f28c7400640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f28ac0b6480 0x7f28ac0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:06.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.510+0000 7f28c7400640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f28ac0b6480 0x7f28ac0b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f28b8011550 tx=0x7f28b8005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:06.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.512+0000 7fe428400640 1 -- 172.21.15.37:0/4226227420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fe42002e640 con 0x7fe4201073a0 2024-09-21T05:44:06.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.514+0000 7f28c4c00640 1 -- 172.21.15.37:0/1398706644 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f28c00adf80 con 0x7f28c8104fa0 2024-09-21T05:44:06.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.520+0000 7fe41e000640 1 -- 172.21.15.37:0/4226227420 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7fe4180d31e0 con 0x7fe4201073a0 2024-09-21T05:44:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.522+0000 7fe428400640 1 -- 172.21.15.37:0/4226227420 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe4080b6480 msgr2=0x7fe4080b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.522+0000 7fe428400640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe4080b6480 0x7fe4080b8990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe414011500 tx=0x7fe414005f90 comp rx=0 tx=0).stop 2024-09-21T05:44:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.522+0000 7fe428400640 1 -- 172.21.15.37:0/4226227420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4201073a0 msgr2=0x7fe42019d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.522+0000 7fe428400640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4201073a0 0x7fe42019d380 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe418006010 tx=0x7fe41802fc20 comp rx=0 tx=0).stop 2024-09-21T05:44:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.522+0000 7fe428400640 1 -- 172.21.15.37:0/4226227420 shutdown_connections 2024-09-21T05:44:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.522+0000 7fe428400640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4201073a0 0x7fe42019d380 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.522+0000 7fe428400640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe4080b6480 0x7fe4080b8990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.522+0000 7fe428400640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe420106a00 0x7fe42019c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.522+0000 7fe428400640 1 --2- 172.21.15.37:0/4226227420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe420105970 0x7fe42019c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.522+0000 7fe428400640 1 -- 172.21.15.37:0/4226227420 >> 172.21.15.37:0/4226227420 conn(0x7fe4201012c0 msgr2=0x7fe420109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.522+0000 7fe428400640 1 -- 172.21.15.37:0/4226227420 shutdown_connections 2024-09-21T05:44:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.523+0000 7fe428400640 1 -- 172.21.15.37:0/4226227420 wait complete. 2024-09-21T05:44:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.738+0000 7f28ccc00640 1 -- 172.21.15.37:0/1398706644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f28a40055b0 con 0x7f28c8104fa0 2024-09-21T05:44:06.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.746+0000 7f28c4c00640 1 -- 172.21.15.37:0/1398706644 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f28c00b2360 con 0x7f28c8104fa0 2024-09-21T05:44:06.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.749+0000 7f28ccc00640 1 -- 172.21.15.37:0/1398706644 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f28ac0b6480 msgr2=0x7f28ac0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:06.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.749+0000 7f28ccc00640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f28ac0b6480 0x7f28ac0b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f28b8011550 tx=0x7f28b8005f90 comp rx=0 tx=0).stop 2024-09-21T05:44:06.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.749+0000 7f28ccc00640 1 -- 172.21.15.37:0/1398706644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c8104fa0 msgr2=0x7f28c8075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:06.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.749+0000 7f28ccc00640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c8104fa0 0x7f28c8075c50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f28c000ec50 tx=0x7f28c000c6a0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.749+0000 7f28ccc00640 1 -- 172.21.15.37:0/1398706644 shutdown_connections 2024-09-21T05:44:06.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.749+0000 7f28ccc00640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c8104fa0 0x7f28c8075c50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.749+0000 7f28ccc00640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f28ac0b6480 0x7f28ac0b8990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.749+0000 7f28ccc00640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28c8104600 0x7f28c8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.749+0000 7f28ccc00640 1 --2- 172.21.15.37:0/1398706644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c8103570 0x7f28c8076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:06.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.749+0000 7f28ccc00640 1 -- 172.21.15.37:0/1398706644 >> 172.21.15.37:0/1398706644 conn(0x7f28c80feec0 msgr2=0x7f28c8107900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:06.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.749+0000 7f28ccc00640 1 -- 172.21.15.37:0/1398706644 shutdown_connections 2024-09-21T05:44:06.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:06.749+0000 7f28ccc00640 1 -- 172.21.15.37:0/1398706644 wait complete. 2024-09-21T05:44:07.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.009+0000 7f5c1f600640 1 -- 172.21.15.37:0/2165909068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c18106a10 msgr2=0x7f5c18106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:07.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.009+0000 7f5c1f600640 1 --2- 172.21.15.37:0/2165909068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c18106a10 0x7f5c18106e20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009900 tx=0x7f5c0402a480 comp rx=0 tx=0).stop 2024-09-21T05:44:07.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.009+0000 7f5c1f600640 1 -- 172.21.15.37:0/2165909068 shutdown_connections 2024-09-21T05:44:07.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.009+0000 7f5c1f600640 1 --2- 172.21.15.37:0/2165909068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c181073b0 0x7f5c1810dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:07.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.009+0000 7f5c1f600640 1 --2- 172.21.15.37:0/2165909068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c18106a10 0x7f5c18106e20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:07.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.009+0000 7f5c1f600640 1 --2- 172.21.15.37:0/2165909068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c18105980 0x7f5c18105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:07.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.009+0000 7f5c1f600640 1 -- 172.21.15.37:0/2165909068 >> 172.21.15.37:0/2165909068 conn(0x7f5c181012f0 msgr2=0x7f5c181037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:07.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.009+0000 7f5c1f600640 1 -- 172.21.15.37:0/2165909068 shutdown_connections 2024-09-21T05:44:07.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.009+0000 7f5c1f600640 1 -- 172.21.15.37:0/2165909068 wait complete. 2024-09-21T05:44:07.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.010+0000 7f5c1f600640 1 Processor -- start 2024-09-21T05:44:07.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.010+0000 7f5c1f600640 1 -- start start 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.010+0000 7f5c1f600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c18105980 0x7f5c1819c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.010+0000 7f5c1f600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c18106a10 0x7f5c1819c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.010+0000 7f5c1f600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c181073b0 0x7f5c1819d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.010+0000 7f5c1f600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18111620 con 0x7f5c181073b0 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.010+0000 7f5c1f600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181114a0 con 0x7f5c18105980 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.010+0000 7f5c1f600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181117a0 con 0x7f5c18106a10 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.011+0000 7f5c1cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c18105980 0x7f5c1819c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.011+0000 7f5c1cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c18105980 0x7f5c1819c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:49064/0 (socket says 172.21.15.37:49064) 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.011+0000 7f5c1cc00640 1 -- 172.21.15.37:0/1138645274 learned_addr learned my addr 172.21.15.37:0/1138645274 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.011+0000 7f5c1d600640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c181073b0 0x7f5c1819d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.011+0000 7f5c17e00640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c18106a10 0x7f5c1819c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.011+0000 7f5c1cc00640 1 -- 172.21.15.37:0/1138645274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c18106a10 msgr2=0x7f5c1819c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.011+0000 7f5c1cc00640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c18106a10 0x7f5c1819c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.011+0000 7f5c1cc00640 1 -- 172.21.15.37:0/1138645274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c181073b0 msgr2=0x7f5c1819d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.011+0000 7f5c1cc00640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c181073b0 0x7f5c1819d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.011+0000 7f5c1cc00640 1 -- 172.21.15.37:0/1138645274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1819dc40 con 0x7f5c18105980 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.011+0000 7f5c1cc00640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c18105980 0x7f5c1819c210 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00ea60 tx=0x7f5c0c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.012+0000 7f5c15600640 1 -- 172.21.15.37:0/1138645274 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c00cde0 con 0x7f5c18105980 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.012+0000 7f5c15600640 1 -- 172.21.15.37:0/1138645274 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c0c0035f0 con 0x7f5c18105980 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.012+0000 7f5c15600640 1 -- 172.21.15.37:0/1138645274 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c010690 con 0x7f5c18105980 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.012+0000 7f5c1f600640 1 -- 172.21.15.37:0/1138645274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1819df30 con 0x7f5c18105980 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.012+0000 7f5c1f600640 1 -- 172.21.15.37:0/1138645274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c181a4630 con 0x7f5c18105980 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.013+0000 7f5c1f600640 1 -- 172.21.15.37:0/1138645274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1810cb40 con 0x7f5c18105980 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.015+0000 7f5c15600640 1 -- 172.21.15.37:0/1138645274 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f5c0c0037a0 con 0x7f5c18105980 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.016+0000 7f5c15600640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5c000b6480 0x7f5c000b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.017+0000 7f5c15600640 1 -- 172.21.15.37:0/1138645274 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5c0c0e5990 con 0x7f5c18105980 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.017+0000 7f5c17e00640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5c000b6480 0x7f5c000b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.018+0000 7f5c17e00640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5c000b6480 0x7f5c000b8990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c04004770 tx=0x7f5c040314a0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.021+0000 7f5c15600640 1 -- 172.21.15.37:0/1138645274 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5c0c0ade50 con 0x7f5c18105980 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.224+0000 7f5c1f600640 1 -- 172.21.15.37:0/1138645274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f5c1802e640 con 0x7f5c18105980 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.232+0000 7f5c15600640 1 -- 172.21.15.37:0/1138645274 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v28)=0 v28) ==== 111+0+0 (secure 0 0 0) 0x7f5c0c0b2230 con 0x7f5c18105980 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.235+0000 7f5c1f600640 1 -- 172.21.15.37:0/1138645274 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5c000b6480 msgr2=0x7f5c000b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.235+0000 7f5c1f600640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5c000b6480 0x7f5c000b8990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c04004770 tx=0x7f5c040314a0 comp rx=0 tx=0).stop 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.235+0000 7f5c1f600640 1 -- 172.21.15.37:0/1138645274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c18105980 msgr2=0x7f5c1819c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.235+0000 7f5c1f600640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c18105980 0x7f5c1819c210 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00ea60 tx=0x7f5c0c00ef20 comp rx=0 tx=0).stop 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.235+0000 7f5c1f600640 1 -- 172.21.15.37:0/1138645274 shutdown_connections 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.235+0000 7f5c1f600640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c181073b0 0x7f5c1819d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.235+0000 7f5c1f600640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c18106a10 0x7f5c1819c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.235+0000 7f5c1f600640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5c000b6480 0x7f5c000b8990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.235+0000 7f5c1f600640 1 --2- 172.21.15.37:0/1138645274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c18105980 0x7f5c1819c210 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.235+0000 7f5c1f600640 1 -- 172.21.15.37:0/1138645274 >> 172.21.15.37:0/1138645274 conn(0x7f5c181012f0 msgr2=0x7f5c18109d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.235+0000 7f5c1f600640 1 -- 172.21.15.37:0/1138645274 shutdown_connections 2024-09-21T05:44:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:07.235+0000 7f5c1f600640 1 -- 172.21.15.37:0/1138645274 wait complete. 2024-09-21T05:44:07.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:07 smithi144 ceph-mon[34351]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:07.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:07 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:44:07.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:07 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:44:07.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:07 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:44:07.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:07.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:07.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:07.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:07.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:07 smithi037 ceph-mon[30631]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:07 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:44:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:07 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:44:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:07 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:44:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:07 smithi067 ceph-mon[34443]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:07 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:44:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:07 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:44:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:07 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:44:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.618+0000 7fc8bb000640 1 -- 172.21.15.37:0/1484265575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b4103750 msgr2=0x7fc8b4103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.618+0000 7fc8bb000640 1 --2- 172.21.15.37:0/1484265575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b4103750 0x7fc8b4103bc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009900 tx=0x7fc8a402a480 comp rx=0 tx=0).stop 2024-09-21T05:44:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.618+0000 7fc8bb000640 1 -- 172.21.15.37:0/1484265575 shutdown_connections 2024-09-21T05:44:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.619+0000 7fc8bb000640 1 --2- 172.21.15.37:0/1484265575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8b4105180 0x7fc8b410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.619+0000 7fc8bb000640 1 --2- 172.21.15.37:0/1484265575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8b41047e0 0x7fc8b4104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.619+0000 7fc8bb000640 1 --2- 172.21.15.37:0/1484265575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b4103750 0x7fc8b4103bc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.619+0000 7fc8bb000640 1 -- 172.21.15.37:0/1484265575 >> 172.21.15.37:0/1484265575 conn(0x7fc8b40ff0c0 msgr2=0x7fc8b4101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.619+0000 7fc8bb000640 1 -- 172.21.15.37:0/1484265575 shutdown_connections 2024-09-21T05:44:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.619+0000 7fc8bb000640 1 -- 172.21.15.37:0/1484265575 wait complete. 2024-09-21T05:44:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.620+0000 7fc8bb000640 1 Processor -- start 2024-09-21T05:44:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.620+0000 7fc8bb000640 1 -- start start 2024-09-21T05:44:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.620+0000 7fc8bb000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b4103750 0x7fc8b419c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.620+0000 7fc8bb000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8b41047e0 0x7fc8b419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.620+0000 7fc8bb000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8b4105180 0x7fc8b419d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.620+0000 7fc8bb000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b410f370 con 0x7fc8b4103750 2024-09-21T05:44:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.620+0000 7fc8bb000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b410f1f0 con 0x7fc8b41047e0 2024-09-21T05:44:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.620+0000 7fc8bb000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b410f4f0 con 0x7fc8b4105180 2024-09-21T05:44:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.620+0000 7fc8b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b4103750 0x7fc8b419c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.620+0000 7fc8b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b4103750 0x7fc8b419c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34256/0 (socket says 172.21.15.37:34256) 2024-09-21T05:44:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.620+0000 7fc8b3e00640 1 -- 172.21.15.37:0/998189130 learned_addr learned my addr 172.21.15.37:0/998189130 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.620+0000 7fc8b3400640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8b41047e0 0x7fc8b419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.621+0000 7fc8b9000640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8b4105180 0x7fc8b419d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.621+0000 7fc8b3400640 1 -- 172.21.15.37:0/998189130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8b4105180 msgr2=0x7fc8b419d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.621+0000 7fc8b3400640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8b4105180 0x7fc8b419d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.621+0000 7fc8b3400640 1 -- 172.21.15.37:0/998189130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b4103750 msgr2=0x7fc8b419c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.621+0000 7fc8b3400640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b4103750 0x7fc8b419c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.621+0000 7fc8b3400640 1 -- 172.21.15.37:0/998189130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b419dbf0 con 0x7fc8b41047e0 2024-09-21T05:44:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.621+0000 7fc8b3e00640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b4103750 0x7fc8b419c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:44:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.621+0000 7fc8b3400640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8b41047e0 0x7fc8b419c830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000e9f0 tx=0x7fc8a000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.621+0000 7fc8b0c00640 1 -- 172.21.15.37:0/998189130 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000ccc0 con 0x7fc8b41047e0 2024-09-21T05:44:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.622+0000 7fc8b0c00640 1 -- 172.21.15.37:0/998189130 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a00108e0 con 0x7fc8b41047e0 2024-09-21T05:44:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.622+0000 7fc8bb000640 1 -- 172.21.15.37:0/998189130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b419dee0 con 0x7fc8b41047e0 2024-09-21T05:44:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.622+0000 7fc8b0c00640 1 -- 172.21.15.37:0/998189130 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0018880 con 0x7fc8b41047e0 2024-09-21T05:44:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.622+0000 7fc8bb000640 1 -- 172.21.15.37:0/998189130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b41a45e0 con 0x7fc8b41047e0 2024-09-21T05:44:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.623+0000 7fc8bb000640 1 -- 172.21.15.37:0/998189130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b41a47b0 con 0x7fc8b41047e0 2024-09-21T05:44:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.626+0000 7fc8b0c00640 1 -- 172.21.15.37:0/998189130 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fc8a0010430 con 0x7fc8b41047e0 2024-09-21T05:44:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.627+0000 7fc8b0c00640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8980b6500 0x7fc8980b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.627+0000 7fc8b0c00640 1 -- 172.21.15.37:0/998189130 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc8a00e5ba0 con 0x7fc8b41047e0 2024-09-21T05:44:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.627+0000 7fc8b3e00640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8980b6500 0x7fc8980b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.628+0000 7fc8b3e00640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8980b6500 0x7fc8980b8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4032fd0 tx=0x7fc8a40314a0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.629+0000 7fc8b0c00640 1 -- 172.21.15.37:0/998189130 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8a00e5e20 con 0x7fc8b41047e0 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.828+0000 7fc8bb000640 1 -- 172.21.15.37:0/998189130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fc8b41a4980 con 0x7fc8b41047e0 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.834+0000 7fc8b0c00640 1 -- 172.21.15.37:0/998189130 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v23)=0 v23) ==== 118+0+0 (secure 0 0 0) 0x7fc8a00b2440 con 0x7fc8b41047e0 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.837+0000 7fc8bb000640 1 -- 172.21.15.37:0/998189130 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8980b6500 msgr2=0x7fc8980b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.837+0000 7fc8bb000640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8980b6500 0x7fc8980b8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4032fd0 tx=0x7fc8a40314a0 comp rx=0 tx=0).stop 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.837+0000 7fc8bb000640 1 -- 172.21.15.37:0/998189130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8b41047e0 msgr2=0x7fc8b419c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.837+0000 7fc8bb000640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8b41047e0 0x7fc8b419c830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000e9f0 tx=0x7fc8a000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.838+0000 7fc8bb000640 1 -- 172.21.15.37:0/998189130 shutdown_connections 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.838+0000 7fc8bb000640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8b4105180 0x7fc8b419d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.838+0000 7fc8bb000640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8980b6500 0x7fc8980b8a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.838+0000 7fc8bb000640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8b41047e0 0x7fc8b419c830 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.838+0000 7fc8bb000640 1 --2- 172.21.15.37:0/998189130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b4103750 0x7fc8b419c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.838+0000 7fc8bb000640 1 -- 172.21.15.37:0/998189130 >> 172.21.15.37:0/998189130 conn(0x7fc8b40ff0c0 msgr2=0x7fc8b40755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.838+0000 7fc8bb000640 1 -- 172.21.15.37:0/998189130 shutdown_connections 2024-09-21T05:44:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:01.838+0000 7fc8bb000640 1 -- 172.21.15.37:0/998189130 wait complete. 2024-09-21T05:44:09.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:09 smithi037 ceph-mon[30631]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:09 smithi144 ceph-mon[34351]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:09.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.641+0000 7fb81c000640 1 -- 172.21.15.37:0/954628919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb814077080 msgr2=0x7fb814075750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:09.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.641+0000 7fb81c000640 1 --2- 172.21.15.37:0/954628919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb814077080 0x7fb814075750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb808009900 tx=0x7fb80802a410 comp rx=0 tx=0).stop 2024-09-21T05:44:09.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.641+0000 7fb81c000640 1 -- 172.21.15.37:0/954628919 shutdown_connections 2024-09-21T05:44:09.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.641+0000 7fb81c000640 1 --2- 172.21.15.37:0/954628919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb81410b750 0x7fb81410db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.641+0000 7fb81c000640 1 --2- 172.21.15.37:0/954628919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb814075c90 0x7fb8140760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.641+0000 7fb81c000640 1 --2- 172.21.15.37:0/954628919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb814077080 0x7fb814075750 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.641+0000 7fb81c000640 1 -- 172.21.15.37:0/954628919 >> 172.21.15.37:0/954628919 conn(0x7fb8140ff0c0 msgr2=0x7fb814101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:09.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.641+0000 7fb81c000640 1 -- 172.21.15.37:0/954628919 shutdown_connections 2024-09-21T05:44:09.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.641+0000 7fb81c000640 1 -- 172.21.15.37:0/954628919 wait complete. 2024-09-21T05:44:09.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.642+0000 7fb81c000640 1 Processor -- start 2024-09-21T05:44:09.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.643+0000 7fb81c000640 1 -- start start 2024-09-21T05:44:09.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.643+0000 7fb81c000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb814075c90 0x7fb81419c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.643+0000 7fb81c000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb814077080 0x7fb81419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.643+0000 7fb81c000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81410b750 0x7fb81419d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.643+0000 7fb81c000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141115c0 con 0x7fb81410b750 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.643+0000 7fb81c000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb814111440 con 0x7fb814075c90 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.643+0000 7fb81c000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb814111740 con 0x7fb814077080 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.643+0000 7fb81a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81410b750 0x7fb81419d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.643+0000 7fb819600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb814075c90 0x7fb81419c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.643+0000 7fb819600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb814075c90 0x7fb81419c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:49074/0 (socket says 172.21.15.37:49074) 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.643+0000 7fb819600640 1 -- 172.21.15.37:0/4002610991 learned_addr learned my addr 172.21.15.37:0/4002610991 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.643+0000 7fb818c00640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb814077080 0x7fb81419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.644+0000 7fb819600640 1 -- 172.21.15.37:0/4002610991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb814077080 msgr2=0x7fb81419c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.644+0000 7fb819600640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb814077080 0x7fb81419c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.644+0000 7fb819600640 1 -- 172.21.15.37:0/4002610991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81410b750 msgr2=0x7fb81419d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.644+0000 7fb819600640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81410b750 0x7fb81419d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.644+0000 7fb819600640 1 -- 172.21.15.37:0/4002610991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81419dc70 con 0x7fb814075c90 2024-09-21T05:44:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.644+0000 7fb818c00640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb814077080 0x7fb81419c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:44:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.644+0000 7fb819600640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb814075c90 0x7fb81419c240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb808031440 tx=0x7fb808003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.644+0000 7fb812000640 1 -- 172.21.15.37:0/4002610991 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80803f070 con 0x7fb814075c90 2024-09-21T05:44:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.644+0000 7fb812000640 1 -- 172.21.15.37:0/4002610991 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb808031c50 con 0x7fb814075c90 2024-09-21T05:44:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.644+0000 7fb81c000640 1 -- 172.21.15.37:0/4002610991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81419df00 con 0x7fb814075c90 2024-09-21T05:44:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.644+0000 7fb812000640 1 -- 172.21.15.37:0/4002610991 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb808035030 con 0x7fb814075c90 2024-09-21T05:44:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.645+0000 7fb81c000640 1 -- 172.21.15.37:0/4002610991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8141a4490 con 0x7fb814075c90 2024-09-21T05:44:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.646+0000 7fb81c000640 1 -- 172.21.15.37:0/4002610991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb81410a560 con 0x7fb814075c90 2024-09-21T05:44:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.648+0000 7fb812000640 1 -- 172.21.15.37:0/4002610991 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fb808042070 con 0x7fb814075c90 2024-09-21T05:44:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.649+0000 7fb812000640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb7fc0b6480 0x7fb7fc0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.649+0000 7fb812000640 1 -- 172.21.15.37:0/4002610991 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb808105e90 con 0x7fb814075c90 2024-09-21T05:44:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.650+0000 7fb818c00640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb7fc0b6480 0x7fb7fc0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.650+0000 7fb818c00640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb7fc0b6480 0x7fb7fc0b8990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb800009fc0 tx=0x7fb800005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.654+0000 7fb812000640 1 -- 172.21.15.37:0/4002610991 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb8080d2730 con 0x7fb814075c90 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.855+0000 7fb81c000640 1 -- 172.21.15.37:0/4002610991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fb81402e640 con 0x7fb814075c90 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.862+0000 7fb812000640 1 -- 172.21.15.37:0/4002610991 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v29)=0 v29) ==== 119+0+0 (secure 0 0 0) 0x7fb8080d7670 con 0x7fb814075c90 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.864+0000 7fb81c000640 1 -- 172.21.15.37:0/4002610991 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb7fc0b6480 msgr2=0x7fb7fc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.864+0000 7fb81c000640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb7fc0b6480 0x7fb7fc0b8990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb800009fc0 tx=0x7fb800005f90 comp rx=0 tx=0).stop 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.864+0000 7fb81c000640 1 -- 172.21.15.37:0/4002610991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb814075c90 msgr2=0x7fb81419c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.864+0000 7fb81c000640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb814075c90 0x7fb81419c240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb808031440 tx=0x7fb808003c10 comp rx=0 tx=0).stop 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.864+0000 7fb81c000640 1 -- 172.21.15.37:0/4002610991 shutdown_connections 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.864+0000 7fb81c000640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81410b750 0x7fb81419d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.864+0000 7fb81c000640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb814077080 0x7fb81419c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.864+0000 7fb81c000640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb7fc0b6480 0x7fb7fc0b8990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.864+0000 7fb81c000640 1 --2- 172.21.15.37:0/4002610991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb814075c90 0x7fb81419c240 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.864+0000 7fb81c000640 1 -- 172.21.15.37:0/4002610991 >> 172.21.15.37:0/4002610991 conn(0x7fb8140ff0c0 msgr2=0x7fb814107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.865+0000 7fb81c000640 1 -- 172.21.15.37:0/4002610991 shutdown_connections 2024-09-21T05:44:09.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:09.865+0000 7fb81c000640 1 -- 172.21.15.37:0/4002610991 wait complete. 2024-09-21T05:44:09.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:09 smithi067 ceph-mon[34443]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:10.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.708+0000 7f914fc00640 1 -- 172.21.15.37:0/2376221242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9148102660 msgr2=0x7f9148102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:10.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.708+0000 7f914fc00640 1 --2- 172.21.15.37:0/2376221242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9148102660 0x7f9148102ad0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f913c009900 tx=0x7f913c02a480 comp rx=0 tx=0).stop 2024-09-21T05:44:10.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.709+0000 7f914fc00640 1 -- 172.21.15.37:0/2376221242 shutdown_connections 2024-09-21T05:44:10.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.709+0000 7f914fc00640 1 --2- 172.21.15.37:0/2376221242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9148104090 0x7f914810aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:10.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.709+0000 7f914fc00640 1 --2- 172.21.15.37:0/2376221242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91481036f0 0x7f9148103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:10.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.709+0000 7f914fc00640 1 --2- 172.21.15.37:0/2376221242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9148102660 0x7f9148102ad0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:10.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.709+0000 7f914fc00640 1 -- 172.21.15.37:0/2376221242 >> 172.21.15.37:0/2376221242 conn(0x7f91480fdfd0 msgr2=0x7f9148100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:10.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.709+0000 7f914fc00640 1 -- 172.21.15.37:0/2376221242 shutdown_connections 2024-09-21T05:44:10.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.709+0000 7f914fc00640 1 -- 172.21.15.37:0/2376221242 wait complete. 2024-09-21T05:44:10.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.710+0000 7f914fc00640 1 Processor -- start 2024-09-21T05:44:10.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.710+0000 7f914fc00640 1 -- start start 2024-09-21T05:44:10.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.710+0000 7f914fc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9148102660 0x7f914819c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:10.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.710+0000 7f914fc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91481036f0 0x7f914819c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:10.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.710+0000 7f914fc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9148104090 0x7f914819d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:10.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.710+0000 7f914fc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f914810e2d0 con 0x7f91481036f0 2024-09-21T05:44:10.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.710+0000 7f914fc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f914810e150 con 0x7f9148104090 2024-09-21T05:44:10.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.710+0000 7f914fc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f914810e450 con 0x7f9148102660 2024-09-21T05:44:10.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.711+0000 7f914d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9148102660 0x7f914819c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:10.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.711+0000 7f9147e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91481036f0 0x7f914819c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:10.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.711+0000 7f914d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9148102660 0x7f914819c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:33854/0 (socket says 172.21.15.37:33854) 2024-09-21T05:44:10.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.711+0000 7f914d200640 1 -- 172.21.15.37:0/1791027550 learned_addr learned my addr 172.21.15.37:0/1791027550 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:10.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.711+0000 7f914dc00640 1 --2- 172.21.15.37:0/1791027550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9148104090 0x7f914819d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:10.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.711+0000 7f914d200640 1 -- 172.21.15.37:0/1791027550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9148104090 msgr2=0x7f914819d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:10.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.711+0000 7f914d200640 1 --2- 172.21.15.37:0/1791027550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9148104090 0x7f914819d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:10.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.711+0000 7f914d200640 1 -- 172.21.15.37:0/1791027550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91481036f0 msgr2=0x7f914819c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:10.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.711+0000 7f914d200640 1 --2- 172.21.15.37:0/1791027550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91481036f0 0x7f914819c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:10.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.711+0000 7f914d200640 1 -- 172.21.15.37:0/1791027550 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914819dd30 con 0x7f9148102660 2024-09-21T05:44:10.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.712+0000 7f914d200640 1 --2- 172.21.15.37:0/1791027550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9148102660 0x7f914819c300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f913c031440 tx=0x7f913c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:10.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.712+0000 7f9145600640 1 -- 172.21.15.37:0/1791027550 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c03f070 con 0x7f9148102660 2024-09-21T05:44:10.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.712+0000 7f9145600640 1 -- 172.21.15.37:0/1791027550 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f913c031c60 con 0x7f9148102660 2024-09-21T05:44:10.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.712+0000 7f9145600640 1 -- 172.21.15.37:0/1791027550 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c035030 con 0x7f9148102660 2024-09-21T05:44:10.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.712+0000 7f914fc00640 1 -- 172.21.15.37:0/1791027550 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f914819dfc0 con 0x7f9148102660 2024-09-21T05:44:10.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.713+0000 7f914fc00640 1 -- 172.21.15.37:0/1791027550 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91481a4550 con 0x7f9148102660 2024-09-21T05:44:10.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.714+0000 7f914fc00640 1 -- 172.21.15.37:0/1791027550 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91481a4840 con 0x7f9148102660 2024-09-21T05:44:10.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.720+0000 7f9145600640 1 -- 172.21.15.37:0/1791027550 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f913c042070 con 0x7f9148102660 2024-09-21T05:44:10.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.721+0000 7f9145600640 1 --2- 172.21.15.37:0/1791027550 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f91300b6580 0x7f91300b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:10.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.722+0000 7f9145600640 1 -- 172.21.15.37:0/1791027550 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f913c106900 con 0x7f9148102660 2024-09-21T05:44:10.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.722+0000 7f9147e00640 1 --2- 172.21.15.37:0/1791027550 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f91300b6580 0x7f91300b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:10.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.722+0000 7f9145600640 1 -- 172.21.15.37:0/1791027550 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f913c049030 con 0x7f9148102660 2024-09-21T05:44:10.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.723+0000 7f9147e00640 1 --2- 172.21.15.37:0/1791027550 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f91300b6580 0x7f91300b8a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9134009bd0 tx=0x7f9134005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:10.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.939+0000 7f914fc00640 1 -- 172.21.15.37:0/1791027550 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f91481a4a10 con 0x7f9148102660 2024-09-21T05:44:10.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.947+0000 7f9145600640 1 -- 172.21.15.37:0/1791027550 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7f913c0cedc0 con 0x7f9148102660 2024-09-21T05:44:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.950+0000 7f914fc00640 1 -- 172.21.15.37:0/1791027550 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f91300b6580 msgr2=0x7f91300b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.950+0000 7f914fc00640 1 --2- 172.21.15.37:0/1791027550 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f91300b6580 0x7f91300b8a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9134009bd0 tx=0x7f9134005f90 comp rx=0 tx=0).stop 2024-09-21T05:44:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.950+0000 7f914fc00640 1 -- 172.21.15.37:0/1791027550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9148102660 msgr2=0x7f914819c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.950+0000 7f914fc00640 1 --2- 172.21.15.37:0/1791027550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9148102660 0x7f914819c300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f913c031440 tx=0x7f913c003c10 comp rx=0 tx=0).stop 2024-09-21T05:44:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.950+0000 7f914fc00640 1 -- 172.21.15.37:0/1791027550 shutdown_connections 2024-09-21T05:44:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.950+0000 7f914fc00640 1 --2- 172.21.15.37:0/1791027550 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f91300b6580 0x7f91300b8a90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.950+0000 7f914fc00640 1 --2- 172.21.15.37:0/1791027550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9148104090 0x7f914819d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.950+0000 7f914fc00640 1 --2- 172.21.15.37:0/1791027550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91481036f0 0x7f914819c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.950+0000 7f914fc00640 1 --2- 172.21.15.37:0/1791027550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9148102660 0x7f914819c300 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.950+0000 7f914fc00640 1 -- 172.21.15.37:0/1791027550 >> 172.21.15.37:0/1791027550 conn(0x7f91480fdfd0 msgr2=0x7f91480ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.950+0000 7f914fc00640 1 -- 172.21.15.37:0/1791027550 shutdown_connections 2024-09-21T05:44:10.953 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:10 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:44:10.953 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:10.953 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:10.954 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:10.954 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:10.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.950+0000 7f914fc00640 1 -- 172.21.15.37:0/1791027550 wait complete. 2024-09-21T05:44:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.086+0000 7f41c1c00640 1 -- 172.21.15.37:0/3176222444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41bc103760 msgr2=0x7f41bc103bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.086+0000 7f41c1c00640 1 --2- 172.21.15.37:0/3176222444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41bc103760 0x7f41bc103bd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009860 tx=0x7f41ac02a3d0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.086+0000 7f41c1c00640 1 -- 172.21.15.37:0/3176222444 shutdown_connections 2024-09-21T05:44:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.086+0000 7f41c1c00640 1 --2- 172.21.15.37:0/3176222444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41bc105190 0x7f41bc10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.086+0000 7f41c1c00640 1 --2- 172.21.15.37:0/3176222444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41bc1047f0 0x7f41bc104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.086+0000 7f41c1c00640 1 --2- 172.21.15.37:0/3176222444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41bc103760 0x7f41bc103bd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.086+0000 7f41c1c00640 1 -- 172.21.15.37:0/3176222444 >> 172.21.15.37:0/3176222444 conn(0x7f41bc0ff0b0 msgr2=0x7f41bc101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.086+0000 7f41c1c00640 1 -- 172.21.15.37:0/3176222444 shutdown_connections 2024-09-21T05:44:11.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.086+0000 7f41c1c00640 1 -- 172.21.15.37:0/3176222444 wait complete. 2024-09-21T05:44:11.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.088+0000 7f41c1c00640 1 Processor -- start 2024-09-21T05:44:11.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.088+0000 7f41c1c00640 1 -- start start 2024-09-21T05:44:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.088+0000 7f41c1c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41bc103760 0x7f41bc19c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.088+0000 7f41c1c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41bc1047f0 0x7f41bc19c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.088+0000 7f41c1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41bc105190 0x7f41bc19d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.088+0000 7f41c1c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc10f3d0 con 0x7f41bc103760 2024-09-21T05:44:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.088+0000 7f41c1c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc10f250 con 0x7f41bc1047f0 2024-09-21T05:44:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.088+0000 7f41c1c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc10f550 con 0x7f41bc105190 2024-09-21T05:44:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.089+0000 7f41bb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41bc105190 0x7f41bc19d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.089+0000 7f41baa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41bc103760 0x7f41bc19c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.089+0000 7f41bb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41bc105190 0x7f41bc19d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:52276/0 (socket says 172.21.15.37:52276) 2024-09-21T05:44:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.089+0000 7f41bb400640 1 -- 172.21.15.37:0/3931771737 learned_addr learned my addr 172.21.15.37:0/3931771737 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.089+0000 7f41ba000640 1 --2- 172.21.15.37:0/3931771737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41bc1047f0 0x7f41bc19c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.089+0000 7f41bb400640 1 -- 172.21.15.37:0/3931771737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41bc1047f0 msgr2=0x7f41bc19c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.089+0000 7f41bb400640 1 --2- 172.21.15.37:0/3931771737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41bc1047f0 0x7f41bc19c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.089+0000 7f41bb400640 1 -- 172.21.15.37:0/3931771737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41bc103760 msgr2=0x7f41bc19c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.089+0000 7f41bb400640 1 --2- 172.21.15.37:0/3931771737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41bc103760 0x7f41bc19c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.089+0000 7f41bb400640 1 -- 172.21.15.37:0/3931771737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41bc19dc00 con 0x7f41bc105190 2024-09-21T05:44:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.090+0000 7f41bb400640 1 --2- 172.21.15.37:0/3931771737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41bc105190 0x7f41bc19d3e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f41b400eb10 tx=0x7f41b400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.090+0000 7f41b3400640 1 -- 172.21.15.37:0/3931771737 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b400ce20 con 0x7f41bc105190 2024-09-21T05:44:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.090+0000 7f41b3400640 1 -- 172.21.15.37:0/3931771737 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41b4005020 con 0x7f41bc105190 2024-09-21T05:44:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.090+0000 7f41b3400640 1 -- 172.21.15.37:0/3931771737 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4010690 con 0x7f41bc105190 2024-09-21T05:44:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.090+0000 7f41c1c00640 1 -- 172.21.15.37:0/3931771737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41bc19def0 con 0x7f41bc105190 2024-09-21T05:44:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.090+0000 7f41c1c00640 1 -- 172.21.15.37:0/3931771737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41bc1a45f0 con 0x7f41bc105190 2024-09-21T05:44:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.092+0000 7f41c1c00640 1 -- 172.21.15.37:0/3931771737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41bc1a47c0 con 0x7f41bc105190 2024-09-21T05:44:11.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.094+0000 7f41b3400640 1 -- 172.21.15.37:0/3931771737 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f41b4005510 con 0x7f41bc105190 2024-09-21T05:44:11.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.096+0000 7f41b3400640 1 --2- 172.21.15.37:0/3931771737 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f41a00b6500 0x7f41a00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:11.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.096+0000 7f41b3400640 1 -- 172.21.15.37:0/3931771737 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f41b40e5f80 con 0x7f41bc105190 2024-09-21T05:44:11.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.096+0000 7f41baa00640 1 --2- 172.21.15.37:0/3931771737 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f41a00b6500 0x7f41a00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:11.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.097+0000 7f41b3400640 1 -- 172.21.15.37:0/3931771737 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41b40ae440 con 0x7f41bc105190 2024-09-21T05:44:11.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.098+0000 7f41baa00640 1 --2- 172.21.15.37:0/3931771737 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f41a00b6500 0x7f41a00b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f41ac02a9c0 tx=0x7f41ac030980 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:11.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:10 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:44:11.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:11.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:11.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:11.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:11.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:10 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:44:11.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:11.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:11.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:11.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.299+0000 7f41c1c00640 1 -- 172.21.15.37:0/3931771737 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f41bc1a4b40 con 0x7f41bc105190 2024-09-21T05:44:11.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.308+0000 7f41b3400640 1 -- 172.21.15.37:0/3931771737 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v32)=0 v32) ==== 125+0+0 (secure 0 0 0) 0x7f41b40b2820 con 0x7f41bc105190 2024-09-21T05:44:11.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.310+0000 7f41c1c00640 1 -- 172.21.15.37:0/3931771737 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f41a00b6500 msgr2=0x7f41a00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:11.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.310+0000 7f41c1c00640 1 --2- 172.21.15.37:0/3931771737 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f41a00b6500 0x7f41a00b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f41ac02a9c0 tx=0x7f41ac030980 comp rx=0 tx=0).stop 2024-09-21T05:44:11.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.310+0000 7f41c1c00640 1 -- 172.21.15.37:0/3931771737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41bc105190 msgr2=0x7f41bc19d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:11.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.310+0000 7f41c1c00640 1 --2- 172.21.15.37:0/3931771737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41bc105190 0x7f41bc19d3e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f41b400eb10 tx=0x7f41b400ef10 comp rx=0 tx=0).stop 2024-09-21T05:44:11.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.311+0000 7f41c1c00640 1 -- 172.21.15.37:0/3931771737 shutdown_connections 2024-09-21T05:44:11.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.311+0000 7f41c1c00640 1 --2- 172.21.15.37:0/3931771737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41bc105190 0x7f41bc19d3e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.311+0000 7f41c1c00640 1 --2- 172.21.15.37:0/3931771737 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f41a00b6500 0x7f41a00b8a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.311+0000 7f41c1c00640 1 --2- 172.21.15.37:0/3931771737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f41bc1047f0 0x7f41bc19c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.311+0000 7f41c1c00640 1 --2- 172.21.15.37:0/3931771737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41bc103760 0x7f41bc19c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.311+0000 7f41c1c00640 1 -- 172.21.15.37:0/3931771737 >> 172.21.15.37:0/3931771737 conn(0x7f41bc0ff0b0 msgr2=0x7f41bc0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:11.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.311+0000 7f41c1c00640 1 -- 172.21.15.37:0/3931771737 shutdown_connections 2024-09-21T05:44:11.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.311+0000 7f41c1c00640 1 -- 172.21.15.37:0/3931771737 wait complete. 2024-09-21T05:44:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.797+0000 7fdc8fa00640 1 -- 172.21.15.37:0/3597753492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc88103750 msgr2=0x7fdc88103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.797+0000 7fdc8fa00640 1 --2- 172.21.15.37:0/3597753492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc88103750 0x7fdc88103bc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009900 tx=0x7fdc7c02a480 comp rx=0 tx=0).stop 2024-09-21T05:44:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.797+0000 7fdc8fa00640 1 -- 172.21.15.37:0/3597753492 shutdown_connections 2024-09-21T05:44:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.797+0000 7fdc8fa00640 1 --2- 172.21.15.37:0/3597753492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88105180 0x7fdc8810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.797+0000 7fdc8fa00640 1 --2- 172.21.15.37:0/3597753492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc881047e0 0x7fdc88104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.797+0000 7fdc8fa00640 1 --2- 172.21.15.37:0/3597753492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc88103750 0x7fdc88103bc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.797+0000 7fdc8fa00640 1 -- 172.21.15.37:0/3597753492 >> 172.21.15.37:0/3597753492 conn(0x7fdc880ff0c0 msgr2=0x7fdc88101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.797+0000 7fdc8fa00640 1 -- 172.21.15.37:0/3597753492 shutdown_connections 2024-09-21T05:44:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.797+0000 7fdc8fa00640 1 -- 172.21.15.37:0/3597753492 wait complete. 2024-09-21T05:44:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.798+0000 7fdc8fa00640 1 Processor -- start 2024-09-21T05:44:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.798+0000 7fdc8fa00640 1 -- start start 2024-09-21T05:44:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.798+0000 7fdc8fa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc88103750 0x7fdc88076dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.798+0000 7fdc8fa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc881047e0 0x7fdc88075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.798+0000 7fdc8fa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88105180 0x7fdc88075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.798+0000 7fdc8fa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8810f390 con 0x7fdc88105180 2024-09-21T05:44:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.798+0000 7fdc8fa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8810f210 con 0x7fdc881047e0 2024-09-21T05:44:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.798+0000 7fdc8fa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8810f510 con 0x7fdc88103750 2024-09-21T05:44:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.799+0000 7fdc8da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88105180 0x7fdc88075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.799+0000 7fdc8d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc88103750 0x7fdc88076dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.799+0000 7fdc8d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc88103750 0x7fdc88076dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:33878/0 (socket says 172.21.15.37:33878) 2024-09-21T05:44:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.799+0000 7fdc87e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc881047e0 0x7fdc88075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.799+0000 7fdc8da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88105180 0x7fdc88075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34402/0 (socket says 172.21.15.37:34402) 2024-09-21T05:44:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.799+0000 7fdc8d000640 1 -- 172.21.15.37:0/358385106 learned_addr learned my addr 172.21.15.37:0/358385106 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.799+0000 7fdc87e00640 1 -- 172.21.15.37:0/358385106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc88103750 msgr2=0x7fdc88076dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.799+0000 7fdc87e00640 1 --2- 172.21.15.37:0/358385106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc88103750 0x7fdc88076dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.799+0000 7fdc87e00640 1 -- 172.21.15.37:0/358385106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88105180 msgr2=0x7fdc88075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.799+0000 7fdc87e00640 1 --2- 172.21.15.37:0/358385106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88105180 0x7fdc88075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.799+0000 7fdc87e00640 1 -- 172.21.15.37:0/358385106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc880762f0 con 0x7fdc881047e0 2024-09-21T05:44:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.800+0000 7fdc87e00640 1 --2- 172.21.15.37:0/358385106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc881047e0 0x7fdc88075710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400e9f0 tx=0x7fdc7400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.800+0000 7fdc85600640 1 -- 172.21.15.37:0/358385106 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400ccc0 con 0x7fdc881047e0 2024-09-21T05:44:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.800+0000 7fdc85600640 1 -- 172.21.15.37:0/358385106 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc74005020 con 0x7fdc881047e0 2024-09-21T05:44:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.800+0000 7fdc85600640 1 -- 172.21.15.37:0/358385106 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc74004a00 con 0x7fdc881047e0 2024-09-21T05:44:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.800+0000 7fdc8fa00640 1 -- 172.21.15.37:0/358385106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc881a40a0 con 0x7fdc881047e0 2024-09-21T05:44:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.800+0000 7fdc8fa00640 1 -- 172.21.15.37:0/358385106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc881a44a0 con 0x7fdc881047e0 2024-09-21T05:44:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.801+0000 7fdc8fa00640 1 -- 172.21.15.37:0/358385106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc8810a930 con 0x7fdc881047e0 2024-09-21T05:44:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.803+0000 7fdc85600640 1 -- 172.21.15.37:0/358385106 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fdc74046bd0 con 0x7fdc881047e0 2024-09-21T05:44:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.806+0000 7fdc85600640 1 --2- 172.21.15.37:0/358385106 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdc700b6500 0x7fdc700b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.806+0000 7fdc85600640 1 -- 172.21.15.37:0/358385106 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdc740e55d0 con 0x7fdc881047e0 2024-09-21T05:44:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.806+0000 7fdc8d000640 1 --2- 172.21.15.37:0/358385106 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdc700b6500 0x7fdc700b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:11.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.807+0000 7fdc85600640 1 -- 172.21.15.37:0/358385106 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc740ada90 con 0x7fdc881047e0 2024-09-21T05:44:11.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:10.807+0000 7fdc8d000640 1 --2- 172.21.15.37:0/358385106 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdc700b6500 0x7fdc700b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0096c0 tx=0x7fdc7c0314a0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:11.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.023+0000 7fdc8fa00640 1 -- 172.21.15.37:0/358385106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fdc8802e640 con 0x7fdc881047e0 2024-09-21T05:44:11.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.031+0000 7fdc85600640 1 -- 172.21.15.37:0/358385106 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v31)=0 v31) ==== 116+0+0 (secure 0 0 0) 0x7fdc740b1e70 con 0x7fdc881047e0 2024-09-21T05:44:11.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.034+0000 7fdc8fa00640 1 -- 172.21.15.37:0/358385106 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdc700b6500 msgr2=0x7fdc700b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:11.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.034+0000 7fdc8fa00640 1 --2- 172.21.15.37:0/358385106 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdc700b6500 0x7fdc700b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0096c0 tx=0x7fdc7c0314a0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.034+0000 7fdc8fa00640 1 -- 172.21.15.37:0/358385106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc881047e0 msgr2=0x7fdc88075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:11.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.034+0000 7fdc8fa00640 1 --2- 172.21.15.37:0/358385106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc881047e0 0x7fdc88075710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400e9f0 tx=0x7fdc7400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.034+0000 7fdc8fa00640 1 -- 172.21.15.37:0/358385106 shutdown_connections 2024-09-21T05:44:11.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.034+0000 7fdc8fa00640 1 --2- 172.21.15.37:0/358385106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc88105180 0x7fdc88075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.034+0000 7fdc8fa00640 1 --2- 172.21.15.37:0/358385106 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdc700b6500 0x7fdc700b8a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.034+0000 7fdc8fa00640 1 --2- 172.21.15.37:0/358385106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc881047e0 0x7fdc88075710 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.034+0000 7fdc8fa00640 1 --2- 172.21.15.37:0/358385106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc88103750 0x7fdc88076dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:11.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.034+0000 7fdc8fa00640 1 -- 172.21.15.37:0/358385106 >> 172.21.15.37:0/358385106 conn(0x7fdc880ff0c0 msgr2=0x7fdc88107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:11.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.034+0000 7fdc8fa00640 1 -- 172.21.15.37:0/358385106 shutdown_connections 2024-09-21T05:44:11.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:11.034+0000 7fdc8fa00640 1 -- 172.21.15.37:0/358385106 wait complete. 2024-09-21T05:44:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:11 smithi144 ceph-mon[34351]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:11 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:44:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:11 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:44:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:11 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:44:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:11 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:11 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:11 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:11 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:12.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:11 smithi037 ceph-mon[30631]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:12.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:11 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:44:12.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:11 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:44:12.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:11 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:44:12.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:12.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:12.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:12.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:12.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:11 smithi067 ceph-mon[34443]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:11 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:44:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:11 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:44:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:11 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:44:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:11 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:11 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:11 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:11 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:14.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:13 smithi037 ceph-mon[30631]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:14.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:13 smithi067 ceph-mon[34443]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:14.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:13 smithi144 ceph-mon[34351]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.353+0000 7ff778a00640 1 -- 172.21.15.37:0/27179417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff774103570 msgr2=0x7ff7741039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.353+0000 7ff778a00640 1 --2- 172.21.15.37:0/27179417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff774103570 0x7ff7741039e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff764009900 tx=0x7ff76402a480 comp rx=0 tx=0).stop 2024-09-21T05:44:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.354+0000 7ff778a00640 1 -- 172.21.15.37:0/27179417 shutdown_connections 2024-09-21T05:44:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.354+0000 7ff778a00640 1 --2- 172.21.15.37:0/27179417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff774104fa0 0x7ff77410b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.354+0000 7ff778a00640 1 --2- 172.21.15.37:0/27179417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff774104600 0x7ff774104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.354+0000 7ff778a00640 1 --2- 172.21.15.37:0/27179417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff774103570 0x7ff7741039e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.354+0000 7ff778a00640 1 -- 172.21.15.37:0/27179417 >> 172.21.15.37:0/27179417 conn(0x7ff7740feec0 msgr2=0x7ff774101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.354+0000 7ff778a00640 1 -- 172.21.15.37:0/27179417 shutdown_connections 2024-09-21T05:44:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.354+0000 7ff778a00640 1 -- 172.21.15.37:0/27179417 wait complete. 2024-09-21T05:44:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.355+0000 7ff778a00640 1 Processor -- start 2024-09-21T05:44:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.355+0000 7ff778a00640 1 -- start start 2024-09-21T05:44:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.355+0000 7ff778a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff774103570 0x7ff774076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.355+0000 7ff778a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff774104600 0x7ff774075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.355+0000 7ff778a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff774104fa0 0x7ff774075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.355+0000 7ff778a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff77410f210 con 0x7ff774103570 2024-09-21T05:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.355+0000 7ff778a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff77410f090 con 0x7ff774104600 2024-09-21T05:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.355+0000 7ff778a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff77410f390 con 0x7ff774104fa0 2024-09-21T05:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.355+0000 7ff772800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff774103570 0x7ff774076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.355+0000 7ff771e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff774104600 0x7ff774075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.355+0000 7ff771e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff774104600 0x7ff774075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:45504/0 (socket says 172.21.15.37:45504) 2024-09-21T05:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.356+0000 7ff771e00640 1 -- 172.21.15.37:0/2827138552 learned_addr learned my addr 172.21.15.37:0/2827138552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.356+0000 7ff773200640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff774104fa0 0x7ff774075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.356+0000 7ff771e00640 1 -- 172.21.15.37:0/2827138552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff774104fa0 msgr2=0x7ff774075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.356+0000 7ff771e00640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff774104fa0 0x7ff774075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.356+0000 7ff771e00640 1 -- 172.21.15.37:0/2827138552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff774103570 msgr2=0x7ff774076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.356+0000 7ff771e00640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff774103570 0x7ff774076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.356+0000 7ff771e00640 1 -- 172.21.15.37:0/2827138552 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff774076350 con 0x7ff774104600 2024-09-21T05:44:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.356+0000 7ff773200640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff774104fa0 0x7ff774075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:44:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.356+0000 7ff771e00640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff774104600 0x7ff774075710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff76000e9f0 tx=0x7ff76000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.357+0000 7ff76b400640 1 -- 172.21.15.37:0/2827138552 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76000cd80 con 0x7ff774104600 2024-09-21T05:44:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.357+0000 7ff76b400640 1 -- 172.21.15.37:0/2827138552 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7600054d0 con 0x7ff774104600 2024-09-21T05:44:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.357+0000 7ff76b400640 1 -- 172.21.15.37:0/2827138552 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760010690 con 0x7ff774104600 2024-09-21T05:44:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.357+0000 7ff778a00640 1 -- 172.21.15.37:0/2827138552 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7741a3ea0 con 0x7ff774104600 2024-09-21T05:44:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.357+0000 7ff778a00640 1 -- 172.21.15.37:0/2827138552 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7741a4240 con 0x7ff774104600 2024-09-21T05:44:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.358+0000 7ff778a00640 1 -- 172.21.15.37:0/2827138552 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7741039e0 con 0x7ff774104600 2024-09-21T05:44:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.361+0000 7ff76b400640 1 -- 172.21.15.37:0/2827138552 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7ff760004e30 con 0x7ff774104600 2024-09-21T05:44:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.362+0000 7ff76b400640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff7580b6580 0x7ff7580b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.363+0000 7ff76b400640 1 -- 172.21.15.37:0/2827138552 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff7600e5c10 con 0x7ff774104600 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.363+0000 7ff772800640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff7580b6580 0x7ff7580b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.363+0000 7ff772800640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff7580b6580 0x7ff7580b8a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff764004770 tx=0x7ff7640314a0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.364+0000 7ff76b400640 1 -- 172.21.15.37:0/2827138552 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7600ae0d0 con 0x7ff774104600 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.570+0000 7ff778a00640 1 -- 172.21.15.37:0/2827138552 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7ff77410a750 con 0x7ff774104600 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.577+0000 7ff76b400640 1 -- 172.21.15.37:0/2827138552 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v33)=0 v33) ==== 117+0+0 (secure 0 0 0) 0x7ff77410a750 con 0x7ff774104600 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.579+0000 7ff778a00640 1 -- 172.21.15.37:0/2827138552 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff7580b6580 msgr2=0x7ff7580b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.579+0000 7ff778a00640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff7580b6580 0x7ff7580b8a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff764004770 tx=0x7ff7640314a0 comp rx=0 tx=0).stop 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.579+0000 7ff778a00640 1 -- 172.21.15.37:0/2827138552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff774104600 msgr2=0x7ff774075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.579+0000 7ff778a00640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff774104600 0x7ff774075710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff76000e9f0 tx=0x7ff76000edf0 comp rx=0 tx=0).stop 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.579+0000 7ff778a00640 1 -- 172.21.15.37:0/2827138552 shutdown_connections 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.579+0000 7ff778a00640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff774104fa0 0x7ff774075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.579+0000 7ff778a00640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff7580b6580 0x7ff7580b8a90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.579+0000 7ff778a00640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff774104600 0x7ff774075710 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.579+0000 7ff778a00640 1 --2- 172.21.15.37:0/2827138552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff774103570 0x7ff774076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:14.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.579+0000 7ff778a00640 1 -- 172.21.15.37:0/2827138552 >> 172.21.15.37:0/2827138552 conn(0x7ff7740feec0 msgr2=0x7ff774107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:14.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.579+0000 7ff778a00640 1 -- 172.21.15.37:0/2827138552 shutdown_connections 2024-09-21T05:44:14.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:14.579+0000 7ff778a00640 1 -- 172.21.15.37:0/2827138552 wait complete. 2024-09-21T05:44:15.771 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:15 smithi037 ceph-mon[30631]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:15.771 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:15 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' 2024-09-21T05:44:15.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:15 smithi144 ceph-mon[34351]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:15.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:15 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' 2024-09-21T05:44:15.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:15 smithi067 ceph-mon[34443]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:15.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:15 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T05:44:16.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.777 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.778 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.779 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.779 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.779 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.779 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c10cdda-77dc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi037') 2024-09-21T05:44:16.779 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T05:44:17.147 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.711+0000 7f55fa000640 1 -- 172.21.15.37:0/682961496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f4104640 msgr2=0x7f55f4104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.711+0000 7f55fa000640 1 --2- 172.21.15.37:0/682961496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f4104640 0x7f55f4104a50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009900 tx=0x7f55e002a480 comp rx=0 tx=0).stop 2024-09-21T05:44:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.711+0000 7f55fa000640 1 -- 172.21.15.37:0/682961496 shutdown_connections 2024-09-21T05:44:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.712+0000 7f55fa000640 1 --2- 172.21.15.37:0/682961496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55f4104fe0 0x7f55f410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.712+0000 7f55fa000640 1 --2- 172.21.15.37:0/682961496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f4104640 0x7f55f4104a50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.712+0000 7f55fa000640 1 --2- 172.21.15.37:0/682961496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f41035b0 0x7f55f4103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.712+0000 7f55fa000640 1 -- 172.21.15.37:0/682961496 >> 172.21.15.37:0/682961496 conn(0x7f55f40fef20 msgr2=0x7f55f41013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.712+0000 7f55fa000640 1 -- 172.21.15.37:0/682961496 shutdown_connections 2024-09-21T05:44:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.712+0000 7f55fa000640 1 -- 172.21.15.37:0/682961496 wait complete. 2024-09-21T05:44:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.713+0000 7f55fa000640 1 Processor -- start 2024-09-21T05:44:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.713+0000 7f55fa000640 1 -- start start 2024-09-21T05:44:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55fa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f41035b0 0x7f55f4199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55fa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55f4104640 0x7f55f419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55fa000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f4104fe0 0x7f55f419b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55fa000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55f410f250 con 0x7f55f41035b0 2024-09-21T05:44:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55fa000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f55f410f0d0 con 0x7f55f4104fe0 2024-09-21T05:44:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55fa000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f55f410f3d0 con 0x7f55f4104640 2024-09-21T05:44:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55f8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f41035b0 0x7f55f4199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55f3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55f4104640 0x7f55f419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55f8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f41035b0 0x7f55f4199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45392/0 (socket says 172.21.15.37:45392) 2024-09-21T05:44:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55f8c00640 1 -- 172.21.15.37:0/4171797606 learned_addr learned my addr 172.21.15.37:0/4171797606 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55f9600640 1 --2- 172.21.15.37:0/4171797606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f4104fe0 0x7f55f419b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55f8c00640 1 -- 172.21.15.37:0/4171797606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55f4104640 msgr2=0x7f55f419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55f8c00640 1 --2- 172.21.15.37:0/4171797606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55f4104640 0x7f55f419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55f8c00640 1 -- 172.21.15.37:0/4171797606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f4104fe0 msgr2=0x7f55f419b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55f8c00640 1 --2- 172.21.15.37:0/4171797606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f4104fe0 0x7f55f419b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.714+0000 7f55f8c00640 1 -- 172.21.15.37:0/4171797606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f419b8d0 con 0x7f55f41035b0 2024-09-21T05:44:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.715+0000 7f55f8c00640 1 --2- 172.21.15.37:0/4171797606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f41035b0 0x7f55f4199ea0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f55e800e9f0 tx=0x7f55e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.715+0000 7f55f1600640 1 -- 172.21.15.37:0/4171797606 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e800cd80 con 0x7f55f41035b0 2024-09-21T05:44:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.715+0000 7f55f1600640 1 -- 172.21.15.37:0/4171797606 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55e80108e0 con 0x7f55f41035b0 2024-09-21T05:44:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.715+0000 7f55f1600640 1 -- 172.21.15.37:0/4171797606 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8018980 con 0x7f55f41035b0 2024-09-21T05:44:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.715+0000 7f55fa000640 1 -- 172.21.15.37:0/4171797606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f419bbc0 con 0x7f55f41035b0 2024-09-21T05:44:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.715+0000 7f55fa000640 1 -- 172.21.15.37:0/4171797606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f40757c0 con 0x7f55f41035b0 2024-09-21T05:44:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.716+0000 7f55fa000640 1 -- 172.21.15.37:0/4171797606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f4103a20 con 0x7f55f41035b0 2024-09-21T05:44:17.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.719+0000 7f55f1600640 1 -- 172.21.15.37:0/4171797606 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f55e8010430 con 0x7f55f41035b0 2024-09-21T05:44:17.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.720+0000 7f55f1600640 1 --2- 172.21.15.37:0/4171797606 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f55dc0b6480 0x7f55dc0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:17.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.720+0000 7f55f1600640 1 -- 172.21.15.37:0/4171797606 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f55e80e5eb0 con 0x7f55f41035b0 2024-09-21T05:44:17.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.720+0000 7f55f3e00640 1 --2- 172.21.15.37:0/4171797606 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f55dc0b6480 0x7f55dc0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:17.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.721+0000 7f55f3e00640 1 --2- 172.21.15.37:0/4171797606 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f55dc0b6480 0x7f55dc0b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f55e0004770 tx=0x7f55e00314a0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:17.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.722+0000 7f55f1600640 1 -- 172.21.15.37:0/4171797606 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55e80b2750 con 0x7f55f41035b0 2024-09-21T05:44:17.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:17 smithi144 ceph-mon[34351]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:17.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:17 smithi037 ceph-mon[30631]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:17.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.925+0000 7f55fa000640 1 -- 172.21.15.37:0/4171797606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f55f402e640 con 0x7f55f41035b0 2024-09-21T05:44:17.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.926+0000 7f55f1600640 1 -- 172.21.15.37:0/4171797606 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+20909 (secure 0 0 0) 0x7f55e80b7690 con 0x7f55f41035b0 2024-09-21T05:44:17.929 INFO:teuthology.orchestra.run.smithi037.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T05:44:17.929 INFO:teuthology.orchestra.run.smithi037.stdout:global dev auth_debug true 2024-09-21T05:44:17.929 INFO:teuthology.orchestra.run.smithi037.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T05:44:17.929 INFO:teuthology.orchestra.run.smithi037.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T05:44:17.929 INFO:teuthology.orchestra.run.smithi037.stdout:global basic log_to_file true 2024-09-21T05:44:17.929 INFO:teuthology.orchestra.run.smithi037.stdout:global basic log_to_journald false 2024-09-21T05:44:17.929 INFO:teuthology.orchestra.run.smithi037.stdout:global basic log_to_stderr false 2024-09-21T05:44:17.929 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_allow_pool_delete true 2024-09-21T05:44:17.929 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T05:44:17.929 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:global dev ms_die_on_bug true 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:global dev ms_die_on_old_message true 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:global dev ms_die_on_skipped_message false 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T05:44:17.930 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced debug_mon 20/20 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced debug_ms 1/1 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced debug_paxos 20/20 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T05:44:17.931 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T05:44:17.932 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T05:44:17.932 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced client_mount_timeout 30 2024-09-21T05:44:17.932 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced debug_client 20/20 2024-09-21T05:44:17.932 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced debug_mgr 20/20 2024-09-21T05:44:17.932 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced debug_ms 1/1 2024-09-21T05:44:17.932 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T05:44:17.932 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T05:44:17.932 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev bdev_debug_aio true 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced debug_bluefs 20/20 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced debug_bluestore 20/20 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced debug_ms 1/1 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced debug_osd 20/20 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T05:44:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T05:44:17.934 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_op_order true 2024-09-21T05:44:17.934 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T05:44:17.934 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_shutdown true 2024-09-21T05:44:17.934 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T05:44:17.934 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T05:44:17.934 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T05:44:17.934 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T05:44:17.934 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T05:44:17.934 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_max_omap_entries_per_request 10000 2024-09-21T05:44:17.934 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T05:44:17.934 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced debug_mds 20/20 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced debug_ms 2/2 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T05:44:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced mds_bal_split_size 100 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:mds dev mds_debug_frag true 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:mds dev mds_debug_scatterstat true 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:mds dev mds_verify_scatter true 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:client advanced client_mount_timeout 600 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:client advanced debug_client 20/20 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:client advanced debug_ms 1/1 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T05:44:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T05:44:17.937 INFO:teuthology.orchestra.run.smithi037.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T05:44:17.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.930+0000 7f55fa000640 1 -- 172.21.15.37:0/4171797606 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f55dc0b6480 msgr2=0x7f55dc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:17.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.930+0000 7f55fa000640 1 --2- 172.21.15.37:0/4171797606 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f55dc0b6480 0x7f55dc0b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f55e0004770 tx=0x7f55e00314a0 comp rx=0 tx=0).stop 2024-09-21T05:44:17.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.930+0000 7f55fa000640 1 -- 172.21.15.37:0/4171797606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f41035b0 msgr2=0x7f55f4199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:17.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.930+0000 7f55fa000640 1 --2- 172.21.15.37:0/4171797606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f41035b0 0x7f55f4199ea0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f55e800e9f0 tx=0x7f55e800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:44:17.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.930+0000 7f55fa000640 1 -- 172.21.15.37:0/4171797606 shutdown_connections 2024-09-21T05:44:17.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.930+0000 7f55fa000640 1 --2- 172.21.15.37:0/4171797606 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f55dc0b6480 0x7f55dc0b8990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:17.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.930+0000 7f55fa000640 1 --2- 172.21.15.37:0/4171797606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55f4104fe0 0x7f55f419b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:17.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.930+0000 7f55fa000640 1 --2- 172.21.15.37:0/4171797606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55f4104640 0x7f55f419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:17.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.930+0000 7f55fa000640 1 --2- 172.21.15.37:0/4171797606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f41035b0 0x7f55f4199ea0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:17.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.930+0000 7f55fa000640 1 -- 172.21.15.37:0/4171797606 >> 172.21.15.37:0/4171797606 conn(0x7f55f40fef20 msgr2=0x7f55f4107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:17.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.931+0000 7f55fa000640 1 -- 172.21.15.37:0/4171797606 shutdown_connections 2024-09-21T05:44:17.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:17.931+0000 7f55fa000640 1 -- 172.21.15.37:0/4171797606 wait complete. 2024-09-21T05:44:17.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:17 smithi067 ceph-mon[34443]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:18.700 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T05:44:18.701 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:44:18.701 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T05:44:18.737 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T05:44:18.738 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-09-21T05:44:18.812 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T05:44:18.812 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:44:18.812 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-09-21T05:44:18.812 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:44:18.812 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:44:18.812 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-21 05:42:58.976653977 +0000 2024-09-21T05:44:18.812 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-21 05:38:28.761747712 +0000 2024-09-21T05:44:18.813 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-21 05:38:28.761747712 +0000 2024-09-21T05:44:18.813 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-21 05:38:28.761747712 +0000 2024-09-21T05:44:18.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T05:44:18.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:18 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/4171797606' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T05:44:18.899 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:18 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/4171797606' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T05:44:18.906 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-21T05:44:18.906 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-21T05:44:18.906 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000266131 s, 1.9 MB/s 2024-09-21T05:44:18.909 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T05:44:18.945 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-09-21T05:44:18.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:18 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/4171797606' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T05:44:19.022 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T05:44:19.022 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:44:19.022 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-09-21T05:44:19.022 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:44:19.022 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:44:19.023 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-21 05:42:59.024653360 +0000 2024-09-21T05:44:19.023 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-21 05:38:29.216741762 +0000 2024-09-21T05:44:19.023 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-21 05:38:29.216741762 +0000 2024-09-21T05:44:19.023 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-21 05:38:29.216741762 +0000 2024-09-21T05:44:19.023 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T05:44:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-21T05:44:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-21T05:44:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000263806 s, 1.9 MB/s 2024-09-21T05:44:19.117 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T05:44:19.154 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-09-21T05:44:19.229 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T05:44:19.229 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:44:19.229 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-09-21T05:44:19.229 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:44:19.229 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:44:19.229 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-21 05:42:59.074652717 +0000 2024-09-21T05:44:19.229 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-21 05:38:29.700735433 +0000 2024-09-21T05:44:19.229 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-21 05:38:29.701735420 +0000 2024-09-21T05:44:19.230 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-21 05:38:29.700735433 +0000 2024-09-21T05:44:19.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T05:44:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-21T05:44:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-21T05:44:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000258135 s, 2.0 MB/s 2024-09-21T05:44:19.324 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T05:44:19.361 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-09-21T05:44:19.436 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T05:44:19.436 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:44:19.436 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-09-21T05:44:19.436 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:44:19.436 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:44:19.436 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-21 05:42:59.122652100 +0000 2024-09-21T05:44:19.436 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-21 05:38:30.198728920 +0000 2024-09-21T05:44:19.436 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-21 05:38:30.198728920 +0000 2024-09-21T05:44:19.436 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-21 05:38:30.198728920 +0000 2024-09-21T05:44:19.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T05:44:19.528 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-21T05:44:19.529 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-21T05:44:19.529 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000277487 s, 1.8 MB/s 2024-09-21T05:44:19.532 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T05:44:19.568 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-21T05:44:19.568 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T05:44:19.588 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T05:44:19.588 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2024-09-21T05:44:19.647 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T05:44:19.647 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:44:19.647 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T05:44:19.647 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:44:19.647 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:44:19.647 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-21 05:43:50.489049167 +0000 2024-09-21T05:44:19.647 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-21 05:37:48.978543832 +0000 2024-09-21T05:44:19.647 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-21 05:37:48.978543832 +0000 2024-09-21T05:44:19.647 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-21 05:37:48.978543832 +0000 2024-09-21T05:44:19.648 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T05:44:19.716 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-21T05:44:19.716 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-21T05:44:19.716 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000296887 s, 1.7 MB/s 2024-09-21T05:44:19.717 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T05:44:19.776 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2024-09-21T05:44:19.831 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T05:44:19.832 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:44:19.832 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T05:44:19.832 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:44:19.832 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:44:19.832 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-21 05:43:50.489049167 +0000 2024-09-21T05:44:19.832 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-21 05:37:49.313536130 +0000 2024-09-21T05:44:19.832 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-21 05:37:49.313536130 +0000 2024-09-21T05:44:19.832 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-21 05:37:49.313536130 +0000 2024-09-21T05:44:19.832 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T05:44:19.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:19 smithi144 ceph-mon[34351]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:19.894 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:19 smithi067 ceph-mon[34443]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:19.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-21T05:44:19.897 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-21T05:44:19.897 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.00022584 s, 2.3 MB/s 2024-09-21T05:44:19.898 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T05:44:19.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:19 smithi037 ceph-mon[30631]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:19.955 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2024-09-21T05:44:20.011 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T05:44:20.011 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:44:20.011 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-21T05:44:20.011 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:44:20.012 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:44:20.012 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-21 05:43:50.489049167 +0000 2024-09-21T05:44:20.012 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-21 05:37:49.653528312 +0000 2024-09-21T05:44:20.012 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-21 05:37:49.653528312 +0000 2024-09-21T05:44:20.012 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-21 05:37:49.653528312 +0000 2024-09-21T05:44:20.012 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T05:44:20.075 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-21T05:44:20.076 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-21T05:44:20.076 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000225091 s, 2.3 MB/s 2024-09-21T05:44:20.077 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T05:44:20.134 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2024-09-21T05:44:20.189 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T05:44:20.189 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:44:20.189 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T05:44:20.189 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:44:20.189 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:44:20.189 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-21 05:43:50.490049145 +0000 2024-09-21T05:44:20.189 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-21 05:37:49.989520587 +0000 2024-09-21T05:44:20.189 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-21 05:37:49.989520587 +0000 2024-09-21T05:44:20.190 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-21 05:37:49.989520587 +0000 2024-09-21T05:44:20.190 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T05:44:20.253 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-21T05:44:20.253 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-21T05:44:20.253 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.00018963 s, 2.7 MB/s 2024-09-21T05:44:20.254 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T05:44:20.311 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T05:44:20.311 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T05:44:20.331 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T05:44:20.331 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2024-09-21T05:44:20.391 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T05:44:20.391 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:44:20.391 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-21T05:44:20.391 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:44:20.391 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:44:20.391 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-21 05:43:48.004217961 +0000 2024-09-21T05:44:20.391 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-21 05:37:48.883902672 +0000 2024-09-21T05:44:20.391 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-21 05:37:48.883902672 +0000 2024-09-21T05:44:20.391 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-21 05:37:48.883902672 +0000 2024-09-21T05:44:20.392 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T05:44:20.461 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-21T05:44:20.461 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-21T05:44:20.461 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000258599 s, 2.0 MB/s 2024-09-21T05:44:20.462 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T05:44:20.520 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2024-09-21T05:44:20.577 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T05:44:20.577 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:44:20.577 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T05:44:20.577 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:44:20.577 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:44:20.578 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-21 05:43:48.004217961 +0000 2024-09-21T05:44:20.578 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-21 05:37:49.221897183 +0000 2024-09-21T05:44:20.578 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-21 05:37:49.221897183 +0000 2024-09-21T05:44:20.578 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-21 05:37:49.221897183 +0000 2024-09-21T05:44:20.578 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T05:44:20.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-21T05:44:20.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-21T05:44:20.644 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000286557 s, 1.8 MB/s 2024-09-21T05:44:20.645 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T05:44:20.702 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2024-09-21T05:44:20.758 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T05:44:20.758 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:44:20.758 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-21T05:44:20.758 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:44:20.758 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:44:20.758 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-21 05:43:48.004217961 +0000 2024-09-21T05:44:20.758 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-21 05:37:49.548891872 +0000 2024-09-21T05:44:20.758 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-21 05:37:49.548891872 +0000 2024-09-21T05:44:20.758 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-21 05:37:49.548891872 +0000 2024-09-21T05:44:20.759 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T05:44:20.822 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-21T05:44:20.822 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-21T05:44:20.822 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000177797 s, 2.9 MB/s 2024-09-21T05:44:20.823 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T05:44:20.879 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2024-09-21T05:44:20.934 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T05:44:20.934 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T05:44:20.934 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T05:44:20.935 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:44:20.935 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T05:44:20.935 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-21 05:43:48.005217945 +0000 2024-09-21T05:44:20.935 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-21 05:37:49.886886383 +0000 2024-09-21T05:44:20.935 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-21 05:37:49.886886383 +0000 2024-09-21T05:44:20.935 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-21 05:37:49.886886383 +0000 2024-09-21T05:44:20.935 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T05:44:20.998 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-21T05:44:20.999 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-21T05:44:20.999 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000203944 s, 2.5 MB/s 2024-09-21T05:44:21.000 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T05:44:21.056 INFO:tasks.cephadm:Deploying osd.0 on smithi037 with /dev/vg_nvme/lv_4... 2024-09-21T05:44:21.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T05:44:21.436 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:21.834 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:21 smithi037 ceph-mon[30631]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:21.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:21 smithi144 ceph-mon[34351]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:21 smithi067 ceph-mon[34443]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:23.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:23 smithi037 ceph-mon[30631]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:23.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:23 smithi144 ceph-mon[34351]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:23.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:23 smithi067 ceph-mon[34443]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:24.608 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:44:24.640 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi037:vg_nvme/lv_4 2024-09-21T05:44:25.008 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:44:25.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.534+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3621388951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c54105980 msgr2=0x7f7c54105df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:25.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.534+0000 7f7c5ae00640 1 --2- 172.21.15.37:0/3621388951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c54105980 0x7f7c54105df0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009900 tx=0x7f7c4402a480 comp rx=0 tx=0).stop 2024-09-21T05:44:25.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.534+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3621388951 shutdown_connections 2024-09-21T05:44:25.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.534+0000 7f7c5ae00640 1 --2- 172.21.15.37:0/3621388951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c541073b0 0x7f7c5410dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:25.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.534+0000 7f7c5ae00640 1 --2- 172.21.15.37:0/3621388951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c54106a10 0x7f7c54106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:25.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.534+0000 7f7c5ae00640 1 --2- 172.21.15.37:0/3621388951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c54105980 0x7f7c54105df0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:25.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.534+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3621388951 >> 172.21.15.37:0/3621388951 conn(0x7f7c541012f0 msgr2=0x7f7c541037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:25.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.534+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3621388951 shutdown_connections 2024-09-21T05:44:25.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.534+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3621388951 wait complete. 2024-09-21T05:44:25.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.535+0000 7f7c5ae00640 1 Processor -- start 2024-09-21T05:44:25.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.536+0000 7f7c5ae00640 1 -- start start 2024-09-21T05:44:25.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.536+0000 7f7c5ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c54105980 0x7f7c5419c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:25.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.536+0000 7f7c5ae00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c54106a10 0x7f7c5419c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:25.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.536+0000 7f7c5ae00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c541073b0 0x7f7c5419d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:25.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.536+0000 7f7c5ae00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c541115f0 con 0x7f7c54106a10 2024-09-21T05:44:25.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.536+0000 7f7c5ae00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7c54111470 con 0x7f7c541073b0 2024-09-21T05:44:25.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.536+0000 7f7c5ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7c54111770 con 0x7f7c54105980 2024-09-21T05:44:25.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.536+0000 7f7c53400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c54106a10 0x7f7c5419c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:25.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.536+0000 7f7c53400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c54106a10 0x7f7c5419c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54800/0 (socket says 172.21.15.37:54800) 2024-09-21T05:44:25.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.536+0000 7f7c53400640 1 -- 172.21.15.37:0/3441724266 learned_addr learned my addr 172.21.15.37:0/3441724266 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:44:25.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.536+0000 7f7c53e00640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c54105980 0x7f7c5419c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:25.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.536+0000 7f7c58e00640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c541073b0 0x7f7c5419d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:25.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.537+0000 7f7c53400640 1 -- 172.21.15.37:0/3441724266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c54105980 msgr2=0x7f7c5419c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:25.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.537+0000 7f7c53400640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c54105980 0x7f7c5419c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.537+0000 7f7c53400640 1 -- 172.21.15.37:0/3441724266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c541073b0 msgr2=0x7f7c5419d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.537+0000 7f7c53400640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c541073b0 0x7f7c5419d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.537+0000 7f7c53400640 1 -- 172.21.15.37:0/3441724266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5419dc10 con 0x7f7c54106a10 2024-09-21T05:44:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.537+0000 7f7c58e00640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c541073b0 0x7f7c5419d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:44:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.537+0000 7f7c53400640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c54106a10 0x7f7c5419c850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000e9f0 tx=0x7f7c4000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.538+0000 7f7c50c00640 1 -- 172.21.15.37:0/3441724266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000cd80 con 0x7f7c54106a10 2024-09-21T05:44:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.538+0000 7f7c50c00640 1 -- 172.21.15.37:0/3441724266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c400108e0 con 0x7f7c54106a10 2024-09-21T05:44:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.538+0000 7f7c50c00640 1 -- 172.21.15.37:0/3441724266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40018980 con 0x7f7c54106a10 2024-09-21T05:44:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.538+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3441724266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5419df00 con 0x7f7c54106a10 2024-09-21T05:44:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.538+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3441724266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c541a4600 con 0x7f7c54106a10 2024-09-21T05:44:25.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.539+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3441724266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c5410cb60 con 0x7f7c54106a10 2024-09-21T05:44:25.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.541+0000 7f7c50c00640 1 -- 172.21.15.37:0/3441724266 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f7c40010430 con 0x7f7c54106a10 2024-09-21T05:44:25.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.544+0000 7f7c50c00640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7c380b6580 0x7f7c380b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:25.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.544+0000 7f7c50c00640 1 -- 172.21.15.37:0/3441724266 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7c400e5df0 con 0x7f7c54106a10 2024-09-21T05:44:25.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.544+0000 7f7c53e00640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7c380b6580 0x7f7c380b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:25.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.545+0000 7f7c53e00640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7c380b6580 0x7f7c380b8a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7c44004770 tx=0x7f7c440314a0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:25.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.546+0000 7f7c50c00640 1 -- 172.21.15.37:0/3441724266 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c400b2690 con 0x7f7c54106a10 2024-09-21T05:44:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:25.757+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3441724266 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7c54063800 con 0x7f7c380b6580 2024-09-21T05:44:25.760 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:25 smithi037 ceph-mon[30631]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:25.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:25 smithi144 ceph-mon[34351]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:25.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:25 smithi067 ceph-mon[34443]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:26.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:26 smithi144 ceph-mon[34351]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:26.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:26 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:44:26.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:26 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:44:26.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:26 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:26.888 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:26 smithi037 ceph-mon[30631]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:26.888 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:26 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:44:26.889 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:26 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:44:26.889 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:26 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:26.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:26 smithi067 ceph-mon[34443]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:26.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:26 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:44:26.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:26 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:44:26.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:26 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:27.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:27 smithi144 ceph-mon[34351]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:27.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:27 smithi037 ceph-mon[30631]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:27.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:27 smithi067 ceph-mon[34443]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:28.862 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:28 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1495949719' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99c3eca3-ee08-45d9-b6d0-65e4035e1d7a"} : dispatch 2024-09-21T05:44:28.863 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:28 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1495949719' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99c3eca3-ee08-45d9-b6d0-65e4035e1d7a"}]': finished 2024-09-21T05:44:28.863 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:28 smithi037 ceph-mon[30631]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T05:44:28.863 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:28 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:28.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:28 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1495949719' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99c3eca3-ee08-45d9-b6d0-65e4035e1d7a"} : dispatch 2024-09-21T05:44:28.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:28 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1495949719' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99c3eca3-ee08-45d9-b6d0-65e4035e1d7a"}]': finished 2024-09-21T05:44:28.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:28 smithi144 ceph-mon[34351]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T05:44:28.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:28 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:28.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:28 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1495949719' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "99c3eca3-ee08-45d9-b6d0-65e4035e1d7a"} : dispatch 2024-09-21T05:44:28.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:28 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1495949719' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99c3eca3-ee08-45d9-b6d0-65e4035e1d7a"}]': finished 2024-09-21T05:44:28.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:28 smithi067 ceph-mon[34443]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T05:44:28.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:28 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:29.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:29 smithi144 ceph-mon[34351]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:29.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:29 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2457869145' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:44:29.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:29 smithi037 ceph-mon[30631]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:29.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:29 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2457869145' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:44:29.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:29 smithi067 ceph-mon[34443]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:29.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:29 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2457869145' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:44:31.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:31 smithi144 ceph-mon[34351]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:31.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:31 smithi037 ceph-mon[30631]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:31.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:31 smithi067 ceph-mon[34443]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:33.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:33 smithi144 ceph-mon[34351]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:33.910 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:33 smithi037 ceph-mon[30631]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:33.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:33 smithi067 ceph-mon[34443]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:35.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:35 smithi037 ceph-mon[30631]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:35.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:35 smithi067 ceph-mon[34443]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:36.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:35 smithi144 ceph-mon[34351]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:37.878 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:37 smithi037 ceph-mon[30631]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:37.878 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:37 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:44:37.878 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:37 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:37.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:37 smithi067 ceph-mon[34443]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:37.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:37 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:44:37.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:37 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:38.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:37 smithi144 ceph-mon[34351]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:38.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:37 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:44:38.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:37 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:38.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:38 smithi037 ceph-mon[30631]: Deploying daemon osd.0 on smithi037 2024-09-21T05:44:38.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:38 smithi067 ceph-mon[34443]: Deploying daemon osd.0 on smithi037 2024-09-21T05:44:39.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:38 smithi144 ceph-mon[34351]: Deploying daemon osd.0 on smithi037 2024-09-21T05:44:39.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:39 smithi037 ceph-mon[30631]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:39.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:39 smithi067 ceph-mon[34443]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:40.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:39 smithi144 ceph-mon[34351]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:41.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:41 smithi037 ceph-mon[30631]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:41.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:41 smithi067 ceph-mon[34443]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:41 smithi144 ceph-mon[34351]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:43.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:43 smithi037 ceph-mon[30631]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:43.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:43 smithi067 ceph-mon[34443]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:44.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:43 smithi144 ceph-mon[34351]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:45.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:45 smithi037 ceph-mon[30631]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:45.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:45 smithi067 ceph-mon[34443]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:45 smithi144 ceph-mon[34351]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:46.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:46.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:46.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:46.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:46.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:46.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:47.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:47.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:47.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:47.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:47 smithi037 ceph-mon[30631]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:47.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:47 smithi067 ceph-mon[34443]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:47 smithi144 ceph-mon[34351]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:49.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:49 smithi037 ceph-mon[30631]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:49.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:49.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:49.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:49.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:49.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:49.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:49 smithi067 ceph-mon[34443]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:49.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:49.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:49.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:49.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:49.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:49.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:49 smithi144 ceph-mon[34351]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:49.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:49.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:49.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:49.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:49.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:51.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:51.180+0000 7f7c50c00640 1 -- 172.21.15.37:0/3441724266 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7c54063800 con 0x7f7c380b6580 2024-09-21T05:44:51.183 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 0 on host 'smithi037' 2024-09-21T05:44:51.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:51.183+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3441724266 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7c380b6580 msgr2=0x7f7c380b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:51.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:51.183+0000 7f7c5ae00640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7c380b6580 0x7f7c380b8a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7c44004770 tx=0x7f7c440314a0 comp rx=0 tx=0).stop 2024-09-21T05:44:51.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:51.183+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3441724266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c54106a10 msgr2=0x7f7c5419c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:51.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:51.183+0000 7f7c5ae00640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c54106a10 0x7f7c5419c850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000e9f0 tx=0x7f7c4000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:44:51.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:51.183+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3441724266 shutdown_connections 2024-09-21T05:44:51.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:51.183+0000 7f7c5ae00640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7c380b6580 0x7f7c380b8a90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:51.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:51.183+0000 7f7c5ae00640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c541073b0 0x7f7c5419d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:51.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:51.183+0000 7f7c5ae00640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c54106a10 0x7f7c5419c850 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:51.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:51.183+0000 7f7c5ae00640 1 --2- 172.21.15.37:0/3441724266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c54105980 0x7f7c5419c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:51.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:51.183+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3441724266 >> 172.21.15.37:0/3441724266 conn(0x7f7c541012f0 msgr2=0x7f7c54109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:51.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:51.183+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3441724266 shutdown_connections 2024-09-21T05:44:51.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:44:51.183+0000 7f7c5ae00640 1 -- 172.21.15.37:0/3441724266 wait complete. 2024-09-21T05:44:51.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:51 smithi037 ceph-mon[30631]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:51.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:51 smithi067 ceph-mon[34443]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:51.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:51 smithi144 ceph-mon[34351]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:51.892 DEBUG:teuthology.orchestra.run.smithi037:osd.0> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T05:44:51.895 INFO:tasks.cephadm:Deploying osd.1 on smithi067 with /dev/vg_nvme/lv_4... 2024-09-21T05:44:51.896 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T05:44:52.154 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:44:52.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:52 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:52.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:52 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:52.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:52 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:52.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:52 smithi067 ceph-mon[34443]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:44:52.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:52 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:52.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:52 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:52.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:52 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:52.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:52 smithi144 ceph-mon[34351]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:44:52.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:52 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:44:52.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:52 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:52.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:52 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:52.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:52 smithi037 ceph-mon[30631]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:44:53.207 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:53 smithi067 ceph-mon[34443]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:53.207 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:53 smithi067 ceph-mon[34443]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:44:53.207 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:53 smithi067 ceph-mon[34443]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T05:44:53.207 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:53 smithi067 ceph-mon[34443]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:44:53.207 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:53.387 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:53 smithi037 ceph-mon[30631]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:53.388 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:53 smithi037 ceph-mon[30631]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:44:53.388 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:53 smithi037 ceph-mon[30631]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T05:44:53.388 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:53 smithi037 ceph-mon[30631]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:44:53.388 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:53.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:53 smithi144 ceph-mon[34351]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:53.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:53 smithi144 ceph-mon[34351]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:44:53.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:53 smithi144 ceph-mon[34351]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T05:44:53.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:53 smithi144 ceph-mon[34351]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:44:53.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:54.165 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 05:44:53 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0[44028]: 2024-09-21T05:44:53.896+0000 7f479e400640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T05:44:54.165 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 05:44:53 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0[44028]: 2024-09-21T05:44:53.906+0000 7f4794400640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:44:54.273 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:54 smithi067 ceph-mon[34443]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T05:44:54.274 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:54 smithi067 ceph-mon[34443]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T05:44:54.274 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:54 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:54.274 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:54 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:54.274 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:54 smithi067 ceph-mon[34443]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' 2024-09-21T05:44:54.590 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:44:54.615 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi067:vg_nvme/lv_4 2024-09-21T05:44:54.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:54 smithi144 ceph-mon[34351]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T05:44:54.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:54 smithi144 ceph-mon[34351]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T05:44:54.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:54 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:54.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:54 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:54.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:54 smithi144 ceph-mon[34351]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' 2024-09-21T05:44:54.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:54 smithi037 ceph-mon[30631]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T05:44:54.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:54 smithi037 ceph-mon[30631]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T05:44:54.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:54 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:54.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:54 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:54.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:54 smithi037 ceph-mon[30631]: from='osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946]' entity='osd.0' 2024-09-21T05:44:54.872 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:44:55.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:55 smithi067 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T05:44:55.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:55 smithi067 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T05:44:55.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:55 smithi067 ceph-mon[34443]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:55.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:55.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:55 smithi067 ceph-mon[34443]: osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946] boot 2024-09-21T05:44:55.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:55 smithi067 ceph-mon[34443]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T05:44:55.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.358+0000 7f02d7b31640 1 -- 172.21.15.67:0/2697143049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02d01040a0 msgr2=0x7f02d010aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.358+0000 7f02d7b31640 1 --2- 172.21.15.67:0/2697143049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02d01040a0 0x7f02d010aa40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009ca0 tx=0x7f02c802a950 comp rx=0 tx=0).stop 2024-09-21T05:44:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.359+0000 7f02d7b31640 1 -- 172.21.15.67:0/2697143049 shutdown_connections 2024-09-21T05:44:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.359+0000 7f02d7b31640 1 --2- 172.21.15.67:0/2697143049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02d01040a0 0x7f02d010aa40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.359+0000 7f02d7b31640 1 --2- 172.21.15.67:0/2697143049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02d0103700 0x7f02d0103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.359+0000 7f02d7b31640 1 --2- 172.21.15.67:0/2697143049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d0102670 0x7f02d0102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.359+0000 7f02d7b31640 1 -- 172.21.15.67:0/2697143049 >> 172.21.15.67:0/2697143049 conn(0x7f02d00fdfe0 msgr2=0x7f02d0100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:44:55.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.359+0000 7f02d7b31640 1 -- 172.21.15.67:0/2697143049 shutdown_connections 2024-09-21T05:44:55.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.359+0000 7f02d7b31640 1 -- 172.21.15.67:0/2697143049 wait complete. 2024-09-21T05:44:55.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.359+0000 7f02d7b31640 1 Processor -- start 2024-09-21T05:44:55.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.359+0000 7f02d7b31640 1 -- start start 2024-09-21T05:44:55.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d7b31640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02d0102670 0x7f02d0199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:55.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d7b31640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d0103700 0x7f02d019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:55.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d7b31640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02d01040a0 0x7f02d019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d7b31640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02d010e2c0 con 0x7f02d0103700 2024-09-21T05:44:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d7b31640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f02d010e140 con 0x7f02d01040a0 2024-09-21T05:44:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d7b31640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f02d010e440 con 0x7f02d0102670 2024-09-21T05:44:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d60ce640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02d01040a0 0x7f02d019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d60ce640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02d01040a0 0x7f02d019b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56692/0 (socket says 172.21.15.67:56692) 2024-09-21T05:44:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d60ce640 1 -- 172.21.15.67:0/2602018879 learned_addr learned my addr 172.21.15.67:0/2602018879 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-21T05:44:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d58cd640 1 --2- 172.21.15.67:0/2602018879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02d0102670 0x7f02d0199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d60ce640 1 -- 172.21.15.67:0/2602018879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02d0102670 msgr2=0x7f02d0199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d60ce640 1 --2- 172.21.15.67:0/2602018879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02d0102670 0x7f02d0199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d60ce640 1 -- 172.21.15.67:0/2602018879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d0103700 msgr2=0x7f02d019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:44:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d60ce640 1 --2- 172.21.15.67:0/2602018879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d0103700 0x7f02d019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:44:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d60ce640 1 -- 172.21.15.67:0/2602018879 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d019b9d0 con 0x7f02d01040a0 2024-09-21T05:44:55.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d60ce640 1 --2- 172.21.15.67:0/2602018879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02d01040a0 0x7f02d019b1b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f02c8006010 tx=0x7f02c802fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:55.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02c6ffd640 1 -- 172.21.15.67:0/2602018879 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8034040 con 0x7f02d01040a0 2024-09-21T05:44:55.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02c6ffd640 1 -- 172.21.15.67:0/2602018879 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c80308f0 con 0x7f02d01040a0 2024-09-21T05:44:55.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02d7b31640 1 -- 172.21.15.67:0/2602018879 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d019bc60 con 0x7f02d01040a0 2024-09-21T05:44:55.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.360+0000 7f02c6ffd640 1 -- 172.21.15.67:0/2602018879 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8039450 con 0x7f02d01040a0 2024-09-21T05:44:55.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.361+0000 7f02d7b31640 1 -- 172.21.15.67:0/2602018879 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d01049f0 con 0x7f02d01040a0 2024-09-21T05:44:55.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.361+0000 7f02d7b31640 1 -- 172.21.15.67:0/2602018879 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d0104c50 con 0x7f02d01040a0 2024-09-21T05:44:55.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.363+0000 7f02c6ffd640 1 -- 172.21.15.67:0/2602018879 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f02c8037020 con 0x7f02d01040a0 2024-09-21T05:44:55.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.364+0000 7f02c6ffd640 1 --2- 172.21.15.67:0/2602018879 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02bc0b6480 0x7f02bc0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:44:55.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.364+0000 7f02c6ffd640 1 -- 172.21.15.67:0/2602018879 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7f02c8106b90 con 0x7f02d01040a0 2024-09-21T05:44:55.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.364+0000 7f02d58cd640 1 --2- 172.21.15.67:0/2602018879 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02bc0b6480 0x7f02bc0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:44:55.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.365+0000 7f02d58cd640 1 --2- 172.21.15.67:0/2602018879 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02bc0b6480 0x7f02bc0b8990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f02cc005d00 tx=0x7f02cc005c50 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:44:55.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.367+0000 7f02c6ffd640 1 -- 172.21.15.67:0/2602018879 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02c80cee90 con 0x7f02d01040a0 2024-09-21T05:44:55.552 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:55 smithi037 ceph-mon[30631]: purged_snaps scrub starts 2024-09-21T05:44:55.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:55 smithi037 ceph-mon[30631]: purged_snaps scrub ok 2024-09-21T05:44:55.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:55 smithi037 ceph-mon[30631]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:55.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:55.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:55 smithi037 ceph-mon[30631]: osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946] boot 2024-09-21T05:44:55.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:55 smithi037 ceph-mon[30631]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T05:44:55.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:55.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:44:55.563+0000 7f02d7b31640 1 -- 172.21.15.67:0/2602018879 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f02d00fff80 con 0x7f02bc0b6480 2024-09-21T05:44:55.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:55 smithi144 ceph-mon[34351]: purged_snaps scrub starts 2024-09-21T05:44:55.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:55 smithi144 ceph-mon[34351]: purged_snaps scrub ok 2024-09-21T05:44:55.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:55 smithi144 ceph-mon[34351]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T05:44:55.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:55.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:55 smithi144 ceph-mon[34351]: osd.0 [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946] boot 2024-09-21T05:44:55.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:55 smithi144 ceph-mon[34351]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T05:44:55.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:44:56.479 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:56 smithi037 ceph-mon[30631]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:56.479 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:44:56.479 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:44:56.479 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:56.479 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:56 smithi037 ceph-mon[30631]: Detected new or changed devices on smithi037 2024-09-21T05:44:56.479 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:56.480 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:56.480 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:56.480 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:56 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi037 to 17094M 2024-09-21T05:44:56.480 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:56.480 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:56.480 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:56.480 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:56.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:56 smithi067 ceph-mon[34443]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:56.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:44:56.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:44:56.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:56.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:56 smithi067 ceph-mon[34443]: Detected new or changed devices on smithi037 2024-09-21T05:44:56.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:56.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:56.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:56.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:56 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi037 to 17094M 2024-09-21T05:44:56.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:56.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:56.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:56.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:56.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:56 smithi144 ceph-mon[34351]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:44:56.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:44:56.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:44:56.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:56.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:56 smithi144 ceph-mon[34351]: Detected new or changed devices on smithi037 2024-09-21T05:44:56.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:56.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:56.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:44:56.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:56 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi037 to 17094M 2024-09-21T05:44:56.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:56.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:44:56.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:44:56.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:44:57.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:57 smithi037 ceph-mon[30631]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:44:57.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:57 smithi037 ceph-mon[30631]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T05:44:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:57 smithi067 ceph-mon[34443]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:44:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:57 smithi067 ceph-mon[34443]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T05:44:58.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:57 smithi144 ceph-mon[34351]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:44:58.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:57 smithi144 ceph-mon[34351]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T05:44:58.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:58 smithi037 ceph-mon[30631]: from='client.? 172.21.15.67:0/209770967' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "15d6817e-4cde-4448-9263-3b3fad8c6d1d"} : dispatch 2024-09-21T05:44:58.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:58 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "15d6817e-4cde-4448-9263-3b3fad8c6d1d"} : dispatch 2024-09-21T05:44:58.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:58 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15d6817e-4cde-4448-9263-3b3fad8c6d1d"}]': finished 2024-09-21T05:44:58.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:58 smithi037 ceph-mon[30631]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T05:44:58.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:58 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:44:58.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:58 smithi037 ceph-mon[30631]: from='client.? 172.21.15.67:0/4026491158' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:44:58.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:58 smithi067 ceph-mon[34443]: from='client.? 172.21.15.67:0/209770967' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "15d6817e-4cde-4448-9263-3b3fad8c6d1d"} : dispatch 2024-09-21T05:44:58.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:58 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "15d6817e-4cde-4448-9263-3b3fad8c6d1d"} : dispatch 2024-09-21T05:44:58.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:58 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15d6817e-4cde-4448-9263-3b3fad8c6d1d"}]': finished 2024-09-21T05:44:58.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:58 smithi067 ceph-mon[34443]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T05:44:58.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:58 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:44:58.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:58 smithi067 ceph-mon[34443]: from='client.? 172.21.15.67:0/4026491158' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:44:59.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:58 smithi144 ceph-mon[34351]: from='client.? 172.21.15.67:0/209770967' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "15d6817e-4cde-4448-9263-3b3fad8c6d1d"} : dispatch 2024-09-21T05:44:59.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:58 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "15d6817e-4cde-4448-9263-3b3fad8c6d1d"} : dispatch 2024-09-21T05:44:59.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:58 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15d6817e-4cde-4448-9263-3b3fad8c6d1d"}]': finished 2024-09-21T05:44:59.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:58 smithi144 ceph-mon[34351]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T05:44:59.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:58 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:44:59.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:58 smithi144 ceph-mon[34351]: from='client.? 172.21.15.67:0/4026491158' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:44:59.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:44:59 smithi037 ceph-mon[30631]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:44:59.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:44:59 smithi067 ceph-mon[34443]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:00.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:44:59 smithi144 ceph-mon[34351]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:01.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:01 smithi037 ceph-mon[30631]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:01.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:01 smithi144 ceph-mon[34351]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:01.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:01 smithi067 ceph-mon[34443]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:03.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:03 smithi067 ceph-mon[34443]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:03.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:03 smithi037 ceph-mon[30631]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:04.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:03 smithi144 ceph-mon[34351]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:05.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:05 smithi037 ceph-mon[30631]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:05.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:05 smithi067 ceph-mon[34443]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:06.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:05 smithi144 ceph-mon[34351]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:06.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:06 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:45:06.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:06 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:06.978 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:06 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:45:06.978 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:06 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:07.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:06 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:45:07.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:06 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:07.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:07 smithi037 ceph-mon[30631]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:07.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:07 smithi037 ceph-mon[30631]: Deploying daemon osd.1 on smithi067 2024-09-21T05:45:07.973 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:07 smithi067 ceph-mon[34443]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:07.973 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:07 smithi067 ceph-mon[34443]: Deploying daemon osd.1 on smithi067 2024-09-21T05:45:08.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:07 smithi144 ceph-mon[34351]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:08.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:07 smithi144 ceph-mon[34351]: Deploying daemon osd.1 on smithi067 2024-09-21T05:45:09.710 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:09 smithi067 ceph-mon[34443]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:09.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:09 smithi037 ceph-mon[30631]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:09 smithi144 ceph-mon[34351]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:11.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:11 smithi037 ceph-mon[30631]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:11.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:11 smithi067 ceph-mon[34443]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:11 smithi144 ceph-mon[34351]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:13.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:13 smithi037 ceph-mon[30631]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:13.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:13 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:13.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:13 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:13.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:13 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:13.980 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:13 smithi067 ceph-mon[34443]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:13.980 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:13 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:13.980 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:13 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:13.981 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:13 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:14.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:13 smithi144 ceph-mon[34351]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:14.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:13 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:14.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:13 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:14.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:13 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:15.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:15 smithi037 ceph-mon[30631]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:15.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:15 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:15.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:15 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:15.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:15 smithi067 ceph-mon[34443]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:15.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:15 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:15.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:15 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:16.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:15 smithi144 ceph-mon[34351]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:16.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:15 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:16.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:15 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:16.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:45:16.704+0000 7f02c6ffd640 1 -- 172.21.15.67:0/2602018879 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f02d00fff80 con 0x7f02bc0b6480 2024-09-21T05:45:16.707 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 1 on host 'smithi067' 2024-09-21T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:45:16.707+0000 7f02d7b31640 1 -- 172.21.15.67:0/2602018879 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02bc0b6480 msgr2=0x7f02bc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:45:16.707+0000 7f02d7b31640 1 --2- 172.21.15.67:0/2602018879 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02bc0b6480 0x7f02bc0b8990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f02cc005d00 tx=0x7f02cc005c50 comp rx=0 tx=0).stop 2024-09-21T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:45:16.707+0000 7f02d7b31640 1 -- 172.21.15.67:0/2602018879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02d01040a0 msgr2=0x7f02d019b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:45:16.707+0000 7f02d7b31640 1 --2- 172.21.15.67:0/2602018879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02d01040a0 0x7f02d019b1b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f02c8006010 tx=0x7f02c802fc00 comp rx=0 tx=0).stop 2024-09-21T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:45:16.707+0000 7f02d7b31640 1 -- 172.21.15.67:0/2602018879 shutdown_connections 2024-09-21T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:45:16.707+0000 7f02d7b31640 1 --2- 172.21.15.67:0/2602018879 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02bc0b6480 0x7f02bc0b8990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:45:16.707+0000 7f02d7b31640 1 --2- 172.21.15.67:0/2602018879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02d01040a0 0x7f02d019b1b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:45:16.707+0000 7f02d7b31640 1 --2- 172.21.15.67:0/2602018879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d0103700 0x7f02d019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:45:16.707+0000 7f02d7b31640 1 --2- 172.21.15.67:0/2602018879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02d0102670 0x7f02d0199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:45:16.707+0000 7f02d7b31640 1 -- 172.21.15.67:0/2602018879 >> 172.21.15.67:0/2602018879 conn(0x7f02d00fdfe0 msgr2=0x7f02d00ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:16.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:45:16.707+0000 7f02d7b31640 1 -- 172.21.15.67:0/2602018879 shutdown_connections 2024-09-21T05:45:16.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:45:16.707+0000 7f02d7b31640 1 -- 172.21.15.67:0/2602018879 wait complete. 2024-09-21T05:45:16.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:16.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:16.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:16.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:16.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:16.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:17.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:17.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:17.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:17.390 DEBUG:teuthology.orchestra.run.smithi067:osd.1> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T05:45:17.392 INFO:tasks.cephadm:Deploying osd.2 on smithi144 with /dev/vg_nvme/lv_4... 2024-09-21T05:45:17.392 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T05:45:17.643 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:45:17.763 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:17 smithi144 ceph-mon[34351]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:17.763 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:17 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:17.764 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:17 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:17.764 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:17 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:17.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:17 smithi037 ceph-mon[30631]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:17.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:17 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:17.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:17 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:17.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:17 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:17.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:17 smithi067 ceph-mon[34443]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:17.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:17 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:17.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:17 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:17.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:17 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:18.997 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 05:45:18 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1[38431]: 2024-09-21T05:45:18.736+0000 7f4242552640 -1 osd.1 0 log_to_monitors true 2024-09-21T05:45:19.992 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:19 smithi067 ceph-mon[34443]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:19.993 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:19 smithi067 ceph-mon[34443]: from='osd.1 [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:45:19.993 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:19 smithi067 ceph-mon[34443]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:45:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:19 smithi144 ceph-mon[34351]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:19 smithi144 ceph-mon[34351]: from='osd.1 [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:45:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:19 smithi144 ceph-mon[34351]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:45:20.158 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:45:20.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:19 smithi037 ceph-mon[30631]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:20.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:19 smithi037 ceph-mon[30631]: from='osd.1 [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:45:20.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:19 smithi037 ceph-mon[30631]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:45:20.185 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi144:vg_nvme/lv_4 2024-09-21T05:45:20.435 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:45:20.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.884+0000 7f4d2e797640 1 -- 172.21.15.144:0/2308149045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d28102cf0 msgr2=0x7f4d28105110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.884+0000 7f4d2e797640 1 --2- 172.21.15.144:0/2308149045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d28102cf0 0x7f4d28105110 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009900 tx=0x7f4d1802a410 comp rx=0 tx=0).stop 2024-09-21T05:45:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.884+0000 7f4d2e797640 1 -- 172.21.15.144:0/2308149045 shutdown_connections 2024-09-21T05:45:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.884+0000 7f4d2e797640 1 --2- 172.21.15.144:0/2308149045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d28108370 0x7f4d2810a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.884+0000 7f4d2e797640 1 --2- 172.21.15.144:0/2308149045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d28105750 0x7f4d28107c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.884+0000 7f4d2e797640 1 --2- 172.21.15.144:0/2308149045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d28102cf0 0x7f4d28105110 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.884+0000 7f4d2e797640 1 -- 172.21.15.144:0/2308149045 >> 172.21.15.144:0/2308149045 conn(0x7f4d280fd770 msgr2=0x7f4d280ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.884+0000 7f4d2e797640 1 -- 172.21.15.144:0/2308149045 shutdown_connections 2024-09-21T05:45:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.884+0000 7f4d2e797640 1 -- 172.21.15.144:0/2308149045 wait complete. 2024-09-21T05:45:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.885+0000 7f4d2e797640 1 Processor -- start 2024-09-21T05:45:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.885+0000 7f4d2e797640 1 -- start start 2024-09-21T05:45:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.885+0000 7f4d2e797640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d28102cf0 0x7f4d2819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.885+0000 7f4d2e797640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d28105750 0x7f4d2819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:20.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.885+0000 7f4d2e797640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d28108370 0x7f4d2819b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.885+0000 7f4d2e797640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2810e2f0 con 0x7f4d28105750 2024-09-21T05:45:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.885+0000 7f4d2e797640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2810e170 con 0x7f4d28102cf0 2024-09-21T05:45:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.885+0000 7f4d2e797640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2810e470 con 0x7f4d28108370 2024-09-21T05:45:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.885+0000 7f4d2cd34640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d28108370 0x7f4d2819b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.885+0000 7f4d2cd34640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d28108370 0x7f4d2819b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51282/0 (socket says 172.21.15.144:51282) 2024-09-21T05:45:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.885+0000 7f4d2cd34640 1 -- 172.21.15.144:0/3242109122 learned_addr learned my addr 172.21.15.144:0/3242109122 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T05:45:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.886+0000 7f4d27fff640 1 --2- 172.21.15.144:0/3242109122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d28102cf0 0x7f4d2819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.886+0000 7f4d2cd34640 1 -- 172.21.15.144:0/3242109122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d28102cf0 msgr2=0x7f4d2819a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.886+0000 7f4d2cd34640 1 --2- 172.21.15.144:0/3242109122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d28102cf0 0x7f4d2819a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:20.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.886+0000 7f4d2cd34640 1 -- 172.21.15.144:0/3242109122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d28105750 msgr2=0x7f4d2819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:20.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.886+0000 7f4d2cd34640 1 --2- 172.21.15.144:0/3242109122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d28105750 0x7f4d2819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:20.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.886+0000 7f4d2cd34640 1 -- 172.21.15.144:0/3242109122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2819ba60 con 0x7f4d28108370 2024-09-21T05:45:20.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.886+0000 7f4d2cd34640 1 --2- 172.21.15.144:0/3242109122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d28108370 0x7f4d2819b240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000b970 tx=0x7f4d2000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:20.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.886+0000 7f4d257fa640 1 -- 172.21.15.144:0/3242109122 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20019070 con 0x7f4d28108370 2024-09-21T05:45:20.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.886+0000 7f4d257fa640 1 -- 172.21.15.144:0/3242109122 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d20014440 con 0x7f4d28108370 2024-09-21T05:45:20.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.886+0000 7f4d257fa640 1 -- 172.21.15.144:0/3242109122 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d200075d0 con 0x7f4d28108370 2024-09-21T05:45:20.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.886+0000 7f4d2e797640 1 -- 172.21.15.144:0/3242109122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d2819bd50 con 0x7f4d28108370 2024-09-21T05:45:20.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.886+0000 7f4d2e797640 1 -- 172.21.15.144:0/3242109122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d281a2450 con 0x7f4d28108370 2024-09-21T05:45:20.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.887+0000 7f4d2e797640 1 -- 172.21.15.144:0/3242109122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d281a2680 con 0x7f4d28108370 2024-09-21T05:45:20.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.890+0000 7f4d257fa640 1 -- 172.21.15.144:0/3242109122 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7f4d2001c070 con 0x7f4d28108370 2024-09-21T05:45:20.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.891+0000 7f4d257fa640 1 --2- 172.21.15.144:0/3242109122 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4d100b6500 0x7f4d100b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:20.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.891+0000 7f4d257fa640 1 -- 172.21.15.144:0/3242109122 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f4d200e5920 con 0x7f4d28108370 2024-09-21T05:45:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.891+0000 7f4d27fff640 1 --2- 172.21.15.144:0/3242109122 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4d100b6500 0x7f4d100b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:20.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.892+0000 7f4d27fff640 1 --2- 172.21.15.144:0/3242109122 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4d100b6500 0x7f4d100b8a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d18000c00 tx=0x7f4d18031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:20.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:20.894+0000 7f4d257fa640 1 -- 172.21.15.144:0/3242109122 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d20023030 con 0x7f4d28108370 2024-09-21T05:45:20.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:20 smithi067 ceph-mon[34443]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:45:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:20 smithi067 ceph-mon[34443]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T05:45:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:20 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:20 smithi067 ceph-mon[34443]: from='osd.1 [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:45:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:20 smithi067 ceph-mon[34443]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:45:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:20 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:20 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:20 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:20 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:20 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:20 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:20 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:21.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:21.082+0000 7f4d2e797640 1 -- 172.21.15.144:0/3242109122 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4d280feb90 con 0x7f4d100b6500 2024-09-21T05:45:21.085 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:20 smithi144 ceph-mon[34351]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:45:21.085 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:20 smithi144 ceph-mon[34351]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T05:45:21.085 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:20 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:21.085 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:20 smithi144 ceph-mon[34351]: from='osd.1 [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:45:21.085 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:20 smithi144 ceph-mon[34351]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:45:21.085 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:20 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:21.085 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:20 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:21.085 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:20 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:21.085 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:20 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:21.085 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:20 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:21.086 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:20 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:21.086 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:20 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:21.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:20 smithi037 ceph-mon[30631]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:45:21.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:20 smithi037 ceph-mon[30631]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T05:45:21.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:20 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:21.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:20 smithi037 ceph-mon[30631]: from='osd.1 [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:45:21.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:20 smithi037 ceph-mon[30631]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:45:21.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:20 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:21.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:20 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:21.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:20 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:21.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:20 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:21.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:20 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:21.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:20 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:21.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:20 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:21.683 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 05:45:21 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1[38431]: 2024-09-21T05:45:21.353+0000 7f423e4d4640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T05:45:21.683 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 05:45:21 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1[38431]: 2024-09-21T05:45:21.358+0000 7f42362ca640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:45:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:21 smithi067 ceph-mon[34443]: Detected new or changed devices on smithi067 2024-09-21T05:45:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:21 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi067 to 17088M 2024-09-21T05:45:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:21 smithi067 ceph-mon[34443]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:21 smithi067 ceph-mon[34443]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-21T05:45:21.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:21 smithi067 ceph-mon[34443]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T05:45:21.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:21 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:21.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:21 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:21.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:21 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:21.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:21 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:21.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:21 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:21.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:21 smithi067 ceph-mon[34443]: from='osd.1 ' entity='osd.1' 2024-09-21T05:45:22.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:21 smithi144 ceph-mon[34351]: Detected new or changed devices on smithi067 2024-09-21T05:45:22.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:21 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi067 to 17088M 2024-09-21T05:45:22.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:21 smithi144 ceph-mon[34351]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:22.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:21 smithi144 ceph-mon[34351]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-21T05:45:22.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:21 smithi144 ceph-mon[34351]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T05:45:22.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:21 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:22.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:21 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:22.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:21 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:22.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:21 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:22.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:21 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:22.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:21 smithi144 ceph-mon[34351]: from='osd.1 ' entity='osd.1' 2024-09-21T05:45:22.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:21 smithi037 ceph-mon[30631]: Detected new or changed devices on smithi067 2024-09-21T05:45:22.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:21 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi067 to 17088M 2024-09-21T05:45:22.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:21 smithi037 ceph-mon[30631]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:21 smithi037 ceph-mon[30631]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-21T05:45:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:21 smithi037 ceph-mon[30631]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T05:45:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:21 smithi037 ceph-mon[30631]: from='osd.1 ' entity='osd.1' 2024-09-21T05:45:22.760 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:22 smithi144 ceph-mon[34351]: purged_snaps scrub starts 2024-09-21T05:45:22.760 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:22 smithi144 ceph-mon[34351]: purged_snaps scrub ok 2024-09-21T05:45:22.760 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:22 smithi144 ceph-mon[34351]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:22.760 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:22 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:22.760 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:22 smithi144 ceph-mon[34351]: osd.1 [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458] boot 2024-09-21T05:45:22.760 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:22 smithi144 ceph-mon[34351]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T05:45:22.761 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:22 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:22.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:22 smithi067 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T05:45:22.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:22 smithi067 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T05:45:22.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:22 smithi067 ceph-mon[34443]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:22.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:22 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:22.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:22 smithi067 ceph-mon[34443]: osd.1 [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458] boot 2024-09-21T05:45:22.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:22 smithi067 ceph-mon[34443]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T05:45:22.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:22 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:23.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:22 smithi037 ceph-mon[30631]: purged_snaps scrub starts 2024-09-21T05:45:23.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:22 smithi037 ceph-mon[30631]: purged_snaps scrub ok 2024-09-21T05:45:23.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:22 smithi037 ceph-mon[30631]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:23.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:22 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:23.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:22 smithi037 ceph-mon[30631]: osd.1 [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458] boot 2024-09-21T05:45:23.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:22 smithi037 ceph-mon[30631]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T05:45:23.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:22 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:45:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:23 smithi067 ceph-mon[34443]: pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:23 smithi067 ceph-mon[34443]: from='client.? 172.21.15.144:0/3085078674' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "091d2006-39ee-41d2-9bfd-dd13cb6bb4a3"} : dispatch 2024-09-21T05:45:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:23 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "091d2006-39ee-41d2-9bfd-dd13cb6bb4a3"} : dispatch 2024-09-21T05:45:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:23 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "091d2006-39ee-41d2-9bfd-dd13cb6bb4a3"}]': finished 2024-09-21T05:45:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:23 smithi067 ceph-mon[34443]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T05:45:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:23 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:24.049 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:23 smithi144 ceph-mon[34351]: pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:24.049 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:23 smithi144 ceph-mon[34351]: from='client.? 172.21.15.144:0/3085078674' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "091d2006-39ee-41d2-9bfd-dd13cb6bb4a3"} : dispatch 2024-09-21T05:45:24.049 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:23 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "091d2006-39ee-41d2-9bfd-dd13cb6bb4a3"} : dispatch 2024-09-21T05:45:24.049 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:23 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "091d2006-39ee-41d2-9bfd-dd13cb6bb4a3"}]': finished 2024-09-21T05:45:24.049 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:23 smithi144 ceph-mon[34351]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T05:45:24.049 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:23 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:24.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:23 smithi037 ceph-mon[30631]: pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T05:45:24.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:23 smithi037 ceph-mon[30631]: from='client.? 172.21.15.144:0/3085078674' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "091d2006-39ee-41d2-9bfd-dd13cb6bb4a3"} : dispatch 2024-09-21T05:45:24.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:23 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "091d2006-39ee-41d2-9bfd-dd13cb6bb4a3"} : dispatch 2024-09-21T05:45:24.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:23 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "091d2006-39ee-41d2-9bfd-dd13cb6bb4a3"}]': finished 2024-09-21T05:45:24.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:23 smithi037 ceph-mon[30631]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T05:45:24.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:23 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:24.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:24 smithi067 ceph-mon[34443]: from='client.? 172.21.15.144:0/3016011159' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:25.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:24 smithi144 ceph-mon[34351]: from='client.? 172.21.15.144:0/3016011159' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:25.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:24 smithi037 ceph-mon[30631]: from='client.? 172.21.15.144:0/3016011159' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:25.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:25 smithi067 ceph-mon[34443]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:26.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:25 smithi144 ceph-mon[34351]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:26.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:25 smithi037 ceph-mon[30631]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:27.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:27 smithi067 ceph-mon[34443]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:28.071 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:27 smithi144 ceph-mon[34351]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:28.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:27 smithi037 ceph-mon[30631]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:29.799 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:29 smithi144 ceph-mon[34351]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:29.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:29 smithi067 ceph-mon[34443]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:30.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:29 smithi037 ceph-mon[30631]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:31.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:31 smithi067 ceph-mon[34443]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:31.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:31 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:45:31.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:31 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:32.076 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:31 smithi144 ceph-mon[34351]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:32.076 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:31 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:45:32.076 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:31 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:32.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:31 smithi037 ceph-mon[30631]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:32.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:31 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:45:32.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:31 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:32.974 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:32 smithi144 ceph-mon[34351]: Deploying daemon osd.2 on smithi144 2024-09-21T05:45:32.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:32 smithi067 ceph-mon[34443]: Deploying daemon osd.2 on smithi144 2024-09-21T05:45:33.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:32 smithi037 ceph-mon[30631]: Deploying daemon osd.2 on smithi144 2024-09-21T05:45:33.822 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:33 smithi144 ceph-mon[34351]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:33.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:33 smithi067 ceph-mon[34443]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:34.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:33 smithi037 ceph-mon[30631]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:35.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:35 smithi067 ceph-mon[34443]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:36.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:35 smithi144 ceph-mon[34351]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:36.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:35 smithi037 ceph-mon[30631]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:37.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:37 smithi067 ceph-mon[34443]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:38.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:37 smithi144 ceph-mon[34351]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:38.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:37 smithi037 ceph-mon[30631]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:38.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:38 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:38 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:38 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:39.065 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:38 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:39.065 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:38 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:39.065 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:38 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:39.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:38 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:39.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:38 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:38 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:39.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:39 smithi067 ceph-mon[34443]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:40.095 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:39 smithi144 ceph-mon[34351]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:40.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:39 smithi037 ceph-mon[30631]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:41.302 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:41.302 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:41.302 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:41.302 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:41.302 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:41.302 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:41 smithi144 ceph-mon[34351]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:41.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:41.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:41.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:41.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:41.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:41.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:41 smithi037 ceph-mon[30631]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:41.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:41.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:41.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:41.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:41.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:41.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:41 smithi067 ceph-mon[34443]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:42.177 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 2 on host 'smithi144' 2024-09-21T05:45:42.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:42.175+0000 7f4d257fa640 1 -- 172.21.15.144:0/3242109122 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4d280feb90 con 0x7f4d100b6500 2024-09-21T05:45:42.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:42.177+0000 7f4d2e797640 1 -- 172.21.15.144:0/3242109122 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4d100b6500 msgr2=0x7f4d100b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:42.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:42.177+0000 7f4d2e797640 1 --2- 172.21.15.144:0/3242109122 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4d100b6500 0x7f4d100b8a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d18000c00 tx=0x7f4d18031400 comp rx=0 tx=0).stop 2024-09-21T05:45:42.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:42.177+0000 7f4d2e797640 1 -- 172.21.15.144:0/3242109122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d28108370 msgr2=0x7f4d2819b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:42.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:42.177+0000 7f4d2e797640 1 --2- 172.21.15.144:0/3242109122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d28108370 0x7f4d2819b240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000b970 tx=0x7f4d2000be30 comp rx=0 tx=0).stop 2024-09-21T05:45:42.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:42.177+0000 7f4d2e797640 1 -- 172.21.15.144:0/3242109122 shutdown_connections 2024-09-21T05:45:42.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:42.177+0000 7f4d2e797640 1 --2- 172.21.15.144:0/3242109122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d28108370 0x7f4d2819b240 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:42.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:42.177+0000 7f4d2e797640 1 --2- 172.21.15.144:0/3242109122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d28105750 0x7f4d2819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:42.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:42.177+0000 7f4d2e797640 1 --2- 172.21.15.144:0/3242109122 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4d100b6500 0x7f4d100b8a10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:42.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:42.177+0000 7f4d2e797640 1 --2- 172.21.15.144:0/3242109122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4d28102cf0 0x7f4d2819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:42.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:42.177+0000 7f4d2e797640 1 -- 172.21.15.144:0/3242109122 >> 172.21.15.144:0/3242109122 conn(0x7f4d280fd770 msgr2=0x7f4d28107870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:42.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:42.177+0000 7f4d2e797640 1 -- 172.21.15.144:0/3242109122 shutdown_connections 2024-09-21T05:45:42.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:45:42.177+0000 7f4d2e797640 1 -- 172.21.15.144:0/3242109122 wait complete. 2024-09-21T05:45:42.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:42.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:42.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:42.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:42.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:42.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:42.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:45:42.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:42.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:42.912 DEBUG:teuthology.orchestra.run.smithi144:osd.2> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T05:45:42.914 INFO:tasks.cephadm:Deploying osd.3 on smithi037 with /dev/vg_nvme/lv_3... 2024-09-21T05:45:42.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T05:45:43.297 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:43.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:43 smithi037 ceph-mon[30631]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:43.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:43 smithi067 ceph-mon[34443]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:43 smithi144 ceph-mon[34351]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:44.336 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:44 smithi144 ceph-mon[34351]: from='osd.2 [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:45:44.336 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:44 smithi144 ceph-mon[34351]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:45:44.336 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 05:45:44 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2[38659]: 2024-09-21T05:45:44.010+0000 7f269afa4640 -1 osd.2 0 log_to_monitors true 2024-09-21T05:45:44.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:44 smithi037 ceph-mon[30631]: from='osd.2 [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:45:44.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:44 smithi037 ceph-mon[30631]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:45:44.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:44 smithi067 ceph-mon[34443]: from='osd.2 [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:45:44.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:44 smithi067 ceph-mon[34443]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:45:45.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:45 smithi144 ceph-mon[34351]: pgmap v93: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:45.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:45 smithi144 ceph-mon[34351]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:45:45.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:45 smithi144 ceph-mon[34351]: from='osd.2 [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:45:45.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:45 smithi144 ceph-mon[34351]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T05:45:45.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:45 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:45.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:45 smithi144 ceph-mon[34351]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:45:45.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:45 smithi037 ceph-mon[30631]: pgmap v93: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:45.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:45 smithi037 ceph-mon[30631]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:45:45.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:45 smithi037 ceph-mon[30631]: from='osd.2 [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:45:45.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:45 smithi037 ceph-mon[30631]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T05:45:45.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:45 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:45.487 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:45 smithi037 ceph-mon[30631]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:45:45.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:45 smithi067 ceph-mon[34443]: pgmap v93: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:45.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:45 smithi067 ceph-mon[34443]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:45:45.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:45 smithi067 ceph-mon[34443]: from='osd.2 [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:45:45.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:45 smithi067 ceph-mon[34443]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T05:45:45.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:45 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:45.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:45 smithi067 ceph-mon[34443]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:45:46.113 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:45:46.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi037:vg_nvme/lv_3 2024-09-21T05:45:46.373 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2[38659]: 2024-09-21T05:45:46.003+0000 7f2696f26640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T05:45:46.373 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2[38659]: 2024-09-21T05:45:46.008+0000 7f268ed1c640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:45:46.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T05:45:46.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T05:45:46.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:46.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:46.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: Detected new or changed devices on smithi144 2024-09-21T05:45:46.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:46.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:46.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:46.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi144 to 17088M 2024-09-21T05:45:46.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:46.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:46.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:46.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:46.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:46 smithi144 ceph-mon[34351]: from='osd.2 ' entity='osd.2' 2024-09-21T05:45:46.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T05:45:46.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T05:45:46.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: Detected new or changed devices on smithi144 2024-09-21T05:45:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi144 to 17088M 2024-09-21T05:45:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:46 smithi037 ceph-mon[30631]: from='osd.2 ' entity='osd.2' 2024-09-21T05:45:46.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T05:45:46.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T05:45:46.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:46.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:46.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: Detected new or changed devices on smithi144 2024-09-21T05:45:46.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:46.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:46.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:45:46.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi144 to 17088M 2024-09-21T05:45:46.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:46.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:46.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:45:46.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:46.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:46 smithi067 ceph-mon[34443]: from='osd.2 ' entity='osd.2' 2024-09-21T05:45:46.533 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:45:47.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.170+0000 7fc4dd600640 1 -- 172.21.15.37:0/4081205875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d8107260 msgr2=0x7fc4d8107760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.170+0000 7fc4dd600640 1 --2- 172.21.15.37:0/4081205875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d8107260 0x7fc4d8107760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009be0 tx=0x7fc4d002a6c0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.170+0000 7fc4dd600640 1 -- 172.21.15.37:0/4081205875 shutdown_connections 2024-09-21T05:45:47.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.170+0000 7fc4dd600640 1 --2- 172.21.15.37:0/4081205875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d8107260 0x7fc4d8107760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.170+0000 7fc4dd600640 1 --2- 172.21.15.37:0/4081205875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d81046c0 0x7fc4d8106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.170+0000 7fc4dd600640 1 --2- 172.21.15.37:0/4081205875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4d806c700 0x7fc4d8104180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.170+0000 7fc4dd600640 1 -- 172.21.15.37:0/4081205875 >> 172.21.15.37:0/4081205875 conn(0x7fc4d80fdfb0 msgr2=0x7fc4d8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:45:47.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.170+0000 7fc4dd600640 1 -- 172.21.15.37:0/4081205875 shutdown_connections 2024-09-21T05:45:47.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.170+0000 7fc4dd600640 1 -- 172.21.15.37:0/4081205875 wait complete. 2024-09-21T05:45:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.171+0000 7fc4dd600640 1 Processor -- start 2024-09-21T05:45:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.171+0000 7fc4dd600640 1 -- start start 2024-09-21T05:45:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.172+0000 7fc4dd600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d806c700 0x7fc4d81a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.172+0000 7fc4dd600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4d81046c0 0x7fc4d81a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.172+0000 7fc4dd600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d8107260 0x7fc4d81a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.172+0000 7fc4dd600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d8115990 con 0x7fc4d81046c0 2024-09-21T05:45:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.172+0000 7fc4dd600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d8115810 con 0x7fc4d8107260 2024-09-21T05:45:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.172+0000 7fc4dd600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d8115b10 con 0x7fc4d806c700 2024-09-21T05:45:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.172+0000 7fc4ce000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4d81046c0 0x7fc4d81a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.172+0000 7fc4ce000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4d81046c0 0x7fc4d81a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46582/0 (socket says 172.21.15.37:46582) 2024-09-21T05:45:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.172+0000 7fc4ce000640 1 -- 172.21.15.37:0/72912116 learned_addr learned my addr 172.21.15.37:0/72912116 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.172+0000 7fc4d6a00640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d806c700 0x7fc4d81a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.172+0000 7fc4d7400640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d8107260 0x7fc4d81a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.173+0000 7fc4ce000640 1 -- 172.21.15.37:0/72912116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d806c700 msgr2=0x7fc4d81a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.173+0000 7fc4ce000640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d806c700 0x7fc4d81a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.173+0000 7fc4ce000640 1 -- 172.21.15.37:0/72912116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d8107260 msgr2=0x7fc4d81a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.173+0000 7fc4ce000640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d8107260 0x7fc4d81a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.173+0000 7fc4ce000640 1 -- 172.21.15.37:0/72912116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d81a1f60 con 0x7fc4d81046c0 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.173+0000 7fc4d6a00640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d806c700 0x7fc4d81a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.173+0000 7fc4ce000640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4d81046c0 0x7fc4d81a0ba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000e9f0 tx=0x7fc4c000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.173+0000 7fc4cfe00640 1 -- 172.21.15.37:0/72912116 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c000ccc0 con 0x7fc4d81046c0 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.173+0000 7fc4cfe00640 1 -- 172.21.15.37:0/72912116 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4c000ce60 con 0x7fc4d81046c0 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.173+0000 7fc4cfe00640 1 -- 172.21.15.37:0/72912116 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0010430 con 0x7fc4d81046c0 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.173+0000 7fc4dd600640 1 -- 172.21.15.37:0/72912116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d81a2250 con 0x7fc4d81046c0 2024-09-21T05:45:47.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.173+0000 7fc4dd600640 1 -- 172.21.15.37:0/72912116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d81a8950 con 0x7fc4d81046c0 2024-09-21T05:45:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.175+0000 7fc4dd600640 1 -- 172.21.15.37:0/72912116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d80ffad0 con 0x7fc4d81046c0 2024-09-21T05:45:47.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.177+0000 7fc4cfe00640 1 -- 172.21.15.37:0/72912116 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154456+0+0 (secure 0 0 0) 0x7fc4c00046c0 con 0x7fc4d81046c0 2024-09-21T05:45:47.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.178+0000 7fc4cfe00640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc4bc0b6500 0x7fc4bc0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:45:47.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.178+0000 7fc4cfe00640 1 -- 172.21.15.37:0/72912116 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2851+0+0 (secure 0 0 0) 0x7fc4c00e6050 con 0x7fc4d81046c0 2024-09-21T05:45:47.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.179+0000 7fc4d6a00640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc4bc0b6500 0x7fc4bc0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:45:47.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.179+0000 7fc4d6a00640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc4bc0b6500 0x7fc4bc0b8a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8005fd0 tx=0x7fc4c8009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:45:47.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.182+0000 7fc4cfe00640 1 -- 172.21.15.37:0/72912116 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc4c00adf10 con 0x7fc4d81046c0 2024-09-21T05:45:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:47.395+0000 7fc4dd600640 1 -- 172.21.15.37:0/72912116 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc4d8063800 con 0x7fc4bc0b6500 2024-09-21T05:45:47.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:47 smithi067 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T05:45:47.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:47 smithi067 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T05:45:47.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:47 smithi067 ceph-mon[34443]: pgmap v96: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:47.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:47.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:47 smithi067 ceph-mon[34443]: osd.2 [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060] boot 2024-09-21T05:45:47.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:47 smithi067 ceph-mon[34443]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T05:45:47.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:47 smithi144 ceph-mon[34351]: purged_snaps scrub starts 2024-09-21T05:45:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:47 smithi144 ceph-mon[34351]: purged_snaps scrub ok 2024-09-21T05:45:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:47 smithi144 ceph-mon[34351]: pgmap v96: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:47 smithi144 ceph-mon[34351]: osd.2 [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060] boot 2024-09-21T05:45:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:47 smithi144 ceph-mon[34351]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T05:45:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:47.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:47 smithi037 ceph-mon[30631]: purged_snaps scrub starts 2024-09-21T05:45:47.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:47 smithi037 ceph-mon[30631]: purged_snaps scrub ok 2024-09-21T05:45:47.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:47 smithi037 ceph-mon[30631]: pgmap v96: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T05:45:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:47 smithi037 ceph-mon[30631]: osd.2 [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060] boot 2024-09-21T05:45:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:47 smithi037 ceph-mon[30631]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T05:45:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:45:48.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:48 smithi067 ceph-mon[34443]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:48.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:48 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:48.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:48 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:48.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:48 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:48.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:48 smithi067 ceph-mon[34443]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T05:45:48.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:48 smithi037 ceph-mon[30631]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:48.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:48 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:48.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:48 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:48.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:48 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:48.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:48 smithi037 ceph-mon[30631]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T05:45:48.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:48 smithi144 ceph-mon[34351]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:45:48.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:48 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:45:48.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:48 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:45:48.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:48 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:45:48.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:48 smithi144 ceph-mon[34351]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T05:45:49.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:49 smithi067 ceph-mon[34443]: pgmap v99: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:49.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:45:49.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:49 smithi144 ceph-mon[34351]: pgmap v99: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:49.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:45:49.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:49 smithi037 ceph-mon[30631]: pgmap v99: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:49.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:45:50.509 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:50 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T05:45:50.509 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:50 smithi144 ceph-mon[34351]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T05:45:50.509 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:50 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:45:50.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:50 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T05:45:50.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:50 smithi037 ceph-mon[30631]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T05:45:50.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:50 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:45:50.595 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48467]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:45:50.595 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48467]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:45:50.595 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:45:50.595 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48467]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:45:50.595 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48470]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:45:50.596 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48470]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:45:50.596 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:45:50.596 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48470]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:45:50.703 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:50 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T05:45:50.703 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:50 smithi067 ceph-mon[34443]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T05:45:50.704 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:50 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T05:45:50.704 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42032]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:45:50.704 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42032]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:45:50.704 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:45:50.704 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42032]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:45:50.704 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42035]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:45:50.704 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42035]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:45:50.704 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:45:50.705 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42035]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:45:50.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42158]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:45:50.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42158]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:45:50.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:45:50.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42158]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:45:50.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42161]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:45:50.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42161]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:45:50.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:45:50.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42161]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:45:50.874 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42152]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:45:50.874 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42152]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:45:50.874 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:45:50.874 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42152]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:45:50.874 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42155]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:45:50.874 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42155]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:45:50.874 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:45:50.874 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 05:45:50 smithi144 sudo[42155]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:45:50.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48479]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:45:50.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48479]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:45:50.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:45:50.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48479]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:45:50.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48482]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:45:50.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48482]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:45:50.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:45:50.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:50 smithi037 sudo[48482]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:45:50.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42038]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T05:45:50.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42038]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:45:50.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:45:50.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42038]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:45:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42041]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T05:45:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42041]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T05:45:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T05:45:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:50 smithi067 sudo[42041]: pam_unix(sudo:session): session closed for user root 2024-09-21T05:45:51.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:51.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T05:45:51.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T05:45:51.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1953977731' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1a7cd518-9d45-43e5-8605-4948d7bda060"} : dispatch 2024-09-21T05:45:51.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1953977731' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a7cd518-9d45-43e5-8605-4948d7bda060"}]': finished 2024-09-21T05:45:51.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T05:45:51.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:45:51.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:51.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:51.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:51.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:45:51.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:45:51.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:51.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:51.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:51.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:45:51.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:51.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:51.625 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:51.625 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:45:51.625 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:45:51.625 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:51.625 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:51.625 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:51.625 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:45:51.625 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:51 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/928086674' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T05:45:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T05:45:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1953977731' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1a7cd518-9d45-43e5-8605-4948d7bda060"} : dispatch 2024-09-21T05:45:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1953977731' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a7cd518-9d45-43e5-8605-4948d7bda060"}]': finished 2024-09-21T05:45:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T05:45:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:45:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:45:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:45:51.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:51 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/928086674' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T05:45:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T05:45:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1953977731' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1a7cd518-9d45-43e5-8605-4948d7bda060"} : dispatch 2024-09-21T05:45:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1953977731' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a7cd518-9d45-43e5-8605-4948d7bda060"}]': finished 2024-09-21T05:45:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T05:45:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:45:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:45:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:45:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:45:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:51.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:51.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:51.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:45:51.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:51.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:51.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:51.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:45:51.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T05:45:51.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:45:51.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:45:51.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:45:51.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T05:45:51.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:51 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/928086674' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:45:52.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:45:52.270+0000 7fc4cfe00640 1 -- 172.21.15.37:0/72912116 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fc4c00a9a80 con 0x7fc4d81046c0 2024-09-21T05:45:53.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:53 smithi144 ceph-mon[34351]: pgmap v104: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:53.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:53 smithi144 ceph-mon[34351]: mgrmap e17: x(active, since 3m), standbys: z, y 2024-09-21T05:45:53.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:53 smithi037 ceph-mon[30631]: pgmap v104: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:53.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:53 smithi037 ceph-mon[30631]: mgrmap e17: x(active, since 3m), standbys: z, y 2024-09-21T05:45:53.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:53 smithi067 ceph-mon[34443]: pgmap v104: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:53.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:53 smithi067 ceph-mon[34443]: mgrmap e17: x(active, since 3m), standbys: z, y 2024-09-21T05:45:55.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:55 smithi144 ceph-mon[34351]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:55.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:55 smithi037 ceph-mon[30631]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:55.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:55 smithi067 ceph-mon[34443]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:57.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:57 smithi037 ceph-mon[30631]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:57.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:57 smithi144 ceph-mon[34351]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:57.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:57 smithi067 ceph-mon[34443]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:59.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:45:59 smithi037 ceph-mon[30631]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:59.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:45:59 smithi144 ceph-mon[34351]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:45:59.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:45:59 smithi067 ceph-mon[34443]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:00.556 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:00 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:46:00.556 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:00 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:00.557 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:00 smithi037 ceph-mon[30631]: Deploying daemon osd.3 on smithi037 2024-09-21T05:46:00.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:00 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:46:00.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:00 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:00.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:00 smithi144 ceph-mon[34351]: Deploying daemon osd.3 on smithi037 2024-09-21T05:46:00.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:00 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:46:00.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:00 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:00.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:00 smithi067 ceph-mon[34443]: Deploying daemon osd.3 on smithi037 2024-09-21T05:46:01.477 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:01 smithi037 ceph-mon[30631]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:01.538 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:01 smithi144 ceph-mon[34351]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:01.648 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:01 smithi067 ceph-mon[34443]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:03.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:03 smithi037 ceph-mon[30631]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:03.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:03 smithi144 ceph-mon[34351]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:03.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:03 smithi067 ceph-mon[34443]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:05.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:05 smithi144 ceph-mon[34351]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:05.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:05 smithi037 ceph-mon[30631]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:05.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:05 smithi067 ceph-mon[34443]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:07.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:07 smithi037 ceph-mon[30631]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:07.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:07 smithi144 ceph-mon[34351]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:07.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:07 smithi067 ceph-mon[34443]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:08.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:08 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:08.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:08 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:08.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:08 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:08.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:08 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:08.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:08 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:08.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:08 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:08.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:08 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:08.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:08 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:08.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:08 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:09.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:09 smithi144 ceph-mon[34351]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:09.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:09 smithi037 ceph-mon[30631]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:09.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:09 smithi067 ceph-mon[34443]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:11.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:11 smithi144 ceph-mon[34351]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:11.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:11 smithi037 ceph-mon[30631]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:11.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:11 smithi067 ceph-mon[34443]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:12.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:12 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:12.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:12 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:12.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:12 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:12.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:12 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:12.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:12 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:12.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:12 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:12.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:12 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:12.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:12 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:12.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:12 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:12.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:12 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:12.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:12 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:12.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:12 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:12.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:12 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:12.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:12 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:12.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:12 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:46:13.427+0000 7fc4cfe00640 1 -- 172.21.15.37:0/72912116 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc4d8063800 con 0x7fc4bc0b6500 2024-09-21T05:46:13.430 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 3 on host 'smithi037' 2024-09-21T05:46:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:46:13.430+0000 7fc4dd600640 1 -- 172.21.15.37:0/72912116 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc4bc0b6500 msgr2=0x7fc4bc0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:46:13.430+0000 7fc4dd600640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc4bc0b6500 0x7fc4bc0b8a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8005fd0 tx=0x7fc4c8009260 comp rx=0 tx=0).stop 2024-09-21T05:46:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:46:13.430+0000 7fc4dd600640 1 -- 172.21.15.37:0/72912116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4d81046c0 msgr2=0x7fc4d81a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:46:13.430+0000 7fc4dd600640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4d81046c0 0x7fc4d81a0ba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000e9f0 tx=0x7fc4c000edf0 comp rx=0 tx=0).stop 2024-09-21T05:46:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:46:13.430+0000 7fc4dd600640 1 -- 172.21.15.37:0/72912116 shutdown_connections 2024-09-21T05:46:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:46:13.430+0000 7fc4dd600640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc4bc0b6500 0x7fc4bc0b8a10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:46:13.430+0000 7fc4dd600640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4d8107260 0x7fc4d81a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:46:13.430+0000 7fc4dd600640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4d81046c0 0x7fc4d81a0ba0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:46:13.430+0000 7fc4dd600640 1 --2- 172.21.15.37:0/72912116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d806c700 0x7fc4d81a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:46:13.430+0000 7fc4dd600640 1 -- 172.21.15.37:0/72912116 >> 172.21.15.37:0/72912116 conn(0x7fc4d80fdfb0 msgr2=0x7fc4d8105550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:46:13.430+0000 7fc4dd600640 1 -- 172.21.15.37:0/72912116 shutdown_connections 2024-09-21T05:46:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:46:13.431+0000 7fc4dd600640 1 -- 172.21.15.37:0/72912116 wait complete. 2024-09-21T05:46:13.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:13 smithi144 ceph-mon[34351]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:13.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:13 smithi037 ceph-mon[30631]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:13.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:13 smithi067 ceph-mon[34443]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:14.111 DEBUG:teuthology.orchestra.run.smithi037:osd.3> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T05:46:14.115 INFO:tasks.cephadm:Deploying osd.4 on smithi067 with /dev/vg_nvme/lv_3... 2024-09-21T05:46:14.115 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T05:46:14.379 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:46:14.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:14 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:14 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:14 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:14 smithi067 ceph-mon[34443]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:46:14.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:14 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:14.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:14 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:14.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:14 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:14.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:14 smithi144 ceph-mon[34351]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:46:14.645 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:14 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:14.645 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:14 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:14.645 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:14 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:14.645 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:14 smithi037 ceph-mon[30631]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:46:15.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:15 smithi037 ceph-mon[30631]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:15.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:15 smithi037 ceph-mon[30631]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:46:15.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:15 smithi037 ceph-mon[30631]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T05:46:15.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:15 smithi037 ceph-mon[30631]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:46:15.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:15 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:46:15.742 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:15 smithi067 ceph-mon[34443]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:15.742 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:15 smithi067 ceph-mon[34443]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:46:15.742 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:15 smithi067 ceph-mon[34443]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T05:46:15.742 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:15 smithi067 ceph-mon[34443]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:46:15.742 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:15 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:46:15.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:15 smithi144 ceph-mon[34351]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:15.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:15 smithi144 ceph-mon[34351]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:46:15.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:15 smithi144 ceph-mon[34351]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T05:46:15.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:15 smithi144 ceph-mon[34351]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:46:15.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:15 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:46:16.524 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:16 smithi067 ceph-mon[34443]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T05:46:16.524 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:16 smithi067 ceph-mon[34443]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T05:46:16.524 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:46:16.524 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:46:16.524 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:16 smithi067 ceph-mon[34443]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' 2024-09-21T05:46:16.524 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:16 smithi067 ceph-mon[34443]: osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769] boot 2024-09-21T05:46:16.524 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:16 smithi067 ceph-mon[34443]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T05:46:16.524 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:46:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:16 smithi037 ceph-mon[30631]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T05:46:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:16 smithi037 ceph-mon[30631]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T05:46:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:46:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:46:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:16 smithi037 ceph-mon[30631]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' 2024-09-21T05:46:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:16 smithi037 ceph-mon[30631]: osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769] boot 2024-09-21T05:46:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:16 smithi037 ceph-mon[30631]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T05:46:16.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:46:16.665 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 05:46:16 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3[50460]: 2024-09-21T05:46:16.201+0000 7f78da000640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T05:46:16.666 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 05:46:16 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3[50460]: 2024-09-21T05:46:16.217+0000 7f78d0000640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:46:16.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:16 smithi144 ceph-mon[34351]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T05:46:16.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:16 smithi144 ceph-mon[34351]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T05:46:16.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:46:16.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:46:16.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:16 smithi144 ceph-mon[34351]: from='osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769]' entity='osd.3' 2024-09-21T05:46:16.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:16 smithi144 ceph-mon[34351]: osd.3 [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769] boot 2024-09-21T05:46:16.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:16 smithi144 ceph-mon[34351]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T05:46:16.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:46:17.017 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:46:17.042 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi067:vg_nvme/lv_3 2024-09-21T05:46:17.289 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:46:17.692 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:17 smithi067 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T05:46:17.692 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:17 smithi067 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T05:46:17.692 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:17 smithi067 ceph-mon[34443]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:17.692 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:17 smithi067 ceph-mon[34443]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T05:46:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.784+0000 7f028caa0640 1 -- 172.21.15.67:0/2482736123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0288105180 msgr2=0x7f028810bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.784+0000 7f028caa0640 1 --2- 172.21.15.67:0/2482736123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0288105180 0x7f028810bb20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0280009ca0 tx=0x7f028002a950 comp rx=0 tx=0).stop 2024-09-21T05:46:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.784+0000 7f028caa0640 1 -- 172.21.15.67:0/2482736123 shutdown_connections 2024-09-21T05:46:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.784+0000 7f028caa0640 1 --2- 172.21.15.67:0/2482736123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0288105180 0x7f028810bb20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.784+0000 7f028caa0640 1 --2- 172.21.15.67:0/2482736123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02881047e0 0x7f0288104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.784+0000 7f028caa0640 1 --2- 172.21.15.67:0/2482736123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0288103750 0x7f0288103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:17.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.784+0000 7f028caa0640 1 -- 172.21.15.67:0/2482736123 >> 172.21.15.67:0/2482736123 conn(0x7f02880ff0c0 msgr2=0x7f0288101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:17.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.784+0000 7f028caa0640 1 -- 172.21.15.67:0/2482736123 shutdown_connections 2024-09-21T05:46:17.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.784+0000 7f028caa0640 1 -- 172.21.15.67:0/2482736123 wait complete. 2024-09-21T05:46:17.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.785+0000 7f028caa0640 1 Processor -- start 2024-09-21T05:46:17.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.785+0000 7f028caa0640 1 -- start start 2024-09-21T05:46:17.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.785+0000 7f028caa0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0288103750 0x7f0288199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:17.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.785+0000 7f028caa0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02881047e0 0x7f028819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:17.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.785+0000 7f028caa0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0288105180 0x7f028819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:17.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.785+0000 7f028caa0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f028810f410 con 0x7f02881047e0 2024-09-21T05:46:17.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.785+0000 7f028caa0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f028810f290 con 0x7f0288103750 2024-09-21T05:46:17.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.785+0000 7f028caa0640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f028810f590 con 0x7f0288105180 2024-09-21T05:46:17.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.785+0000 7f028659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0288103750 0x7f0288199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:17.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.785+0000 7f028659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0288103750 0x7f0288199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42082/0 (socket says 172.21.15.67:42082) 2024-09-21T05:46:17.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.785+0000 7f028659c640 1 -- 172.21.15.67:0/1837012048 learned_addr learned my addr 172.21.15.67:0/1837012048 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.785+0000 7f0286d9d640 1 --2- 172.21.15.67:0/1837012048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0288105180 0x7f028819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.786+0000 7f028659c640 1 -- 172.21.15.67:0/1837012048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0288105180 msgr2=0x7f028819b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.786+0000 7f028659c640 1 --2- 172.21.15.67:0/1837012048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0288105180 0x7f028819b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.786+0000 7f028659c640 1 -- 172.21.15.67:0/1837012048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02881047e0 msgr2=0x7f028819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.786+0000 7f028659c640 1 --2- 172.21.15.67:0/1837012048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02881047e0 0x7f028819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.786+0000 7f028659c640 1 -- 172.21.15.67:0/1837012048 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028819b9e0 con 0x7f0288103750 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.786+0000 7f028659c640 1 --2- 172.21.15.67:0/1837012048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0288103750 0x7f0288199fb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f027800b4a0 tx=0x7f027800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.786+0000 7f02777fe640 1 -- 172.21.15.67:0/1837012048 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0278014070 con 0x7f0288103750 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.786+0000 7f028caa0640 1 -- 172.21.15.67:0/1837012048 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f028819bcd0 con 0x7f0288103750 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.786+0000 7f02777fe640 1 -- 172.21.15.67:0/1837012048 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0278010ac0 con 0x7f0288103750 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.786+0000 7f02777fe640 1 -- 172.21.15.67:0/1837012048 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0278017c30 con 0x7f0288103750 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.786+0000 7f028caa0640 1 -- 172.21.15.67:0/1837012048 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02881a23d0 con 0x7f0288103750 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.787+0000 7f028caa0640 1 -- 172.21.15.67:0/1837012048 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f028810a930 con 0x7f0288103750 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.788+0000 7f02777fe640 1 -- 172.21.15.67:0/1837012048 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f0278017070 con 0x7f0288103750 2024-09-21T05:46:17.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.789+0000 7f02777fe640 1 --2- 172.21.15.67:0/1837012048 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02700b6510 0x7f02700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:17.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.790+0000 7f02777fe640 1 -- 172.21.15.67:0/1837012048 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3669+0+0 (secure 0 0 0) 0x7f02780e57b0 con 0x7f0288103750 2024-09-21T05:46:17.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.790+0000 7f0285d9b640 1 --2- 172.21.15.67:0/1837012048 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02700b6510 0x7f02700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:17.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.790+0000 7f0285d9b640 1 --2- 172.21.15.67:0/1837012048 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02700b6510 0x7f02700b8a20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f027c005fd0 tx=0x7f027c005850 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:17.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.794+0000 7f02777fe640 1 -- 172.21.15.67:0/1837012048 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02780ad260 con 0x7f0288103750 2024-09-21T05:46:17.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:17 smithi144 ceph-mon[34351]: purged_snaps scrub starts 2024-09-21T05:46:17.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:17 smithi144 ceph-mon[34351]: purged_snaps scrub ok 2024-09-21T05:46:17.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:17 smithi144 ceph-mon[34351]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:17.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:17 smithi144 ceph-mon[34351]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T05:46:17.873 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:17 smithi037 ceph-mon[30631]: purged_snaps scrub starts 2024-09-21T05:46:17.873 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:17 smithi037 ceph-mon[30631]: purged_snaps scrub ok 2024-09-21T05:46:17.874 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:17 smithi037 ceph-mon[30631]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T05:46:17.874 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:17 smithi037 ceph-mon[30631]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T05:46:17.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:17.992+0000 7f028caa0640 1 -- 172.21.15.67:0/1837012048 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0288063800 con 0x7f02700b6510 2024-09-21T05:46:18.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: Detected new or changed devices on smithi037 2024-09-21T05:46:18.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:18.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi037 to 8547M 2024-09-21T05:46:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:18 smithi067 ceph-mon[34443]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T05:46:19.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: Detected new or changed devices on smithi037 2024-09-21T05:46:19.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:19.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:19.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:19.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:19.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi037 to 8547M 2024-09-21T05:46:19.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:19.375 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:19.375 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:19.375 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:19.375 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:19.375 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:19.375 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:19.375 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:19.376 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:19.376 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:18 smithi144 ceph-mon[34351]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T05:46:19.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: Detected new or changed devices on smithi037 2024-09-21T05:46:19.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:19.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:19.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:19.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:19.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi037 to 8547M 2024-09-21T05:46:19.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:19.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:19.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:19.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:19.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:19.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:19.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:19.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:19.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:19.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:18 smithi037 ceph-mon[30631]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T05:46:21.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:21 smithi067 ceph-mon[34443]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:21.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:21 smithi067 ceph-mon[34443]: from='client.? 172.21.15.67:0/2262529061' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d0d79b65-1a85-43bf-92f6-ed3061c53901"} : dispatch 2024-09-21T05:46:21.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:21 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d0d79b65-1a85-43bf-92f6-ed3061c53901"} : dispatch 2024-09-21T05:46:21.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:21 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0d79b65-1a85-43bf-92f6-ed3061c53901"}]': finished 2024-09-21T05:46:21.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:21 smithi067 ceph-mon[34443]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T05:46:21.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:21 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:21.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:21 smithi067 ceph-mon[34443]: from='client.? 172.21.15.67:0/4270372188' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:21.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:21 smithi144 ceph-mon[34351]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:21.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:21 smithi144 ceph-mon[34351]: from='client.? 172.21.15.67:0/2262529061' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d0d79b65-1a85-43bf-92f6-ed3061c53901"} : dispatch 2024-09-21T05:46:21.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:21 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d0d79b65-1a85-43bf-92f6-ed3061c53901"} : dispatch 2024-09-21T05:46:21.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:21 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0d79b65-1a85-43bf-92f6-ed3061c53901"}]': finished 2024-09-21T05:46:21.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:21 smithi144 ceph-mon[34351]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T05:46:21.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:21 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:21.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:21 smithi144 ceph-mon[34351]: from='client.? 172.21.15.67:0/4270372188' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:21.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:21 smithi037 ceph-mon[30631]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:21.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:21 smithi037 ceph-mon[30631]: from='client.? 172.21.15.67:0/2262529061' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d0d79b65-1a85-43bf-92f6-ed3061c53901"} : dispatch 2024-09-21T05:46:21.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:21 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d0d79b65-1a85-43bf-92f6-ed3061c53901"} : dispatch 2024-09-21T05:46:21.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:21 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0d79b65-1a85-43bf-92f6-ed3061c53901"}]': finished 2024-09-21T05:46:21.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:21 smithi037 ceph-mon[30631]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T05:46:21.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:21.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:21 smithi037 ceph-mon[30631]: from='client.? 172.21.15.67:0/4270372188' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:23.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:23 smithi067 ceph-mon[34443]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:23.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:23 smithi144 ceph-mon[34351]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:23.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:23 smithi037 ceph-mon[30631]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:25.368 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:25 smithi067 ceph-mon[34443]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-21T05:46:25.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:25 smithi144 ceph-mon[34351]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-21T05:46:25.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:25 smithi037 ceph-mon[30631]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-21T05:46:27.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:27 smithi067 ceph-mon[34443]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:46:27.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:27 smithi144 ceph-mon[34351]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:46:27.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:27 smithi037 ceph-mon[30631]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:46:29.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:29 smithi067 ceph-mon[34443]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T05:46:29.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:29 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:46:29.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:29 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:29.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:29 smithi067 ceph-mon[34443]: Deploying daemon osd.4 on smithi067 2024-09-21T05:46:29.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:29 smithi144 ceph-mon[34351]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T05:46:29.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:29 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:46:29.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:29 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:29.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:29 smithi144 ceph-mon[34351]: Deploying daemon osd.4 on smithi067 2024-09-21T05:46:29.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:29 smithi037 ceph-mon[30631]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T05:46:29.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:29 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:46:29.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:29 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:29.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:29 smithi037 ceph-mon[30631]: Deploying daemon osd.4 on smithi067 2024-09-21T05:46:31.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:31 smithi067 ceph-mon[34443]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:46:31.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:31 smithi144 ceph-mon[34351]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:46:31.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:31 smithi037 ceph-mon[30631]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:46:33.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:33 smithi067 ceph-mon[34443]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T05:46:33.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:33 smithi144 ceph-mon[34351]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T05:46:33.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:33 smithi037 ceph-mon[30631]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T05:46:35.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:35 smithi067 ceph-mon[34443]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:46:35.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:35 smithi144 ceph-mon[34351]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:46:35.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:35 smithi037 ceph-mon[30631]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:46:36.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:36 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:36.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:36 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:36.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:36 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:36.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:36 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:36.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:36 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:36.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:36 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:36.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:36 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:36.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:36 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:36.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:36 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:37.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:37 smithi144 ceph-mon[34351]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:37.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:37 smithi037 ceph-mon[30631]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:37.666 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:37 smithi067 ceph-mon[34443]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:39.314 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:39 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:39.315 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:39 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:39.315 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:39 smithi067 ceph-mon[34443]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:39.315 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:39 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:39.315 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:39 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:39.315 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:39 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:39.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:39.355+0000 7f02777fe640 1 -- 172.21.15.67:0/1837012048 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0288063800 con 0x7f02700b6510 2024-09-21T05:46:39.358 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 4 on host 'smithi067' 2024-09-21T05:46:39.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:39.358+0000 7f028caa0640 1 -- 172.21.15.67:0/1837012048 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02700b6510 msgr2=0x7f02700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:39.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:39.358+0000 7f028caa0640 1 --2- 172.21.15.67:0/1837012048 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02700b6510 0x7f02700b8a20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f027c005fd0 tx=0x7f027c005850 comp rx=0 tx=0).stop 2024-09-21T05:46:39.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:39.358+0000 7f028caa0640 1 -- 172.21.15.67:0/1837012048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0288103750 msgr2=0x7f0288199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:39.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:39.358+0000 7f028caa0640 1 --2- 172.21.15.67:0/1837012048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0288103750 0x7f0288199fb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f027800b4a0 tx=0x7f027800b960 comp rx=0 tx=0).stop 2024-09-21T05:46:39.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:39.358+0000 7f028caa0640 1 -- 172.21.15.67:0/1837012048 shutdown_connections 2024-09-21T05:46:39.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:39.358+0000 7f028caa0640 1 --2- 172.21.15.67:0/1837012048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0288105180 0x7f028819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:39.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:39.358+0000 7f028caa0640 1 --2- 172.21.15.67:0/1837012048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02881047e0 0x7f028819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:39.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:39.358+0000 7f028caa0640 1 --2- 172.21.15.67:0/1837012048 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02700b6510 0x7f02700b8a20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:39.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:39.358+0000 7f028caa0640 1 --2- 172.21.15.67:0/1837012048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0288103750 0x7f0288199fb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:39.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:39.358+0000 7f028caa0640 1 -- 172.21.15.67:0/1837012048 >> 172.21.15.67:0/1837012048 conn(0x7f02880ff0c0 msgr2=0x7f0288107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:39.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:39.358+0000 7f028caa0640 1 -- 172.21.15.67:0/1837012048 shutdown_connections 2024-09-21T05:46:39.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:46:39.358+0000 7f028caa0640 1 -- 172.21.15.67:0/1837012048 wait complete. 2024-09-21T05:46:39.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:39.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:39.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:39 smithi144 ceph-mon[34351]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:39.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:39.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:39.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:39 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:39.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:39.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:39.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:39 smithi037 ceph-mon[30631]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:39.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:39.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:39.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:39 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:40.099 DEBUG:teuthology.orchestra.run.smithi067:osd.4> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T05:46:40.101 INFO:tasks.cephadm:Deploying osd.5 on smithi144 with /dev/vg_nvme/lv_3... 2024-09-21T05:46:40.102 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T05:46:40.317 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:40 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:40.317 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:40 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:40.317 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:40 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:46:40.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:40 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:40.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:40 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:40.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:40 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:40.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:40 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:46:40.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:40 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:40.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:40 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:41.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:41 smithi037 ceph-mon[30631]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:41.325 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:41 smithi067 ceph-mon[34443]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:41.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:41 smithi144 ceph-mon[34351]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:41.996 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 05:46:41 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4[44587]: 2024-09-21T05:46:41.671+0000 7fe46f879640 -1 osd.4 0 log_to_monitors true 2024-09-21T05:46:42.065 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:42 smithi144 ceph-mon[34351]: from='osd.4 [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:46:42.066 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:42 smithi144 ceph-mon[34351]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:46:42.337 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:42 smithi037 ceph-mon[30631]: from='osd.4 [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:46:42.338 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:42 smithi037 ceph-mon[30631]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:46:42.456 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:42 smithi067 ceph-mon[34443]: from='osd.4 [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:46:42.456 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:42 smithi067 ceph-mon[34443]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:46:43.065 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:46:43.091 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi144:vg_nvme/lv_3 2024-09-21T05:46:43.340 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:46:43.346 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:46:43.346 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T05:46:43.346 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:43.346 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: from='osd.4 [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:46:43.346 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:46:43.346 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:43.346 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: Detected new or changed devices on smithi067 2024-09-21T05:46:43.347 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:43.347 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:43.347 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:43.347 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:43.347 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi067 to 8544M 2024-09-21T05:46:43.347 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:43.347 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:43.347 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:43.347 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:43.384 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4[44587]: 2024-09-21T05:46:43.034+0000 7fe46b7fb640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T05:46:43.384 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4[44587]: 2024-09-21T05:46:43.042+0000 7fe4675f9640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:46:43.384 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:46:43.384 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: from='osd.4 [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: Detected new or changed devices on smithi067 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi067 to 8544M 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:43.385 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:43.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:46:43.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T05:46:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: from='osd.4 [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:46:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:46:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: Detected new or changed devices on smithi067 2024-09-21T05:46:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:46:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi067 to 8544M 2024-09-21T05:46:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:43.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:43.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:46:43.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:46:43.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.831+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/200598909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd01046d0 msgr2=0x7fcdd0106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:43.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.831+0000 7fcdd7a9e640 1 --2- 172.21.15.144:0/200598909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd01046d0 0x7fcdd0106b30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009900 tx=0x7fcdc002a410 comp rx=0 tx=0).stop 2024-09-21T05:46:43.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.831+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/200598909 shutdown_connections 2024-09-21T05:46:43.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.831+0000 7fcdd7a9e640 1 --2- 172.21.15.144:0/200598909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdd0107270 0x7fcdd0107770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:43.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.831+0000 7fcdd7a9e640 1 --2- 172.21.15.144:0/200598909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd01046d0 0x7fcdd0106b30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:43.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.831+0000 7fcdd7a9e640 1 --2- 172.21.15.144:0/200598909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdd006c660 0x7fcdd0104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:43.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.831+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/200598909 >> 172.21.15.144:0/200598909 conn(0x7fcdd00fdfe0 msgr2=0x7fcdd0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:46:43.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.832+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/200598909 shutdown_connections 2024-09-21T05:46:43.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.832+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/200598909 wait complete. 2024-09-21T05:46:43.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.832+0000 7fcdd7a9e640 1 Processor -- start 2024-09-21T05:46:43.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.832+0000 7fcdd7a9e640 1 -- start start 2024-09-21T05:46:43.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.832+0000 7fcdd7a9e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdd006c660 0x7fcdd01a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:43.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.832+0000 7fcdd7a9e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd01046d0 0x7fcdd01a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:43.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.832+0000 7fcdd7a9e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdd0107270 0x7fcdd01a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:43.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.832+0000 7fcdd7a9e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd0115990 con 0x7fcdd0107270 2024-09-21T05:46:43.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.832+0000 7fcdd7a9e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd0115810 con 0x7fcdd006c660 2024-09-21T05:46:43.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.832+0000 7fcdd7a9e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd0115b10 con 0x7fcdd01046d0 2024-09-21T05:46:43.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdd5039640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd01046d0 0x7fcdd01a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:43.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdd5039640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd01046d0 0x7fcdd01a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48130/0 (socket says 172.21.15.144:48130) 2024-09-21T05:46:43.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdd5039640 1 -- 172.21.15.144:0/1001735098 learned_addr learned my addr 172.21.15.144:0/1001735098 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T05:46:43.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdd583a640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdd006c660 0x7fcdd01a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:43.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdd603b640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdd0107270 0x7fcdd01a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:43.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdd5039640 1 -- 172.21.15.144:0/1001735098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdd006c660 msgr2=0x7fcdd01a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:43.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdd5039640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdd006c660 0x7fcdd01a05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:43.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdd5039640 1 -- 172.21.15.144:0/1001735098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdd0107270 msgr2=0x7fcdd01a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:46:43.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdd5039640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdd0107270 0x7fcdd01a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:46:43.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdd5039640 1 -- 172.21.15.144:0/1001735098 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd01a1fe0 con 0x7fcdd01046d0 2024-09-21T05:46:43.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdd5039640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd01046d0 0x7fcdd01a0c20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0006010 tx=0x7fcdc0031a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:43.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdc6ffd640 1 -- 172.21.15.144:0/1001735098 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc003f030 con 0x7fcdd01046d0 2024-09-21T05:46:43.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdc6ffd640 1 -- 172.21.15.144:0/1001735098 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdc0003aa0 con 0x7fcdd01046d0 2024-09-21T05:46:43.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/1001735098 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd01a2270 con 0x7fcdd01046d0 2024-09-21T05:46:43.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdc6ffd640 1 -- 172.21.15.144:0/1001735098 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0035070 con 0x7fcdd01046d0 2024-09-21T05:46:43.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.833+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/1001735098 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd01a89d0 con 0x7fcdd01046d0 2024-09-21T05:46:43.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.834+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/1001735098 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd00ffb00 con 0x7fcdd01046d0 2024-09-21T05:46:43.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.836+0000 7fcdc6ffd640 1 -- 172.21.15.144:0/1001735098 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fcdc0042030 con 0x7fcdd01046d0 2024-09-21T05:46:43.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.836+0000 7fcdc6ffd640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcdbc0b6590 0x7fcdbc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:46:43.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.837+0000 7fcdc6ffd640 1 -- 172.21.15.144:0/1001735098 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7fcdc0106da0 con 0x7fcdd01046d0 2024-09-21T05:46:43.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.837+0000 7fcdd583a640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcdbc0b6590 0x7fcdbc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:46:43.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.837+0000 7fcdd583a640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcdbc0b6590 0x7fcdbc0b8aa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc009bd0 tx=0x7fcdcc005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:46:43.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:43.840+0000 7fcdc6ffd640 1 -- 172.21.15.144:0/1001735098 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcdc00ce7c0 con 0x7fcdd01046d0 2024-09-21T05:46:44.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:46:44.027+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/1001735098 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fcdd0063800 con 0x7fcdbc0b6590 2024-09-21T05:46:44.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:44 smithi037 ceph-mon[30631]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-21T05:46:44.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:44 smithi037 ceph-mon[30631]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T05:46:44.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:44.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:44.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:44.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:44.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:44.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:44.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:44 smithi144 ceph-mon[34351]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-21T05:46:44.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:44 smithi144 ceph-mon[34351]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T05:46:44.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:44.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:44.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:44.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:44.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:44.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:44.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:44 smithi067 ceph-mon[34443]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-21T05:46:44.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:44 smithi067 ceph-mon[34443]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T05:46:44.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:44.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:44.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:46:44.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:46:44.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:44.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:45.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:45 smithi144 ceph-mon[34351]: purged_snaps scrub starts 2024-09-21T05:46:45.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:45 smithi144 ceph-mon[34351]: purged_snaps scrub ok 2024-09-21T05:46:45.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:45 smithi144 ceph-mon[34351]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:45.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:45 smithi144 ceph-mon[34351]: osd.4 [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743] boot 2024-09-21T05:46:45.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:45 smithi144 ceph-mon[34351]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T05:46:45.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:45 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:45.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:45 smithi144 ceph-mon[34351]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:45.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:45 smithi037 ceph-mon[30631]: purged_snaps scrub starts 2024-09-21T05:46:45.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:45 smithi037 ceph-mon[30631]: purged_snaps scrub ok 2024-09-21T05:46:45.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:45 smithi037 ceph-mon[30631]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:45.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:45 smithi037 ceph-mon[30631]: osd.4 [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743] boot 2024-09-21T05:46:45.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:45 smithi037 ceph-mon[30631]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T05:46:45.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:45 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:45.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:45 smithi037 ceph-mon[30631]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:45.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:45 smithi067 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T05:46:45.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:45 smithi067 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T05:46:45.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:45 smithi067 ceph-mon[34443]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:46:45.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:45 smithi067 ceph-mon[34443]: osd.4 [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743] boot 2024-09-21T05:46:45.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:45 smithi067 ceph-mon[34443]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T05:46:45.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:45 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:46:45.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:45 smithi067 ceph-mon[34443]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T05:46:46.055 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:46 smithi144 ceph-mon[34351]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T05:46:46.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:46 smithi037 ceph-mon[30631]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T05:46:46.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:46 smithi067 ceph-mon[34443]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T05:46:47.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:47 smithi144 ceph-mon[34351]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:47.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:47 smithi144 ceph-mon[34351]: from='client.? 172.21.15.144:0/1407927933' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3aabba3-6ac9-451e-b445-1573f10856ab"} : dispatch 2024-09-21T05:46:47.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:47 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3aabba3-6ac9-451e-b445-1573f10856ab"} : dispatch 2024-09-21T05:46:47.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:47 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3aabba3-6ac9-451e-b445-1573f10856ab"}]': finished 2024-09-21T05:46:47.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:47 smithi144 ceph-mon[34351]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T05:46:47.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:46:47.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:47 smithi144 ceph-mon[34351]: from='client.? 172.21.15.144:0/2151736978' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:47.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:47 smithi037 ceph-mon[30631]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:47.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:47 smithi037 ceph-mon[30631]: from='client.? 172.21.15.144:0/1407927933' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3aabba3-6ac9-451e-b445-1573f10856ab"} : dispatch 2024-09-21T05:46:47.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:47 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3aabba3-6ac9-451e-b445-1573f10856ab"} : dispatch 2024-09-21T05:46:47.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:47 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3aabba3-6ac9-451e-b445-1573f10856ab"}]': finished 2024-09-21T05:46:47.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:47 smithi037 ceph-mon[30631]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T05:46:47.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:46:47.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:47 smithi037 ceph-mon[30631]: from='client.? 172.21.15.144:0/2151736978' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:47.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:47 smithi067 ceph-mon[34443]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:47.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:47 smithi067 ceph-mon[34443]: from='client.? 172.21.15.144:0/1407927933' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3aabba3-6ac9-451e-b445-1573f10856ab"} : dispatch 2024-09-21T05:46:47.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:47 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3aabba3-6ac9-451e-b445-1573f10856ab"} : dispatch 2024-09-21T05:46:47.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:47 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3aabba3-6ac9-451e-b445-1573f10856ab"}]': finished 2024-09-21T05:46:47.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:47 smithi067 ceph-mon[34443]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T05:46:47.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:46:47.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:47 smithi067 ceph-mon[34443]: from='client.? 172.21.15.144:0/2151736978' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:46:49.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:49 smithi067 ceph-mon[34443]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:49.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:49 smithi144 ceph-mon[34351]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:49.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:49 smithi037 ceph-mon[30631]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:51.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:51 smithi144 ceph-mon[34351]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:51.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:51 smithi067 ceph-mon[34443]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:51.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:51 smithi037 ceph-mon[30631]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:53.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:53 smithi067 ceph-mon[34443]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:53.530 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:53 smithi144 ceph-mon[34351]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:53.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:53 smithi037 ceph-mon[30631]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:55.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:55 smithi067 ceph-mon[34443]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:55.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:46:55.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:55.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:55 smithi067 ceph-mon[34443]: Deploying daemon osd.5 on smithi144 2024-09-21T05:46:55.507 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:55 smithi144 ceph-mon[34351]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:55.507 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:46:55.507 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:55.507 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:55 smithi144 ceph-mon[34351]: Deploying daemon osd.5 on smithi144 2024-09-21T05:46:55.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:55 smithi037 ceph-mon[30631]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:55.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:46:55.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:46:55.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:55 smithi037 ceph-mon[30631]: Deploying daemon osd.5 on smithi144 2024-09-21T05:46:57.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:57 smithi067 ceph-mon[34443]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:57.601 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:57 smithi144 ceph-mon[34351]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:57.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:57 smithi037 ceph-mon[30631]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:59.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:46:59 smithi067 ceph-mon[34443]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:59.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:46:59 smithi144 ceph-mon[34351]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:46:59.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:46:59 smithi037 ceph-mon[30631]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:01.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:01 smithi144 ceph-mon[34351]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:01.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:01 smithi067 ceph-mon[34443]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:01.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:01 smithi037 ceph-mon[30631]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:02.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:02.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:02.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:02.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:02.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:02.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:02.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:02.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:02.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:03.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:03 smithi144 ceph-mon[34351]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:03.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:03 smithi037 ceph-mon[30631]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:03.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:03 smithi067 ceph-mon[34443]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:05.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:05.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:05 smithi037 ceph-mon[30631]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:05.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:05.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:05.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:05.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:05.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:05.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:05 smithi067 ceph-mon[34443]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:05.499 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:05.499 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:05.499 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:05.499 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:05.499 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:05.499 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:05 smithi144 ceph-mon[34351]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:05.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:47:05.541+0000 7fcdc6ffd640 1 -- 172.21.15.144:0/1001735098 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcdd0063800 con 0x7fcdbc0b6590 2024-09-21T05:47:05.543 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 5 on host 'smithi144' 2024-09-21T05:47:05.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:47:05.543+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/1001735098 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcdbc0b6590 msgr2=0x7fcdbc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:05.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:47:05.543+0000 7fcdd7a9e640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcdbc0b6590 0x7fcdbc0b8aa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc009bd0 tx=0x7fcdcc005f90 comp rx=0 tx=0).stop 2024-09-21T05:47:05.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:47:05.543+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/1001735098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd01046d0 msgr2=0x7fcdd01a0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:05.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:47:05.543+0000 7fcdd7a9e640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd01046d0 0x7fcdd01a0c20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0006010 tx=0x7fcdc0031a50 comp rx=0 tx=0).stop 2024-09-21T05:47:05.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:47:05.543+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/1001735098 shutdown_connections 2024-09-21T05:47:05.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:47:05.543+0000 7fcdd7a9e640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdd0107270 0x7fcdd01a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:05.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:47:05.543+0000 7fcdd7a9e640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd01046d0 0x7fcdd01a0c20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:05.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:47:05.543+0000 7fcdd7a9e640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcdbc0b6590 0x7fcdbc0b8aa0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:05.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:47:05.543+0000 7fcdd7a9e640 1 --2- 172.21.15.144:0/1001735098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdd006c660 0x7fcdd01a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:05.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:47:05.543+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/1001735098 >> 172.21.15.144:0/1001735098 conn(0x7fcdd00fdfe0 msgr2=0x7fcdd01055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:05.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:47:05.543+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/1001735098 shutdown_connections 2024-09-21T05:47:05.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:47:05.543+0000 7fcdd7a9e640 1 -- 172.21.15.144:0/1001735098 wait complete. 2024-09-21T05:47:06.155 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:06 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:06.155 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:06 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:06.155 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:06 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:06.221 DEBUG:teuthology.orchestra.run.smithi144:osd.5> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T05:47:06.223 INFO:tasks.cephadm:Deploying osd.6 on smithi037 with /dev/vg_nvme/lv_2... 2024-09-21T05:47:06.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T05:47:06.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:06 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:06.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:06 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:06.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:06 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:06.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:06 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:06.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:06 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:06.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:06 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:06.606 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:07 smithi144 ceph-mon[34351]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:07 smithi144 ceph-mon[34351]: from='osd.5 [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:47:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:07 smithi144 ceph-mon[34351]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:47:07.373 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 05:47:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T05:47:06.961+0000 7f1d0c7d1640 -1 osd.5 0 log_to_monitors true 2024-09-21T05:47:07.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:07 smithi037 ceph-mon[30631]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:07.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:07 smithi037 ceph-mon[30631]: from='osd.5 [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:47:07.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:07 smithi037 ceph-mon[30631]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:47:07.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:07 smithi067 ceph-mon[34443]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:07.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:07 smithi067 ceph-mon[34443]: from='osd.5 [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:47:07.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:07 smithi067 ceph-mon[34443]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:47:08.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:08 smithi144 ceph-mon[34351]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:47:08.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:08 smithi144 ceph-mon[34351]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T05:47:08.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:08 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:08.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:08 smithi144 ceph-mon[34351]: from='osd.5 [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:47:08.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:08 smithi144 ceph-mon[34351]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:47:08.450 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:08 smithi037 ceph-mon[30631]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:47:08.450 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:08 smithi037 ceph-mon[30631]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T05:47:08.450 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:08 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:08.450 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:08 smithi037 ceph-mon[30631]: from='osd.5 [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:47:08.450 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:08 smithi037 ceph-mon[30631]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:47:08.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:08 smithi067 ceph-mon[34443]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:47:08.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:08 smithi067 ceph-mon[34443]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T05:47:08.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:08 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:08.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:08 smithi067 ceph-mon[34443]: from='osd.5 [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:47:08.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:08 smithi067 ceph-mon[34443]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:47:09.173 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 05:47:08 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T05:47:08.917+0000 7f1d08753640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T05:47:09.173 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 05:47:08 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T05:47:08.922+0000 7f1d00549640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:47:09.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:09 smithi037 ceph-mon[30631]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T05:47:09.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:09 smithi037 ceph-mon[30631]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T05:47:09.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:09.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:09 smithi037 ceph-mon[30631]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:09.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:09.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:09 smithi037 ceph-mon[30631]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T05:47:09.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:09.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:09 smithi037 ceph-mon[30631]: from='osd.5 ' entity='osd.5' 2024-09-21T05:47:09.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:09 smithi067 ceph-mon[34443]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T05:47:09.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:09 smithi067 ceph-mon[34443]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T05:47:09.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:09.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:09 smithi067 ceph-mon[34443]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:09 smithi067 ceph-mon[34443]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T05:47:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:09 smithi067 ceph-mon[34443]: from='osd.5 ' entity='osd.5' 2024-09-21T05:47:09.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:09 smithi144 ceph-mon[34351]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T05:47:09.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:09 smithi144 ceph-mon[34351]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T05:47:09.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:09.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:09 smithi144 ceph-mon[34351]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:09.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:09.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:09 smithi144 ceph-mon[34351]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T05:47:09.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:09.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:09 smithi144 ceph-mon[34351]: from='osd.5 ' entity='osd.5' 2024-09-21T05:47:09.785 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:47:09.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi037:vg_nvme/lv_2 2024-09-21T05:47:10.205 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:47:10.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: purged_snaps scrub starts 2024-09-21T05:47:10.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: purged_snaps scrub ok 2024-09-21T05:47:10.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:10.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: osd.5 [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791] boot 2024-09-21T05:47:10.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T05:47:10.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:10.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: Detected new or changed devices on smithi144 2024-09-21T05:47:10.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:10.495 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:10.495 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:10.495 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:10.495 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-21T05:47:10.495 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:10.495 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:10.495 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:10.495 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:10.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T05:47:10.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T05:47:10.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:10.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: osd.5 [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791] boot 2024-09-21T05:47:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T05:47:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: Detected new or changed devices on smithi144 2024-09-21T05:47:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-21T05:47:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:10.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: purged_snaps scrub starts 2024-09-21T05:47:10.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: purged_snaps scrub ok 2024-09-21T05:47:10.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:10.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: osd.5 [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791] boot 2024-09-21T05:47:10.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T05:47:10.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:47:10.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: Detected new or changed devices on smithi144 2024-09-21T05:47:10.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:10.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:10.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:10.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:10.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-21T05:47:10.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:10.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:10.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:10.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.789+0000 7f8b65800640 1 -- 172.21.15.37:0/2969112854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b601047e0 msgr2=0x7f8b60104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.789+0000 7f8b65800640 1 --2- 172.21.15.37:0/2969112854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b601047e0 0x7f8b60104bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009900 tx=0x7f8b4802a480 comp rx=0 tx=0).stop 2024-09-21T05:47:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.789+0000 7f8b65800640 1 -- 172.21.15.37:0/2969112854 shutdown_connections 2024-09-21T05:47:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.789+0000 7f8b65800640 1 --2- 172.21.15.37:0/2969112854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b60105180 0x7f8b6010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.789+0000 7f8b65800640 1 --2- 172.21.15.37:0/2969112854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b601047e0 0x7f8b60104bf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:10.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.789+0000 7f8b65800640 1 --2- 172.21.15.37:0/2969112854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b60103750 0x7f8b60103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:10.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.789+0000 7f8b65800640 1 -- 172.21.15.37:0/2969112854 >> 172.21.15.37:0/2969112854 conn(0x7f8b600ff0c0 msgr2=0x7f8b60101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:10.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.789+0000 7f8b65800640 1 -- 172.21.15.37:0/2969112854 shutdown_connections 2024-09-21T05:47:10.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.789+0000 7f8b65800640 1 -- 172.21.15.37:0/2969112854 wait complete. 2024-09-21T05:47:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.790+0000 7f8b65800640 1 Processor -- start 2024-09-21T05:47:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.791+0000 7f8b65800640 1 -- start start 2024-09-21T05:47:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.791+0000 7f8b65800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b60103750 0x7f8b6019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.791+0000 7f8b65800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b601047e0 0x7f8b6019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.791+0000 7f8b65800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b60105180 0x7f8b6019d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.791+0000 7f8b65800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6010f3a0 con 0x7f8b60103750 2024-09-21T05:47:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.791+0000 7f8b65800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6010f220 con 0x7f8b60105180 2024-09-21T05:47:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.791+0000 7f8b65800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6010f520 con 0x7f8b601047e0 2024-09-21T05:47:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.791+0000 7f8b5ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b60103750 0x7f8b6019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.791+0000 7f8b5ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b60103750 0x7f8b6019c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34370/0 (socket says 172.21.15.37:34370) 2024-09-21T05:47:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.791+0000 7f8b5ea00640 1 -- 172.21.15.37:0/2461988475 learned_addr learned my addr 172.21.15.37:0/2461988475 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:47:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.792+0000 7f8b5f400640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b60105180 0x7f8b6019d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.792+0000 7f8b57e00640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b601047e0 0x7f8b6019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.792+0000 7f8b5ea00640 1 -- 172.21.15.37:0/2461988475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b601047e0 msgr2=0x7f8b6019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.792+0000 7f8b5ea00640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b601047e0 0x7f8b6019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.792+0000 7f8b5ea00640 1 -- 172.21.15.37:0/2461988475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b60105180 msgr2=0x7f8b6019d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.792+0000 7f8b5ea00640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b60105180 0x7f8b6019d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.792+0000 7f8b5ea00640 1 -- 172.21.15.37:0/2461988475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6019dc10 con 0x7f8b60103750 2024-09-21T05:47:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.792+0000 7f8b5f400640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b60105180 0x7f8b6019d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:47:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.792+0000 7f8b5ea00640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b60103750 0x7f8b6019c1e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000ea60 tx=0x7f8b5000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.793+0000 7f8b57400640 1 -- 172.21.15.37:0/2461988475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5000cde0 con 0x7f8b60103750 2024-09-21T05:47:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.793+0000 7f8b57400640 1 -- 172.21.15.37:0/2461988475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b500035f0 con 0x7f8b60103750 2024-09-21T05:47:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.793+0000 7f8b57400640 1 -- 172.21.15.37:0/2461988475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50010690 con 0x7f8b60103750 2024-09-21T05:47:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.793+0000 7f8b65800640 1 -- 172.21.15.37:0/2461988475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6019df00 con 0x7f8b60103750 2024-09-21T05:47:10.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.793+0000 7f8b65800640 1 -- 172.21.15.37:0/2461988475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b601a4600 con 0x7f8b60103750 2024-09-21T05:47:10.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.794+0000 7f8b65800640 1 -- 172.21.15.37:0/2461988475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b601a4830 con 0x7f8b60103750 2024-09-21T05:47:10.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.796+0000 7f8b57400640 1 -- 172.21.15.37:0/2461988475 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f8b500037a0 con 0x7f8b60103750 2024-09-21T05:47:10.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.798+0000 7f8b57400640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b440b6590 0x7f8b440b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:10.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.798+0000 7f8b57400640 1 -- 172.21.15.37:0/2461988475 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4533+0+0 (secure 0 0 0) 0x7f8b500e6700 con 0x7f8b60103750 2024-09-21T05:47:10.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.798+0000 7f8b57e00640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b440b6590 0x7f8b440b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:10.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.799+0000 7f8b57e00640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b440b6590 0x7f8b440b8aa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8b48000c00 tx=0x7f8b48031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:10.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:10.803+0000 7f8b57400640 1 -- 172.21.15.37:0/2461988475 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b500addb0 con 0x7f8b60103750 2024-09-21T05:47:11.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:11.012+0000 7f8b65800640 1 -- 172.21.15.37:0/2461988475 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8b60076d10 con 0x7f8b440b6590 2024-09-21T05:47:11.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:11 smithi037 ceph-mon[30631]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:11.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:11 smithi037 ceph-mon[30631]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T05:47:11.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:47:11.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:47:11.551 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:11.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:11 smithi144 ceph-mon[34351]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:11.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:11 smithi144 ceph-mon[34351]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T05:47:11.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:11 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:47:11.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:11 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:47:11.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:11 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:11.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:11 smithi067 ceph-mon[34443]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T05:47:11.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:11 smithi067 ceph-mon[34443]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T05:47:11.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:11 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:47:11.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:11 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:47:11.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:11 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:12.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:12 smithi037 ceph-mon[30631]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:12.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:12 smithi037 ceph-mon[30631]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T05:47:12.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:12 smithi144 ceph-mon[34351]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:12.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:12 smithi144 ceph-mon[34351]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T05:47:12.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:12 smithi067 ceph-mon[34443]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:12.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:12 smithi067 ceph-mon[34443]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T05:47:13.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:13 smithi067 ceph-mon[34443]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:13.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:13 smithi144 ceph-mon[34351]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:13.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:13 smithi037 ceph-mon[30631]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:15.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:15 smithi037 ceph-mon[30631]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T05:47:15.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:15 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1945818673' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e6451b5-b06c-4998-aebb-7fa806f2e4dc"} : dispatch 2024-09-21T05:47:15.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:15 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1945818673' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e6451b5-b06c-4998-aebb-7fa806f2e4dc"}]': finished 2024-09-21T05:47:15.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:15 smithi037 ceph-mon[30631]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T05:47:15.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:15 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:15.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:15 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2903974885' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:47:15.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:15 smithi144 ceph-mon[34351]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T05:47:15.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:15 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1945818673' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e6451b5-b06c-4998-aebb-7fa806f2e4dc"} : dispatch 2024-09-21T05:47:15.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:15 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1945818673' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e6451b5-b06c-4998-aebb-7fa806f2e4dc"}]': finished 2024-09-21T05:47:15.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:15 smithi144 ceph-mon[34351]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T05:47:15.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:15 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:15.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:15 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2903974885' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:47:15.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:15 smithi067 ceph-mon[34443]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T05:47:15.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:15 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1945818673' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2e6451b5-b06c-4998-aebb-7fa806f2e4dc"} : dispatch 2024-09-21T05:47:15.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:15 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1945818673' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e6451b5-b06c-4998-aebb-7fa806f2e4dc"}]': finished 2024-09-21T05:47:15.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:15 smithi067 ceph-mon[34443]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T05:47:15.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:15 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:15.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:15 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2903974885' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:47:17.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:17 smithi144 ceph-mon[34351]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:47:17.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:17 smithi037 ceph-mon[30631]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:47:17.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:17 smithi067 ceph-mon[34443]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:47:19.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:19 smithi144 ceph-mon[34351]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T05:47:19.641 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:19 smithi037 ceph-mon[30631]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T05:47:19.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:19 smithi067 ceph-mon[34443]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T05:47:21.534 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:21 smithi037 ceph-mon[30631]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T05:47:21.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:21 smithi144 ceph-mon[34351]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T05:47:21.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:21 smithi067 ceph-mon[34443]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T05:47:23.459 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:23 smithi037 ceph-mon[30631]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:47:23.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:23 smithi144 ceph-mon[34351]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:47:23.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:23 smithi067 ceph-mon[34443]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:47:24.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:24 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:47:24.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:24 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:24.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:24 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:47:24.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:24 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:24.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:24 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:47:24.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:24 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:25.618 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:25 smithi037 ceph-mon[30631]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:25.618 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:25 smithi037 ceph-mon[30631]: Deploying daemon osd.6 on smithi037 2024-09-21T05:47:25.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:25 smithi144 ceph-mon[34351]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:25.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:25 smithi144 ceph-mon[34351]: Deploying daemon osd.6 on smithi037 2024-09-21T05:47:25.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:25 smithi067 ceph-mon[34443]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:25.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:25 smithi067 ceph-mon[34443]: Deploying daemon osd.6 on smithi037 2024-09-21T05:47:27.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:27 smithi144 ceph-mon[34351]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:27.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:27 smithi037 ceph-mon[30631]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:27.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:27 smithi067 ceph-mon[34443]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:29.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:29 smithi037 ceph-mon[30631]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:29.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:29 smithi144 ceph-mon[34351]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:29.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:29 smithi067 ceph-mon[34443]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:31.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:31 smithi144 ceph-mon[34351]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:31.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:31 smithi037 ceph-mon[30631]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:31.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:31 smithi067 ceph-mon[34443]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:33.413 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:33 smithi037 ceph-mon[30631]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:33.413 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:33.413 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:33.413 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:33.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:33 smithi144 ceph-mon[34351]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:33.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:33.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:33.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:33.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:33 smithi067 ceph-mon[34443]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:33.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:33.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:33.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:35.440 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:35 smithi037 ceph-mon[30631]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:35.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:35 smithi144 ceph-mon[34351]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:35.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:35 smithi067 ceph-mon[34443]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:37.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:36 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:37.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:36 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:37.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:36 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:37.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:36 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:37.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:36 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:37.162 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:36 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:37.162 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:36 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:37.162 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:36 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:37.162 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:36 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:37.162 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:36 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:37.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:36 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:37.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:36 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:37.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:36 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:37.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:36 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:37.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:36 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:37.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:37.636+0000 7f8b57400640 1 -- 172.21.15.37:0/2461988475 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8b60076d10 con 0x7f8b440b6590 2024-09-21T05:47:37.638 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 6 on host 'smithi037' 2024-09-21T05:47:37.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:37.638+0000 7f8b65800640 1 -- 172.21.15.37:0/2461988475 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b440b6590 msgr2=0x7f8b440b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:37.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:37.638+0000 7f8b65800640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b440b6590 0x7f8b440b8aa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8b48000c00 tx=0x7f8b48031400 comp rx=0 tx=0).stop 2024-09-21T05:47:37.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:37.638+0000 7f8b65800640 1 -- 172.21.15.37:0/2461988475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b60103750 msgr2=0x7f8b6019c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:37.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:37.638+0000 7f8b65800640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b60103750 0x7f8b6019c1e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000ea60 tx=0x7f8b5000ef20 comp rx=0 tx=0).stop 2024-09-21T05:47:37.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:37.638+0000 7f8b65800640 1 -- 172.21.15.37:0/2461988475 shutdown_connections 2024-09-21T05:47:37.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:37.639+0000 7f8b65800640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b440b6590 0x7f8b440b8aa0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:37.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:37.639+0000 7f8b65800640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b60105180 0x7f8b6019d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:37.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:37.639+0000 7f8b65800640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b601047e0 0x7f8b6019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:37.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:37.639+0000 7f8b65800640 1 --2- 172.21.15.37:0/2461988475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b60103750 0x7f8b6019c1e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:37.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:37.639+0000 7f8b65800640 1 -- 172.21.15.37:0/2461988475 >> 172.21.15.37:0/2461988475 conn(0x7f8b600ff0c0 msgr2=0x7f8b600755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:37.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:37.639+0000 7f8b65800640 1 -- 172.21.15.37:0/2461988475 shutdown_connections 2024-09-21T05:47:37.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:47:37.639+0000 7f8b65800640 1 -- 172.21.15.37:0/2461988475 wait complete. 2024-09-21T05:47:38.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:37 smithi144 ceph-mon[34351]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:38.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:37 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:38.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:37 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:38.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:37 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:38.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:37 smithi037 ceph-mon[30631]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:38.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:37 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:38.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:37 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:38.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:37 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:38.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:37 smithi067 ceph-mon[34443]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:38.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:37 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:47:38.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:37 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:38.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:37 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:38.420 DEBUG:teuthology.orchestra.run.smithi037:osd.6> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T05:47:38.426 INFO:tasks.cephadm:Deploying osd.7 on smithi067 with /dev/vg_nvme/lv_2... 2024-09-21T05:47:38.426 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T05:47:38.693 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:47:39.061 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 05:47:38 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T05:47:38.935+0000 7f2a9962d640 -1 osd.6 0 log_to_monitors true 2024-09-21T05:47:39.937 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:39 smithi067 ceph-mon[34443]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:39.937 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:39 smithi067 ceph-mon[34443]: from='osd.6 [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:47:39.937 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:39 smithi067 ceph-mon[34443]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:47:40.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:39 smithi144 ceph-mon[34351]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:40.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:39 smithi144 ceph-mon[34351]: from='osd.6 [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:47:40.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:39 smithi144 ceph-mon[34351]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:47:40.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:39 smithi037 ceph-mon[30631]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:40.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:39 smithi037 ceph-mon[30631]: from='osd.6 [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:47:40.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:39 smithi037 ceph-mon[30631]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:47:40.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:40 smithi037 ceph-mon[30631]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:47:40.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:40 smithi037 ceph-mon[30631]: from='osd.6 [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:47:40.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:40 smithi037 ceph-mon[30631]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T05:47:40.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:40 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:40.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:40 smithi037 ceph-mon[30631]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:47:40.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:40 smithi037 ceph-mon[30631]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T05:47:40.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:40 smithi037 ceph-mon[30631]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T05:47:40.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:40 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:40.915 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 05:47:40 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T05:47:40.815+0000 7f2a93e00640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T05:47:40.916 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 05:47:40 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T05:47:40.826+0000 7f2a8ee00640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:47:41.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:40 smithi144 ceph-mon[34351]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:47:41.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:40 smithi144 ceph-mon[34351]: from='osd.6 [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:47:41.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:40 smithi144 ceph-mon[34351]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T05:47:41.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:40 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:41.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:40 smithi144 ceph-mon[34351]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:47:41.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:40 smithi144 ceph-mon[34351]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T05:47:41.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:40 smithi144 ceph-mon[34351]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T05:47:41.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:40 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:41.228 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:40 smithi067 ceph-mon[34443]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:47:41.229 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:40 smithi067 ceph-mon[34443]: from='osd.6 [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:47:41.229 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:40 smithi067 ceph-mon[34443]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T05:47:41.229 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:40 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:41.229 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:40 smithi067 ceph-mon[34443]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:47:41.229 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:40 smithi067 ceph-mon[34443]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T05:47:41.229 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:40 smithi067 ceph-mon[34443]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T05:47:41.229 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:40 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:41.540 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:47:41.567 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi067:vg_nvme/lv_2 2024-09-21T05:47:41.825 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:47:41.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:41 smithi037 ceph-mon[30631]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:41.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:41.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:42.075 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:41 smithi067 ceph-mon[34443]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:42.075 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:42.075 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:41 smithi144 ceph-mon[34351]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:42.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.327+0000 7f6c8847e640 1 -- 172.21.15.67:0/3137690142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c801036d0 msgr2=0x7f6c80103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:42.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.327+0000 7f6c8847e640 1 --2- 172.21.15.67:0/3137690142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c801036d0 0x7f6c80103ae0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009900 tx=0x7f6c7002a480 comp rx=0 tx=0).stop 2024-09-21T05:47:42.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.328+0000 7f6c8847e640 1 -- 172.21.15.67:0/3137690142 shutdown_connections 2024-09-21T05:47:42.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.328+0000 7f6c8847e640 1 --2- 172.21.15.67:0/3137690142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c80104070 0x7f6c8010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.328+0000 7f6c8847e640 1 --2- 172.21.15.67:0/3137690142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c801036d0 0x7f6c80103ae0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.328+0000 7f6c8847e640 1 --2- 172.21.15.67:0/3137690142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c80102640 0x7f6c80102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.328+0000 7f6c8847e640 1 -- 172.21.15.67:0/3137690142 >> 172.21.15.67:0/3137690142 conn(0x7f6c800fdfb0 msgr2=0x7f6c80100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:47:42.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.328+0000 7f6c8847e640 1 -- 172.21.15.67:0/3137690142 shutdown_connections 2024-09-21T05:47:42.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.328+0000 7f6c8847e640 1 -- 172.21.15.67:0/3137690142 wait complete. 2024-09-21T05:47:42.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.328+0000 7f6c8847e640 1 Processor -- start 2024-09-21T05:47:42.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.328+0000 7f6c8847e640 1 -- start start 2024-09-21T05:47:42.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8847e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c80102640 0x7f6c8019c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:42.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8847e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c801036d0 0x7f6c8019c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:42.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8847e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c80104070 0x7f6c8019d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:42.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8847e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8010e290 con 0x7f6c80104070 2024-09-21T05:47:42.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8847e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8010e110 con 0x7f6c80102640 2024-09-21T05:47:42.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8847e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8010e410 con 0x7f6c801036d0 2024-09-21T05:47:42.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8621a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c80102640 0x7f6c8019c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:42.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8621a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c80102640 0x7f6c8019c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38786/0 (socket says 172.21.15.67:38786) 2024-09-21T05:47:42.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8621a640 1 -- 172.21.15.67:0/3065046704 learned_addr learned my addr 172.21.15.67:0/3065046704 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-21T05:47:42.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c85a19640 1 --2- 172.21.15.67:0/3065046704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c801036d0 0x7f6c8019c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:42.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8621a640 1 -- 172.21.15.67:0/3065046704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c801036d0 msgr2=0x7f6c8019c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:42.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8621a640 1 --2- 172.21.15.67:0/3065046704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c801036d0 0x7f6c8019c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8621a640 1 -- 172.21.15.67:0/3065046704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c80104070 msgr2=0x7f6c8019d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:47:42.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8621a640 1 --2- 172.21.15.67:0/3065046704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c80104070 0x7f6c8019d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:47:42.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8621a640 1 -- 172.21.15.67:0/3065046704 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8019dc00 con 0x7f6c80102640 2024-09-21T05:47:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8621a640 1 --2- 172.21.15.67:0/3065046704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c80102640 0x7f6c8019c1d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00c970 tx=0x7f6c7c00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c777fe640 1 -- 172.21.15.67:0/3065046704 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c007bb0 con 0x7f6c80102640 2024-09-21T05:47:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c777fe640 1 -- 172.21.15.67:0/3065046704 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c7c007d50 con 0x7f6c80102640 2024-09-21T05:47:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.329+0000 7f6c8847e640 1 -- 172.21.15.67:0/3065046704 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8019def0 con 0x7f6c80102640 2024-09-21T05:47:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.330+0000 7f6c777fe640 1 -- 172.21.15.67:0/3065046704 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00f450 con 0x7f6c80102640 2024-09-21T05:47:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.330+0000 7f6c8847e640 1 -- 172.21.15.67:0/3065046704 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c801a45f0 con 0x7f6c80102640 2024-09-21T05:47:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.331+0000 7f6c8847e640 1 -- 172.21.15.67:0/3065046704 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c801a4820 con 0x7f6c80102640 2024-09-21T05:47:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.332+0000 7f6c777fe640 1 -- 172.21.15.67:0/3065046704 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f6c7c004f00 con 0x7f6c80102640 2024-09-21T05:47:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.333+0000 7f6c777fe640 1 --2- 172.21.15.67:0/3065046704 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6c6c0b6590 0x7f6c6c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:47:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.333+0000 7f6c777fe640 1 -- 172.21.15.67:0/3065046704 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4965+0+0 (secure 0 0 0) 0x7f6c7c0e6720 con 0x7f6c80102640 2024-09-21T05:47:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.333+0000 7f6c85a19640 1 --2- 172.21.15.67:0/3065046704 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6c6c0b6590 0x7f6c6c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:47:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.334+0000 7f6c85a19640 1 --2- 172.21.15.67:0/3065046704 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6c6c0b6590 0x7f6c6c0b8aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6c70031440 tx=0x7f6c700314a0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:47:42.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.340+0000 7f6c777fe640 1 -- 172.21.15.67:0/3065046704 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6c7c014030 con 0x7f6c80102640 2024-09-21T05:47:42.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:47:42.550+0000 7f6c8847e640 1 -- 172.21.15.67:0/3065046704 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6c800fffa0 con 0x7f6c6c0b6590 2024-09-21T05:47:43.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: purged_snaps scrub starts 2024-09-21T05:47:43.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: purged_snaps scrub ok 2024-09-21T05:47:43.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: osd.6 [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668] boot 2024-09-21T05:47:43.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T05:47:43.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:43.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:43.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:43.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:43.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:43.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:43.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:43.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:43.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:43.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:43.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:47:43.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:47:43.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:42 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:43.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: purged_snaps scrub starts 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: purged_snaps scrub ok 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: osd.6 [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668] boot 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:47:43.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:47:43.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:42 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:43.169 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T05:47:43.169 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T05:47:43.169 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: osd.6 [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668] boot 2024-09-21T05:47:43.170 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T05:47:43.170 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:47:43.170 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:43.170 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:43.170 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:43.170 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:43.170 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:47:43.170 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:43.170 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:43.170 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:47:43.170 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:47:43.170 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:47:43.170 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:47:43.171 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:42 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:43.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:43 smithi037 ceph-mon[30631]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:43.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:43 smithi037 ceph-mon[30631]: Detected new or changed devices on smithi037 2024-09-21T05:47:43.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:43 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi037 to 5698M 2024-09-21T05:47:43.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:43 smithi037 ceph-mon[30631]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:43.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:43 smithi037 ceph-mon[30631]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T05:47:43.915 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:43 smithi067 ceph-mon[34443]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:43.915 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:43 smithi067 ceph-mon[34443]: Detected new or changed devices on smithi037 2024-09-21T05:47:43.915 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:43 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi037 to 5698M 2024-09-21T05:47:43.915 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:43 smithi067 ceph-mon[34443]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:43.915 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:43 smithi067 ceph-mon[34443]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T05:47:44.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:43 smithi144 ceph-mon[34351]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-21T05:47:44.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:43 smithi144 ceph-mon[34351]: Detected new or changed devices on smithi037 2024-09-21T05:47:44.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:43 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi037 to 5698M 2024-09-21T05:47:44.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:43 smithi144 ceph-mon[34351]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:47:44.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:43 smithi144 ceph-mon[34351]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T05:47:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:45 smithi144 ceph-mon[34351]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:45 smithi144 ceph-mon[34351]: from='client.? 172.21.15.67:0/425939324' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "edac908f-40fe-42ee-a1ea-52f413776785"} : dispatch 2024-09-21T05:47:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:45 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "edac908f-40fe-42ee-a1ea-52f413776785"} : dispatch 2024-09-21T05:47:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:45 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edac908f-40fe-42ee-a1ea-52f413776785"}]': finished 2024-09-21T05:47:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:45 smithi144 ceph-mon[34351]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T05:47:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:45 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:47:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:45 smithi144 ceph-mon[34351]: from='client.? 172.21.15.67:0/2679486835' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:47:46.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:45 smithi037 ceph-mon[30631]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:46.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:45 smithi037 ceph-mon[30631]: from='client.? 172.21.15.67:0/425939324' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "edac908f-40fe-42ee-a1ea-52f413776785"} : dispatch 2024-09-21T05:47:46.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:45 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "edac908f-40fe-42ee-a1ea-52f413776785"} : dispatch 2024-09-21T05:47:46.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:45 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edac908f-40fe-42ee-a1ea-52f413776785"}]': finished 2024-09-21T05:47:46.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:45 smithi037 ceph-mon[30631]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T05:47:46.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:45 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:47:46.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:45 smithi037 ceph-mon[30631]: from='client.? 172.21.15.67:0/2679486835' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:47:46.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:45 smithi067 ceph-mon[34443]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:46.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:45 smithi067 ceph-mon[34443]: from='client.? 172.21.15.67:0/425939324' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "edac908f-40fe-42ee-a1ea-52f413776785"} : dispatch 2024-09-21T05:47:46.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:45 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "edac908f-40fe-42ee-a1ea-52f413776785"} : dispatch 2024-09-21T05:47:46.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:45 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edac908f-40fe-42ee-a1ea-52f413776785"}]': finished 2024-09-21T05:47:46.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:45 smithi067 ceph-mon[34443]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T05:47:46.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:45 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:47:46.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:45 smithi067 ceph-mon[34443]: from='client.? 172.21.15.67:0/2679486835' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:47:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:47 smithi144 ceph-mon[34351]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:48.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:47 smithi037 ceph-mon[30631]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:48.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:47 smithi067 ceph-mon[34443]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:49 smithi144 ceph-mon[34351]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:50.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:49 smithi037 ceph-mon[30631]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:50.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:49 smithi067 ceph-mon[34443]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:51.964 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:51 smithi067 ceph-mon[34443]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:52.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:51 smithi144 ceph-mon[34351]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:52.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:51 smithi037 ceph-mon[30631]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:53.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:53 smithi037 ceph-mon[30631]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:53.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:47:53.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:53.947 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:53 smithi067 ceph-mon[34443]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:53.947 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:47:53.947 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:54.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:53 smithi144 ceph-mon[34351]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:54.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:47:54.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:47:54.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:54 smithi067 ceph-mon[34443]: Deploying daemon osd.7 on smithi067 2024-09-21T05:47:55.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:54 smithi144 ceph-mon[34351]: Deploying daemon osd.7 on smithi067 2024-09-21T05:47:55.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:54 smithi037 ceph-mon[30631]: Deploying daemon osd.7 on smithi067 2024-09-21T05:47:56.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:55 smithi144 ceph-mon[34351]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:56.145 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:55 smithi067 ceph-mon[34443]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:56.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:55 smithi037 ceph-mon[30631]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:58.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:57 smithi144 ceph-mon[34351]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:58.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:57 smithi037 ceph-mon[30631]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:47:58.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:57 smithi067 ceph-mon[34443]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:00.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:59 smithi144 ceph-mon[34351]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:00.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:59 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:00.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:59 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:00.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:47:59 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:00.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:59 smithi037 ceph-mon[30631]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:00.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:59 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:00.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:59 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:00.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:47:59 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:00.194 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:59 smithi067 ceph-mon[34443]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:00.194 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:59 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:00.194 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:59 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:00.194 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:47:59 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:02.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:01 smithi144 ceph-mon[34351]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:02.135 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:01 smithi067 ceph-mon[34443]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:02.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:01 smithi037 ceph-mon[30631]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:03.594 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:03 smithi067 ceph-mon[34443]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:03.594 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:03.594 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:03.594 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:03.594 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:03.594 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:03.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:48:03.639+0000 7f6c777fe640 1 -- 172.21.15.67:0/3065046704 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6c800fffa0 con 0x7f6c6c0b6590 2024-09-21T05:48:03.643 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 7 on host 'smithi067' 2024-09-21T05:48:03.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:48:03.642+0000 7f6c8847e640 1 -- 172.21.15.67:0/3065046704 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6c6c0b6590 msgr2=0x7f6c6c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:03.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:48:03.642+0000 7f6c8847e640 1 --2- 172.21.15.67:0/3065046704 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6c6c0b6590 0x7f6c6c0b8aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6c70031440 tx=0x7f6c700314a0 comp rx=0 tx=0).stop 2024-09-21T05:48:03.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:48:03.642+0000 7f6c8847e640 1 -- 172.21.15.67:0/3065046704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c80102640 msgr2=0x7f6c8019c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:03.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:48:03.642+0000 7f6c8847e640 1 --2- 172.21.15.67:0/3065046704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c80102640 0x7f6c8019c1d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00c970 tx=0x7f6c7c00ce30 comp rx=0 tx=0).stop 2024-09-21T05:48:03.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:48:03.642+0000 7f6c8847e640 1 -- 172.21.15.67:0/3065046704 shutdown_connections 2024-09-21T05:48:03.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:48:03.642+0000 7f6c8847e640 1 --2- 172.21.15.67:0/3065046704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c80104070 0x7f6c8019d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:03.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:48:03.642+0000 7f6c8847e640 1 --2- 172.21.15.67:0/3065046704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c801036d0 0x7f6c8019c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:03.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:48:03.642+0000 7f6c8847e640 1 --2- 172.21.15.67:0/3065046704 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6c6c0b6590 0x7f6c6c0b8aa0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:03.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:48:03.642+0000 7f6c8847e640 1 --2- 172.21.15.67:0/3065046704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c80102640 0x7f6c8019c1d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:03.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:48:03.642+0000 7f6c8847e640 1 -- 172.21.15.67:0/3065046704 >> 172.21.15.67:0/3065046704 conn(0x7f6c800fdfb0 msgr2=0x7f6c800ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:03.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:48:03.642+0000 7f6c8847e640 1 -- 172.21.15.67:0/3065046704 shutdown_connections 2024-09-21T05:48:03.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:48:03.642+0000 7f6c8847e640 1 -- 172.21.15.67:0/3065046704 wait complete. 2024-09-21T05:48:03.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:03 smithi144 ceph-mon[34351]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:03.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:03.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:03.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:03.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:03.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:03.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:03 smithi037 ceph-mon[30631]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:03.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:03.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:03.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:03.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:03.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:04.274 DEBUG:teuthology.orchestra.run.smithi067:osd.7> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T05:48:04.277 INFO:tasks.cephadm:Deploying osd.8 on smithi144 with /dev/vg_nvme/lv_2... 2024-09-21T05:48:04.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T05:48:04.532 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:48:04.593 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:04 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:04.593 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:04 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:04.593 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:04 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:04.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:04 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:04.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:04 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:04.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:04 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:04.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:04 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:04.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:04 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:04.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:04 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:05.730 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:05 smithi067 ceph-mon[34443]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:05.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:05 smithi037 ceph-mon[30631]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:05.996 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 05:48:05 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T05:48:05.728+0000 7f8bf3446640 -1 osd.7 0 log_to_monitors true 2024-09-21T05:48:06.016 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:05 smithi144 ceph-mon[34351]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:06.872 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:06 smithi067 ceph-mon[34443]: from='osd.7 [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:48:06.872 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:06 smithi067 ceph-mon[34443]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:48:06.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:06 smithi037 ceph-mon[30631]: from='osd.7 [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:48:06.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:06 smithi037 ceph-mon[30631]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:48:07.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:06 smithi144 ceph-mon[34351]: from='osd.7 [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:48:07.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:06 smithi144 ceph-mon[34351]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:48:07.181 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:48:07.208 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi144:vg_nvme/lv_2 2024-09-21T05:48:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:48:07.834 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:07.834 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:48:07.834 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: from='osd.7 [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:48:07.834 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T05:48:07.835 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:07.835 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:48:07.835 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:07.835 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:07.835 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:07.835 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:07.835 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:07.835 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:07.835 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:07.835 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:07.835 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:07.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:48:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: from='osd.7 [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:48:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T05:48:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:48:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:07.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:07.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:07.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.924+0000 7f76536ec640 1 -- 172.21.15.144:0/1649027838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f764c105180 msgr2=0x7f764c10bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:07.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.924+0000 7f76536ec640 1 --2- 172.21.15.144:0/1649027838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f764c105180 0x7f764c10bb20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7644009ca0 tx=0x7f764402a950 comp rx=0 tx=0).stop 2024-09-21T05:48:07.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.924+0000 7f76536ec640 1 -- 172.21.15.144:0/1649027838 shutdown_connections 2024-09-21T05:48:07.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.924+0000 7f76536ec640 1 --2- 172.21.15.144:0/1649027838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f764c105180 0x7f764c10bb20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.924+0000 7f76536ec640 1 --2- 172.21.15.144:0/1649027838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c1047e0 0x7f764c104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.924+0000 7f76536ec640 1 --2- 172.21.15.144:0/1649027838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764c103750 0x7f764c103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.924+0000 7f76536ec640 1 -- 172.21.15.144:0/1649027838 >> 172.21.15.144:0/1649027838 conn(0x7f764c0ff0c0 msgr2=0x7f764c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:07.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.925+0000 7f76536ec640 1 -- 172.21.15.144:0/1649027838 shutdown_connections 2024-09-21T05:48:07.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.925+0000 7f76536ec640 1 -- 172.21.15.144:0/1649027838 wait complete. 2024-09-21T05:48:07.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.925+0000 7f76536ec640 1 Processor -- start 2024-09-21T05:48:07.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.925+0000 7f76536ec640 1 -- start start 2024-09-21T05:48:07.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.925+0000 7f76536ec640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f764c103750 0x7f764c199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:07.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.925+0000 7f76536ec640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764c1047e0 0x7f764c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:07.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.925+0000 7f76536ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c105180 0x7f764c19b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:07.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.925+0000 7f76536ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f764c10f420 con 0x7f764c105180 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.925+0000 7f76536ec640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f764c10f2a0 con 0x7f764c1047e0 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.925+0000 7f76536ec640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f764c10f5a0 con 0x7f764c103750 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.925+0000 7f7651488640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f764c103750 0x7f764c199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f7651488640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f764c103750 0x7f764c199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35520/0 (socket says 172.21.15.144:35520) 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f7651488640 1 -- 172.21.15.144:0/2710327414 learned_addr learned my addr 172.21.15.144:0/2710327414 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f7650c87640 1 --2- 172.21.15.144:0/2710327414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764c1047e0 0x7f764c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f7651488640 1 -- 172.21.15.144:0/2710327414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764c1047e0 msgr2=0x7f764c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f7651488640 1 --2- 172.21.15.144:0/2710327414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764c1047e0 0x7f764c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f7651488640 1 -- 172.21.15.144:0/2710327414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c105180 msgr2=0x7f764c19b1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f7651488640 1 --2- 172.21.15.144:0/2710327414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c105180 0x7f764c19b1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f7651488640 1 -- 172.21.15.144:0/2710327414 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764c19b9e0 con 0x7f764c103750 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f7651488640 1 --2- 172.21.15.144:0/2710327414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f764c103750 0x7f764c199fb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f764800d770 tx=0x7f764800db70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f76427fc640 1 -- 172.21.15.144:0/2710327414 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648017070 con 0x7f764c103750 2024-09-21T05:48:07.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f76427fc640 1 -- 172.21.15.144:0/2710327414 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7648009820 con 0x7f764c103750 2024-09-21T05:48:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f76427fc640 1 -- 172.21.15.144:0/2710327414 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648004bc0 con 0x7f764c103750 2024-09-21T05:48:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f76536ec640 1 -- 172.21.15.144:0/2710327414 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764c19bcd0 con 0x7f764c103750 2024-09-21T05:48:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.926+0000 7f76536ec640 1 -- 172.21.15.144:0/2710327414 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f764c1a23d0 con 0x7f764c103750 2024-09-21T05:48:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.927+0000 7f76536ec640 1 -- 172.21.15.144:0/2710327414 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f764c10a930 con 0x7f764c103750 2024-09-21T05:48:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.929+0000 7f76427fc640 1 -- 172.21.15.144:0/2710327414 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f76480099d0 con 0x7f764c103750 2024-09-21T05:48:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.929+0000 7f76427fc640 1 --2- 172.21.15.144:0/2710327414 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f76380b6590 0x7f76380b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.930+0000 7f76427fc640 1 -- 172.21.15.144:0/2710327414 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5117+0+0 (secure 0 0 0) 0x7f76480e6100 con 0x7f764c103750 2024-09-21T05:48:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.930+0000 7f7650c87640 1 --2- 172.21.15.144:0/2710327414 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f76380b6590 0x7f76380b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.931+0000 7f7650c87640 1 --2- 172.21.15.144:0/2710327414 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f76380b6590 0x7f76380b8aa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f763c009990 tx=0x7f763c009110 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:07.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:07.934+0000 7f76427fc640 1 -- 172.21.15.144:0/2710327414 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76480ad610 con 0x7f764c103750 2024-09-21T05:48:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:48:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: from='osd.7 [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:48:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T05:48:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:48:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:07.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:07.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:07.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:07.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:08.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:08.125+0000 7f76536ec640 1 -- 172.21.15.144:0/2710327414 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f764c063800 con 0x7f76380b6590 2024-09-21T05:48:08.663 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T05:48:08.352+0000 7f8bef3c8640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T05:48:08.664 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T05:48:08.364+0000 7f8be71be640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:48:08.770 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:08 smithi144 ceph-mon[34351]: Detected new or changed devices on smithi067 2024-09-21T05:48:08.770 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:08 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi067 to 5696M 2024-09-21T05:48:08.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:08 smithi144 ceph-mon[34351]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-21T05:48:08.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:08 smithi144 ceph-mon[34351]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T05:48:08.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:08 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:08.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:08 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:08.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:08 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:08.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:08 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:08.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:08 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:08.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:08 smithi144 ceph-mon[34351]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T05:48:08.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:08 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:08.771 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:08 smithi144 ceph-mon[34351]: from='osd.7 ' entity='osd.7' 2024-09-21T05:48:08.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:08 smithi037 ceph-mon[30631]: Detected new or changed devices on smithi067 2024-09-21T05:48:08.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:08 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi067 to 5696M 2024-09-21T05:48:08.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:08 smithi037 ceph-mon[30631]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-21T05:48:08.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:08 smithi037 ceph-mon[30631]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T05:48:08.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:08 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:08.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:08 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:08.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:08 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:08.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:08 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:08.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:08 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:08.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:08 smithi037 ceph-mon[30631]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T05:48:08.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:08 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:08.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:08 smithi037 ceph-mon[30631]: from='osd.7 ' entity='osd.7' 2024-09-21T05:48:08.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-mon[34443]: Detected new or changed devices on smithi067 2024-09-21T05:48:08.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi067 to 5696M 2024-09-21T05:48:08.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-mon[34443]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-21T05:48:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-mon[34443]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T05:48:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-mon[34443]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T05:48:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:08 smithi067 ceph-mon[34443]: from='osd.7 ' entity='osd.7' 2024-09-21T05:48:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:09 smithi144 ceph-mon[34351]: purged_snaps scrub starts 2024-09-21T05:48:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:09 smithi144 ceph-mon[34351]: purged_snaps scrub ok 2024-09-21T05:48:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:09 smithi144 ceph-mon[34351]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:09 smithi144 ceph-mon[34351]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:09.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:09 smithi144 ceph-mon[34351]: osd.7 [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723] boot 2024-09-21T05:48:09.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:09 smithi144 ceph-mon[34351]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T05:48:09.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:09.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:09 smithi067 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T05:48:09.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:09 smithi067 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T05:48:09.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:09 smithi067 ceph-mon[34443]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:09.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:09 smithi067 ceph-mon[34443]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:09.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:09.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:09 smithi067 ceph-mon[34443]: osd.7 [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723] boot 2024-09-21T05:48:09.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:09 smithi067 ceph-mon[34443]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T05:48:09.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:10.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:09 smithi037 ceph-mon[30631]: purged_snaps scrub starts 2024-09-21T05:48:10.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:09 smithi037 ceph-mon[30631]: purged_snaps scrub ok 2024-09-21T05:48:10.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:09 smithi037 ceph-mon[30631]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:10.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:09 smithi037 ceph-mon[30631]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-21T05:48:10.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:10.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:09 smithi037 ceph-mon[30631]: osd.7 [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723] boot 2024-09-21T05:48:10.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:09 smithi037 ceph-mon[30631]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T05:48:10.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:48:11.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:11 smithi144 ceph-mon[34351]: pgmap v200: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:11.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:11 smithi144 ceph-mon[34351]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T05:48:11.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:11 smithi144 ceph-mon[34351]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-21T05:48:11.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:11 smithi144 ceph-mon[34351]: from='client.? 172.21.15.144:0/3371294866' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "85372a82-dd7e-4de9-a3d5-bf000d2dd9c7"} : dispatch 2024-09-21T05:48:11.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:11 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "85372a82-dd7e-4de9-a3d5-bf000d2dd9c7"} : dispatch 2024-09-21T05:48:11.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:11 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85372a82-dd7e-4de9-a3d5-bf000d2dd9c7"}]': finished 2024-09-21T05:48:11.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:11 smithi144 ceph-mon[34351]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T05:48:11.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:11 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:11.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:11 smithi037 ceph-mon[30631]: pgmap v200: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:11.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:11 smithi037 ceph-mon[30631]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T05:48:11.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:11 smithi037 ceph-mon[30631]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-21T05:48:11.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:11 smithi037 ceph-mon[30631]: from='client.? 172.21.15.144:0/3371294866' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "85372a82-dd7e-4de9-a3d5-bf000d2dd9c7"} : dispatch 2024-09-21T05:48:11.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:11 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "85372a82-dd7e-4de9-a3d5-bf000d2dd9c7"} : dispatch 2024-09-21T05:48:11.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:11 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85372a82-dd7e-4de9-a3d5-bf000d2dd9c7"}]': finished 2024-09-21T05:48:11.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:11 smithi037 ceph-mon[30631]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T05:48:11.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:11 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:11.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:11 smithi067 ceph-mon[34443]: pgmap v200: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:11.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:11 smithi067 ceph-mon[34443]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T05:48:11.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:11 smithi067 ceph-mon[34443]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-21T05:48:11.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:11 smithi067 ceph-mon[34443]: from='client.? 172.21.15.144:0/3371294866' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "85372a82-dd7e-4de9-a3d5-bf000d2dd9c7"} : dispatch 2024-09-21T05:48:11.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:11 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "85372a82-dd7e-4de9-a3d5-bf000d2dd9c7"} : dispatch 2024-09-21T05:48:11.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:11 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85372a82-dd7e-4de9-a3d5-bf000d2dd9c7"}]': finished 2024-09-21T05:48:11.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:11 smithi067 ceph-mon[34443]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T05:48:11.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:11 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:12.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:12 smithi144 ceph-mon[34351]: from='client.? 172.21.15.144:0/2061785109' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:48:12.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:12 smithi144 ceph-mon[34351]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T05:48:12.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:12 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:12 smithi037 ceph-mon[30631]: from='client.? 172.21.15.144:0/2061785109' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:48:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:12 smithi037 ceph-mon[30631]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T05:48:12.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:12 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:12.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:12 smithi067 ceph-mon[34443]: from='client.? 172.21.15.144:0/2061785109' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:48:12.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:12 smithi067 ceph-mon[34443]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T05:48:12.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:12 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:13.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:13 smithi067 ceph-mon[34443]: pgmap v204: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:14.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:13 smithi144 ceph-mon[34351]: pgmap v204: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:14.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:13 smithi037 ceph-mon[30631]: pgmap v204: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:15.994 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:15 smithi144 ceph-mon[34351]: pgmap v205: 1 pgs: 1 remapped; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:15.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:15 smithi067 ceph-mon[34443]: pgmap v205: 1 pgs: 1 remapped; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:16.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:15 smithi037 ceph-mon[30631]: pgmap v205: 1 pgs: 1 remapped; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:17.082 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:16 smithi144 ceph-mon[34351]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-21T05:48:17.082 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:16 smithi144 ceph-mon[34351]: Cluster is now healthy 2024-09-21T05:48:17.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:16 smithi037 ceph-mon[30631]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-21T05:48:17.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:16 smithi037 ceph-mon[30631]: Cluster is now healthy 2024-09-21T05:48:17.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:16 smithi067 ceph-mon[34443]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-21T05:48:17.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:16 smithi067 ceph-mon[34443]: Cluster is now healthy 2024-09-21T05:48:17.844 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:17 smithi144 ceph-mon[34351]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-09-21T05:48:18.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:17 smithi037 ceph-mon[30631]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-09-21T05:48:18.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:17 smithi067 ceph-mon[34443]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-09-21T05:48:19.989 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:19 smithi144 ceph-mon[34351]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s, 0 objects/s recovering 2024-09-21T05:48:19.989 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:19 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T05:48:19.989 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:19 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:20.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:19 smithi037 ceph-mon[30631]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s, 0 objects/s recovering 2024-09-21T05:48:20.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T05:48:20.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:20.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:19 smithi067 ceph-mon[34443]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s, 0 objects/s recovering 2024-09-21T05:48:20.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:19 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T05:48:20.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:19 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:21.085 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:20 smithi144 ceph-mon[34351]: Deploying daemon osd.8 on smithi144 2024-09-21T05:48:21.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:20 smithi037 ceph-mon[30631]: Deploying daemon osd.8 on smithi144 2024-09-21T05:48:21.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:20 smithi067 ceph-mon[34443]: Deploying daemon osd.8 on smithi144 2024-09-21T05:48:21.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:21 smithi144 ceph-mon[34351]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-21T05:48:22.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:21 smithi037 ceph-mon[30631]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-21T05:48:22.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:21 smithi067 ceph-mon[34443]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-21T05:48:24.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:23 smithi144 ceph-mon[34351]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-21T05:48:24.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:23 smithi037 ceph-mon[30631]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-21T05:48:24.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:23 smithi067 ceph-mon[34443]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-21T05:48:26.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:25 smithi144 ceph-mon[34351]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:48:26.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:25 smithi037 ceph-mon[30631]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:48:26.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:25 smithi067 ceph-mon[34443]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:48:27.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:26 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:27.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:26 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:27.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:26 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:27.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:26 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:27.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:26 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:27.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:26 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:27.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:26 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:27.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:26 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:27.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:26 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:28.111 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:27 smithi144 ceph-mon[34351]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:48:28.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:27 smithi037 ceph-mon[30631]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:48:28.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:27 smithi067 ceph-mon[34443]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T05:48:29.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:29.426+0000 7f76427fc640 1 -- 172.21.15.144:0/2710327414 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f764c063800 con 0x7f76380b6590 2024-09-21T05:48:29.428 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 8 on host 'smithi144' 2024-09-21T05:48:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:29.429+0000 7f76536ec640 1 -- 172.21.15.144:0/2710327414 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f76380b6590 msgr2=0x7f76380b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:29.429+0000 7f76536ec640 1 --2- 172.21.15.144:0/2710327414 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f76380b6590 0x7f76380b8aa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f763c009990 tx=0x7f763c009110 comp rx=0 tx=0).stop 2024-09-21T05:48:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:29.429+0000 7f76536ec640 1 -- 172.21.15.144:0/2710327414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f764c103750 msgr2=0x7f764c199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:29.429+0000 7f76536ec640 1 --2- 172.21.15.144:0/2710327414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f764c103750 0x7f764c199fb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f764800d770 tx=0x7f764800db70 comp rx=0 tx=0).stop 2024-09-21T05:48:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:29.430+0000 7f76536ec640 1 -- 172.21.15.144:0/2710327414 shutdown_connections 2024-09-21T05:48:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:29.430+0000 7f76536ec640 1 --2- 172.21.15.144:0/2710327414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f764c105180 0x7f764c19b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:29.430+0000 7f76536ec640 1 --2- 172.21.15.144:0/2710327414 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f76380b6590 0x7f76380b8aa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:29.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:29.430+0000 7f76536ec640 1 --2- 172.21.15.144:0/2710327414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764c1047e0 0x7f764c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:29.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:29.430+0000 7f76536ec640 1 --2- 172.21.15.144:0/2710327414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f764c103750 0x7f764c199fb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:29.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:29.430+0000 7f76536ec640 1 -- 172.21.15.144:0/2710327414 >> 172.21.15.144:0/2710327414 conn(0x7f764c0ff0c0 msgr2=0x7f764c107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:29.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:29.430+0000 7f76536ec640 1 -- 172.21.15.144:0/2710327414 shutdown_connections 2024-09-21T05:48:29.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:48:29.430+0000 7f76536ec640 1 -- 172.21.15.144:0/2710327414 wait complete. 2024-09-21T05:48:30.098 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:29 smithi144 ceph-mon[34351]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:30.098 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:29 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:30.098 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:29 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:30.098 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:29 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:30.098 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:29 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:30.125 DEBUG:teuthology.orchestra.run.smithi144:osd.8> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T05:48:30.128 INFO:tasks.cephadm:Deploying osd.9 on smithi037 with /dev/vg_nvme/lv_1... 2024-09-21T05:48:30.128 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T05:48:30.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:29 smithi037 ceph-mon[30631]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:30.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:29 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:30.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:29 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:30.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:29 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:30.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:29 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:30.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:29 smithi067 ceph-mon[34443]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:30.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:29 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:30.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:29 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:30.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:29 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:30.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:29 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:30.522 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:31.986 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 05:48:31 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T05:48:31.842+0000 7efe11a88640 -1 osd.8 0 log_to_monitors true 2024-09-21T05:48:31.986 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:31 smithi144 ceph-mon[34351]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:32.049 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:31 smithi067 ceph-mon[34443]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:32.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:31 smithi037 ceph-mon[30631]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:32.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:32 smithi037 ceph-mon[30631]: from='osd.8 [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:48:32.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:32 smithi037 ceph-mon[30631]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:48:33.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:32 smithi144 ceph-mon[34351]: from='osd.8 [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:48:33.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:32 smithi144 ceph-mon[34351]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:48:33.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:32 smithi067 ceph-mon[34443]: from='osd.8 [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:48:33.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:32 smithi067 ceph-mon[34443]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T05:48:33.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:33.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='osd.8 [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:33.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:33.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:33.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:33.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:33.963 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:48:33.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi037:vg_nvme/lv_1 2024-09-21T05:48:34.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:34.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T05:48:34.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='osd.8 [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:48:34.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T05:48:34.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:34.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:48:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:34.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T05:48:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='osd.8 [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:48:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T05:48:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:48:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:48:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:34.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:34.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:34.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:34.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:48:34.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:48:34.815 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 05:48:34 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T05:48:34.507+0000 7efe0da0a640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T05:48:34.816 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 05:48:34 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T05:48:34.516+0000 7efe05800640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:48:34.836 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:34 smithi037 ceph-mon[30631]: Detected new or changed devices on smithi144 2024-09-21T05:48:34.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:34 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-21T05:48:34.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:34 smithi037 ceph-mon[30631]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T05:48:34.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:34 smithi037 ceph-mon[30631]: osdmap e53: 9 total, 8 up, 9 in 2024-09-21T05:48:34.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:34 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:34.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:34 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:34.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:34 smithi037 ceph-mon[30631]: from='osd.8 ' entity='osd.8' 2024-09-21T05:48:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.067+0000 7f8eddc00640 1 -- 172.21.15.37:0/2437240009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8106a10 msgr2=0x7f8ed8106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.067+0000 7f8eddc00640 1 --2- 172.21.15.37:0/2437240009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8106a10 0x7f8ed8106e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4009900 tx=0x7f8ec402a480 comp rx=0 tx=0).stop 2024-09-21T05:48:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.067+0000 7f8eddc00640 1 -- 172.21.15.37:0/2437240009 shutdown_connections 2024-09-21T05:48:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.067+0000 7f8eddc00640 1 --2- 172.21.15.37:0/2437240009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed81073b0 0x7f8ed810dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.067+0000 7f8eddc00640 1 --2- 172.21.15.37:0/2437240009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed8106a10 0x7f8ed8106e20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.067+0000 7f8eddc00640 1 --2- 172.21.15.37:0/2437240009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ed8105980 0x7f8ed8105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.067+0000 7f8eddc00640 1 -- 172.21.15.37:0/2437240009 >> 172.21.15.37:0/2437240009 conn(0x7f8ed81012f0 msgr2=0x7f8ed81037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:48:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.067+0000 7f8eddc00640 1 -- 172.21.15.37:0/2437240009 shutdown_connections 2024-09-21T05:48:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.067+0000 7f8eddc00640 1 -- 172.21.15.37:0/2437240009 wait complete. 2024-09-21T05:48:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.068+0000 7f8eddc00640 1 Processor -- start 2024-09-21T05:48:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.068+0000 7f8eddc00640 1 -- start start 2024-09-21T05:48:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8eddc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed8105980 0x7f8ed819c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8eddc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ed8106a10 0x7f8ed819c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8eddc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed81073b0 0x7f8ed819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8eddc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed8111600 con 0x7f8ed81073b0 2024-09-21T05:48:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8eddc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed8111480 con 0x7f8ed8106a10 2024-09-21T05:48:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8eddc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed8111780 con 0x7f8ed8105980 2024-09-21T05:48:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8ed6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed8105980 0x7f8ed819c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8ed7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed81073b0 0x7f8ed819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8ed6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed8105980 0x7f8ed819c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:51732/0 (socket says 172.21.15.37:51732) 2024-09-21T05:48:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8ed7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed81073b0 0x7f8ed819d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55584/0 (socket says 172.21.15.37:55584) 2024-09-21T05:48:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8ed6a00640 1 -- 172.21.15.37:0/2099881301 learned_addr learned my addr 172.21.15.37:0/2099881301 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:48:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8ed6000640 1 --2- 172.21.15.37:0/2099881301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ed8106a10 0x7f8ed819c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8ed7400640 1 -- 172.21.15.37:0/2099881301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed8105980 msgr2=0x7f8ed819c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8ed7400640 1 --2- 172.21.15.37:0/2099881301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed8105980 0x7f8ed819c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8ed7400640 1 -- 172.21.15.37:0/2099881301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ed8106a10 msgr2=0x7f8ed819c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:48:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.069+0000 7f8ed7400640 1 --2- 172.21.15.37:0/2099881301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ed8106a10 0x7f8ed819c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:48:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.070+0000 7f8ed7400640 1 -- 172.21.15.37:0/2099881301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed819dc30 con 0x7f8ed81073b0 2024-09-21T05:48:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.070+0000 7f8ed7400640 1 --2- 172.21.15.37:0/2099881301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed81073b0 0x7f8ed819d410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009fd0 tx=0x7f8ed000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:35.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.070+0000 7f8ecf400640 1 -- 172.21.15.37:0/2099881301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000ce20 con 0x7f8ed81073b0 2024-09-21T05:48:35.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.070+0000 7f8ecf400640 1 -- 172.21.15.37:0/2099881301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed0005020 con 0x7f8ed81073b0 2024-09-21T05:48:35.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.070+0000 7f8eddc00640 1 -- 172.21.15.37:0/2099881301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed819df20 con 0x7f8ed81073b0 2024-09-21T05:48:35.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.070+0000 7f8ecf400640 1 -- 172.21.15.37:0/2099881301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0010690 con 0x7f8ed81073b0 2024-09-21T05:48:35.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.070+0000 7f8eddc00640 1 -- 172.21.15.37:0/2099881301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed81a4620 con 0x7f8ed81073b0 2024-09-21T05:48:35.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.072+0000 7f8eddc00640 1 -- 172.21.15.37:0/2099881301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed810cb60 con 0x7f8ed81073b0 2024-09-21T05:48:35.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.074+0000 7f8ecf400640 1 -- 172.21.15.37:0/2099881301 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f8ed00054d0 con 0x7f8ed81073b0 2024-09-21T05:48:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.076+0000 7f8ecf400640 1 --2- 172.21.15.37:0/2099881301 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8ebc0b6510 0x7f8ebc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:48:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.076+0000 7f8ecf400640 1 -- 172.21.15.37:0/2099881301 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5862+0+0 (secure 0 0 0) 0x7f8ed00e7090 con 0x7f8ed81073b0 2024-09-21T05:48:35.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.076+0000 7f8ed6a00640 1 --2- 172.21.15.37:0/2099881301 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8ebc0b6510 0x7f8ebc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:48:35.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.076+0000 7f8ed6a00640 1 --2- 172.21.15.37:0/2099881301 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8ebc0b6510 0x7f8ebc0b8a20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80095f0 tx=0x7f8ec8005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:48:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.078+0000 7f8ecf400640 1 -- 172.21.15.37:0/2099881301 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ed00ae210 con 0x7f8ed81073b0 2024-09-21T05:48:35.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:34 smithi144 ceph-mon[34351]: Detected new or changed devices on smithi144 2024-09-21T05:48:35.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:34 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-21T05:48:35.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:34 smithi144 ceph-mon[34351]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T05:48:35.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:34 smithi144 ceph-mon[34351]: osdmap e53: 9 total, 8 up, 9 in 2024-09-21T05:48:35.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:34 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:35.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:34 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:35.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:34 smithi144 ceph-mon[34351]: from='osd.8 ' entity='osd.8' 2024-09-21T05:48:35.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:34 smithi067 ceph-mon[34443]: Detected new or changed devices on smithi144 2024-09-21T05:48:35.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:34 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-21T05:48:35.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:34 smithi067 ceph-mon[34443]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T05:48:35.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:34 smithi067 ceph-mon[34443]: osdmap e53: 9 total, 8 up, 9 in 2024-09-21T05:48:35.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:35.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:34 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:35.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:34 smithi067 ceph-mon[34443]: from='osd.8 ' entity='osd.8' 2024-09-21T05:48:35.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:48:35.290+0000 7f8eddc00640 1 -- 172.21.15.37:0/2099881301 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f8ed8063800 con 0x7f8ebc0b6510 2024-09-21T05:48:36.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:35 smithi037 ceph-mon[30631]: purged_snaps scrub starts 2024-09-21T05:48:36.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:35 smithi037 ceph-mon[30631]: purged_snaps scrub ok 2024-09-21T05:48:36.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:35 smithi037 ceph-mon[30631]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:36.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:35 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:36.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:35 smithi037 ceph-mon[30631]: osd.8 [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551] boot 2024-09-21T05:48:36.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:35 smithi037 ceph-mon[30631]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T05:48:36.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:35 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:36.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:35 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:36.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:35 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:36.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:35 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:36.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:35 smithi144 ceph-mon[34351]: purged_snaps scrub starts 2024-09-21T05:48:36.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:35 smithi144 ceph-mon[34351]: purged_snaps scrub ok 2024-09-21T05:48:36.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:35 smithi144 ceph-mon[34351]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:36.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:35 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:36.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:35 smithi144 ceph-mon[34351]: osd.8 [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551] boot 2024-09-21T05:48:36.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:35 smithi144 ceph-mon[34351]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T05:48:36.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:35 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:36.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:35 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:36.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:35 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:36.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:35 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:36.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:35 smithi067 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T05:48:36.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:35 smithi067 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T05:48:36.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:35 smithi067 ceph-mon[34443]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:48:36.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:35 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:36.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:35 smithi067 ceph-mon[34443]: osd.8 [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551] boot 2024-09-21T05:48:36.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:35 smithi067 ceph-mon[34443]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T05:48:36.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:35 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T05:48:36.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:35 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:48:36.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:35 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:48:36.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:35 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:37.084 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:36 smithi037 ceph-mon[30631]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:37.084 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:36 smithi037 ceph-mon[30631]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T05:48:37.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:36 smithi144 ceph-mon[34351]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:37.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:36 smithi144 ceph-mon[34351]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T05:48:37.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:36 smithi067 ceph-mon[34443]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:48:37.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:36 smithi067 ceph-mon[34443]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T05:48:37.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:37 smithi037 ceph-mon[30631]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:37.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:37 smithi037 ceph-mon[30631]: osdmap e56: 9 total, 9 up, 9 in 2024-09-21T05:48:38.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:37 smithi144 ceph-mon[34351]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:38.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:37 smithi144 ceph-mon[34351]: osdmap e56: 9 total, 9 up, 9 in 2024-09-21T05:48:38.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:37 smithi067 ceph-mon[34443]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:38.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:37 smithi067 ceph-mon[34443]: osdmap e56: 9 total, 9 up, 9 in 2024-09-21T05:48:39.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:38 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3865259695' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "996af6b7-e17f-4a58-94f5-1a7bfec6f702"} : dispatch 2024-09-21T05:48:39.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:38 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "996af6b7-e17f-4a58-94f5-1a7bfec6f702"} : dispatch 2024-09-21T05:48:39.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:38 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "996af6b7-e17f-4a58-94f5-1a7bfec6f702"}]': finished 2024-09-21T05:48:39.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:38 smithi144 ceph-mon[34351]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T05:48:39.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:38 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:48:39.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:38 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3865259695' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "996af6b7-e17f-4a58-94f5-1a7bfec6f702"} : dispatch 2024-09-21T05:48:39.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:38 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "996af6b7-e17f-4a58-94f5-1a7bfec6f702"} : dispatch 2024-09-21T05:48:39.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:38 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "996af6b7-e17f-4a58-94f5-1a7bfec6f702"}]': finished 2024-09-21T05:48:39.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:38 smithi037 ceph-mon[30631]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T05:48:39.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:38 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:48:39.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:38 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3865259695' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "996af6b7-e17f-4a58-94f5-1a7bfec6f702"} : dispatch 2024-09-21T05:48:39.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:38 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "996af6b7-e17f-4a58-94f5-1a7bfec6f702"} : dispatch 2024-09-21T05:48:39.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:38 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "996af6b7-e17f-4a58-94f5-1a7bfec6f702"}]': finished 2024-09-21T05:48:39.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:38 smithi067 ceph-mon[34443]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T05:48:39.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:38 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:48:40.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:39 smithi144 ceph-mon[34351]: pgmap v222: 1 pgs: 1 peering; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:40.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:39 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3434908349' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:48:40.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:39 smithi037 ceph-mon[30631]: pgmap v222: 1 pgs: 1 peering; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:40.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:39 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3434908349' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:48:40.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:39 smithi067 ceph-mon[34443]: pgmap v222: 1 pgs: 1 peering; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:40.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:39 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3434908349' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:48:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:41 smithi144 ceph-mon[34351]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-21T05:48:42.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:41 smithi037 ceph-mon[30631]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-21T05:48:42.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:41 smithi067 ceph-mon[34443]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-21T05:48:44.093 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:43 smithi037 ceph-mon[30631]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T05:48:44.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:43 smithi144 ceph-mon[34351]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T05:48:44.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:43 smithi067 ceph-mon[34443]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T05:48:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:45 smithi144 ceph-mon[34351]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:48:46.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:45 smithi037 ceph-mon[30631]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:48:46.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:45 smithi067 ceph-mon[34443]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:48:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:47 smithi144 ceph-mon[34351]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T05:48:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T05:48:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:48.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:47 smithi037 ceph-mon[30631]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T05:48:48.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T05:48:48.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:48.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:47 smithi067 ceph-mon[34443]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T05:48:48.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T05:48:48.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:48:49.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:48 smithi144 ceph-mon[34351]: Deploying daemon osd.9 on smithi037 2024-09-21T05:48:49.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:48 smithi037 ceph-mon[30631]: Deploying daemon osd.9 on smithi037 2024-09-21T05:48:49.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:48 smithi067 ceph-mon[34443]: Deploying daemon osd.9 on smithi037 2024-09-21T05:48:50.036 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:49 smithi037 ceph-mon[30631]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:48:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:49 smithi144 ceph-mon[34351]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:48:50.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:49 smithi067 ceph-mon[34443]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T05:48:52.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:51 smithi144 ceph-mon[34351]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T05:48:52.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:51 smithi037 ceph-mon[30631]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T05:48:52.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:51 smithi067 ceph-mon[34443]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T05:48:54.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:53 smithi144 ceph-mon[34351]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:54.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:53 smithi037 ceph-mon[30631]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:54.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:53 smithi067 ceph-mon[34443]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:56.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:55 smithi144 ceph-mon[34351]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:56.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:55 smithi037 ceph-mon[30631]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:55 smithi067 ceph-mon[34443]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:57.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:57.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:57.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:57.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:57.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:57.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:57.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:48:57.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:57.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:48:57.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:57 smithi037 ceph-mon[30631]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:58.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:57 smithi144 ceph-mon[34351]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:48:58.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:57 smithi067 ceph-mon[34443]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:00.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:59 smithi037 ceph-mon[30631]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:00.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:59 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:00.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:59 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:00.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:59 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:00.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:59 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:00.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:48:59 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:00.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:59 smithi067 ceph-mon[34443]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:00.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:59 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:00.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:59 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:59 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:59 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:48:59 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:59 smithi144 ceph-mon[34351]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:59 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:59 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:59 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:59 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:48:59 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:00.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:00.694+0000 7f8ecf400640 1 -- 172.21.15.37:0/2099881301 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8ed8063800 con 0x7f8ebc0b6510 2024-09-21T05:49:00.696 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 9 on host 'smithi037' 2024-09-21T05:49:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:00.697+0000 7f8eddc00640 1 -- 172.21.15.37:0/2099881301 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8ebc0b6510 msgr2=0x7f8ebc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:00.697+0000 7f8eddc00640 1 --2- 172.21.15.37:0/2099881301 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8ebc0b6510 0x7f8ebc0b8a20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80095f0 tx=0x7f8ec8005f90 comp rx=0 tx=0).stop 2024-09-21T05:49:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:00.697+0000 7f8eddc00640 1 -- 172.21.15.37:0/2099881301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed81073b0 msgr2=0x7f8ed819d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:00.697+0000 7f8eddc00640 1 --2- 172.21.15.37:0/2099881301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed81073b0 0x7f8ed819d410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009fd0 tx=0x7f8ed000ef10 comp rx=0 tx=0).stop 2024-09-21T05:49:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:00.697+0000 7f8eddc00640 1 -- 172.21.15.37:0/2099881301 shutdown_connections 2024-09-21T05:49:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:00.697+0000 7f8eddc00640 1 --2- 172.21.15.37:0/2099881301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ed81073b0 0x7f8ed819d410 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:00.697+0000 7f8eddc00640 1 --2- 172.21.15.37:0/2099881301 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8ebc0b6510 0x7f8ebc0b8a20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:00.697+0000 7f8eddc00640 1 --2- 172.21.15.37:0/2099881301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ed8106a10 0x7f8ed819c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:00.697+0000 7f8eddc00640 1 --2- 172.21.15.37:0/2099881301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed8105980 0x7f8ed819c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:00.697+0000 7f8eddc00640 1 -- 172.21.15.37:0/2099881301 >> 172.21.15.37:0/2099881301 conn(0x7f8ed81012f0 msgr2=0x7f8ed8109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:00.698+0000 7f8eddc00640 1 -- 172.21.15.37:0/2099881301 shutdown_connections 2024-09-21T05:49:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:00.698+0000 7f8eddc00640 1 -- 172.21.15.37:0/2099881301 wait complete. 2024-09-21T05:49:00.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:00 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:00.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:00 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:00.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:00 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:01.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:00 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:01.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:00 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:01.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:00 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:01.274 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:00 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:01.274 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:00 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:01.274 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:00 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:01.479 DEBUG:teuthology.orchestra.run.smithi037:osd.9> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T05:49:01.483 INFO:tasks.cephadm:Deploying osd.10 on smithi067 with /dev/vg_nvme/lv_1... 2024-09-21T05:49:01.483 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T05:49:01.748 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:49:01.981 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:01 smithi037 ceph-mon[30631]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:01.981 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:01 smithi037 ceph-mon[30631]: from='osd.9 [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T05:49:01.981 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:01 smithi037 ceph-mon[30631]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T05:49:01.982 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 05:49:01 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T05:49:01.754+0000 7fcd5d627640 -1 osd.9 0 log_to_monitors true 2024-09-21T05:49:02.242 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:01 smithi067 ceph-mon[34443]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:02.242 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:01 smithi067 ceph-mon[34443]: from='osd.9 [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T05:49:02.242 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:01 smithi067 ceph-mon[34443]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T05:49:02.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:01 smithi144 ceph-mon[34351]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:02.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:01 smithi144 ceph-mon[34351]: from='osd.9 [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T05:49:02.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:01 smithi144 ceph-mon[34351]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T05:49:02.945 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:02 smithi037 ceph-mon[30631]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T05:49:02.945 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:02 smithi037 ceph-mon[30631]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T05:49:02.945 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:02.945 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:02 smithi037 ceph-mon[30631]: from='osd.9 [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:49:02.945 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:02 smithi037 ceph-mon[30631]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:49:03.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:02 smithi067 ceph-mon[34443]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T05:49:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:02 smithi067 ceph-mon[34443]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T05:49:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:02 smithi067 ceph-mon[34443]: from='osd.9 [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:49:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:02 smithi067 ceph-mon[34443]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:49:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:02 smithi144 ceph-mon[34351]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T05:49:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:02 smithi144 ceph-mon[34351]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T05:49:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:02 smithi144 ceph-mon[34351]: from='osd.9 [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:49:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:02 smithi144 ceph-mon[34351]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T05:49:04.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:03 smithi037 ceph-mon[30631]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:04.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:03 smithi037 ceph-mon[30631]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T05:49:04.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:03 smithi037 ceph-mon[30631]: osdmap e59: 10 total, 9 up, 10 in 2024-09-21T05:49:04.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:04.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:04.165 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 05:49:03 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T05:49:03.938+0000 7fcd58200640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T05:49:04.165 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 05:49:03 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T05:49:03.971+0000 7fcd4e200640 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:49:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:03 smithi067 ceph-mon[34443]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:03 smithi067 ceph-mon[34443]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T05:49:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:03 smithi067 ceph-mon[34443]: osdmap e59: 10 total, 9 up, 10 in 2024-09-21T05:49:04.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:04.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:03 smithi144 ceph-mon[34351]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:03 smithi144 ceph-mon[34351]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T05:49:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:03 smithi144 ceph-mon[34351]: osdmap e59: 10 total, 9 up, 10 in 2024-09-21T05:49:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:04.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:04.618 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-21T05:49:04.646 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi067:vg_nvme/lv_1 2024-09-21T05:49:04.904 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:49:05.152 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:04 smithi067 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T05:49:05.152 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:04 smithi067 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T05:49:05.152 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:04 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:05.152 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:04 smithi067 ceph-mon[34443]: from='osd.9 ' entity='osd.9' 2024-09-21T05:49:05.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:04 smithi037 ceph-mon[30631]: purged_snaps scrub starts 2024-09-21T05:49:05.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:04 smithi037 ceph-mon[30631]: purged_snaps scrub ok 2024-09-21T05:49:05.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:04 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:05.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:04 smithi037 ceph-mon[30631]: from='osd.9 ' entity='osd.9' 2024-09-21T05:49:05.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:04 smithi144 ceph-mon[34351]: purged_snaps scrub starts 2024-09-21T05:49:05.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:04 smithi144 ceph-mon[34351]: purged_snaps scrub ok 2024-09-21T05:49:05.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:04 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:05.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:04 smithi144 ceph-mon[34351]: from='osd.9 ' entity='osd.9' 2024-09-21T05:49:05.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.396+0000 7f6eedc4d640 1 -- 172.21.15.67:0/1587875577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ee8102640 msgr2=0x7f6ee8102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:05.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.396+0000 7f6eedc4d640 1 --2- 172.21.15.67:0/1587875577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ee8102640 0x7f6ee8102ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009ca0 tx=0x7f6ed802a950 comp rx=0 tx=0).stop 2024-09-21T05:49:05.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.396+0000 7f6eedc4d640 1 -- 172.21.15.67:0/1587875577 shutdown_connections 2024-09-21T05:49:05.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.396+0000 7f6eedc4d640 1 --2- 172.21.15.67:0/1587875577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8104070 0x7f6ee810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:05.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.396+0000 7f6eedc4d640 1 --2- 172.21.15.67:0/1587875577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee81036d0 0x7f6ee8103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:05.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.396+0000 7f6eedc4d640 1 --2- 172.21.15.67:0/1587875577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ee8102640 0x7f6ee8102ab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:05.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.396+0000 7f6eedc4d640 1 -- 172.21.15.67:0/1587875577 >> 172.21.15.67:0/1587875577 conn(0x7f6ee80fdfb0 msgr2=0x7f6ee8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:05.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.396+0000 7f6eedc4d640 1 -- 172.21.15.67:0/1587875577 shutdown_connections 2024-09-21T05:49:05.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.396+0000 7f6eedc4d640 1 -- 172.21.15.67:0/1587875577 wait complete. 2024-09-21T05:49:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.397+0000 7f6eedc4d640 1 Processor -- start 2024-09-21T05:49:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.397+0000 7f6eedc4d640 1 -- start start 2024-09-21T05:49:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.397+0000 7f6eedc4d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8102640 0x7f6ee8198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.397+0000 7f6eedc4d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee81036d0 0x7f6ee8199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.397+0000 7f6eedc4d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ee8104070 0x7f6ee819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6eedc4d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810e300 con 0x7f6ee81036d0 2024-09-21T05:49:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6eedc4d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810e180 con 0x7f6ee8104070 2024-09-21T05:49:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6eedc4d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810e480 con 0x7f6ee8102640 2024-09-21T05:49:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ee8104070 0x7f6ee819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ee8104070 0x7f6ee819a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60334/0 (socket says 172.21.15.67:60334) 2024-09-21T05:49:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee7fff640 1 -- 172.21.15.67:0/3121364589 learned_addr learned my addr 172.21.15.67:0/3121364589 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-21T05:49:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee77fe640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8102640 0x7f6ee8198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee6ffd640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee81036d0 0x7f6ee8199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee7fff640 1 -- 172.21.15.67:0/3121364589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8102640 msgr2=0x7f6ee8198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8102640 0x7f6ee8198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee7fff640 1 -- 172.21.15.67:0/3121364589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee81036d0 msgr2=0x7f6ee8199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee81036d0 0x7f6ee8199530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee7fff640 1 -- 172.21.15.67:0/3121364589 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee819a8f0 con 0x7f6ee8104070 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee6ffd640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee81036d0 0x7f6ee8199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ee8104070 0x7f6ee819a0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000d750 tx=0x7f6ee000dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee4ff9640 1 -- 172.21.15.67:0/3121364589 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0017070 con 0x7f6ee8104070 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6eedc4d640 1 -- 172.21.15.67:0/3121364589 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee819abe0 con 0x7f6ee8104070 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee4ff9640 1 -- 172.21.15.67:0/3121364589 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee00054d0 con 0x7f6ee8104070 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6ee4ff9640 1 -- 172.21.15.67:0/3121364589 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0004c60 con 0x7f6ee8104070 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.398+0000 7f6eedc4d640 1 -- 172.21.15.67:0/3121364589 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee81a12e0 con 0x7f6ee8104070 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.400+0000 7f6eedc4d640 1 -- 172.21.15.67:0/3121364589 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee8109820 con 0x7f6ee8104070 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.401+0000 7f6ee4ff9640 1 -- 172.21.15.67:0/3121364589 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f6ee0009bd0 con 0x7f6ee8104070 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.402+0000 7f6ee4ff9640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6ed00b6590 0x7f6ed00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.403+0000 7f6ee4ff9640 1 -- 172.21.15.67:0/3121364589 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6261+0+0 (secure 0 0 0) 0x7f6ee00e6820 con 0x7f6ee8104070 2024-09-21T05:49:05.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.403+0000 7f6ee77fe640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6ed00b6590 0x7f6ed00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:05.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.403+0000 7f6ee77fe640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6ed00b6590 0x7f6ed00b8aa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6ed802f8d0 tx=0x7f6ed8009360 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:05.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.406+0000 7f6ee4ff9640 1 -- 172.21.15.67:0/3121364589 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ee00ad930 con 0x7f6ee8104070 2024-09-21T05:49:05.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:05.605+0000 7f6eedc4d640 1 -- 172.21.15.67:0/3121364589 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6ee8063800 con 0x7f6ed00b6590 2024-09-21T05:49:06.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: osd.9 [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355] boot 2024-09-21T05:49:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T05:49:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:49:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:49:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:06.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:06.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:06.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:06.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:06.230 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:06.230 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:06.230 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: osd.9 [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355] boot 2024-09-21T05:49:06.230 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T05:49:06.230 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:06.231 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:49:06.231 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:49:06.231 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:06.231 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:06.231 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:06.231 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:06.231 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:06.231 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:06.231 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:06.231 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:06.231 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:06.231 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:06.231 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-09-21T05:49:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: osd.9 [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355] boot 2024-09-21T05:49:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T05:49:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T05:49:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:49:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:49:06.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:06.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:06.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:06.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:06.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:06.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:06.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:06.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:06.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:06.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:06.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:06.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:06 smithi067 ceph-mon[34443]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:06.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:06 smithi067 ceph-mon[34443]: Detected new or changed devices on smithi037 2024-09-21T05:49:06.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:06 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi037 to 4273M 2024-09-21T05:49:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:06 smithi067 ceph-mon[34443]: osdmap e61: 10 total, 10 up, 10 in 2024-09-21T05:49:07.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:06 smithi037 ceph-mon[30631]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:07.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:06 smithi037 ceph-mon[30631]: Detected new or changed devices on smithi037 2024-09-21T05:49:07.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:06 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi037 to 4273M 2024-09-21T05:49:07.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:06 smithi037 ceph-mon[30631]: osdmap e61: 10 total, 10 up, 10 in 2024-09-21T05:49:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:06 smithi144 ceph-mon[34351]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:06 smithi144 ceph-mon[34351]: Detected new or changed devices on smithi037 2024-09-21T05:49:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:06 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi037 to 4273M 2024-09-21T05:49:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:06 smithi144 ceph-mon[34351]: osdmap e61: 10 total, 10 up, 10 in 2024-09-21T05:49:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:07 smithi067 ceph-mon[34443]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:08.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:07 smithi037 ceph-mon[30631]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:08.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:07 smithi144 ceph-mon[34351]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:09.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:08 smithi037 ceph-mon[30631]: from='client.? 172.21.15.67:0/1340008416' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a37f19e-3ade-4852-b887-426e26953433"} : dispatch 2024-09-21T05:49:09.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:08 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a37f19e-3ade-4852-b887-426e26953433"} : dispatch 2024-09-21T05:49:09.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:08 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a37f19e-3ade-4852-b887-426e26953433"}]': finished 2024-09-21T05:49:09.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:08 smithi037 ceph-mon[30631]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T05:49:09.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:08 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:09.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:08 smithi037 ceph-mon[30631]: from='client.? 172.21.15.67:0/3343751335' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:09.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:08 smithi067 ceph-mon[34443]: from='client.? 172.21.15.67:0/1340008416' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a37f19e-3ade-4852-b887-426e26953433"} : dispatch 2024-09-21T05:49:09.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:08 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a37f19e-3ade-4852-b887-426e26953433"} : dispatch 2024-09-21T05:49:09.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:08 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a37f19e-3ade-4852-b887-426e26953433"}]': finished 2024-09-21T05:49:09.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:08 smithi067 ceph-mon[34443]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T05:49:09.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:08 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:09.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:08 smithi067 ceph-mon[34443]: from='client.? 172.21.15.67:0/3343751335' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:09.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:08 smithi144 ceph-mon[34351]: from='client.? 172.21.15.67:0/1340008416' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a37f19e-3ade-4852-b887-426e26953433"} : dispatch 2024-09-21T05:49:09.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:08 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a37f19e-3ade-4852-b887-426e26953433"} : dispatch 2024-09-21T05:49:09.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:08 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a37f19e-3ade-4852-b887-426e26953433"}]': finished 2024-09-21T05:49:09.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:08 smithi144 ceph-mon[34351]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T05:49:09.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:08 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:09.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:08 smithi144 ceph-mon[34351]: from='client.? 172.21.15.67:0/3343751335' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:10.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:09 smithi037 ceph-mon[30631]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:10.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:09 smithi067 ceph-mon[34443]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:10.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:09 smithi144 ceph-mon[34351]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:12.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:11 smithi067 ceph-mon[34443]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:12.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:11 smithi144 ceph-mon[34351]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:12.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:11 smithi037 ceph-mon[30631]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:14.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:13 smithi067 ceph-mon[34443]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:14.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:13 smithi144 ceph-mon[34351]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:14.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:13 smithi037 ceph-mon[30631]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:16.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:15 smithi067 ceph-mon[34443]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:16.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:15 smithi144 ceph-mon[34351]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:16.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:15 smithi037 ceph-mon[30631]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:17.236 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T05:49:17.236 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:17.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T05:49:17.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:17.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T05:49:17.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:18.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:17 smithi067 ceph-mon[34443]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:18.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:17 smithi067 ceph-mon[34443]: Deploying daemon osd.10 on smithi067 2024-09-21T05:49:18.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:17 smithi144 ceph-mon[34351]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:18.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:17 smithi144 ceph-mon[34351]: Deploying daemon osd.10 on smithi067 2024-09-21T05:49:18.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:17 smithi037 ceph-mon[30631]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:18.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:17 smithi037 ceph-mon[30631]: Deploying daemon osd.10 on smithi067 2024-09-21T05:49:20.239 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:19 smithi067 ceph-mon[34443]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:20.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:19 smithi144 ceph-mon[34351]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:20.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:19 smithi037 ceph-mon[30631]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:22.229 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:21 smithi067 ceph-mon[34443]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:22.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:21 smithi144 ceph-mon[34351]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:22.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:21 smithi037 ceph-mon[30631]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:23.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:22 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:23.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:22 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:23.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:22 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:23.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:22 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:23.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:22 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:23.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:22 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:23.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:22 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:23.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:22 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:23.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:22 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:24.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:23 smithi067 ceph-mon[34443]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:24.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:23 smithi144 ceph-mon[34351]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:24.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:23 smithi037 ceph-mon[30631]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:25.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:25 smithi144 ceph-mon[34351]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:25.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:25 smithi037 ceph-mon[30631]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:25.491 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:25 smithi067 ceph-mon[34443]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:25.866 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 10 on host 'smithi067' 2024-09-21T05:49:25.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:25.864+0000 7f6ee4ff9640 1 -- 172.21.15.67:0/3121364589 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f6ee8063800 con 0x7f6ed00b6590 2024-09-21T05:49:25.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:25.866+0000 7f6eedc4d640 1 -- 172.21.15.67:0/3121364589 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6ed00b6590 msgr2=0x7f6ed00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:25.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:25.866+0000 7f6eedc4d640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6ed00b6590 0x7f6ed00b8aa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6ed802f8d0 tx=0x7f6ed8009360 comp rx=0 tx=0).stop 2024-09-21T05:49:25.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:25.866+0000 7f6eedc4d640 1 -- 172.21.15.67:0/3121364589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ee8104070 msgr2=0x7f6ee819a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:25.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:25.866+0000 7f6eedc4d640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ee8104070 0x7f6ee819a0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000d750 tx=0x7f6ee000dc10 comp rx=0 tx=0).stop 2024-09-21T05:49:25.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:25.866+0000 7f6eedc4d640 1 -- 172.21.15.67:0/3121364589 shutdown_connections 2024-09-21T05:49:25.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:25.866+0000 7f6eedc4d640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6ed00b6590 0x7f6ed00b8aa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:25.866+0000 7f6eedc4d640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ee8104070 0x7f6ee819a0d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:25.866+0000 7f6eedc4d640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee81036d0 0x7f6ee8199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:25.866+0000 7f6eedc4d640 1 --2- 172.21.15.67:0/3121364589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ee8102640 0x7f6ee8198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:25.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:25.866+0000 7f6eedc4d640 1 -- 172.21.15.67:0/3121364589 >> 172.21.15.67:0/3121364589 conn(0x7f6ee80fdfb0 msgr2=0x7f6ee81069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:25.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:25.866+0000 7f6eedc4d640 1 -- 172.21.15.67:0/3121364589 shutdown_connections 2024-09-21T05:49:25.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-21T05:49:25.867+0000 7f6eedc4d640 1 -- 172.21.15.67:0/3121364589 wait complete. 2024-09-21T05:49:26.886 DEBUG:teuthology.orchestra.run.smithi067:osd.10> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T05:49:26.888 INFO:tasks.cephadm:Deploying osd.11 on smithi144 with /dev/vg_nvme/lv_1... 2024-09-21T05:49:26.888 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T05:49:27.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:26 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:27.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:26 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:27.143 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:49:27.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:26 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:27.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:26 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:27.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:26 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:27.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:26 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:28.063 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:27 smithi067 ceph-mon[34443]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:28.063 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:27 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:28.063 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:27 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:28.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:27 smithi144 ceph-mon[34351]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:28.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:27 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:28.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:27 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:28.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:27 smithi037 ceph-mon[30631]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:28.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:27 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:28.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:27 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:28.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:28 smithi067 ceph-mon[34443]: from='osd.10 [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:49:28.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:28 smithi067 ceph-mon[34443]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:49:28.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 05:49:28 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T05:49:28.693+0000 7f0167440640 -1 osd.10 0 log_to_monitors true 2024-09-21T05:49:29.140 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:28 smithi144 ceph-mon[34351]: from='osd.10 [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:49:29.140 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:28 smithi144 ceph-mon[34351]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:49:29.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:28 smithi037 ceph-mon[30631]: from='osd.10 [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:49:29.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:28 smithi037 ceph-mon[30631]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T05:49:29.898 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T05:49:29.926 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi144:vg_nvme/lv_1 2024-09-21T05:49:30.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:29 smithi037 ceph-mon[30631]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:30.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:29 smithi037 ceph-mon[30631]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T05:49:30.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:29 smithi037 ceph-mon[30631]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T05:49:30.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:29 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:30.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:29 smithi037 ceph-mon[30631]: from='osd.10 [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:49:30.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:29 smithi037 ceph-mon[30631]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:49:30.176 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:49:30.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:29 smithi067 ceph-mon[34443]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:30.255 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:29 smithi067 ceph-mon[34443]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T05:49:30.256 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:29 smithi067 ceph-mon[34443]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T05:49:30.256 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:29 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:30.256 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:29 smithi067 ceph-mon[34443]: from='osd.10 [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:49:30.256 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:29 smithi067 ceph-mon[34443]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:49:30.257 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 05:49:29 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T05:49:29.882+0000 7f01633c2640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T05:49:30.257 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 05:49:29 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T05:49:29.898+0000 7f015f1c0640 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:49:30.303 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:29 smithi144 ceph-mon[34351]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:30.303 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:29 smithi144 ceph-mon[34351]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T05:49:30.303 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:29 smithi144 ceph-mon[34351]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T05:49:30.303 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:29 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:30.303 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:29 smithi144 ceph-mon[34351]: from='osd.10 [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:49:30.303 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:29 smithi144 ceph-mon[34351]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-21T05:49:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.649+0000 7f98e9b16640 1 -- 172.21.15.144:0/3099800050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98e41036d0 msgr2=0x7f98e4103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.649+0000 7f98e9b16640 1 --2- 172.21.15.144:0/3099800050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98e41036d0 0x7f98e4103ae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009ca0 tx=0x7f98d802a950 comp rx=0 tx=0).stop 2024-09-21T05:49:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.649+0000 7f98e9b16640 1 -- 172.21.15.144:0/3099800050 shutdown_connections 2024-09-21T05:49:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.649+0000 7f98e9b16640 1 --2- 172.21.15.144:0/3099800050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98e4104070 0x7f98e410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.649+0000 7f98e9b16640 1 --2- 172.21.15.144:0/3099800050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98e41036d0 0x7f98e4103ae0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.649+0000 7f98e9b16640 1 --2- 172.21.15.144:0/3099800050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98e4102640 0x7f98e4102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.649+0000 7f98e9b16640 1 -- 172.21.15.144:0/3099800050 >> 172.21.15.144:0/3099800050 conn(0x7f98e40fdfb0 msgr2=0x7f98e4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.649+0000 7f98e9b16640 1 -- 172.21.15.144:0/3099800050 shutdown_connections 2024-09-21T05:49:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.649+0000 7f98e9b16640 1 -- 172.21.15.144:0/3099800050 wait complete. 2024-09-21T05:49:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.650+0000 7f98e9b16640 1 Processor -- start 2024-09-21T05:49:30.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.650+0000 7f98e9b16640 1 -- start start 2024-09-21T05:49:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.650+0000 7f98e9b16640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98e4102640 0x7f98e406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.650+0000 7f98e9b16640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98e41036d0 0x7f98e419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.650+0000 7f98e9b16640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98e4104070 0x7f98e41a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.650+0000 7f98e9b16640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f98e410e290 con 0x7f98e41036d0 2024-09-21T05:49:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.650+0000 7f98e9b16640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f98e410e110 con 0x7f98e4104070 2024-09-21T05:49:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.650+0000 7f98e9b16640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f98e410e410 con 0x7f98e4102640 2024-09-21T05:49:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.650+0000 7f98e37fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98e4102640 0x7f98e406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.650+0000 7f98e37fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98e4102640 0x7f98e406b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53896/0 (socket says 172.21.15.144:53896) 2024-09-21T05:49:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.650+0000 7f98e37fe640 1 -- 172.21.15.144:0/2643966527 learned_addr learned my addr 172.21.15.144:0/2643966527 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T05:49:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.650+0000 7f98e3fff640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98e4104070 0x7f98e41a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.650+0000 7f98e2ffd640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98e41036d0 0x7f98e419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.651+0000 7f98e37fe640 1 -- 172.21.15.144:0/2643966527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98e4104070 msgr2=0x7f98e41a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.651+0000 7f98e37fe640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98e4104070 0x7f98e41a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.651+0000 7f98e37fe640 1 -- 172.21.15.144:0/2643966527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98e41036d0 msgr2=0x7f98e419ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.651+0000 7f98e37fe640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98e41036d0 0x7f98e419ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.651+0000 7f98e37fe640 1 -- 172.21.15.144:0/2643966527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e41a19c0 con 0x7f98e4102640 2024-09-21T05:49:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.651+0000 7f98e3fff640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98e4104070 0x7f98e41a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:49:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.651+0000 7f98e37fe640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98e4102640 0x7f98e406b6a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f98d400c920 tx=0x7f98d400cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.651+0000 7f98e0ff9640 1 -- 172.21.15.144:0/2643966527 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4007c70 con 0x7f98e4102640 2024-09-21T05:49:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.651+0000 7f98e9b16640 1 -- 172.21.15.144:0/2643966527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e41a1cb0 con 0x7f98e4102640 2024-09-21T05:49:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.651+0000 7f98e0ff9640 1 -- 172.21.15.144:0/2643966527 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98d4007e10 con 0x7f98e4102640 2024-09-21T05:49:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.651+0000 7f98e0ff9640 1 -- 172.21.15.144:0/2643966527 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4018820 con 0x7f98e4102640 2024-09-21T05:49:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.651+0000 7f98e9b16640 1 -- 172.21.15.144:0/2643966527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e41a2190 con 0x7f98e4102640 2024-09-21T05:49:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.652+0000 7f98e9b16640 1 -- 172.21.15.144:0/2643966527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e4109800 con 0x7f98e4102640 2024-09-21T05:49:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.654+0000 7f98e0ff9640 1 -- 172.21.15.144:0/2643966527 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f98d400f450 con 0x7f98e4102640 2024-09-21T05:49:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.654+0000 7f98e0ff9640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f98cc0b6510 0x7f98cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.654+0000 7f98e0ff9640 1 -- 172.21.15.144:0/2643966527 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6414+0+0 (secure 0 0 0) 0x7f98d40e7010 con 0x7f98e4102640 2024-09-21T05:49:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.655+0000 7f98e2ffd640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f98cc0b6510 0x7f98cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.656+0000 7f98e2ffd640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f98cc0b6510 0x7f98cc0b8a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f98d8004af0 tx=0x7f98d8009360 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.658+0000 7f98e0ff9640 1 -- 172.21.15.144:0/2643966527 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f98d4014030 con 0x7f98e4102640 2024-09-21T05:49:30.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:30.853+0000 7f98e9b16640 1 -- 172.21.15.144:0/2643966527 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f98e4063800 con 0x7f98cc0b6510 2024-09-21T05:49:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-21T05:49:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: osdmap e64: 11 total, 10 up, 11 in 2024-09-21T05:49:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:30.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:30.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:30.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:30.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:30.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:30.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:30.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:30.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:30.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:49:30.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:49:30.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:31.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-21T05:49:31.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: osdmap e64: 11 total, 10 up, 11 in 2024-09-21T05:49:31.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:31.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:31.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:31.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:49:31.125 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:49:31.125 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:31.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-21T05:49:31.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: osdmap e64: 11 total, 10 up, 11 in 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:31.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:31.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:31.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:31.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T05:49:31.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T05:49:31.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:32.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:31 smithi037 ceph-mon[30631]: purged_snaps scrub starts 2024-09-21T05:49:32.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:31 smithi037 ceph-mon[30631]: purged_snaps scrub ok 2024-09-21T05:49:32.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:31 smithi037 ceph-mon[30631]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:32.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:31 smithi037 ceph-mon[30631]: Detected new or changed devices on smithi067 2024-09-21T05:49:32.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:31 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi067 to 4272M 2024-09-21T05:49:32.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:31 smithi037 ceph-mon[30631]: from='client.24568 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:32.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:31 smithi037 ceph-mon[30631]: osd.10 [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854] boot 2024-09-21T05:49:32.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:31 smithi037 ceph-mon[30631]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T05:49:32.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:31 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:32.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:31 smithi037 ceph-mon[30631]: osdmap e66: 11 total, 11 up, 11 in 2024-09-21T05:49:32.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:31 smithi067 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T05:49:32.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:31 smithi067 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T05:49:32.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:31 smithi067 ceph-mon[34443]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:32.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:31 smithi067 ceph-mon[34443]: Detected new or changed devices on smithi067 2024-09-21T05:49:32.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:31 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi067 to 4272M 2024-09-21T05:49:32.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:31 smithi067 ceph-mon[34443]: from='client.24568 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:32.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:31 smithi067 ceph-mon[34443]: osd.10 [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854] boot 2024-09-21T05:49:32.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:31 smithi067 ceph-mon[34443]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T05:49:32.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:31 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:32.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:31 smithi067 ceph-mon[34443]: osdmap e66: 11 total, 11 up, 11 in 2024-09-21T05:49:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:31 smithi144 ceph-mon[34351]: purged_snaps scrub starts 2024-09-21T05:49:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:31 smithi144 ceph-mon[34351]: purged_snaps scrub ok 2024-09-21T05:49:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:31 smithi144 ceph-mon[34351]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-09-21T05:49:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:31 smithi144 ceph-mon[34351]: Detected new or changed devices on smithi067 2024-09-21T05:49:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:31 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi067 to 4272M 2024-09-21T05:49:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:31 smithi144 ceph-mon[34351]: from='client.24568 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:49:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:31 smithi144 ceph-mon[34351]: osd.10 [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854] boot 2024-09-21T05:49:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:31 smithi144 ceph-mon[34351]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T05:49:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:31 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T05:49:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:31 smithi144 ceph-mon[34351]: osdmap e66: 11 total, 11 up, 11 in 2024-09-21T05:49:34.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:33 smithi144 ceph-mon[34351]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:34.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:33 smithi144 ceph-mon[34351]: osdmap e67: 11 total, 11 up, 11 in 2024-09-21T05:49:34.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:33 smithi144 ceph-mon[34351]: from='client.? 172.21.15.144:0/634354670' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b3f23e60-4d29-4b07-aec5-1d497ee617cb"} : dispatch 2024-09-21T05:49:34.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:33 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b3f23e60-4d29-4b07-aec5-1d497ee617cb"} : dispatch 2024-09-21T05:49:34.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:33 smithi144 ceph-mon[34351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3f23e60-4d29-4b07-aec5-1d497ee617cb"}]': finished 2024-09-21T05:49:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:33 smithi144 ceph-mon[34351]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T05:49:34.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:33 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:34.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:33 smithi037 ceph-mon[30631]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:34.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:33 smithi037 ceph-mon[30631]: osdmap e67: 11 total, 11 up, 11 in 2024-09-21T05:49:34.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:33 smithi037 ceph-mon[30631]: from='client.? 172.21.15.144:0/634354670' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b3f23e60-4d29-4b07-aec5-1d497ee617cb"} : dispatch 2024-09-21T05:49:34.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:33 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b3f23e60-4d29-4b07-aec5-1d497ee617cb"} : dispatch 2024-09-21T05:49:34.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:33 smithi037 ceph-mon[30631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3f23e60-4d29-4b07-aec5-1d497ee617cb"}]': finished 2024-09-21T05:49:34.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:33 smithi037 ceph-mon[30631]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T05:49:34.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:33 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:34.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:33 smithi067 ceph-mon[34443]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:34.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:33 smithi067 ceph-mon[34443]: osdmap e67: 11 total, 11 up, 11 in 2024-09-21T05:49:34.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:33 smithi067 ceph-mon[34443]: from='client.? 172.21.15.144:0/634354670' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b3f23e60-4d29-4b07-aec5-1d497ee617cb"} : dispatch 2024-09-21T05:49:34.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:33 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b3f23e60-4d29-4b07-aec5-1d497ee617cb"} : dispatch 2024-09-21T05:49:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:33 smithi067 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3f23e60-4d29-4b07-aec5-1d497ee617cb"}]': finished 2024-09-21T05:49:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:33 smithi067 ceph-mon[34443]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T05:49:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:33 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:35.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:34 smithi037 ceph-mon[30631]: from='client.? 172.21.15.144:0/655027045' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:35.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:34 smithi067 ceph-mon[34443]: from='client.? 172.21.15.144:0/655027045' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:35.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:34 smithi144 ceph-mon[34351]: from='client.? 172.21.15.144:0/655027045' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T05:49:36.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:35 smithi037 ceph-mon[30631]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:36.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:35 smithi067 ceph-mon[34443]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:36.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:35 smithi144 ceph-mon[34351]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:38.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:37 smithi037 ceph-mon[30631]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T05:49:38.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:37 smithi067 ceph-mon[34443]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T05:49:38.294 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:37 smithi144 ceph-mon[34351]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T05:49:40.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:39 smithi144 ceph-mon[34351]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T05:49:40.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:39 smithi037 ceph-mon[30631]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T05:49:40.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:39 smithi067 ceph-mon[34443]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T05:49:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:41 smithi144 ceph-mon[34351]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:49:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T05:49:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:42.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:41 smithi037 ceph-mon[30631]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:49:42.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T05:49:42.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:42.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:41 smithi067 ceph-mon[34443]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T05:49:42.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T05:49:42.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:43.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:42 smithi037 ceph-mon[30631]: Deploying daemon osd.11 on smithi144 2024-09-21T05:49:43.234 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:42 smithi144 ceph-mon[34351]: Deploying daemon osd.11 on smithi144 2024-09-21T05:49:43.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:42 smithi067 ceph-mon[34443]: Deploying daemon osd.11 on smithi144 2024-09-21T05:49:44.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:43 smithi037 ceph-mon[30631]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T05:49:44.241 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:43 smithi144 ceph-mon[34351]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T05:49:44.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:43 smithi067 ceph-mon[34443]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T05:49:46.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:45 smithi067 ceph-mon[34443]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T05:49:46.298 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:45 smithi144 ceph-mon[34351]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T05:49:46.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:45 smithi037 ceph-mon[30631]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T05:49:48.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:47 smithi067 ceph-mon[34443]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:49:48.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:47 smithi144 ceph-mon[34351]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:49:48.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:47 smithi037 ceph-mon[30631]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T05:49:49.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:48 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:49.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:48 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:49.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:48 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:49.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:48 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:49.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:48 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:49.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:48 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:49.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:48 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:49.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:48 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:49.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:48 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:49 smithi144 ceph-mon[34351]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:50.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:49 smithi067 ceph-mon[34443]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:50.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:49 smithi037 ceph-mon[30631]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:51.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:51.669+0000 7f98e0ff9640 1 -- 172.21.15.144:0/2643966527 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f98e4063800 con 0x7f98cc0b6510 2024-09-21T05:49:51.671 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 11 on host 'smithi144' 2024-09-21T05:49:51.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:51.671+0000 7f98e9b16640 1 -- 172.21.15.144:0/2643966527 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f98cc0b6510 msgr2=0x7f98cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:51.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:51.671+0000 7f98e9b16640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f98cc0b6510 0x7f98cc0b8a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f98d8004af0 tx=0x7f98d8009360 comp rx=0 tx=0).stop 2024-09-21T05:49:51.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:51.671+0000 7f98e9b16640 1 -- 172.21.15.144:0/2643966527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98e4102640 msgr2=0x7f98e406b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:51.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:51.671+0000 7f98e9b16640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98e4102640 0x7f98e406b6a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f98d400c920 tx=0x7f98d400cde0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:51.671+0000 7f98e9b16640 1 -- 172.21.15.144:0/2643966527 shutdown_connections 2024-09-21T05:49:51.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:51.671+0000 7f98e9b16640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f98cc0b6510 0x7f98cc0b8a20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:51.671+0000 7f98e9b16640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98e4104070 0x7f98e41a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:51.671+0000 7f98e9b16640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98e41036d0 0x7f98e419ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:51.671+0000 7f98e9b16640 1 --2- 172.21.15.144:0/2643966527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98e4102640 0x7f98e406b6a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:51.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:51.671+0000 7f98e9b16640 1 -- 172.21.15.144:0/2643966527 >> 172.21.15.144:0/2643966527 conn(0x7f98e40fdfb0 msgr2=0x7f98e41069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:51.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:51.671+0000 7f98e9b16640 1 -- 172.21.15.144:0/2643966527 shutdown_connections 2024-09-21T05:49:51.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:49:51.671+0000 7f98e9b16640 1 -- 172.21.15.144:0/2643966527 wait complete. 2024-09-21T05:49:52.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:51 smithi037 ceph-mon[30631]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:52.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:52.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:52.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:52.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:51 smithi067 ceph-mon[34443]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:52.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:52.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:52.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:52.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.357 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:51 smithi144 ceph-mon[34351]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:52.357 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.357 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.357 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:52.357 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:52.357 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.357 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:49:52.357 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.358 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:52.386 DEBUG:teuthology.orchestra.run.smithi144:osd.11> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T05:49:52.388 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T05:49:52.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T05:49:52.779 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:53.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.400+0000 7f7270e00640 1 -- 172.21.15.37:0/3993693289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c10b770 msgr2=0x7f726c10db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.400+0000 7f7270e00640 1 --2- 172.21.15.37:0/3993693289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c10b770 0x7f726c10db90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7264009ca0 tx=0x7f726402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.400+0000 7f7270e00640 1 -- 172.21.15.37:0/3993693289 shutdown_connections 2024-09-21T05:49:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.400+0000 7f7270e00640 1 --2- 172.21.15.37:0/3993693289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c10b770 0x7f726c10db90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.400+0000 7f7270e00640 1 --2- 172.21.15.37:0/3993693289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726c075c70 0x7f726c076080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.400+0000 7f7270e00640 1 --2- 172.21.15.37:0/3993693289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c077060 0x7f726c075730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.400+0000 7f7270e00640 1 -- 172.21.15.37:0/3993693289 >> 172.21.15.37:0/3993693289 conn(0x7f726c0ff0c0 msgr2=0x7f726c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.400+0000 7f7270e00640 1 -- 172.21.15.37:0/3993693289 shutdown_connections 2024-09-21T05:49:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.400+0000 7f7270e00640 1 -- 172.21.15.37:0/3993693289 wait complete. 2024-09-21T05:49:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.401+0000 7f7270e00640 1 Processor -- start 2024-09-21T05:49:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.402+0000 7f7270e00640 1 -- start start 2024-09-21T05:49:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.402+0000 7f7270e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c075c70 0x7f726c19c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.402+0000 7f7270e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726c077060 0x7f726c19c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.402+0000 7f7270e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c10b770 0x7f726c19d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.402+0000 7f7270e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f726c111570 con 0x7f726c10b770 2024-09-21T05:49:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.402+0000 7f7270e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f726c1113f0 con 0x7f726c075c70 2024-09-21T05:49:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.402+0000 7f7270e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f726c1116f0 con 0x7f726c077060 2024-09-21T05:49:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.402+0000 7f726a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c10b770 0x7f726c19d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.402+0000 7f7269e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c075c70 0x7f726c19c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.402+0000 7f726a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c10b770 0x7f726c19d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33702/0 (socket says 172.21.15.37:33702) 2024-09-21T05:49:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.402+0000 7f726a800640 1 -- 172.21.15.37:0/726159517 learned_addr learned my addr 172.21.15.37:0/726159517 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:49:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.402+0000 7f7269400640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726c077060 0x7f726c19c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.403+0000 7f7269e00640 1 -- 172.21.15.37:0/726159517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726c077060 msgr2=0x7f726c19c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.403+0000 7f7269e00640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726c077060 0x7f726c19c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.403+0000 7f7269e00640 1 -- 172.21.15.37:0/726159517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c10b770 msgr2=0x7f726c19d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.403+0000 7f7269e00640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c10b770 0x7f726c19d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.403+0000 7f7269e00640 1 -- 172.21.15.37:0/726159517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c19db90 con 0x7f726c075c70 2024-09-21T05:49:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.403+0000 7f7269400640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726c077060 0x7f726c19c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:49:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.403+0000 7f7269e00640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c075c70 0x7f726c19c160 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f725c00e9f0 tx=0x7f725c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.403+0000 7f7262a00640 1 -- 172.21.15.37:0/726159517 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c00ccc0 con 0x7f726c075c70 2024-09-21T05:49:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.403+0000 7f7262a00640 1 -- 172.21.15.37:0/726159517 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f725c0108e0 con 0x7f726c075c70 2024-09-21T05:49:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.403+0000 7f7270e00640 1 -- 172.21.15.37:0/726159517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c19de80 con 0x7f726c075c70 2024-09-21T05:49:53.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.403+0000 7f7262a00640 1 -- 172.21.15.37:0/726159517 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c018880 con 0x7f726c075c70 2024-09-21T05:49:53.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.404+0000 7f7270e00640 1 -- 172.21.15.37:0/726159517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c1a4580 con 0x7f726c075c70 2024-09-21T05:49:53.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.405+0000 7f7270e00640 1 -- 172.21.15.37:0/726159517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726c1a4750 con 0x7f726c075c70 2024-09-21T05:49:53.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.407+0000 7f7262a00640 1 -- 172.21.15.37:0/726159517 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f725c010430 con 0x7f726c075c70 2024-09-21T05:49:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.408+0000 7f7262a00640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f72500b6510 0x7f72500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.409+0000 7f7262a00640 1 -- 172.21.15.37:0/726159517 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6809+0+0 (secure 0 0 0) 0x7f725c0e7500 con 0x7f726c075c70 2024-09-21T05:49:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.409+0000 7f7269400640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f72500b6510 0x7f72500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:53.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.409+0000 7f7269400640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f72500b6510 0x7f72500b8a20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7258009fc0 tx=0x7f7258005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:53.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.410+0000 7f7262a00640 1 -- 172.21.15.37:0/726159517 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f725c0b26b0 con 0x7f726c075c70 2024-09-21T05:49:53.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.609+0000 7f7270e00640 1 -- 172.21.15.37:0/726159517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f726c1a4920 con 0x7f726c075c70 2024-09-21T05:49:53.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.610+0000 7f7262a00640 1 -- 172.21.15.37:0/726159517 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f725c0b75f0 con 0x7f726c075c70 2024-09-21T05:49:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:49:53.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.612+0000 7f7270e00640 1 -- 172.21.15.37:0/726159517 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f72500b6510 msgr2=0x7f72500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.612+0000 7f7270e00640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f72500b6510 0x7f72500b8a20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7258009fc0 tx=0x7f7258005f90 comp rx=0 tx=0).stop 2024-09-21T05:49:53.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.612+0000 7f7270e00640 1 -- 172.21.15.37:0/726159517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c075c70 msgr2=0x7f726c19c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:53.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.612+0000 7f7270e00640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c075c70 0x7f726c19c160 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f725c00e9f0 tx=0x7f725c00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.612+0000 7f7270e00640 1 -- 172.21.15.37:0/726159517 shutdown_connections 2024-09-21T05:49:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.612+0000 7f7270e00640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f726c10b770 0x7f726c19d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.612+0000 7f7270e00640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726c077060 0x7f726c19c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.612+0000 7f7270e00640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f72500b6510 0x7f72500b8a20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.612+0000 7f7270e00640 1 --2- 172.21.15.37:0/726159517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726c075c70 0x7f726c19c160 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.612+0000 7f7270e00640 1 -- 172.21.15.37:0/726159517 >> 172.21.15.37:0/726159517 conn(0x7f726c0ff0c0 msgr2=0x7f726c0ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.612+0000 7f7270e00640 1 -- 172.21.15.37:0/726159517 shutdown_connections 2024-09-21T05:49:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:53.612+0000 7f7270e00640 1 -- 172.21.15.37:0/726159517 wait complete. 2024-09-21T05:49:53.833 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 05:49:53 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T05:49:53.770+0000 7f8e3aea7640 -1 osd.11 0 log_to_monitors true 2024-09-21T05:49:54.094 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:53 smithi144 ceph-mon[34351]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:54.094 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:53 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/726159517' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:49:54.094 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:53 smithi144 ceph-mon[34351]: from='osd.11 [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:49:54.094 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:53 smithi144 ceph-mon[34351]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:49:54.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:53 smithi037 ceph-mon[30631]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:54.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:53 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/726159517' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:49:54.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:53 smithi037 ceph-mon[30631]: from='osd.11 [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:49:54.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:53 smithi037 ceph-mon[30631]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:49:54.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:53 smithi067 ceph-mon[34443]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:54.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:53 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/726159517' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:49:54.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:53 smithi067 ceph-mon[34443]: from='osd.11 [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:49:54.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:53 smithi067 ceph-mon[34443]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T05:49:54.609 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726897770,"num_in_osds":12,"osd_in_since":1726897773,"num_remapped_pgs":0} 2024-09-21T05:49:54.998 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:54 smithi144 ceph-mon[34351]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T05:49:54.998 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:54 smithi144 ceph-mon[34351]: from='osd.11 [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:49:54.998 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:54 smithi144 ceph-mon[34351]: osdmap e69: 12 total, 11 up, 12 in 2024-09-21T05:49:54.999 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:54 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:54.999 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:54 smithi144 ceph-mon[34351]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:49:54.999 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 05:49:54 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T05:49:54.896+0000 7f8e36e29640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T05:49:54.999 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 05:49:54 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T05:49:54.908+0000 7f8e32c27640 -1 osd.11 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:49:55.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:54 smithi037 ceph-mon[30631]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T05:49:55.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:54 smithi037 ceph-mon[30631]: from='osd.11 [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:49:55.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:54 smithi037 ceph-mon[30631]: osdmap e69: 12 total, 11 up, 12 in 2024-09-21T05:49:55.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:54 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:55.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:54 smithi037 ceph-mon[30631]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:49:55.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:54 smithi067 ceph-mon[34443]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T05:49:55.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:54 smithi067 ceph-mon[34443]: from='osd.11 [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:49:55.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:54 smithi067 ceph-mon[34443]: osdmap e69: 12 total, 11 up, 12 in 2024-09-21T05:49:55.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:54 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:55.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:54 smithi067 ceph-mon[34443]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T05:49:55.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T05:49:56.009 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:56.125 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:56.126 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T05:49:56.126 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: osdmap e70: 12 total, 11 up, 12 in 2024-09-21T05:49:56.126 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:56.126 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:56.126 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:56.126 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:56.126 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:56.126 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:56.126 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:56.126 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:56.126 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:56.127 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:56.127 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:56.127 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T05:49:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: osdmap e70: 12 total, 11 up, 12 in 2024-09-21T05:49:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T05:49:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: osdmap e70: 12 total, 11 up, 12 in 2024-09-21T05:49:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T05:49:56.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:56.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:49:56.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:49:56.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:49:56.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.786+0000 7febffe00640 1 -- 172.21.15.37:0/3295612666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec00109290 msgr2=0x7fec0010b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:56.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.786+0000 7febffe00640 1 --2- 172.21.15.37:0/3295612666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec00109290 0x7fec0010b7a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7febf8009ca0 tx=0x7febf802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.786+0000 7febffe00640 1 -- 172.21.15.37:0/3295612666 shutdown_connections 2024-09-21T05:49:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.786+0000 7febffe00640 1 --2- 172.21.15.37:0/3295612666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec00109290 0x7fec0010b7a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.786+0000 7febffe00640 1 --2- 172.21.15.37:0/3295612666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec001066f0 0x7fec00108b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.786+0000 7febffe00640 1 --2- 172.21.15.37:0/3295612666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0006b980 0x7fec001061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.786+0000 7febffe00640 1 -- 172.21.15.37:0/3295612666 >> 172.21.15.37:0/3295612666 conn(0x7fec000fddd0 msgr2=0x7fec00100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.786+0000 7febffe00640 1 -- 172.21.15.37:0/3295612666 shutdown_connections 2024-09-21T05:49:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.786+0000 7febffe00640 1 -- 172.21.15.37:0/3295612666 wait complete. 2024-09-21T05:49:56.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.787+0000 7febffe00640 1 Processor -- start 2024-09-21T05:49:56.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.788+0000 7febffe00640 1 -- start start 2024-09-21T05:49:56.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.788+0000 7febffe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0006b980 0x7fec0019bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.788+0000 7febffe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec001066f0 0x7fec0019c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.788+0000 7febffe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec00109290 0x7fec0019d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.788+0000 7febffe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec0010f180 con 0x7fec001066f0 2024-09-21T05:49:56.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.788+0000 7febffe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fec0010f000 con 0x7fec00109290 2024-09-21T05:49:56.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.788+0000 7febffe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec0010f300 con 0x7fec0006b980 2024-09-21T05:49:56.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.788+0000 7febfe000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec001066f0 0x7fec0019c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.788+0000 7febff400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec00109290 0x7fec0019d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.788+0000 7febfe000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec001066f0 0x7fec0019c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33710/0 (socket says 172.21.15.37:33710) 2024-09-21T05:49:56.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.789+0000 7febfe000640 1 -- 172.21.15.37:0/2171758563 learned_addr learned my addr 172.21.15.37:0/2171758563 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:49:56.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.789+0000 7febfea00640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0006b980 0x7fec0019bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.789+0000 7febfe000640 1 -- 172.21.15.37:0/2171758563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0006b980 msgr2=0x7fec0019bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.789+0000 7febfe000640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0006b980 0x7fec0019bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.789+0000 7febfe000640 1 -- 172.21.15.37:0/2171758563 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec00109290 msgr2=0x7fec0019d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.789+0000 7febfe000640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec00109290 0x7fec0019d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.789+0000 7febfe000640 1 -- 172.21.15.37:0/2171758563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0019d980 con 0x7fec001066f0 2024-09-21T05:49:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.789+0000 7febff400640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec00109290 0x7fec0019d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:49:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.789+0000 7febfe000640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec001066f0 0x7fec0019c5c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7febec00e9f0 tx=0x7febec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.790+0000 7febf7400640 1 -- 172.21.15.37:0/2171758563 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec00cd80 con 0x7fec001066f0 2024-09-21T05:49:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.790+0000 7febf7400640 1 -- 172.21.15.37:0/2171758563 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febec0108e0 con 0x7fec001066f0 2024-09-21T05:49:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.790+0000 7febffe00640 1 -- 172.21.15.37:0/2171758563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0019dc70 con 0x7fec001066f0 2024-09-21T05:49:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.790+0000 7febf7400640 1 -- 172.21.15.37:0/2171758563 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec018980 con 0x7fec001066f0 2024-09-21T05:49:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.790+0000 7febffe00640 1 -- 172.21.15.37:0/2171758563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec001a4370 con 0x7fec001066f0 2024-09-21T05:49:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.791+0000 7febffe00640 1 -- 172.21.15.37:0/2171758563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec001a4600 con 0x7fec001066f0 2024-09-21T05:49:56.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.794+0000 7febf7400640 1 -- 172.21.15.37:0/2171758563 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7febec010430 con 0x7fec001066f0 2024-09-21T05:49:56.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.797+0000 7febf7400640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7febe40b6590 0x7febe40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:56.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.797+0000 7febf7400640 1 -- 172.21.15.37:0/2171758563 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7febec0e7620 con 0x7fec001066f0 2024-09-21T05:49:56.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.797+0000 7febfea00640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7febe40b6590 0x7febe40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:56.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.798+0000 7febfea00640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7febe40b6590 0x7febe40b8aa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7febf0009bd0 tx=0x7febf0005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:56.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:56.799+0000 7febf7400640 1 -- 172.21.15.37:0/2171758563 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7febec0b2690 con 0x7fec001066f0 2024-09-21T05:49:57.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.003+0000 7febffe00640 1 -- 172.21.15.37:0/2171758563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fec001a47d0 con 0x7fec001066f0 2024-09-21T05:49:57.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.004+0000 7febf7400640 1 -- 172.21.15.37:0/2171758563 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7febec0b75d0 con 0x7fec001066f0 2024-09-21T05:49:57.006 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:49:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.007+0000 7febffe00640 1 -- 172.21.15.37:0/2171758563 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7febe40b6590 msgr2=0x7febe40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.007+0000 7febffe00640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7febe40b6590 0x7febe40b8aa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7febf0009bd0 tx=0x7febf0005f90 comp rx=0 tx=0).stop 2024-09-21T05:49:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.007+0000 7febffe00640 1 -- 172.21.15.37:0/2171758563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec001066f0 msgr2=0x7fec0019c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.007+0000 7febffe00640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec001066f0 0x7fec0019c5c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7febec00e9f0 tx=0x7febec00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:49:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.007+0000 7febffe00640 1 -- 172.21.15.37:0/2171758563 shutdown_connections 2024-09-21T05:49:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.007+0000 7febffe00640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7febe40b6590 0x7febe40b8aa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.007+0000 7febffe00640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec00109290 0x7fec0019d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.007+0000 7febffe00640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec001066f0 0x7fec0019c5c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:57.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.007+0000 7febffe00640 1 --2- 172.21.15.37:0/2171758563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0006b980 0x7fec0019bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:57.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.007+0000 7febffe00640 1 -- 172.21.15.37:0/2171758563 >> 172.21.15.37:0/2171758563 conn(0x7fec000fddd0 msgr2=0x7fec001001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:57.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.007+0000 7febffe00640 1 -- 172.21.15.37:0/2171758563 shutdown_connections 2024-09-21T05:49:57.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:57.007+0000 7febffe00640 1 -- 172.21.15.37:0/2171758563 wait complete. 2024-09-21T05:49:57.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:56 smithi067 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T05:49:57.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:56 smithi067 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T05:49:57.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:56 smithi067 ceph-mon[34443]: Detected new or changed devices on smithi144 2024-09-21T05:49:57.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:56 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-21T05:49:57.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:56 smithi067 ceph-mon[34443]: osd.11 [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890] boot 2024-09-21T05:49:57.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:56 smithi067 ceph-mon[34443]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T05:49:57.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:57.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:56 smithi144 ceph-mon[34351]: purged_snaps scrub starts 2024-09-21T05:49:57.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:56 smithi144 ceph-mon[34351]: purged_snaps scrub ok 2024-09-21T05:49:57.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:56 smithi144 ceph-mon[34351]: Detected new or changed devices on smithi144 2024-09-21T05:49:57.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:56 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-21T05:49:57.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:56 smithi144 ceph-mon[34351]: osd.11 [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890] boot 2024-09-21T05:49:57.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:56 smithi144 ceph-mon[34351]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T05:49:57.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:57.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:56 smithi037 ceph-mon[30631]: purged_snaps scrub starts 2024-09-21T05:49:57.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:56 smithi037 ceph-mon[30631]: purged_snaps scrub ok 2024-09-21T05:49:57.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:56 smithi037 ceph-mon[30631]: Detected new or changed devices on smithi144 2024-09-21T05:49:57.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:56 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-21T05:49:57.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:56 smithi037 ceph-mon[30631]: osd.11 [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890] boot 2024-09-21T05:49:57.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:56 smithi037 ceph-mon[30631]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T05:49:57.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T05:49:57.892 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":72,"num_osds":12,"num_up_osds":12,"osd_up_since":1726897795,"num_in_osds":12,"osd_in_since":1726897773,"num_remapped_pgs":0} 2024-09-21T05:49:57.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:49:58.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:57 smithi037 ceph-mon[30631]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:58.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:57 smithi037 ceph-mon[30631]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T05:49:58.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:57 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2171758563' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:49:58.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:57 smithi067 ceph-mon[34443]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:58.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:57 smithi067 ceph-mon[34443]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T05:49:58.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:57 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2171758563' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:49:58.265 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:49:58.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:57 smithi144 ceph-mon[34351]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-21T05:49:58.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:57 smithi144 ceph-mon[34351]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T05:49:58.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:57 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2171758563' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T05:49:59.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.051+0000 7f2b69a00640 1 -- 172.21.15.37:0/3735633106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b64103b60 msgr2=0x7f2b64103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:59.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.051+0000 7f2b69a00640 1 --2- 172.21.15.37:0/3735633106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b64103b60 0x7f2b64103f70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009900 tx=0x7f2b5402a3f0 comp rx=0 tx=0).stop 2024-09-21T05:49:59.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.051+0000 7f2b69a00640 1 -- 172.21.15.37:0/3735633106 shutdown_connections 2024-09-21T05:49:59.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.051+0000 7f2b69a00640 1 --2- 172.21.15.37:0/3735633106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b64109df0 0x7f2b64110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:59.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.051+0000 7f2b69a00640 1 --2- 172.21.15.37:0/3735633106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b641094a0 0x7f2b641098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:59.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.051+0000 7f2b69a00640 1 --2- 172.21.15.37:0/3735633106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b64103b60 0x7f2b64103f70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:59.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.051+0000 7f2b69a00640 1 -- 172.21.15.37:0/3735633106 >> 172.21.15.37:0/3735633106 conn(0x7f2b6407b850 msgr2=0x7f2b6407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:59.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.051+0000 7f2b69a00640 1 -- 172.21.15.37:0/3735633106 shutdown_connections 2024-09-21T05:49:59.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.051+0000 7f2b69a00640 1 -- 172.21.15.37:0/3735633106 wait complete. 2024-09-21T05:49:59.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.052+0000 7f2b69a00640 1 Processor -- start 2024-09-21T05:49:59.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.053+0000 7f2b69a00640 1 -- start start 2024-09-21T05:49:59.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.053+0000 7f2b69a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b64103b60 0x7f2b6419c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:59.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.053+0000 7f2b69a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b641094a0 0x7f2b6419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:59.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.053+0000 7f2b69a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b64109df0 0x7f2b641a2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.053+0000 7f2b69a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b64113b00 con 0x7f2b64103b60 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.053+0000 7f2b69a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2b64113980 con 0x7f2b64109df0 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.053+0000 7f2b69a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b64113c80 con 0x7f2b641094a0 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.053+0000 7f2b62a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b64103b60 0x7f2b6419c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.053+0000 7f2b62a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b64103b60 0x7f2b6419c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33728/0 (socket says 172.21.15.37:33728) 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.053+0000 7f2b62a00640 1 -- 172.21.15.37:0/322878613 learned_addr learned my addr 172.21.15.37:0/322878613 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.053+0000 7f2b63400640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b64109df0 0x7f2b641a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.053+0000 7f2b5a000640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b641094a0 0x7f2b6419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.054+0000 7f2b62a00640 1 -- 172.21.15.37:0/322878613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b641094a0 msgr2=0x7f2b6419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.054+0000 7f2b62a00640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b641094a0 0x7f2b6419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.054+0000 7f2b62a00640 1 -- 172.21.15.37:0/322878613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b64109df0 msgr2=0x7f2b641a2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.054+0000 7f2b62a00640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b64109df0 0x7f2b641a2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.054+0000 7f2b62a00640 1 -- 172.21.15.37:0/322878613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b641a2760 con 0x7f2b64103b60 2024-09-21T05:49:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.054+0000 7f2b62a00640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b64103b60 0x7f2b6419c7f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2b54005ab0 tx=0x7f2b54003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:59.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.054+0000 7f2b5be00640 1 -- 172.21.15.37:0/322878613 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5403f070 con 0x7f2b64103b60 2024-09-21T05:49:59.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.054+0000 7f2b5be00640 1 -- 172.21.15.37:0/322878613 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b54031d60 con 0x7f2b64103b60 2024-09-21T05:49:59.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.054+0000 7f2b5be00640 1 -- 172.21.15.37:0/322878613 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b54035030 con 0x7f2b64103b60 2024-09-21T05:49:59.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.055+0000 7f2b69a00640 1 -- 172.21.15.37:0/322878613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b641a29f0 con 0x7f2b64103b60 2024-09-21T05:49:59.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.055+0000 7f2b69a00640 1 -- 172.21.15.37:0/322878613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b641a91b0 con 0x7f2b64103b60 2024-09-21T05:49:59.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.056+0000 7f2b69a00640 1 -- 172.21.15.37:0/322878613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b64103f70 con 0x7f2b64103b60 2024-09-21T05:49:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.058+0000 7f2b5be00640 1 -- 172.21.15.37:0/322878613 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f2b5403bd10 con 0x7f2b64103b60 2024-09-21T05:49:59.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.060+0000 7f2b5be00640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2b480b6590 0x7f2b480b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:49:59.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.060+0000 7f2b5be00640 1 -- 172.21.15.37:0/322878613 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f2b54107950 con 0x7f2b64103b60 2024-09-21T05:49:59.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.060+0000 7f2b5a000640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2b480b6590 0x7f2b480b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:49:59.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.061+0000 7f2b5a000640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2b480b6590 0x7f2b480b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b64108fc0 tx=0x7f2b4c00b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:49:59.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.062+0000 7f2b5be00640 1 -- 172.21.15.37:0/322878613 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b540ce5e0 con 0x7f2b64103b60 2024-09-21T05:49:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.262+0000 7f2b69a00640 1 -- 172.21.15.37:0/322878613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b641a94a0 con 0x7f2b64103b60 2024-09-21T05:49:59.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.263+0000 7f2b5be00640 1 -- 172.21.15.37:0/322878613 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+18432 (secure 0 0 0) 0x7f2b540d29c0 con 0x7f2b64103b60 2024-09-21T05:49:59.266 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:49:59.266 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":72,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:49:56.904288+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:49:59.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.266+0000 7f2b69a00640 1 -- 172.21.15.37:0/322878613 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2b480b6590 msgr2=0x7f2b480b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:59.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.266+0000 7f2b69a00640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2b480b6590 0x7f2b480b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b64108fc0 tx=0x7f2b4c00b410 comp rx=0 tx=0).stop 2024-09-21T05:49:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.266+0000 7f2b69a00640 1 -- 172.21.15.37:0/322878613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b64103b60 msgr2=0x7f2b6419c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:49:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.266+0000 7f2b69a00640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b64103b60 0x7f2b6419c7f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2b54005ab0 tx=0x7f2b54003c80 comp rx=0 tx=0).stop 2024-09-21T05:49:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.266+0000 7f2b69a00640 1 -- 172.21.15.37:0/322878613 shutdown_connections 2024-09-21T05:49:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.266+0000 7f2b69a00640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2b480b6590 0x7f2b480b8aa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.266+0000 7f2b69a00640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b64109df0 0x7f2b641a2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.266+0000 7f2b69a00640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b641094a0 0x7f2b6419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.266+0000 7f2b69a00640 1 --2- 172.21.15.37:0/322878613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b64103b60 0x7f2b6419c7f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:49:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.266+0000 7f2b69a00640 1 -- 172.21.15.37:0/322878613 >> 172.21.15.37:0/322878613 conn(0x7f2b6407b850 msgr2=0x7f2b641073b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:49:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.266+0000 7f2b69a00640 1 -- 172.21.15.37:0/322878613 shutdown_connections 2024-09-21T05:49:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:49:59.266+0000 7f2b69a00640 1 -- 172.21.15.37:0/322878613 wait complete. 2024-09-21T05:49:59.974 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T05:45:48.604918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T05:49:59.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T05:50:00.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:59 smithi067 ceph-mon[34443]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:00.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:49:59 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/322878613' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:50:00.351 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:59 smithi144 ceph-mon[34351]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:49:59 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/322878613' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:50:00.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:59 smithi037 ceph-mon[30631]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:00.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:49:59 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/322878613' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:50:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.987+0000 7f74c7000640 1 -- 172.21.15.37:0/2813594158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0114740 msgr2=0x7f74c0116b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.987+0000 7f74c7000640 1 --2- 172.21.15.37:0/2813594158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0114740 0x7f74c0116b60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009ca0 tx=0x7f74b802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:50:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.987+0000 7f74c7000640 1 -- 172.21.15.37:0/2813594158 shutdown_connections 2024-09-21T05:50:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.987+0000 7f74c7000640 1 --2- 172.21.15.37:0/2813594158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0114740 0x7f74c0116b60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.987+0000 7f74c7000640 1 --2- 172.21.15.37:0/2813594158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74c0078290 0x7f74c0114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.987+0000 7f74c7000640 1 --2- 172.21.15.37:0/2813594158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74c0077940 0x7f74c0077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.987+0000 7f74c7000640 1 -- 172.21.15.37:0/2813594158 >> 172.21.15.37:0/2813594158 conn(0x7f74c0101810 msgr2=0x7f74c0103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:00.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.987+0000 7f74c7000640 1 -- 172.21.15.37:0/2813594158 shutdown_connections 2024-09-21T05:50:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.988+0000 7f74c7000640 1 -- 172.21.15.37:0/2813594158 wait complete. 2024-09-21T05:50:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.988+0000 7f74c7000640 1 Processor -- start 2024-09-21T05:50:00.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.989+0000 7f74c7000640 1 -- start start 2024-09-21T05:50:00.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.989+0000 7f74c7000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0077940 0x7f74c01a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:00.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.989+0000 7f74c7000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74c0078290 0x7f74c01a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:00.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.989+0000 7f74c7000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74c0114740 0x7f74c01a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.989+0000 7f74c7000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74c011a100 con 0x7f74c0077940 2024-09-21T05:50:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.989+0000 7f74c7000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f74c0119f80 con 0x7f74c0078290 2024-09-21T05:50:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.989+0000 7f74c7000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f74c011a280 con 0x7f74c0114740 2024-09-21T05:50:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.989+0000 7f74bfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0077940 0x7f74c01a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.989+0000 7f74b7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74c0078290 0x7f74c01a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.989+0000 7f74bfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0077940 0x7f74c01a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56324/0 (socket says 172.21.15.37:56324) 2024-09-21T05:50:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.989+0000 7f74b7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74c0078290 0x7f74c01a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:48548/0 (socket says 172.21.15.37:48548) 2024-09-21T05:50:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.989+0000 7f74bfe00640 1 -- 172.21.15.37:0/4182382026 learned_addr learned my addr 172.21.15.37:0/4182382026 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.990+0000 7f74c5000640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74c0114740 0x7f74c01a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.990+0000 7f74b7e00640 1 -- 172.21.15.37:0/4182382026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74c0114740 msgr2=0x7f74c01a6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.990+0000 7f74b7e00640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74c0114740 0x7f74c01a6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.990+0000 7f74b7e00640 1 -- 172.21.15.37:0/4182382026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0077940 msgr2=0x7f74c01a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:00.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.990+0000 7f74b7e00640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0077940 0x7f74c01a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.990+0000 7f74b7e00640 1 -- 172.21.15.37:0/4182382026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c01a69a0 con 0x7f74c0078290 2024-09-21T05:50:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.990+0000 7f74c5000640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74c0114740 0x7f74c01a6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:50:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.990+0000 7f74b7e00640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74c0078290 0x7f74c01a0fd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74c006caa0 tx=0x7f74a800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.990+0000 7f74bd600640 1 -- 172.21.15.37:0/4182382026 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a800cc40 con 0x7f74c0078290 2024-09-21T05:50:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.990+0000 7f74bd600640 1 -- 172.21.15.37:0/4182382026 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74a800cde0 con 0x7f74c0078290 2024-09-21T05:50:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.990+0000 7f74c7000640 1 -- 172.21.15.37:0/4182382026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c01a6c90 con 0x7f74c0078290 2024-09-21T05:50:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.990+0000 7f74bd600640 1 -- 172.21.15.37:0/4182382026 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8018780 con 0x7f74c0078290 2024-09-21T05:50:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.991+0000 7f74c7000640 1 -- 172.21.15.37:0/4182382026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c01ad3f0 con 0x7f74c0078290 2024-09-21T05:50:00.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.992+0000 7f74c7000640 1 -- 172.21.15.37:0/4182382026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c0077d50 con 0x7f74c0078290 2024-09-21T05:50:00.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.994+0000 7f74bd600640 1 -- 172.21.15.37:0/4182382026 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f74a8010a90 con 0x7f74c0078290 2024-09-21T05:50:00.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.995+0000 7f74bd600640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f74a40b6590 0x7f74a40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:00.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.995+0000 7f74bd600640 1 -- 172.21.15.37:0/4182382026 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f74a80e73d0 con 0x7f74c0078290 2024-09-21T05:50:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.995+0000 7f74bfe00640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f74a40b6590 0x7f74a40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.996+0000 7f74bfe00640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f74a40b6590 0x7f74a40b8aa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009c90 tx=0x7f74b0005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:00.997+0000 7f74bd600640 1 -- 172.21.15.37:0/4182382026 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74a80ae060 con 0x7f74c0078290 2024-09-21T05:50:01.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:00 smithi037 ceph-mon[30631]: overall HEALTH_OK 2024-09-21T05:50:01.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.196+0000 7f74c7000640 1 -- 172.21.15.37:0/4182382026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f74c002e640 con 0x7f74c0078290 2024-09-21T05:50:01.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.197+0000 7f74bd600640 1 -- 172.21.15.37:0/4182382026 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7f74a80b2440 con 0x7f74c0078290 2024-09-21T05:50:01.199 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-09-21T05:50:01.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.199+0000 7f74c7000640 1 -- 172.21.15.37:0/4182382026 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f74a40b6590 msgr2=0x7f74a40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:01.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.199+0000 7f74c7000640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f74a40b6590 0x7f74a40b8aa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009c90 tx=0x7f74b0005f90 comp rx=0 tx=0).stop 2024-09-21T05:50:01.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.199+0000 7f74c7000640 1 -- 172.21.15.37:0/4182382026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74c0078290 msgr2=0x7f74c01a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:01.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.199+0000 7f74c7000640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74c0078290 0x7f74c01a0fd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74c006caa0 tx=0x7f74a800ee50 comp rx=0 tx=0).stop 2024-09-21T05:50:01.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.199+0000 7f74c7000640 1 -- 172.21.15.37:0/4182382026 shutdown_connections 2024-09-21T05:50:01.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.199+0000 7f74c7000640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74c0114740 0x7f74c01a6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:01.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.199+0000 7f74c7000640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f74a40b6590 0x7f74a40b8aa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:01.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.199+0000 7f74c7000640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74c0078290 0x7f74c01a0fd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:01.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.199+0000 7f74c7000640 1 --2- 172.21.15.37:0/4182382026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0077940 0x7f74c01a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:01.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.199+0000 7f74c7000640 1 -- 172.21.15.37:0/4182382026 >> 172.21.15.37:0/4182382026 conn(0x7f74c0101810 msgr2=0x7f74c0116730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:01.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.199+0000 7f74c7000640 1 -- 172.21.15.37:0/4182382026 shutdown_connections 2024-09-21T05:50:01.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:01.199+0000 7f74c7000640 1 -- 172.21.15.37:0/4182382026 wait complete. 2024-09-21T05:50:01.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:00 smithi067 ceph-mon[34443]: overall HEALTH_OK 2024-09-21T05:50:01.274 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:00 smithi144 ceph-mon[34351]: overall HEALTH_OK 2024-09-21T05:50:01.916 INFO:tasks.cephadm:Adding mds.a on smithi037 2024-09-21T05:50:01.916 INFO:tasks.cephadm:Adding mds.d on smithi037 2024-09-21T05:50:01.916 INFO:tasks.cephadm:Adding mds.g on smithi037 2024-09-21T05:50:01.916 INFO:tasks.cephadm:Adding mds.j on smithi037 2024-09-21T05:50:01.916 INFO:tasks.cephadm:Adding mds.b on smithi067 2024-09-21T05:50:01.916 INFO:tasks.cephadm:Adding mds.e on smithi067 2024-09-21T05:50:01.916 INFO:tasks.cephadm:Adding mds.h on smithi067 2024-09-21T05:50:01.916 INFO:tasks.cephadm:Adding mds.k on smithi067 2024-09-21T05:50:01.916 INFO:tasks.cephadm:Adding mds.c on smithi144 2024-09-21T05:50:01.916 INFO:tasks.cephadm:Adding mds.f on smithi144 2024-09-21T05:50:01.917 INFO:tasks.cephadm:Adding mds.i on smithi144 2024-09-21T05:50:01.917 INFO:tasks.cephadm:Adding mds.l on smithi144 2024-09-21T05:50:01.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l' 2024-09-21T05:50:02.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:01 smithi037 ceph-mon[30631]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:02.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:01 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/4182382026' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:50:02.168 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T05:50:02.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:01 smithi067 ceph-mon[34443]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:02.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:01 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/4182382026' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:50:02.289 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:01 smithi144 ceph-mon[34351]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:02.289 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:01 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/4182382026' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T05:50:02.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.682+0000 7f87bdd90640 1 -- 172.21.15.144:0/830805625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b8103750 msgr2=0x7f87b8103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:02.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.682+0000 7f87bdd90640 1 --2- 172.21.15.144:0/830805625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b8103750 0x7f87b8103bc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009ca0 tx=0x7f87a802a950 comp rx=0 tx=0).stop 2024-09-21T05:50:02.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.682+0000 7f87bdd90640 1 -- 172.21.15.144:0/830805625 shutdown_connections 2024-09-21T05:50:02.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.682+0000 7f87bdd90640 1 --2- 172.21.15.144:0/830805625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87b8105180 0x7f87b810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:02.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.682+0000 7f87bdd90640 1 --2- 172.21.15.144:0/830805625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b81047e0 0x7f87b8104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:02.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.682+0000 7f87bdd90640 1 --2- 172.21.15.144:0/830805625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b8103750 0x7f87b8103bc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:02.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.682+0000 7f87bdd90640 1 -- 172.21.15.144:0/830805625 >> 172.21.15.144:0/830805625 conn(0x7f87b80ff0c0 msgr2=0x7f87b8101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:02.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.682+0000 7f87bdd90640 1 -- 172.21.15.144:0/830805625 shutdown_connections 2024-09-21T05:50:02.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.682+0000 7f87bdd90640 1 -- 172.21.15.144:0/830805625 wait complete. 2024-09-21T05:50:02.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.683+0000 7f87bdd90640 1 Processor -- start 2024-09-21T05:50:02.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.683+0000 7f87bdd90640 1 -- start start 2024-09-21T05:50:02.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.683+0000 7f87bdd90640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b8103750 0x7f87b8199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:02.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.683+0000 7f87bdd90640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b81047e0 0x7f87b819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:02.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87bdd90640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87b8105180 0x7f87b819b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:02.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87bdd90640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f87b810f3f0 con 0x7f87b8103750 2024-09-21T05:50:02.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87bdd90640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f87b810f270 con 0x7f87b8105180 2024-09-21T05:50:02.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87bdd90640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f87b810f570 con 0x7f87b81047e0 2024-09-21T05:50:02.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b6ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b81047e0 0x7f87b819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b6ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b81047e0 0x7f87b819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55946/0 (socket says 172.21.15.144:55946) 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b6ffd640 1 -- 172.21.15.144:0/438012861 learned_addr learned my addr 172.21.15.144:0/438012861 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b7fff640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87b8105180 0x7f87b819b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b77fe640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b8103750 0x7f87b8199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b6ffd640 1 -- 172.21.15.144:0/438012861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87b8105180 msgr2=0x7f87b819b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b6ffd640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87b8105180 0x7f87b819b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b6ffd640 1 -- 172.21.15.144:0/438012861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b8103750 msgr2=0x7f87b8199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b6ffd640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b8103750 0x7f87b8199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b6ffd640 1 -- 172.21.15.144:0/438012861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b819ba10 con 0x7f87b81047e0 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b77fe640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b8103750 0x7f87b8199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b6ffd640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b81047e0 0x7f87b819a650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f87a000b4a0 tx=0x7f87a000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b4ff9640 1 -- 172.21.15.144:0/438012861 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0014070 con 0x7f87b81047e0 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87bdd90640 1 -- 172.21.15.144:0/438012861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b819bd00 con 0x7f87b81047e0 2024-09-21T05:50:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b4ff9640 1 -- 172.21.15.144:0/438012861 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87a0010ac0 con 0x7f87b81047e0 2024-09-21T05:50:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87b4ff9640 1 -- 172.21.15.144:0/438012861 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0017c30 con 0x7f87b81047e0 2024-09-21T05:50:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.684+0000 7f87bdd90640 1 -- 172.21.15.144:0/438012861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b81a2400 con 0x7f87b81047e0 2024-09-21T05:50:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.686+0000 7f87bdd90640 1 -- 172.21.15.144:0/438012861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b8103bc0 con 0x7f87b81047e0 2024-09-21T05:50:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.687+0000 7f87b4ff9640 1 -- 172.21.15.144:0/438012861 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f87a0017070 con 0x7f87b81047e0 2024-09-21T05:50:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.687+0000 7f87b4ff9640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f87a40b6510 0x7f87a40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.688+0000 7f87b4ff9640 1 -- 172.21.15.144:0/438012861 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f87a00e6420 con 0x7f87b81047e0 2024-09-21T05:50:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.688+0000 7f87b77fe640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f87a40b6510 0x7f87a40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.688+0000 7f87b77fe640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f87a40b6510 0x7f87a40b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f87a8000f80 tx=0x7f87a802f870 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.692+0000 7f87b4ff9640 1 -- 172.21.15.144:0/438012861 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f87a00ad150 con 0x7f87b81047e0 2024-09-21T05:50:02.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.880+0000 7f87bdd90640 1 -- 172.21.15.144:0/438012861 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}) -- 0x7f87b8063900 con 0x7f87a40b6510 2024-09-21T05:50:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.890+0000 7f87b4ff9640 1 -- 172.21.15.144:0/438012861 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f87b8063900 con 0x7f87a40b6510 2024-09-21T05:50:02.892 INFO:teuthology.orchestra.run.smithi144.stdout:Scheduled mds.all update... 2024-09-21T05:50:02.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.892+0000 7f87bdd90640 1 -- 172.21.15.144:0/438012861 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f87a40b6510 msgr2=0x7f87a40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.892+0000 7f87bdd90640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f87a40b6510 0x7f87a40b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f87a8000f80 tx=0x7f87a802f870 comp rx=0 tx=0).stop 2024-09-21T05:50:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.892+0000 7f87bdd90640 1 -- 172.21.15.144:0/438012861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b81047e0 msgr2=0x7f87b819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.892+0000 7f87bdd90640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b81047e0 0x7f87b819a650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f87a000b4a0 tx=0x7f87a000b960 comp rx=0 tx=0).stop 2024-09-21T05:50:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.892+0000 7f87bdd90640 1 -- 172.21.15.144:0/438012861 shutdown_connections 2024-09-21T05:50:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.892+0000 7f87bdd90640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f87a40b6510 0x7f87a40b8a20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.892+0000 7f87bdd90640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87b8105180 0x7f87b819b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.892+0000 7f87bdd90640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b81047e0 0x7f87b819a650 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.892+0000 7f87bdd90640 1 --2- 172.21.15.144:0/438012861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87b8103750 0x7f87b8199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.892+0000 7f87bdd90640 1 -- 172.21.15.144:0/438012861 >> 172.21.15.144:0/438012861 conn(0x7f87b80ff0c0 msgr2=0x7f87b8107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.892+0000 7f87bdd90640 1 -- 172.21.15.144:0/438012861 shutdown_connections 2024-09-21T05:50:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T05:50:02.892+0000 7f87bdd90640 1 -- 172.21.15.144:0/438012861 wait complete. 2024-09-21T05:50:03.633 DEBUG:teuthology.orchestra.run.smithi037:mds.a> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T05:50:03.637 DEBUG:teuthology.orchestra.run.smithi037:mds.d> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T05:50:03.681 DEBUG:teuthology.orchestra.run.smithi037:mds.g> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T05:50:03.726 DEBUG:teuthology.orchestra.run.smithi037:mds.j> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T05:50:03.771 DEBUG:teuthology.orchestra.run.smithi067:mds.b> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T05:50:03.774 DEBUG:teuthology.orchestra.run.smithi067:mds.e> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T05:50:03.818 DEBUG:teuthology.orchestra.run.smithi067:mds.h> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T05:50:03.860 DEBUG:teuthology.orchestra.run.smithi067:mds.k> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T05:50:03.904 DEBUG:teuthology.orchestra.run.smithi144:mds.c> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T05:50:03.907 DEBUG:teuthology.orchestra.run.smithi144:mds.f> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T05:50:03.950 DEBUG:teuthology.orchestra.run.smithi144:mds.i> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T05:50:03.993 DEBUG:teuthology.orchestra.run.smithi144:mds.l> sudo journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T05:50:04.036 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T05:50:04.036 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:50:04.067 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:03 smithi067 ceph-mon[34443]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:04.067 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:03 smithi067 ceph-mon[34443]: from='client.24619 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:04.067 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:03 smithi067 ceph-mon[34443]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-21T05:50:04.067 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:04.067 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:04.067 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:04.067 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:04.067 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:04.067 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:04.067 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:04.068 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:04.084 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:03 smithi037 ceph-mon[30631]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:04.084 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:03 smithi037 ceph-mon[30631]: from='client.24619 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:04.084 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:03 smithi037 ceph-mon[30631]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-21T05:50:04.085 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:04.085 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:04.085 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:04.085 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:04.085 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:04.085 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:04.085 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:04.085 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:04.190 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:03 smithi144 ceph-mon[34351]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:04.190 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:03 smithi144 ceph-mon[34351]: from='client.24619 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:50:04.190 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:03 smithi144 ceph-mon[34351]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-21T05:50:04.190 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:04.190 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:04.190 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:04.190 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:04.190 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:04.190 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:04.190 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:04.190 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:04.407 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.043+0000 7f695fe00640 1 -- 172.21.15.37:0/1298648047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69601092d0 msgr2=0x7f69601096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:05.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.043+0000 7f695fe00640 1 --2- 172.21.15.37:0/1298648047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69601092d0 0x7f69601096e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6948009900 tx=0x7f694802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:50:05.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.044+0000 7f695fe00640 1 -- 172.21.15.37:0/1298648047 shutdown_connections 2024-09-21T05:50:05.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.044+0000 7f695fe00640 1 --2- 172.21.15.37:0/1298648047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6960109c20 0x7f6960110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:05.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.044+0000 7f695fe00640 1 --2- 172.21.15.37:0/1298648047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69601092d0 0x7f69601096e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:05.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.044+0000 7f695fe00640 1 --2- 172.21.15.37:0/1298648047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6960103990 0x7f6960103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:05.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.044+0000 7f695fe00640 1 -- 172.21.15.37:0/1298648047 >> 172.21.15.37:0/1298648047 conn(0x7f69600ff440 msgr2=0x7f6960101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:05.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.044+0000 7f695fe00640 1 -- 172.21.15.37:0/1298648047 shutdown_connections 2024-09-21T05:50:05.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.044+0000 7f695fe00640 1 -- 172.21.15.37:0/1298648047 wait complete. 2024-09-21T05:50:05.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.045+0000 7f695fe00640 1 Processor -- start 2024-09-21T05:50:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.045+0000 7f695fe00640 1 -- start start 2024-09-21T05:50:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.046+0000 7f695fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6960103990 0x7f696019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.046+0000 7f695fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69601092d0 0x7f696019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.046+0000 7f695fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6960109c20 0x7f69601a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.046+0000 7f695fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69601138e0 con 0x7f6960103990 2024-09-21T05:50:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.046+0000 7f695fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6960113760 con 0x7f6960109c20 2024-09-21T05:50:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.046+0000 7f695fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6960113a60 con 0x7f69601092d0 2024-09-21T05:50:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.046+0000 7f695f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6960109c20 0x7f69601a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.046+0000 7f695f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6960109c20 0x7f69601a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:48568/0 (socket says 172.21.15.37:48568) 2024-09-21T05:50:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.046+0000 7f695f400640 1 -- 172.21.15.37:0/988218312 learned_addr learned my addr 172.21.15.37:0/988218312 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.046+0000 7f695ea00640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6960103990 0x7f696019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.046+0000 7f6956000640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69601092d0 0x7f696019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:05.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.047+0000 7f695f400640 1 -- 172.21.15.37:0/988218312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69601092d0 msgr2=0x7f696019cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:05.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.047+0000 7f695f400640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69601092d0 0x7f696019cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:05.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.047+0000 7f695f400640 1 -- 172.21.15.37:0/988218312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6960103990 msgr2=0x7f696019c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:05.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.047+0000 7f695f400640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6960103990 0x7f696019c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:05.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.047+0000 7f695f400640 1 -- 172.21.15.37:0/988218312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69601a2480 con 0x7f6960109c20 2024-09-21T05:50:05.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.047+0000 7f695f400640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6960109c20 0x7f69601a1d50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f695800eb10 tx=0x7f695800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:05.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.047+0000 7f6957e00640 1 -- 172.21.15.37:0/988218312 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958004b20 con 0x7f6960109c20 2024-09-21T05:50:05.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.047+0000 7f6957e00640 1 -- 172.21.15.37:0/988218312 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6958004cc0 con 0x7f6960109c20 2024-09-21T05:50:05.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.047+0000 7f6957e00640 1 -- 172.21.15.37:0/988218312 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958010670 con 0x7f6960109c20 2024-09-21T05:50:05.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.047+0000 7f695fe00640 1 -- 172.21.15.37:0/988218312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69601a2770 con 0x7f6960109c20 2024-09-21T05:50:05.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.047+0000 7f695fe00640 1 -- 172.21.15.37:0/988218312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69601a8ed0 con 0x7f6960109c20 2024-09-21T05:50:05.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.048+0000 7f695fe00640 1 -- 172.21.15.37:0/988218312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6960103da0 con 0x7f6960109c20 2024-09-21T05:50:05.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.051+0000 7f6957e00640 1 -- 172.21.15.37:0/988218312 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f6958005000 con 0x7f6960109c20 2024-09-21T05:50:05.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.052+0000 7f6957e00640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f69440b6510 0x7f69440b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:05.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.052+0000 7f6957e00640 1 -- 172.21.15.37:0/988218312 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f69580e75d0 con 0x7f6960109c20 2024-09-21T05:50:05.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.053+0000 7f695ea00640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f69440b6510 0x7f69440b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:05.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.053+0000 7f695ea00640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f69440b6510 0x7f69440b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6950005d00 tx=0x7f695000b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:05.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.058+0000 7f6957e00640 1 -- 172.21.15.37:0/988218312 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6958056710 con 0x7f6960109c20 2024-09-21T05:50:05.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:04 smithi037 ceph-mon[30631]: Deploying daemon mds.l on smithi144 2024-09-21T05:50:05.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:04 smithi067 ceph-mon[34443]: Deploying daemon mds.l on smithi144 2024-09-21T05:50:05.253 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:04 smithi144 ceph-mon[34351]: Deploying daemon mds.l on smithi144 2024-09-21T05:50:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.303+0000 7f695fe00640 1 -- 172.21.15.37:0/988218312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f696019d640 con 0x7f6960109c20 2024-09-21T05:50:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.304+0000 7f6957e00640 1 -- 172.21.15.37:0/988218312 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f696019d640 con 0x7f6960109c20 2024-09-21T05:50:05.306 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:50:05.306 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"btime":"2024-09-21T05:41:47:034913+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T05:50:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 1 2024-09-21T05:50:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.306+0000 7f695fe00640 1 -- 172.21.15.37:0/988218312 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f69440b6510 msgr2=0x7f69440b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.306+0000 7f695fe00640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f69440b6510 0x7f69440b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6950005d00 tx=0x7f695000b410 comp rx=0 tx=0).stop 2024-09-21T05:50:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.306+0000 7f695fe00640 1 -- 172.21.15.37:0/988218312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6960109c20 msgr2=0x7f69601a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.306+0000 7f695fe00640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6960109c20 0x7f69601a1d50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f695800eb10 tx=0x7f695800c2d0 comp rx=0 tx=0).stop 2024-09-21T05:50:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.306+0000 7f695fe00640 1 -- 172.21.15.37:0/988218312 shutdown_connections 2024-09-21T05:50:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.306+0000 7f695fe00640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f69440b6510 0x7f69440b8a20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.306+0000 7f695fe00640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6960109c20 0x7f69601a1d50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.306+0000 7f695fe00640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69601092d0 0x7f696019cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.306+0000 7f695fe00640 1 --2- 172.21.15.37:0/988218312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6960103990 0x7f696019c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.306+0000 7f695fe00640 1 -- 172.21.15.37:0/988218312 >> 172.21.15.37:0/988218312 conn(0x7f69600ff440 msgr2=0x7f6960106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.306+0000 7f695fe00640 1 -- 172.21.15.37:0/988218312 shutdown_connections 2024-09-21T05:50:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:05.306+0000 7f695fe00640 1 -- 172.21.15.37:0/988218312 wait complete. 2024-09-21T05:50:05.623 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 05:50:05 smithi144 systemd[1]: Starting Ceph mds.l for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:50:05.899 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:05 smithi144 ceph-mon[34351]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:05.899 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 05:50:05 smithi144 podman[61957]: 2024-09-21 05:50:05.549598165 +0000 UTC m=+0.015669581 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:50:05.899 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 05:50:05 smithi144 podman[61957]: 2024-09-21 05:50:05.671055727 +0000 UTC m=+0.137127132 container create 91a5a2896474d650c078c397888f91c2b05d45951f75157c8bf4011677915d5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T05:50:06.159 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:05 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/988218312' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:06.159 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 05:50:06 smithi144 podman[61957]: 2024-09-21 05:50:06.002575569 +0000 UTC m=+0.468646977 container init 91a5a2896474d650c078c397888f91c2b05d45951f75157c8bf4011677915d5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T05:50:06.159 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 05:50:06 smithi144 podman[61957]: 2024-09-21 05:50:06.005432499 +0000 UTC m=+0.471503912 container start 91a5a2896474d650c078c397888f91c2b05d45951f75157c8bf4011677915d5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T05:50:06.159 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 05:50:06 smithi144 ceph-mds[61976]: -- 172.21.15.144:0/1513939710 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b0fb389860 con 0x55b0ff531600 2024-09-21T05:50:06.159 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 05:50:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-l[61972]: starting mds.l at 2024-09-21T05:50:06.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:05 smithi037 ceph-mon[30631]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:06.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:05 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/988218312' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:05 smithi067 ceph-mon[34443]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:05 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/988218312' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:06.623 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 05:50:06 smithi144 bash[61957]: 91a5a2896474d650c078c397888f91c2b05d45951f75157c8bf4011677915d5f 2024-09-21T05:50:06.623 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 05:50:06 smithi144 systemd[1]: Started Ceph mds.l for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:50:07.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:07 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.144:6832/3966820038,v1:172.21.15.144:6833/3966820038] up:boot 2024-09-21T05:50:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:07 smithi067 ceph-mon[34443]: fsmap 1 up:standby 2024-09-21T05:50:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T05:50:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:07 smithi067 ceph-mon[34443]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:07 smithi067 ceph-mon[34443]: Deploying daemon mds.k on smithi067 2024-09-21T05:50:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:07 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.144:6832/3966820038,v1:172.21.15.144:6833/3966820038] up:boot 2024-09-21T05:50:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:07 smithi144 ceph-mon[34351]: fsmap 1 up:standby 2024-09-21T05:50:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T05:50:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:07 smithi144 ceph-mon[34351]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:07 smithi144 ceph-mon[34351]: Deploying daemon mds.k on smithi067 2024-09-21T05:50:07.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:07 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.144:6832/3966820038,v1:172.21.15.144:6833/3966820038] up:boot 2024-09-21T05:50:07.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:07 smithi037 ceph-mon[30631]: fsmap 1 up:standby 2024-09-21T05:50:07.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T05:50:07.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:07 smithi037 ceph-mon[30631]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:07.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:07.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:07.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:07.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:07.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:07.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:07.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:07 smithi037 ceph-mon[30631]: Deploying daemon mds.k on smithi067 2024-09-21T05:50:08.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:50:08.418 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:08.440 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 05:50:08 smithi067 systemd[1]: Starting Ceph mds.k for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:50:08.703 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 05:50:08 smithi067 podman[61960]: 2024-09-21 05:50:08.340814188 +0000 UTC m=+0.016318988 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:50:08.703 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 05:50:08 smithi067 podman[61960]: 2024-09-21 05:50:08.45748824 +0000 UTC m=+0.132993038 container create 8fc114606522ca7c195593efae6fe9af0fe9992a2ac3e3e64b7e4b033985984b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-k, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T05:50:08.996 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 05:50:08 smithi067 podman[61960]: 2024-09-21 05:50:08.701769736 +0000 UTC m=+0.377274533 container init 8fc114606522ca7c195593efae6fe9af0fe9992a2ac3e3e64b7e4b033985984b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-k, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T05:50:08.997 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 05:50:08 smithi067 podman[61960]: 2024-09-21 05:50:08.70474431 +0000 UTC m=+0.380249108 container start 8fc114606522ca7c195593efae6fe9af0fe9992a2ac3e3e64b7e4b033985984b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-k, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T05:50:08.997 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 05:50:08 smithi067 ceph-mds[61979]: -- 172.21.15.67:0/2654427822 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d1ce503860 con 0x55d1d26ab180 2024-09-21T05:50:08.997 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 05:50:08 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-k[61975]: starting mds.k at 2024-09-21T05:50:08.997 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 05:50:08 smithi067 bash[61960]: 8fc114606522ca7c195593efae6fe9af0fe9992a2ac3e3e64b7e4b033985984b 2024-09-21T05:50:08.997 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 05:50:08 smithi067 systemd[1]: Started Ceph mds.k for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:50:09.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.071+0000 7f8e5ea00640 1 -- 172.21.15.37:0/4272374794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e581039b0 msgr2=0x7f8e58103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:09.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.071+0000 7f8e5ea00640 1 --2- 172.21.15.37:0/4272374794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e581039b0 0x7f8e58103dc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009900 tx=0x7f8e4c02a3f0 comp rx=0 tx=0).stop 2024-09-21T05:50:09.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.071+0000 7f8e5ea00640 1 -- 172.21.15.37:0/4272374794 shutdown_connections 2024-09-21T05:50:09.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.071+0000 7f8e5ea00640 1 --2- 172.21.15.37:0/4272374794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e58109c40 0x7f8e58110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:09.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.071+0000 7f8e5ea00640 1 --2- 172.21.15.37:0/4272374794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e581092f0 0x7f8e58109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:09.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.071+0000 7f8e5ea00640 1 --2- 172.21.15.37:0/4272374794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e581039b0 0x7f8e58103dc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:09.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.071+0000 7f8e5ea00640 1 -- 172.21.15.37:0/4272374794 >> 172.21.15.37:0/4272374794 conn(0x7f8e580ff400 msgr2=0x7f8e58101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:09.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.071+0000 7f8e5ea00640 1 -- 172.21.15.37:0/4272374794 shutdown_connections 2024-09-21T05:50:09.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.071+0000 7f8e5ea00640 1 -- 172.21.15.37:0/4272374794 wait complete. 2024-09-21T05:50:09.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.072+0000 7f8e5ea00640 1 Processor -- start 2024-09-21T05:50:09.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.072+0000 7f8e5ea00640 1 -- start start 2024-09-21T05:50:09.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.073+0000 7f8e5ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e581039b0 0x7f8e5819c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:09.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.073+0000 7f8e5ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e581092f0 0x7f8e5819cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:09.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.073+0000 7f8e5ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e58109c40 0x7f8e581a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:09.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.073+0000 7f8e5ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58113950 con 0x7f8e581092f0 2024-09-21T05:50:09.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.073+0000 7f8e5ea00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581137d0 con 0x7f8e58109c40 2024-09-21T05:50:09.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.073+0000 7f8e5ea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58113ad0 con 0x7f8e581039b0 2024-09-21T05:50:09.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.073+0000 7f8e5cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e581092f0 0x7f8e5819cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:09.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.073+0000 7f8e5e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e58109c40 0x7f8e581a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:09.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.073+0000 7f8e5d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e581039b0 0x7f8e5819c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:09.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.073+0000 7f8e5e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e58109c40 0x7f8e581a1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:48590/0 (socket says 172.21.15.37:48590) 2024-09-21T05:50:09.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.073+0000 7f8e5e000640 1 -- 172.21.15.37:0/1268011475 learned_addr learned my addr 172.21.15.37:0/1268011475 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:09.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.074+0000 7f8e5e000640 1 -- 172.21.15.37:0/1268011475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e581039b0 msgr2=0x7f8e5819c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:09.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.074+0000 7f8e5e000640 1 --2- 172.21.15.37:0/1268011475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e581039b0 0x7f8e5819c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:09.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.074+0000 7f8e5e000640 1 -- 172.21.15.37:0/1268011475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e581092f0 msgr2=0x7f8e5819cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:09.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.074+0000 7f8e5e000640 1 --2- 172.21.15.37:0/1268011475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e581092f0 0x7f8e5819cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:09.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.074+0000 7f8e5e000640 1 -- 172.21.15.37:0/1268011475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e581a2490 con 0x7f8e58109c40 2024-09-21T05:50:09.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.074+0000 7f8e5e000640 1 --2- 172.21.15.37:0/1268011475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e58109c40 0x7f8e581a1d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000efd0 tx=0x7f8e5000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:09.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.074+0000 7f8e56000640 1 -- 172.21.15.37:0/1268011475 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50003b70 con 0x7f8e58109c40 2024-09-21T05:50:09.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.075+0000 7f8e56000640 1 -- 172.21.15.37:0/1268011475 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e50003d10 con 0x7f8e58109c40 2024-09-21T05:50:09.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.075+0000 7f8e56000640 1 -- 172.21.15.37:0/1268011475 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e500108a0 con 0x7f8e58109c40 2024-09-21T05:50:09.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.075+0000 7f8e5ea00640 1 -- 172.21.15.37:0/1268011475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e581a2780 con 0x7f8e58109c40 2024-09-21T05:50:09.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.075+0000 7f8e5ea00640 1 -- 172.21.15.37:0/1268011475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e581a8ee0 con 0x7f8e58109c40 2024-09-21T05:50:09.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.076+0000 7f8e5ea00640 1 -- 172.21.15.37:0/1268011475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e58103dc0 con 0x7f8e58109c40 2024-09-21T05:50:09.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.079+0000 7f8e56000640 1 -- 172.21.15.37:0/1268011475 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f8e50004020 con 0x7f8e58109c40 2024-09-21T05:50:09.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.081+0000 7f8e56000640 1 --2- 172.21.15.37:0/1268011475 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8e400b6590 0x7f8e400b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:09.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.081+0000 7f8e56000640 1 -- 172.21.15.37:0/1268011475 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f8e500e7290 con 0x7f8e58109c40 2024-09-21T05:50:09.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.081+0000 7f8e5d600640 1 --2- 172.21.15.37:0/1268011475 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8e400b6590 0x7f8e400b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:09.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.082+0000 7f8e5d600640 1 --2- 172.21.15.37:0/1268011475 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8e400b6590 0x7f8e400b8aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c005ab0 tx=0x7f8e4c005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.084+0000 7f8e56000640 1 -- 172.21.15.37:0/1268011475 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e500adf20 con 0x7f8e58109c40 2024-09-21T05:50:09.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.355+0000 7f8e5ea00640 1 -- 172.21.15.37:0/1268011475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e581a9180 con 0x7f8e58109c40 2024-09-21T05:50:09.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.356+0000 7f8e56000640 1 -- 172.21.15.37:0/1268011475 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f8e500b2300 con 0x7f8e58109c40 2024-09-21T05:50:09.358 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:50:09.358 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"btime":"2024-09-21T05:50:09:211005+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T05:50:09.359 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2024-09-21T05:50:09.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.358+0000 7f8e5ea00640 1 -- 172.21.15.37:0/1268011475 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8e400b6590 msgr2=0x7f8e400b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:09.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.358+0000 7f8e5ea00640 1 --2- 172.21.15.37:0/1268011475 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8e400b6590 0x7f8e400b8aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c005ab0 tx=0x7f8e4c005a20 comp rx=0 tx=0).stop 2024-09-21T05:50:09.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.358+0000 7f8e5ea00640 1 -- 172.21.15.37:0/1268011475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e58109c40 msgr2=0x7f8e581a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:09.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.358+0000 7f8e5ea00640 1 --2- 172.21.15.37:0/1268011475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e58109c40 0x7f8e581a1d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000efd0 tx=0x7f8e5000c6a0 comp rx=0 tx=0).stop 2024-09-21T05:50:09.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.358+0000 7f8e5ea00640 1 -- 172.21.15.37:0/1268011475 shutdown_connections 2024-09-21T05:50:09.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.358+0000 7f8e5ea00640 1 --2- 172.21.15.37:0/1268011475 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8e400b6590 0x7f8e400b8aa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:09.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.358+0000 7f8e5ea00640 1 --2- 172.21.15.37:0/1268011475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e58109c40 0x7f8e581a1d60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:09.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.358+0000 7f8e5ea00640 1 --2- 172.21.15.37:0/1268011475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e581092f0 0x7f8e5819cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:09.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.358+0000 7f8e5ea00640 1 --2- 172.21.15.37:0/1268011475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e581039b0 0x7f8e5819c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:09.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.358+0000 7f8e5ea00640 1 -- 172.21.15.37:0/1268011475 >> 172.21.15.37:0/1268011475 conn(0x7f8e580ff400 msgr2=0x7f8e58108980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:09.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.359+0000 7f8e5ea00640 1 -- 172.21.15.37:0/1268011475 shutdown_connections 2024-09-21T05:50:09.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:09.359+0000 7f8e5ea00640 1 -- 172.21.15.37:0/1268011475 wait complete. 2024-09-21T05:50:10.114 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:09 smithi037 ceph-mon[30631]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:10.114 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:10.114 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:10.114 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:10.114 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:10.114 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:10.114 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:10.114 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:09 smithi037 ceph-mon[30631]: Deploying daemon mds.j on smithi037 2024-09-21T05:50:10.114 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:09 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.67:6832/2950882558,v1:172.21.15.67:6833/2950882558] up:boot 2024-09-21T05:50:10.114 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:09 smithi037 ceph-mon[30631]: fsmap 2 up:standby 2024-09-21T05:50:10.114 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T05:50:10.114 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:09 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1268011475' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:09 smithi144 ceph-mon[34351]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:09 smithi144 ceph-mon[34351]: Deploying daemon mds.j on smithi037 2024-09-21T05:50:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:09 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.67:6832/2950882558,v1:172.21.15.67:6833/2950882558] up:boot 2024-09-21T05:50:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:09 smithi144 ceph-mon[34351]: fsmap 2 up:standby 2024-09-21T05:50:10.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T05:50:10.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:09 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1268011475' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:10.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:09 smithi067 ceph-mon[34443]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:10.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:10.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:10.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:10.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:10.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:10.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:10.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:09 smithi067 ceph-mon[34443]: Deploying daemon mds.j on smithi037 2024-09-21T05:50:10.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:09 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.67:6832/2950882558,v1:172.21.15.67:6833/2950882558] up:boot 2024-09-21T05:50:10.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:09 smithi067 ceph-mon[34443]: fsmap 2 up:standby 2024-09-21T05:50:10.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T05:50:10.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:09 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1268011475' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:11.783 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 05:50:11 smithi037 systemd[1]: Starting Ceph mds.j for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:50:12.108 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:11 smithi037 ceph-mon[30631]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:12.109 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 05:50:11 smithi037 podman[68428]: 2024-09-21 05:50:11.685144495 +0000 UTC m=+0.027840438 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:50:12.109 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 05:50:11 smithi037 podman[68428]: 2024-09-21 05:50:11.804910904 +0000 UTC m=+0.147606829 container create 03932e4311853d85da65a19d47e6bb3e2634975f910b4417d4af794b2385ff0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-j, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:50:12.109 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 05:50:11 smithi037 podman[68428]: 2024-09-21 05:50:11.999182225 +0000 UTC m=+0.341878177 container init 03932e4311853d85da65a19d47e6bb3e2634975f910b4417d4af794b2385ff0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-j, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:50:12.109 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 05:50:12 smithi037 podman[68428]: 2024-09-21 05:50:12.005439104 +0000 UTC m=+0.348135029 container start 03932e4311853d85da65a19d47e6bb3e2634975f910b4417d4af794b2385ff0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:50:12.109 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 05:50:12 smithi037 bash[68428]: 03932e4311853d85da65a19d47e6bb3e2634975f910b4417d4af794b2385ff0c 2024-09-21T05:50:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:11 smithi144 ceph-mon[34351]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:12.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:11 smithi067 ceph-mon[34443]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:12.414 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 05:50:12 smithi037 ceph-mds[68447]: -- 172.21.15.37:0/198668251 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565381e99860 con 0x565386041a80 2024-09-21T05:50:12.414 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 05:50:12 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-j[68443]: starting mds.j at 2024-09-21T05:50:12.414 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 05:50:12 smithi037 systemd[1]: Started Ceph mds.j for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:50:13.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:50:13.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:13 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:13.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:13 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:13.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:13 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:13.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:13 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:13.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:13 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:13.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:13 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:13.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:13 smithi037 ceph-mon[30631]: Deploying daemon mds.d on smithi037 2024-09-21T05:50:13.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:13 smithi037 ceph-mon[30631]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:13.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:13 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.37:6834/2170500784,v1:172.21.15.37:6835/2170500784] up:boot 2024-09-21T05:50:13.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:13 smithi037 ceph-mon[30631]: fsmap 3 up:standby 2024-09-21T05:50:13.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:13 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T05:50:13.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:13 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:13 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:13 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:13 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:13 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:13 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:13 smithi067 ceph-mon[34443]: Deploying daemon mds.d on smithi037 2024-09-21T05:50:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:13 smithi067 ceph-mon[34443]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:13 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.37:6834/2170500784,v1:172.21.15.37:6835/2170500784] up:boot 2024-09-21T05:50:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:13 smithi067 ceph-mon[34443]: fsmap 3 up:standby 2024-09-21T05:50:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:13 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T05:50:13.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:13 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:13.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:13 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:13.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:13 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:13.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:13 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:13.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:13 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:13.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:13 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:13.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:13 smithi144 ceph-mon[34351]: Deploying daemon mds.d on smithi037 2024-09-21T05:50:13.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:13 smithi144 ceph-mon[34351]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:13.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:13 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.37:6834/2170500784,v1:172.21.15.37:6835/2170500784] up:boot 2024-09-21T05:50:13.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:13 smithi144 ceph-mon[34351]: fsmap 3 up:standby 2024-09-21T05:50:13.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:13 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T05:50:13.910 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.538+0000 7f51a8e00640 1 -- 172.21.15.37:0/2603016755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51a410ff10 msgr2=0x7f51a4112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.538+0000 7f51a8e00640 1 --2- 172.21.15.37:0/2603016755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51a410ff10 0x7f51a4112350 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f519c009ca0 tx=0x7f519c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:50:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.538+0000 7f51a8e00640 1 -- 172.21.15.37:0/2603016755 shutdown_connections 2024-09-21T05:50:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.538+0000 7f51a8e00640 1 --2- 172.21.15.37:0/2603016755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51a410ff10 0x7f51a4112350 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.538+0000 7f51a8e00640 1 --2- 172.21.15.37:0/2603016755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51a4076100 0x7f51a410f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.538+0000 7f51a8e00640 1 --2- 172.21.15.37:0/2603016755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51a40757b0 0x7f51a4075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.538+0000 7f51a8e00640 1 -- 172.21.15.37:0/2603016755 >> 172.21.15.37:0/2603016755 conn(0x7f51a40ff440 msgr2=0x7f51a4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.538+0000 7f51a8e00640 1 -- 172.21.15.37:0/2603016755 shutdown_connections 2024-09-21T05:50:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.538+0000 7f51a8e00640 1 -- 172.21.15.37:0/2603016755 wait complete. 2024-09-21T05:50:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.539+0000 7f51a8e00640 1 Processor -- start 2024-09-21T05:50:14.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.539+0000 7f51a8e00640 1 -- start start 2024-09-21T05:50:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.540+0000 7f51a8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51a40757b0 0x7f51a419c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.540+0000 7f51a8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51a4076100 0x7f51a419ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.540+0000 7f51a8e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51a410ff10 0x7f51a41a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.540+0000 7f51a8e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f51a4115ac0 con 0x7f51a4076100 2024-09-21T05:50:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.540+0000 7f51a8e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f51a4115940 con 0x7f51a410ff10 2024-09-21T05:50:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.540+0000 7f51a8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51a4115c40 con 0x7f51a40757b0 2024-09-21T05:50:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.540+0000 7f51a2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51a4076100 0x7f51a419ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.540+0000 7f51a2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51a4076100 0x7f51a419ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36172/0 (socket says 172.21.15.37:36172) 2024-09-21T05:50:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.540+0000 7f51a3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51a410ff10 0x7f51a41a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.540+0000 7f51a2a00640 1 -- 172.21.15.37:0/611585412 learned_addr learned my addr 172.21.15.37:0/611585412 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.540+0000 7f51a3400640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51a40757b0 0x7f51a419c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.541+0000 7f51a2a00640 1 -- 172.21.15.37:0/611585412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51a40757b0 msgr2=0x7f51a419c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.541+0000 7f51a2a00640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51a40757b0 0x7f51a419c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.541+0000 7f51a2a00640 1 -- 172.21.15.37:0/611585412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51a410ff10 msgr2=0x7f51a41a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.541+0000 7f51a2a00640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51a410ff10 0x7f51a41a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.541+0000 7f51a2a00640 1 -- 172.21.15.37:0/611585412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a41a2460 con 0x7f51a4076100 2024-09-21T05:50:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.541+0000 7f51a3e00640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51a410ff10 0x7f51a41a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:50:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.541+0000 7f51a2a00640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51a4076100 0x7f51a419ca90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f519000e9c0 tx=0x7f519000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.541+0000 7f519be00640 1 -- 172.21.15.37:0/611585412 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519000cd80 con 0x7f51a4076100 2024-09-21T05:50:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.541+0000 7f51a8e00640 1 -- 172.21.15.37:0/611585412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a41a2750 con 0x7f51a4076100 2024-09-21T05:50:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.541+0000 7f519be00640 1 -- 172.21.15.37:0/611585412 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51900035f0 con 0x7f51a4076100 2024-09-21T05:50:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.541+0000 7f519be00640 1 -- 172.21.15.37:0/611585412 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190010690 con 0x7f51a4076100 2024-09-21T05:50:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.541+0000 7f51a8e00640 1 -- 172.21.15.37:0/611585412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a41a8eb0 con 0x7f51a4076100 2024-09-21T05:50:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.543+0000 7f51a8e00640 1 -- 172.21.15.37:0/611585412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a4075bc0 con 0x7f51a4076100 2024-09-21T05:50:14.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.546+0000 7f519be00640 1 -- 172.21.15.37:0/611585412 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f51900037a0 con 0x7f51a4076100 2024-09-21T05:50:14.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.548+0000 7f519be00640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f51880b6510 0x7f51880b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:14.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.548+0000 7f519be00640 1 -- 172.21.15.37:0/611585412 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f51900e7290 con 0x7f51a4076100 2024-09-21T05:50:14.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.548+0000 7f51a3400640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f51880b6510 0x7f51880b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:14.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.549+0000 7f51a3400640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f51880b6510 0x7f51880b8a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5194009bd0 tx=0x7f5194005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:14.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.554+0000 7f519be00640 1 -- 172.21.15.37:0/611585412 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f51900adf20 con 0x7f51a4076100 2024-09-21T05:50:14.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.812+0000 7f51a8e00640 1 -- 172.21.15.37:0/611585412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51a419d620 con 0x7f51a4076100 2024-09-21T05:50:14.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.813+0000 7f519be00640 1 -- 172.21.15.37:0/611585412 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f51a419d620 con 0x7f51a4076100 2024-09-21T05:50:14.816 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:50:14.816 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":4,"btime":"2024-09-21T05:50:12:853052+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T05:50:14.816 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 4 2024-09-21T05:50:14.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.816+0000 7f51a8e00640 1 -- 172.21.15.37:0/611585412 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f51880b6510 msgr2=0x7f51880b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:14.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.816+0000 7f51a8e00640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f51880b6510 0x7f51880b8a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5194009bd0 tx=0x7f5194005f90 comp rx=0 tx=0).stop 2024-09-21T05:50:14.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.816+0000 7f51a8e00640 1 -- 172.21.15.37:0/611585412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51a4076100 msgr2=0x7f51a419ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:14.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.816+0000 7f51a8e00640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51a4076100 0x7f51a419ca90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f519000e9c0 tx=0x7f519000ee80 comp rx=0 tx=0).stop 2024-09-21T05:50:14.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.816+0000 7f51a8e00640 1 -- 172.21.15.37:0/611585412 shutdown_connections 2024-09-21T05:50:14.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.816+0000 7f51a8e00640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f51880b6510 0x7f51880b8a20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:14.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.816+0000 7f51a8e00640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51a410ff10 0x7f51a41a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:14.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.816+0000 7f51a8e00640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51a4076100 0x7f51a419ca90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:14.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.816+0000 7f51a8e00640 1 --2- 172.21.15.37:0/611585412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51a40757b0 0x7f51a419c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:14.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.816+0000 7f51a8e00640 1 -- 172.21.15.37:0/611585412 >> 172.21.15.37:0/611585412 conn(0x7f51a40ff440 msgr2=0x7f51a4109a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:14.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.816+0000 7f51a8e00640 1 -- 172.21.15.37:0/611585412 shutdown_connections 2024-09-21T05:50:14.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:14.816+0000 7f51a8e00640 1 -- 172.21.15.37:0/611585412 wait complete. 2024-09-21T05:50:15.495 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:15 smithi037 ceph-mon[30631]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:15.495 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:15 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/611585412' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:15.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:15 smithi144 ceph-mon[34351]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:15.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:15 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/611585412' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:15.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:15 smithi067 ceph-mon[34443]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:15.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:15 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/611585412' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:16.164 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 05:50:15 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-d[68832]: starting mds.d at 2024-09-21T05:50:17.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:16 smithi067 ceph-mon[34443]: Deploying daemon mds.e on smithi067 2024-09-21T05:50:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:16 smithi067 ceph-mon[34443]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:16 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.37:6836/2573014939,v1:172.21.15.37:6837/2573014939] up:boot 2024-09-21T05:50:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:16 smithi067 ceph-mon[34443]: fsmap 4 up:standby 2024-09-21T05:50:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:16 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T05:50:17.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:17.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:17.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:17.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:17.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:17.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:17.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:16 smithi144 ceph-mon[34351]: Deploying daemon mds.e on smithi067 2024-09-21T05:50:17.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:16 smithi144 ceph-mon[34351]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:17.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:16 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.37:6836/2573014939,v1:172.21.15.37:6837/2573014939] up:boot 2024-09-21T05:50:17.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:16 smithi144 ceph-mon[34351]: fsmap 4 up:standby 2024-09-21T05:50:17.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:16 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T05:50:17.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:17.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:17.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:17.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:17.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:17.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:17.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:16 smithi037 ceph-mon[30631]: Deploying daemon mds.e on smithi067 2024-09-21T05:50:17.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:16 smithi037 ceph-mon[30631]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:17.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:16 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.37:6836/2573014939,v1:172.21.15.37:6837/2573014939] up:boot 2024-09-21T05:50:17.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:16 smithi037 ceph-mon[30631]: fsmap 4 up:standby 2024-09-21T05:50:17.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:16 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T05:50:17.532 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:50:17.924 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:18.230 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 05:50:18 smithi067 systemd[1]: Starting Ceph mds.e for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:50:18.496 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 05:50:18 smithi067 podman[62229]: 2024-09-21 05:50:18.131074743 +0000 UTC m=+0.015653432 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:50:18.496 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 05:50:18 smithi067 podman[62229]: 2024-09-21 05:50:18.259092678 +0000 UTC m=+0.143671398 container create b77f6d6dbd24ff2cdc1f80a47af101374154eceaa639ce601f4fcbc88c71a994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T05:50:18.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.572+0000 7f54d9400640 1 -- 172.21.15.37:0/1185739265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d41039b0 msgr2=0x7f54d4103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:18.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.572+0000 7f54d9400640 1 --2- 172.21.15.37:0/1185739265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d41039b0 0x7f54d4103dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009900 tx=0x7f54c402a410 comp rx=0 tx=0).stop 2024-09-21T05:50:18.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.572+0000 7f54d9400640 1 -- 172.21.15.37:0/1185739265 shutdown_connections 2024-09-21T05:50:18.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.572+0000 7f54d9400640 1 --2- 172.21.15.37:0/1185739265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54d4109c40 0x7f54d4110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:18.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.572+0000 7f54d9400640 1 --2- 172.21.15.37:0/1185739265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d41092f0 0x7f54d4109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:18.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.572+0000 7f54d9400640 1 --2- 172.21.15.37:0/1185739265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d41039b0 0x7f54d4103dc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:18.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.572+0000 7f54d9400640 1 -- 172.21.15.37:0/1185739265 >> 172.21.15.37:0/1185739265 conn(0x7f54d40ff440 msgr2=0x7f54d4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:18.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.572+0000 7f54d9400640 1 -- 172.21.15.37:0/1185739265 shutdown_connections 2024-09-21T05:50:18.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.572+0000 7f54d9400640 1 -- 172.21.15.37:0/1185739265 wait complete. 2024-09-21T05:50:18.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.573+0000 7f54d9400640 1 Processor -- start 2024-09-21T05:50:18.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.574+0000 7f54d9400640 1 -- start start 2024-09-21T05:50:18.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.574+0000 7f54d9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d41039b0 0x7f54d419c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:18.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.574+0000 7f54d9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54d41092f0 0x7f54d419cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:18.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.574+0000 7f54d9400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d4109c40 0x7f54d41a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.574+0000 7f54d9400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54d4113950 con 0x7f54d41039b0 2024-09-21T05:50:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.574+0000 7f54d9400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f54d41137d0 con 0x7f54d4109c40 2024-09-21T05:50:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.574+0000 7f54d9400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f54d4113ad0 con 0x7f54d41092f0 2024-09-21T05:50:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.574+0000 7f54d3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d41039b0 0x7f54d419c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.574+0000 7f54d8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d4109c40 0x7f54d41a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.574+0000 7f54d3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d41039b0 0x7f54d419c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36214/0 (socket says 172.21.15.37:36214) 2024-09-21T05:50:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.574+0000 7f54d3e00640 1 -- 172.21.15.37:0/3990918494 learned_addr learned my addr 172.21.15.37:0/3990918494 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.574+0000 7f54cb400640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54d41092f0 0x7f54d419cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.575+0000 7f54d3e00640 1 -- 172.21.15.37:0/3990918494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54d41092f0 msgr2=0x7f54d419cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.575+0000 7f54d3e00640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54d41092f0 0x7f54d419cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.575+0000 7f54d3e00640 1 -- 172.21.15.37:0/3990918494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d4109c40 msgr2=0x7f54d41a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.575+0000 7f54d3e00640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d4109c40 0x7f54d41a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:18.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.575+0000 7f54d3e00640 1 -- 172.21.15.37:0/3990918494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d41a24d0 con 0x7f54d41039b0 2024-09-21T05:50:18.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.575+0000 7f54d8a00640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d4109c40 0x7f54d41a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:50:18.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.575+0000 7f54d3e00640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d41039b0 0x7f54d419c560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f54c4005ab0 tx=0x7f54c4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:18.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.575+0000 7f54d1600640 1 -- 172.21.15.37:0/3990918494 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c403f070 con 0x7f54d41039b0 2024-09-21T05:50:18.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.575+0000 7f54d1600640 1 -- 172.21.15.37:0/3990918494 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54c4031d60 con 0x7f54d41039b0 2024-09-21T05:50:18.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.575+0000 7f54d9400640 1 -- 172.21.15.37:0/3990918494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d41a2760 con 0x7f54d41039b0 2024-09-21T05:50:18.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.575+0000 7f54d1600640 1 -- 172.21.15.37:0/3990918494 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4035030 con 0x7f54d41039b0 2024-09-21T05:50:18.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.576+0000 7f54d9400640 1 -- 172.21.15.37:0/3990918494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d41a8f20 con 0x7f54d41039b0 2024-09-21T05:50:18.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.577+0000 7f54d9400640 1 -- 172.21.15.37:0/3990918494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d4104c30 con 0x7f54d41039b0 2024-09-21T05:50:18.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.579+0000 7f54d1600640 1 -- 172.21.15.37:0/3990918494 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f54c4042070 con 0x7f54d41039b0 2024-09-21T05:50:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.580+0000 7f54d1600640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54b80b6590 0x7f54b80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.581+0000 7f54d1600640 1 -- 172.21.15.37:0/3990918494 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f54c4107c40 con 0x7f54d41039b0 2024-09-21T05:50:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.581+0000 7f54cb400640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54b80b6590 0x7f54b80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.581+0000 7f54cb400640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54b80b6590 0x7f54b80b8aa0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f54d4107ca0 tx=0x7f54bc005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:18.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.583+0000 7f54d1600640 1 -- 172.21.15.37:0/3990918494 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f54c40d2cb0 con 0x7f54d41039b0 2024-09-21T05:50:18.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.825+0000 7f54d9400640 1 -- 172.21.15.37:0/3990918494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54d4103dc0 con 0x7f54d41039b0 2024-09-21T05:50:18.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.826+0000 7f54d1600640 1 -- 172.21.15.37:0/3990918494 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f54c40d7bf0 con 0x7f54d41039b0 2024-09-21T05:50:18.827 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:50:18.827 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"btime":"2024-09-21T05:50:16:263145+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T05:50:18.827 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 5 2024-09-21T05:50:18.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.828+0000 7f54d9400640 1 -- 172.21.15.37:0/3990918494 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54b80b6590 msgr2=0x7f54b80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:18.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.828+0000 7f54d9400640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54b80b6590 0x7f54b80b8aa0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f54d4107ca0 tx=0x7f54bc005f90 comp rx=0 tx=0).stop 2024-09-21T05:50:18.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.828+0000 7f54d9400640 1 -- 172.21.15.37:0/3990918494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d41039b0 msgr2=0x7f54d419c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:18.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.828+0000 7f54d9400640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d41039b0 0x7f54d419c560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f54c4005ab0 tx=0x7f54c4003c80 comp rx=0 tx=0).stop 2024-09-21T05:50:18.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.829+0000 7f54d9400640 1 -- 172.21.15.37:0/3990918494 shutdown_connections 2024-09-21T05:50:18.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.829+0000 7f54d9400640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54b80b6590 0x7f54b80b8aa0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:18.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.829+0000 7f54d9400640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d4109c40 0x7f54d41a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:18.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.829+0000 7f54d9400640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54d41092f0 0x7f54d419cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:18.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.829+0000 7f54d9400640 1 --2- 172.21.15.37:0/3990918494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d41039b0 0x7f54d419c560 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:18.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.829+0000 7f54d9400640 1 -- 172.21.15.37:0/3990918494 >> 172.21.15.37:0/3990918494 conn(0x7f54d40ff440 msgr2=0x7f54d41089d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:18.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.829+0000 7f54d9400640 1 -- 172.21.15.37:0/3990918494 shutdown_connections 2024-09-21T05:50:18.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:18.829+0000 7f54d9400640 1 -- 172.21.15.37:0/3990918494 wait complete. 2024-09-21T05:50:18.996 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 05:50:18 smithi067 podman[62229]: 2024-09-21 05:50:18.523343931 +0000 UTC m=+0.407922615 container init b77f6d6dbd24ff2cdc1f80a47af101374154eceaa639ce601f4fcbc88c71a994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T05:50:18.997 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 05:50:18 smithi067 podman[62229]: 2024-09-21 05:50:18.526196909 +0000 UTC m=+0.410775584 container start b77f6d6dbd24ff2cdc1f80a47af101374154eceaa639ce601f4fcbc88c71a994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T05:50:18.997 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 05:50:18 smithi067 ceph-mds[62248]: -- 172.21.15.67:0/1160203698 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c7b9f3860 con 0x560c7fb9ba80 2024-09-21T05:50:18.997 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 05:50:18 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-e[62244]: starting mds.e at 2024-09-21T05:50:18.997 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 05:50:18 smithi067 bash[62229]: b77f6d6dbd24ff2cdc1f80a47af101374154eceaa639ce601f4fcbc88c71a994 2024-09-21T05:50:18.997 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 05:50:18 smithi067 systemd[1]: Started Ceph mds.e for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:50:19.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:19 smithi037 ceph-mon[30631]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:19.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:19.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:19.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:19.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:19.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:19.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:19.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:19 smithi037 ceph-mon[30631]: Deploying daemon mds.f on smithi144 2024-09-21T05:50:19.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:19 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3990918494' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:19.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:19 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.67:6834/2708261252,v1:172.21.15.67:6835/2708261252] up:boot 2024-09-21T05:50:19.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:19 smithi037 ceph-mon[30631]: fsmap 5 up:standby 2024-09-21T05:50:19.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:19 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T05:50:19.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:19 smithi067 ceph-mon[34443]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:19.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:19 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:19.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:19 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:19.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:19 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:19.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:19 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:19.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:19 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:19.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:19 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:19.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:19 smithi067 ceph-mon[34443]: Deploying daemon mds.f on smithi144 2024-09-21T05:50:19.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:19 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3990918494' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:19.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:19 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.67:6834/2708261252,v1:172.21.15.67:6835/2708261252] up:boot 2024-09-21T05:50:19.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:19 smithi067 ceph-mon[34443]: fsmap 5 up:standby 2024-09-21T05:50:19.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:19 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T05:50:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:19 smithi144 ceph-mon[34351]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:19 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:19 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:19 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:19 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:20.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:19 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:20.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:19 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:20.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:19 smithi144 ceph-mon[34351]: Deploying daemon mds.f on smithi144 2024-09-21T05:50:20.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:19 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3990918494' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:20.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:19 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.67:6834/2708261252,v1:172.21.15.67:6835/2708261252] up:boot 2024-09-21T05:50:20.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:19 smithi144 ceph-mon[34351]: fsmap 5 up:standby 2024-09-21T05:50:20.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:19 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T05:50:20.873 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 05:50:20 smithi144 systemd[1]: Starting Ceph mds.f for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:50:21.222 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 05:50:20 smithi144 podman[62228]: 2024-09-21 05:50:20.837617808 +0000 UTC m=+0.015752932 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:50:21.223 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 05:50:20 smithi144 podman[62228]: 2024-09-21 05:50:20.968718322 +0000 UTC m=+0.146853488 container create fde8f51b11a717f0ba5c3d79e434f59337d641fa51c9bedc3eaece4a1369c17f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T05:50:21.223 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 05:50:21 smithi144 podman[62228]: 2024-09-21 05:50:21.221313583 +0000 UTC m=+0.399448708 container init fde8f51b11a717f0ba5c3d79e434f59337d641fa51c9bedc3eaece4a1369c17f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-f, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T05:50:21.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:50:21.623 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 05:50:21 smithi144 podman[62228]: 2024-09-21 05:50:21.224238111 +0000 UTC m=+0.402373239 container start fde8f51b11a717f0ba5c3d79e434f59337d641fa51c9bedc3eaece4a1369c17f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T05:50:21.623 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 05:50:21 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-f[62243]: starting mds.f at 2024-09-21T05:50:21.623 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 05:50:21 smithi144 bash[62228]: fde8f51b11a717f0ba5c3d79e434f59337d641fa51c9bedc3eaece4a1369c17f 2024-09-21T05:50:21.623 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 05:50:21 smithi144 systemd[1]: Started Ceph mds.f for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:50:21.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:21 smithi037 ceph-mon[30631]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:21.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:21.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:21.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:21.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:21.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:21.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:21 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:21.934 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:21 smithi144 ceph-mon[34351]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:21.934 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:21 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:21.934 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:21 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:21.934 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:21 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:21.934 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:21 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:21.934 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:21 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:21.934 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:21 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:21.992 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:21 smithi067 ceph-mon[34443]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:21 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:21 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:21 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:21 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:21 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:21 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.596+0000 7f614ea00640 1 -- 172.21.15.37:0/3766399177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61481094a0 msgr2=0x7f61481098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.596+0000 7f614ea00640 1 --2- 172.21.15.37:0/3766399177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61481094a0 0x7f61481098b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6130009900 tx=0x7f613002a3f0 comp rx=0 tx=0).stop 2024-09-21T05:50:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.596+0000 7f614ea00640 1 -- 172.21.15.37:0/3766399177 shutdown_connections 2024-09-21T05:50:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.596+0000 7f614ea00640 1 --2- 172.21.15.37:0/3766399177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6148109df0 0x7f6148110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.596+0000 7f614ea00640 1 --2- 172.21.15.37:0/3766399177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61481094a0 0x7f61481098b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.596+0000 7f614ea00640 1 --2- 172.21.15.37:0/3766399177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6148103b60 0x7f6148103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.596+0000 7f614ea00640 1 -- 172.21.15.37:0/3766399177 >> 172.21.15.37:0/3766399177 conn(0x7f614807b850 msgr2=0x7f614807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.596+0000 7f614ea00640 1 -- 172.21.15.37:0/3766399177 shutdown_connections 2024-09-21T05:50:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.596+0000 7f614ea00640 1 -- 172.21.15.37:0/3766399177 wait complete. 2024-09-21T05:50:22.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.597+0000 7f614ea00640 1 Processor -- start 2024-09-21T05:50:22.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.597+0000 7f614ea00640 1 -- start start 2024-09-21T05:50:22.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.598+0000 7f614ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6148103b60 0x7f614819c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:22.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.598+0000 7f614ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61481094a0 0x7f614819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:22.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.598+0000 7f614ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6148109df0 0x7f61481a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:22.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.598+0000 7f614ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6148113b00 con 0x7f61481094a0 2024-09-21T05:50:22.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.598+0000 7f614ea00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6148113980 con 0x7f6148109df0 2024-09-21T05:50:22.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.598+0000 7f614ea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6148113c80 con 0x7f6148103b60 2024-09-21T05:50:22.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.598+0000 7f6147e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6148103b60 0x7f614819c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:22.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.598+0000 7f613f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61481094a0 0x7f614819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:22.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.598+0000 7f6147e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6148103b60 0x7f614819c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:44248/0 (socket says 172.21.15.37:44248) 2024-09-21T05:50:22.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.598+0000 7f6147e00640 1 -- 172.21.15.37:0/1701638355 learned_addr learned my addr 172.21.15.37:0/1701638355 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.598+0000 7f614ca00640 1 --2- 172.21.15.37:0/1701638355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6148109df0 0x7f61481a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.599+0000 7f6147e00640 1 -- 172.21.15.37:0/1701638355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6148109df0 msgr2=0x7f61481a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.599+0000 7f6147e00640 1 --2- 172.21.15.37:0/1701638355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6148109df0 0x7f61481a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.599+0000 7f6147e00640 1 -- 172.21.15.37:0/1701638355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61481094a0 msgr2=0x7f614819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.599+0000 7f6147e00640 1 --2- 172.21.15.37:0/1701638355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61481094a0 0x7f614819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.599+0000 7f6147e00640 1 -- 172.21.15.37:0/1701638355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61481a2620 con 0x7f6148103b60 2024-09-21T05:50:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.599+0000 7f6147e00640 1 --2- 172.21.15.37:0/1701638355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6148103b60 0x7f614819c6b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f613800e9f0 tx=0x7f613800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.599+0000 7f6145600640 1 -- 172.21.15.37:0/1701638355 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613800cd80 con 0x7f6148103b60 2024-09-21T05:50:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.599+0000 7f6145600640 1 -- 172.21.15.37:0/1701638355 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61380108e0 con 0x7f6148103b60 2024-09-21T05:50:22.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.599+0000 7f614ea00640 1 -- 172.21.15.37:0/1701638355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61481a2910 con 0x7f6148103b60 2024-09-21T05:50:22.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.599+0000 7f6145600640 1 -- 172.21.15.37:0/1701638355 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138018980 con 0x7f6148103b60 2024-09-21T05:50:22.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.599+0000 7f614ea00640 1 -- 172.21.15.37:0/1701638355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61481a9070 con 0x7f6148103b60 2024-09-21T05:50:22.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.601+0000 7f614ea00640 1 -- 172.21.15.37:0/1701638355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6148103f70 con 0x7f6148103b60 2024-09-21T05:50:22.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.603+0000 7f6145600640 1 -- 172.21.15.37:0/1701638355 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f6138010430 con 0x7f6148103b60 2024-09-21T05:50:22.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.604+0000 7f6145600640 1 --2- 172.21.15.37:0/1701638355 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f612c0b6590 0x7f612c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:22.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.604+0000 7f6145600640 1 -- 172.21.15.37:0/1701638355 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f61380e7640 con 0x7f6148103b60 2024-09-21T05:50:22.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.604+0000 7f613f400640 1 --2- 172.21.15.37:0/1701638355 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f612c0b6590 0x7f612c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:22.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.605+0000 7f613f400640 1 --2- 172.21.15.37:0/1701638355 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f612c0b6590 0x7f612c0b8aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f613002a9e0 tx=0x7f6130005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:22.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.606+0000 7f6145600640 1 -- 172.21.15.37:0/1701638355 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61380b26b0 con 0x7f6148103b60 2024-09-21T05:50:22.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.843+0000 7f614ea00640 1 -- 172.21.15.37:0/1701638355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61481a9360 con 0x7f6148103b60 2024-09-21T05:50:22.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.844+0000 7f6145600640 1 -- 172.21.15.37:0/1701638355 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5566 (secure 0 0 0) 0x7f61380b75f0 con 0x7f6148103b60 2024-09-21T05:50:22.846 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:50:22.846 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"btime":"2024-09-21T05:50:21:674737+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T05:50:22.846 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2024-09-21T05:50:22.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.846+0000 7f614ea00640 1 -- 172.21.15.37:0/1701638355 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f612c0b6590 msgr2=0x7f612c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:22.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.846+0000 7f614ea00640 1 --2- 172.21.15.37:0/1701638355 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f612c0b6590 0x7f612c0b8aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f613002a9e0 tx=0x7f6130005a20 comp rx=0 tx=0).stop 2024-09-21T05:50:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.846+0000 7f614ea00640 1 -- 172.21.15.37:0/1701638355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6148103b60 msgr2=0x7f614819c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.846+0000 7f614ea00640 1 --2- 172.21.15.37:0/1701638355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6148103b60 0x7f614819c6b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f613800e9f0 tx=0x7f613800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:50:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.846+0000 7f614ea00640 1 -- 172.21.15.37:0/1701638355 shutdown_connections 2024-09-21T05:50:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.846+0000 7f614ea00640 1 --2- 172.21.15.37:0/1701638355 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f612c0b6590 0x7f612c0b8aa0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.846+0000 7f614ea00640 1 --2- 172.21.15.37:0/1701638355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6148109df0 0x7f61481a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.846+0000 7f614ea00640 1 --2- 172.21.15.37:0/1701638355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61481094a0 0x7f614819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.846+0000 7f614ea00640 1 --2- 172.21.15.37:0/1701638355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6148103b60 0x7f614819c6b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.846+0000 7f614ea00640 1 -- 172.21.15.37:0/1701638355 >> 172.21.15.37:0/1701638355 conn(0x7f614807b850 msgr2=0x7f61481072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.846+0000 7f614ea00640 1 -- 172.21.15.37:0/1701638355 shutdown_connections 2024-09-21T05:50:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:22.846+0000 7f614ea00640 1 -- 172.21.15.37:0/1701638355 wait complete. 2024-09-21T05:50:22.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:22 smithi144 ceph-mon[34351]: Deploying daemon mds.c on smithi144 2024-09-21T05:50:22.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:22 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.144:6834/3872897790,v1:172.21.15.144:6835/3872897790] up:boot 2024-09-21T05:50:22.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:22 smithi144 ceph-mon[34351]: fsmap 6 up:standby 2024-09-21T05:50:22.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:22 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T05:50:22.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:22 smithi067 ceph-mon[34443]: Deploying daemon mds.c on smithi144 2024-09-21T05:50:22.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:22 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.144:6834/3872897790,v1:172.21.15.144:6835/3872897790] up:boot 2024-09-21T05:50:22.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:22 smithi067 ceph-mon[34443]: fsmap 6 up:standby 2024-09-21T05:50:22.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:22 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T05:50:23.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:22 smithi037 ceph-mon[30631]: Deploying daemon mds.c on smithi144 2024-09-21T05:50:23.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:22 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.144:6834/3872897790,v1:172.21.15.144:6835/3872897790] up:boot 2024-09-21T05:50:23.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:22 smithi037 ceph-mon[30631]: fsmap 6 up:standby 2024-09-21T05:50:23.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:22 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T05:50:23.623 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 05:50:23 smithi144 systemd[1]: Starting Ceph mds.c for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:50:23.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:23 smithi037 ceph-mon[30631]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:23.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:23 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1701638355' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:23.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:23 smithi144 ceph-mon[34351]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:23.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:23 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1701638355' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:23.921 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 05:50:23 smithi144 podman[62497]: 2024-09-21 05:50:23.530075864 +0000 UTC m=+0.015927326 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:50:23.921 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 05:50:23 smithi144 podman[62497]: 2024-09-21 05:50:23.65796105 +0000 UTC m=+0.143812514 container create 528f81ce7b5263115101268bac42c0e92907da7ccb83fb9961ff861917550c92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-c, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T05:50:23.921 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 05:50:23 smithi144 podman[62497]: 2024-09-21 05:50:23.919569485 +0000 UTC m=+0.405420950 container init 528f81ce7b5263115101268bac42c0e92907da7ccb83fb9961ff861917550c92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:50:23.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:23 smithi067 ceph-mon[34443]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:23.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:23 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1701638355' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:24.373 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 05:50:23 smithi144 podman[62497]: 2024-09-21 05:50:23.922297392 +0000 UTC m=+0.408148856 container start 528f81ce7b5263115101268bac42c0e92907da7ccb83fb9961ff861917550c92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T05:50:24.373 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 05:50:23 smithi144 ceph-mds[62516]: -- 172.21.15.144:0/2963895517 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d0aeb39860 con 0x55d0b2ce1180 2024-09-21T05:50:24.373 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 05:50:23 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-c[62512]: starting mds.c at 2024-09-21T05:50:24.373 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 05:50:24 smithi144 bash[62497]: 528f81ce7b5263115101268bac42c0e92907da7ccb83fb9961ff861917550c92 2024-09-21T05:50:24.373 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 05:50:24 smithi144 systemd[1]: Started Ceph mds.c for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:50:25.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:25 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:25.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:25 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:25.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:25 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:25.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:25 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:25.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:25 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:25.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:25 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:25.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:25 smithi144 ceph-mon[34351]: Deploying daemon mds.h on smithi067 2024-09-21T05:50:25.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:25 smithi144 ceph-mon[34351]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:25.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:25 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.144:6836/1687841256,v1:172.21.15.144:6837/1687841256] up:boot 2024-09-21T05:50:25.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:25 smithi144 ceph-mon[34351]: fsmap 7 up:standby 2024-09-21T05:50:25.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:25 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T05:50:25.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:25 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:25.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:25 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:25.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:25 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:25.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:25 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:25.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:25 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:25.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:25 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:25.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:25 smithi037 ceph-mon[30631]: Deploying daemon mds.h on smithi067 2024-09-21T05:50:25.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:25 smithi037 ceph-mon[30631]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:25.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:25 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.144:6836/1687841256,v1:172.21.15.144:6837/1687841256] up:boot 2024-09-21T05:50:25.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:25 smithi037 ceph-mon[30631]: fsmap 7 up:standby 2024-09-21T05:50:25.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:25 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T05:50:25.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:25 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:25.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:25 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:25.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:25 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:25.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:25 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:25.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:25 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:25.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:25 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:25.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:25 smithi067 ceph-mon[34443]: Deploying daemon mds.h on smithi067 2024-09-21T05:50:25.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:25 smithi067 ceph-mon[34443]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:25.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:25 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.144:6836/1687841256,v1:172.21.15.144:6837/1687841256] up:boot 2024-09-21T05:50:25.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:25 smithi067 ceph-mon[34443]: fsmap 7 up:standby 2024-09-21T05:50:25.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:25 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T05:50:25.611 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:50:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:26.246 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 05:50:26 smithi067 systemd[1]: Starting Ceph mds.h for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:50:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.585+0000 7f9686000640 1 -- 172.21.15.37:0/421035832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968010b6f0 msgr2=0x7f968010bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.585+0000 7f9686000640 1 --2- 172.21.15.37:0/421035832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968010b6f0 0x7f968010bb00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9668009ca0 tx=0x7f966802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:50:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.586+0000 7f9686000640 1 -- 172.21.15.37:0/421035832 shutdown_connections 2024-09-21T05:50:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.586+0000 7f9686000640 1 --2- 172.21.15.37:0/421035832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f968010c040 0x7f9680112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.586+0000 7f9686000640 1 --2- 172.21.15.37:0/421035832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968010b6f0 0x7f968010bb00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.586+0000 7f9686000640 1 --2- 172.21.15.37:0/421035832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9680105db0 0x7f96801061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.586+0000 7f9686000640 1 -- 172.21.15.37:0/421035832 >> 172.21.15.37:0/421035832 conn(0x7f96801017e0 msgr2=0x7f9680103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.586+0000 7f9686000640 1 -- 172.21.15.37:0/421035832 shutdown_connections 2024-09-21T05:50:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.586+0000 7f9686000640 1 -- 172.21.15.37:0/421035832 wait complete. 2024-09-21T05:50:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.587+0000 7f9686000640 1 Processor -- start 2024-09-21T05:50:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.587+0000 7f9686000640 1 -- start start 2024-09-21T05:50:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.587+0000 7f9686000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9680105db0 0x7f968019c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.587+0000 7f9686000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968010b6f0 0x7f968019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.587+0000 7f9686000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f968010c040 0x7f96801a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.587+0000 7f9686000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9680115d50 con 0x7f9680105db0 2024-09-21T05:50:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.587+0000 7f9686000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9680115bd0 con 0x7f968010b6f0 2024-09-21T05:50:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.588+0000 7f9686000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9680115ed0 con 0x7f968010c040 2024-09-21T05:50:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.588+0000 7f967f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9680105db0 0x7f968019c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.588+0000 7f967f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9680105db0 0x7f968019c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43990/0 (socket says 172.21.15.37:43990) 2024-09-21T05:50:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.588+0000 7f967f400640 1 -- 172.21.15.37:0/1867389016 learned_addr learned my addr 172.21.15.37:0/1867389016 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.588+0000 7f9676a00640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968010b6f0 0x7f968019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.588+0000 7f967fe00640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f968010c040 0x7f96801a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.588+0000 7f967f400640 1 -- 172.21.15.37:0/1867389016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f968010c040 msgr2=0x7f96801a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.588+0000 7f967f400640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f968010c040 0x7f96801a1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.588+0000 7f967f400640 1 -- 172.21.15.37:0/1867389016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968010b6f0 msgr2=0x7f968019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.588+0000 7f967f400640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968010b6f0 0x7f968019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.588+0000 7f967f400640 1 -- 172.21.15.37:0/1867389016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96801a26f0 con 0x7f9680105db0 2024-09-21T05:50:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.589+0000 7f967f400640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9680105db0 0x7f968019c780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f967000e9f0 tx=0x7f967000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.589+0000 7f967cc00640 1 -- 172.21.15.37:0/1867389016 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967000cd80 con 0x7f9680105db0 2024-09-21T05:50:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.589+0000 7f967cc00640 1 -- 172.21.15.37:0/1867389016 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96700108e0 con 0x7f9680105db0 2024-09-21T05:50:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.589+0000 7f9686000640 1 -- 172.21.15.37:0/1867389016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96801a29e0 con 0x7f9680105db0 2024-09-21T05:50:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.589+0000 7f967cc00640 1 -- 172.21.15.37:0/1867389016 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670018980 con 0x7f9680105db0 2024-09-21T05:50:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.589+0000 7f9686000640 1 -- 172.21.15.37:0/1867389016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96801a9140 con 0x7f9680105db0 2024-09-21T05:50:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.590+0000 7f9686000640 1 -- 172.21.15.37:0/1867389016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96801061c0 con 0x7f9680105db0 2024-09-21T05:50:26.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.593+0000 7f967cc00640 1 -- 172.21.15.37:0/1867389016 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f9670010430 con 0x7f9680105db0 2024-09-21T05:50:26.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.594+0000 7f967cc00640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f96640b6510 0x7f96640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:26.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.594+0000 7f967cc00640 1 -- 172.21.15.37:0/1867389016 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f96700e76a0 con 0x7f9680105db0 2024-09-21T05:50:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.594+0000 7f9676a00640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f96640b6510 0x7f96640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.595+0000 7f9676a00640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f96640b6510 0x7f96640b8a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9668000f80 tx=0x7f9668005fd0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:26.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.597+0000 7f967cc00640 1 -- 172.21.15.37:0/1867389016 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f96700b2710 con 0x7f9680105db0 2024-09-21T05:50:26.655 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 05:50:26 smithi067 podman[62498]: 2024-09-21 05:50:26.285174367 +0000 UTC m=+0.016329822 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:50:26.655 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 05:50:26 smithi067 podman[62498]: 2024-09-21 05:50:26.401030529 +0000 UTC m=+0.132185972 container create e4a148a54a25c66c489601a46631fe457fe5920d2910bbdde5f44a577caa4d89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-h, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T05:50:26.655 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 05:50:26 smithi067 podman[62498]: 2024-09-21 05:50:26.653913208 +0000 UTC m=+0.385068653 container init e4a148a54a25c66c489601a46631fe457fe5920d2910bbdde5f44a577caa4d89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-h, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T05:50:26.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.837+0000 7f9686000640 1 -- 172.21.15.37:0/1867389016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f968002e640 con 0x7f9680105db0 2024-09-21T05:50:26.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.837+0000 7f967cc00640 1 -- 172.21.15.37:0/1867389016 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f96700b7650 con 0x7f9680105db0 2024-09-21T05:50:26.840 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:50:26.840 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"btime":"2024-09-21T05:50:24:688979+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T05:50:26.840 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-09-21T05:50:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.840+0000 7f9686000640 1 -- 172.21.15.37:0/1867389016 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f96640b6510 msgr2=0x7f96640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.840+0000 7f9686000640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f96640b6510 0x7f96640b8a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9668000f80 tx=0x7f9668005fd0 comp rx=0 tx=0).stop 2024-09-21T05:50:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.840+0000 7f9686000640 1 -- 172.21.15.37:0/1867389016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9680105db0 msgr2=0x7f968019c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.840+0000 7f9686000640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9680105db0 0x7f968019c780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f967000e9f0 tx=0x7f967000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:50:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.840+0000 7f9686000640 1 -- 172.21.15.37:0/1867389016 shutdown_connections 2024-09-21T05:50:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.840+0000 7f9686000640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f968010c040 0x7f96801a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.840+0000 7f9686000640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f96640b6510 0x7f96640b8a20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.840+0000 7f9686000640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f968010b6f0 0x7f968019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.840+0000 7f9686000640 1 --2- 172.21.15.37:0/1867389016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9680105db0 0x7f968019c780 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.840+0000 7f9686000640 1 -- 172.21.15.37:0/1867389016 >> 172.21.15.37:0/1867389016 conn(0x7f96801017e0 msgr2=0x7f968010ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.840+0000 7f9686000640 1 -- 172.21.15.37:0/1867389016 shutdown_connections 2024-09-21T05:50:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:26.840+0000 7f9686000640 1 -- 172.21.15.37:0/1867389016 wait complete. 2024-09-21T05:50:26.996 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 05:50:26 smithi067 podman[62498]: 2024-09-21 05:50:26.656934566 +0000 UTC m=+0.388090012 container start e4a148a54a25c66c489601a46631fe457fe5920d2910bbdde5f44a577caa4d89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-h, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T05:50:26.997 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 05:50:26 smithi067 ceph-mds[62517]: -- 172.21.15.67:0/2968110451 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56204bb79860 con 0x56204fd21a80 2024-09-21T05:50:26.997 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 05:50:26 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-h[62513]: starting mds.h at 2024-09-21T05:50:26.997 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 05:50:26 smithi067 bash[62498]: e4a148a54a25c66c489601a46631fe457fe5920d2910bbdde5f44a577caa4d89 2024-09-21T05:50:26.997 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 05:50:26 smithi067 systemd[1]: Started Ceph mds.h for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:50:28.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:27 smithi144 ceph-mon[34351]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:28.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:27 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:28.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:27 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:28.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:27 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:28.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:27 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:28.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:27 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:28.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:27 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:28.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:27 smithi144 ceph-mon[34351]: Deploying daemon mds.i on smithi144 2024-09-21T05:50:28.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:27 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1867389016' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:28.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:27 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.67:6836/2398426210,v1:172.21.15.67:6837/2398426210] up:boot 2024-09-21T05:50:28.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:27 smithi144 ceph-mon[34351]: fsmap 8 up:standby 2024-09-21T05:50:28.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:27 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T05:50:28.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:27 smithi037 ceph-mon[30631]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:28.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:27 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:28.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:27 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:28.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:27 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:28.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:27 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:28.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:27 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:28.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:27 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:28.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:27 smithi037 ceph-mon[30631]: Deploying daemon mds.i on smithi144 2024-09-21T05:50:28.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:27 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1867389016' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:28.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:27 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.67:6836/2398426210,v1:172.21.15.67:6837/2398426210] up:boot 2024-09-21T05:50:28.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:27 smithi037 ceph-mon[30631]: fsmap 8 up:standby 2024-09-21T05:50:28.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:27 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T05:50:28.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:27 smithi067 ceph-mon[34443]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:28.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:27 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:28.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:27 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:28.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:27 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:28.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:27 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:28.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:27 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:28.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:27 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:28.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:27 smithi067 ceph-mon[34443]: Deploying daemon mds.i on smithi144 2024-09-21T05:50:28.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:27 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1867389016' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:28.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:27 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.67:6836/2398426210,v1:172.21.15.67:6837/2398426210] up:boot 2024-09-21T05:50:28.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:27 smithi067 ceph-mon[34443]: fsmap 8 up:standby 2024-09-21T05:50:28.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:27 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T05:50:29.037 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 05:50:28 smithi144 systemd[1]: Starting Ceph mds.i for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:50:29.319 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 05:50:29 smithi144 podman[62769]: 2024-09-21 05:50:28.938427714 +0000 UTC m=+0.016081962 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:50:29.319 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 05:50:29 smithi144 podman[62769]: 2024-09-21 05:50:29.089582577 +0000 UTC m=+0.167236817 container create 22dbfef21f1f9d12a654a1c1721590dfe9f41bea8ae4874d19c2bfd7c727cd99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-i, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:50:29.319 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 05:50:29 smithi144 podman[62769]: 2024-09-21 05:50:29.317374317 +0000 UTC m=+0.395028558 container init 22dbfef21f1f9d12a654a1c1721590dfe9f41bea8ae4874d19c2bfd7c727cd99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-i, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T05:50:29.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:50:29.623 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 05:50:29 smithi144 podman[62769]: 2024-09-21 05:50:29.320319932 +0000 UTC m=+0.397974181 container start 22dbfef21f1f9d12a654a1c1721590dfe9f41bea8ae4874d19c2bfd7c727cd99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T05:50:29.623 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 05:50:29 smithi144 ceph-mds[62787]: -- 172.21.15.144:0/2896073568 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e75a3a9860 con 0x55e75e551600 2024-09-21T05:50:29.623 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 05:50:29 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-i[62783]: starting mds.i at 2024-09-21T05:50:29.623 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 05:50:29 smithi144 bash[62769]: 22dbfef21f1f9d12a654a1c1721590dfe9f41bea8ae4874d19c2bfd7c727cd99 2024-09-21T05:50:29.623 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 05:50:29 smithi144 systemd[1]: Started Ceph mds.i for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:50:29.919 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:30.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:29 smithi037 ceph-mon[30631]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:30.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:29 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:30.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:29 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:30.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:29 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:30.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:29 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:30.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:29 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:30.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:29 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:30.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:29 smithi144 ceph-mon[34351]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:30.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:29 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:30.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:29 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:30.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:29 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:30.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:29 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:30.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:29 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:30.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:29 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:30.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:29 smithi067 ceph-mon[34443]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:30.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:29 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:30.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:29 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:30.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:29 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:30.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:29 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:30.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:29 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:30.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:29 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.834+0000 7f97c6400640 1 -- 172.21.15.37:0/327324442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c0102f20 msgr2=0x7f97c010fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.834+0000 7f97c6400640 1 --2- 172.21.15.37:0/327324442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c0102f20 0x7f97c010fc40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009900 tx=0x7f97ac02a480 comp rx=0 tx=0).stop 2024-09-21T05:50:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.834+0000 7f97c6400640 1 -- 172.21.15.37:0/327324442 shutdown_connections 2024-09-21T05:50:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.834+0000 7f97c6400640 1 --2- 172.21.15.37:0/327324442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97c0110180 0x7f97c01125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.834+0000 7f97c6400640 1 --2- 172.21.15.37:0/327324442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c0102f20 0x7f97c010fc40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.834+0000 7f97c6400640 1 --2- 172.21.15.37:0/327324442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c01025d0 0x7f97c01029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.834+0000 7f97c6400640 1 -- 172.21.15.37:0/327324442 >> 172.21.15.37:0/327324442 conn(0x7f97c0079760 msgr2=0x7f97c0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.834+0000 7f97c6400640 1 -- 172.21.15.37:0/327324442 shutdown_connections 2024-09-21T05:50:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.834+0000 7f97c6400640 1 -- 172.21.15.37:0/327324442 wait complete. 2024-09-21T05:50:30.838 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:30 smithi037 ceph-mon[30631]: Deploying daemon mds.g on smithi037 2024-09-21T05:50:30.838 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:30 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.144:6838/2186109815,v1:172.21.15.144:6839/2186109815] up:boot 2024-09-21T05:50:30.838 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:30 smithi037 ceph-mon[30631]: fsmap 9 up:standby 2024-09-21T05:50:30.838 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:30 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T05:50:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.836+0000 7f97c6400640 1 Processor -- start 2024-09-21T05:50:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.836+0000 7f97c6400640 1 -- start start 2024-09-21T05:50:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.836+0000 7f97c6400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97c01025d0 0x7f97c019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.836+0000 7f97c6400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c0102f20 0x7f97c019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.836+0000 7f97c6400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c0110180 0x7f97c01a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.836+0000 7f97c6400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0115cc0 con 0x7f97c0110180 2024-09-21T05:50:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.836+0000 7f97c6400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0115b40 con 0x7f97c0102f20 2024-09-21T05:50:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.836+0000 7f97c6400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0115e40 con 0x7f97c01025d0 2024-09-21T05:50:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.837+0000 7f97bea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c0102f20 0x7f97c019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.837+0000 7f97bea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c0102f20 0x7f97c019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:54002/0 (socket says 172.21.15.37:54002) 2024-09-21T05:50:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.837+0000 7f97bea00640 1 -- 172.21.15.37:0/1463924269 learned_addr learned my addr 172.21.15.37:0/1463924269 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.837+0000 7f97bf400640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97c01025d0 0x7f97c019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.837+0000 7f97bfe00640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c0110180 0x7f97c01a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.837+0000 7f97bf400640 1 -- 172.21.15.37:0/1463924269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c0102f20 msgr2=0x7f97c019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.837+0000 7f97bf400640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c0102f20 0x7f97c019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.837+0000 7f97bf400640 1 -- 172.21.15.37:0/1463924269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c0110180 msgr2=0x7f97c01a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.837+0000 7f97bf400640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c0110180 0x7f97c01a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.837+0000 7f97bf400640 1 -- 172.21.15.37:0/1463924269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c01a25e0 con 0x7f97c01025d0 2024-09-21T05:50:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.837+0000 7f97bfe00640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c0110180 0x7f97c01a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:50:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.838+0000 7f97bf400640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97c01025d0 0x7f97c019c670 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f97b000e9f0 tx=0x7f97b000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.838+0000 7f97b7e00640 1 -- 172.21.15.37:0/1463924269 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b000ccc0 con 0x7f97c01025d0 2024-09-21T05:50:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.838+0000 7f97b7e00640 1 -- 172.21.15.37:0/1463924269 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97b00108e0 con 0x7f97c01025d0 2024-09-21T05:50:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.838+0000 7f97c6400640 1 -- 172.21.15.37:0/1463924269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c01a28d0 con 0x7f97c01025d0 2024-09-21T05:50:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.838+0000 7f97b7e00640 1 -- 172.21.15.37:0/1463924269 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0018880 con 0x7f97c01025d0 2024-09-21T05:50:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.838+0000 7f97c6400640 1 -- 172.21.15.37:0/1463924269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c01a9030 con 0x7f97c01025d0 2024-09-21T05:50:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.839+0000 7f97c6400640 1 -- 172.21.15.37:0/1463924269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c006c2c0 con 0x7f97c01025d0 2024-09-21T05:50:30.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.841+0000 7f97b7e00640 1 -- 172.21.15.37:0/1463924269 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f97b0010430 con 0x7f97c01025d0 2024-09-21T05:50:30.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.843+0000 7f97b7e00640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f97a40b6590 0x7f97a40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:30.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.843+0000 7f97b7e00640 1 -- 172.21.15.37:0/1463924269 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f97b00e71a0 con 0x7f97c01025d0 2024-09-21T05:50:30.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.843+0000 7f97bea00640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f97a40b6590 0x7f97a40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:30.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.844+0000 7f97bea00640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f97a40b6590 0x7f97a40b8aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f97c0104000 tx=0x7f97ac005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:30.847+0000 7f97b7e00640 1 -- 172.21.15.37:0/1463924269 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f97b00b2210 con 0x7f97c01025d0 2024-09-21T05:50:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.088+0000 7f97c6400640 1 -- 172.21.15.37:0/1463924269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97c01029e0 con 0x7f97c01025d0 2024-09-21T05:50:31.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.088+0000 7f97b7e00640 1 -- 172.21.15.37:0/1463924269 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8049 (secure 0 0 0) 0x7f97b00b7150 con 0x7f97c01025d0 2024-09-21T05:50:31.091 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:50:31.091 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"btime":"2024-09-21T05:50:29:814207+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24706,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T05:50:31.091 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 10 2024-09-21T05:50:31.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.091+0000 7f97c6400640 1 -- 172.21.15.37:0/1463924269 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f97a40b6590 msgr2=0x7f97a40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:31.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.091+0000 7f97c6400640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f97a40b6590 0x7f97a40b8aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f97c0104000 tx=0x7f97ac005a20 comp rx=0 tx=0).stop 2024-09-21T05:50:31.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.091+0000 7f97c6400640 1 -- 172.21.15.37:0/1463924269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97c01025d0 msgr2=0x7f97c019c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:31.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.091+0000 7f97c6400640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97c01025d0 0x7f97c019c670 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f97b000e9f0 tx=0x7f97b000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:50:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.091+0000 7f97c6400640 1 -- 172.21.15.37:0/1463924269 shutdown_connections 2024-09-21T05:50:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.091+0000 7f97c6400640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c0110180 0x7f97c01a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.091+0000 7f97c6400640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f97a40b6590 0x7f97a40b8aa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.091+0000 7f97c6400640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c0102f20 0x7f97c019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.091+0000 7f97c6400640 1 --2- 172.21.15.37:0/1463924269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97c01025d0 0x7f97c019c670 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.091+0000 7f97c6400640 1 -- 172.21.15.37:0/1463924269 >> 172.21.15.37:0/1463924269 conn(0x7f97c0079760 msgr2=0x7f97c0108bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.091+0000 7f97c6400640 1 -- 172.21.15.37:0/1463924269 shutdown_connections 2024-09-21T05:50:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:31.091+0000 7f97c6400640 1 -- 172.21.15.37:0/1463924269 wait complete. 2024-09-21T05:50:31.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:30 smithi144 ceph-mon[34351]: Deploying daemon mds.g on smithi037 2024-09-21T05:50:31.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:30 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.144:6838/2186109815,v1:172.21.15.144:6839/2186109815] up:boot 2024-09-21T05:50:31.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:30 smithi144 ceph-mon[34351]: fsmap 9 up:standby 2024-09-21T05:50:31.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:30 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T05:50:31.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:30 smithi067 ceph-mon[34443]: Deploying daemon mds.g on smithi037 2024-09-21T05:50:31.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:30 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.144:6838/2186109815,v1:172.21.15.144:6839/2186109815] up:boot 2024-09-21T05:50:31.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:30 smithi067 ceph-mon[34443]: fsmap 9 up:standby 2024-09-21T05:50:31.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:30 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T05:50:32.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:31 smithi144 ceph-mon[34351]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:32.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:31 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1463924269' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:32.152 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:31 smithi037 ceph-mon[30631]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:32.152 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:31 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1463924269' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:32.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:31 smithi067 ceph-mon[34443]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:32.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:31 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1463924269' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:33.551 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 05:50:33 smithi037 systemd[1]: Starting Ceph mds.g for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:50:33.829 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 05:50:33 smithi037 podman[69545]: 2024-09-21 05:50:33.453916823 +0000 UTC m=+0.027782657 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:50:33.829 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 05:50:33 smithi037 podman[69545]: 2024-09-21 05:50:33.574731377 +0000 UTC m=+0.148597205 container create 171307452f4f41c6a2ac1c67fc83a3e3509f10c6084cc99294a0b6fdb5ad1bda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-g, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T05:50:34.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:33 smithi144 ceph-mon[34351]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:34.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:33 smithi037 ceph-mon[30631]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:34.164 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 05:50:33 smithi037 podman[69545]: 2024-09-21 05:50:33.827583107 +0000 UTC m=+0.401448931 container init 171307452f4f41c6a2ac1c67fc83a3e3509f10c6084cc99294a0b6fdb5ad1bda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-g, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:50:34.164 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 05:50:33 smithi037 podman[69545]: 2024-09-21 05:50:33.834546886 +0000 UTC m=+0.408412709 container start 171307452f4f41c6a2ac1c67fc83a3e3509f10c6084cc99294a0b6fdb5ad1bda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-g, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T05:50:34.165 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 05:50:33 smithi037 ceph-mds[69564]: -- 172.21.15.37:0/1708728681 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55958e679860 con 0x559592821600 2024-09-21T05:50:34.165 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 05:50:33 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-g[69560]: starting mds.g at 2024-09-21T05:50:34.165 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 05:50:33 smithi037 bash[69545]: 171307452f4f41c6a2ac1c67fc83a3e3509f10c6084cc99294a0b6fdb5ad1bda 2024-09-21T05:50:34.165 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 05:50:33 smithi037 systemd[1]: Started Ceph mds.g for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:50:34.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:33 smithi067 ceph-mon[34443]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:34.414 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:50:35.288 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:35.308 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:35 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:35.308 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:35 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:35.308 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:35 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:35.308 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:35 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:35.309 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:35 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:35.309 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:35 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:35.309 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:35 smithi067 ceph-mon[34443]: Deploying daemon mds.a on smithi037 2024-09-21T05:50:35.309 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:35 smithi067 ceph-mon[34443]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:35.309 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:35 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.37:6838/2136415371,v1:172.21.15.37:6839/2136415371] up:boot 2024-09-21T05:50:35.309 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:35 smithi067 ceph-mon[34443]: fsmap 10 up:standby 2024-09-21T05:50:35.309 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:35 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T05:50:35.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:35 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:35.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:35 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:35.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:35 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:35.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:35 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:35.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:35 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:35.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:35 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:35.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:35 smithi144 ceph-mon[34351]: Deploying daemon mds.a on smithi037 2024-09-21T05:50:35.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:35 smithi144 ceph-mon[34351]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:35.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:35 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.37:6838/2136415371,v1:172.21.15.37:6839/2136415371] up:boot 2024-09-21T05:50:35.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:35 smithi144 ceph-mon[34351]: fsmap 10 up:standby 2024-09-21T05:50:35.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:35 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T05:50:35.409 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:35 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:35.409 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:35 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:35.409 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:35 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:35.409 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:35 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:35.409 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:35 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:35.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:35 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:35.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:35 smithi037 ceph-mon[30631]: Deploying daemon mds.a on smithi037 2024-09-21T05:50:35.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:35 smithi037 ceph-mon[30631]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:35.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:35 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.37:6838/2136415371,v1:172.21.15.37:6839/2136415371] up:boot 2024-09-21T05:50:35.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:35 smithi037 ceph-mon[30631]: fsmap 10 up:standby 2024-09-21T05:50:35.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:35 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T05:50:36.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.465+0000 7f0eaa400640 1 -- 172.21.15.37:0/2555107498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ea4103b60 msgr2=0x7f0ea4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:36.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.465+0000 7f0eaa400640 1 --2- 172.21.15.37:0/2555107498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ea4103b60 0x7f0ea4103f70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009860 tx=0x7f0e9402a340 comp rx=0 tx=0).stop 2024-09-21T05:50:36.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.465+0000 7f0eaa400640 1 -- 172.21.15.37:0/2555107498 shutdown_connections 2024-09-21T05:50:36.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.465+0000 7f0eaa400640 1 --2- 172.21.15.37:0/2555107498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea4109df0 0x7f0ea4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.465+0000 7f0eaa400640 1 --2- 172.21.15.37:0/2555107498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea41094a0 0x7f0ea41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.465+0000 7f0eaa400640 1 --2- 172.21.15.37:0/2555107498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ea4103b60 0x7f0ea4103f70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.465+0000 7f0eaa400640 1 -- 172.21.15.37:0/2555107498 >> 172.21.15.37:0/2555107498 conn(0x7f0ea407b850 msgr2=0x7f0ea407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:36.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.465+0000 7f0eaa400640 1 -- 172.21.15.37:0/2555107498 shutdown_connections 2024-09-21T05:50:36.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.465+0000 7f0eaa400640 1 -- 172.21.15.37:0/2555107498 wait complete. 2024-09-21T05:50:36.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.467+0000 7f0eaa400640 1 Processor -- start 2024-09-21T05:50:36.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.467+0000 7f0eaa400640 1 -- start start 2024-09-21T05:50:36.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0eaa400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea4103b60 0x7f0ea4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:36.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0eaa400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea41094a0 0x7f0ea4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:36.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0eaa400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ea4109df0 0x7f0ea4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:36.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0eaa400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea4113ab0 con 0x7f0ea41094a0 2024-09-21T05:50:36.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0eaa400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea4113930 con 0x7f0ea4109df0 2024-09-21T05:50:36.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0eaa400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea4113c30 con 0x7f0ea4103b60 2024-09-21T05:50:36.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0ea3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea4103b60 0x7f0ea4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0ea3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea4103b60 0x7f0ea4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:54370/0 (socket says 172.21.15.37:54370) 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0ea3400640 1 -- 172.21.15.37:0/1579696026 learned_addr learned my addr 172.21.15.37:0/1579696026 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0ea2a00640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea41094a0 0x7f0ea4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0ea3e00640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ea4109df0 0x7f0ea4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0ea3400640 1 -- 172.21.15.37:0/1579696026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ea4109df0 msgr2=0x7f0ea4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0ea3400640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ea4109df0 0x7f0ea4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0ea3400640 1 -- 172.21.15.37:0/1579696026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea41094a0 msgr2=0x7f0ea4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0ea3400640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea41094a0 0x7f0ea4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.468+0000 7f0ea3400640 1 -- 172.21.15.37:0/1579696026 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea41a8760 con 0x7f0ea4103b60 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.469+0000 7f0ea3400640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea4103b60 0x7f0ea4075710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0e94035040 tx=0x7f0e94032dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.469+0000 7f0e9be00640 1 -- 172.21.15.37:0/1579696026 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94037040 con 0x7f0ea4103b60 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.469+0000 7f0e9be00640 1 -- 172.21.15.37:0/1579696026 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e94041070 con 0x7f0ea4103b60 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.469+0000 7f0eaa400640 1 -- 172.21.15.37:0/1579696026 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea41a89f0 con 0x7f0ea4103b60 2024-09-21T05:50:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.469+0000 7f0e9be00640 1 -- 172.21.15.37:0/1579696026 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94003850 con 0x7f0ea4103b60 2024-09-21T05:50:36.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.469+0000 7f0eaa400640 1 -- 172.21.15.37:0/1579696026 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea41a8e70 con 0x7f0ea4103b60 2024-09-21T05:50:36.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.470+0000 7f0eaa400640 1 -- 172.21.15.37:0/1579696026 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea4103f70 con 0x7f0ea4103b60 2024-09-21T05:50:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.473+0000 7f0e9be00640 1 -- 172.21.15.37:0/1579696026 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f0e94004050 con 0x7f0ea4103b60 2024-09-21T05:50:36.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.474+0000 7f0e9be00640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0e880b6510 0x7f0e880b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:36.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.474+0000 7f0e9be00640 1 -- 172.21.15.37:0/1579696026 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f0e94106cd0 con 0x7f0ea4103b60 2024-09-21T05:50:36.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.474+0000 7f0ea2a00640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0e880b6510 0x7f0e880b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:36.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.475+0000 7f0ea2a00640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0e880b6510 0x7f0e880b8a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4106530 tx=0x7f0e9000b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:36.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.476+0000 7f0e9be00640 1 -- 172.21.15.37:0/1579696026 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e940cd960 con 0x7f0ea4103b60 2024-09-21T05:50:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.737+0000 7f0eaa400640 1 -- 172.21.15.37:0/1579696026 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ea402e640 con 0x7f0ea4103b60 2024-09-21T05:50:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.738+0000 7f0e9be00640 1 -- 172.21.15.37:0/1579696026 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7f0e940d1d40 con 0x7f0ea4103b60 2024-09-21T05:50:36.741 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:50:36.741 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":11,"btime":"2024-09-21T05:50:34:834806+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24706,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T05:50:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 11 2024-09-21T05:50:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.741+0000 7f0eaa400640 1 -- 172.21.15.37:0/1579696026 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0e880b6510 msgr2=0x7f0e880b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.741+0000 7f0eaa400640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0e880b6510 0x7f0e880b8a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4106530 tx=0x7f0e9000b410 comp rx=0 tx=0).stop 2024-09-21T05:50:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.741+0000 7f0eaa400640 1 -- 172.21.15.37:0/1579696026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea4103b60 msgr2=0x7f0ea4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.741+0000 7f0eaa400640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea4103b60 0x7f0ea4075710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0e94035040 tx=0x7f0e94032dc0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.741+0000 7f0eaa400640 1 -- 172.21.15.37:0/1579696026 shutdown_connections 2024-09-21T05:50:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.741+0000 7f0eaa400640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0e880b6510 0x7f0e880b8a20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.741+0000 7f0eaa400640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ea4109df0 0x7f0ea4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.741+0000 7f0eaa400640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea41094a0 0x7f0ea4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.741+0000 7f0eaa400640 1 --2- 172.21.15.37:0/1579696026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea4103b60 0x7f0ea4075710 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.741+0000 7f0eaa400640 1 -- 172.21.15.37:0/1579696026 >> 172.21.15.37:0/1579696026 conn(0x7f0ea407b850 msgr2=0x7f0ea4107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.742+0000 7f0eaa400640 1 -- 172.21.15.37:0/1579696026 shutdown_connections 2024-09-21T05:50:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:36.742+0000 7f0eaa400640 1 -- 172.21.15.37:0/1579696026 wait complete. 2024-09-21T05:50:37.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:37 smithi037 ceph-mon[30631]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:37.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:37 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1579696026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:37.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:37 smithi144 ceph-mon[34351]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:37.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:37 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1579696026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:37.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:37 smithi067 ceph-mon[34443]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:37.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:37 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1579696026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:37.815 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 05:50:37 smithi037 podman[69907]: 2024-09-21 05:50:37.709061091 +0000 UTC m=+1.071760630 container start f94f9c88a7e9d2e79cd5b45469928340ace9f927f40a701855beb221988a4240 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-a, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T05:50:38.164 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 05:50:37 smithi037 ceph-mds[69942]: -- 172.21.15.37:0/2589949131 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5649315d7c20 con 0x56493577f180 2024-09-21T05:50:38.165 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 05:50:37 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-a[69934]: starting mds.a at 2024-09-21T05:50:38.165 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 05:50:37 smithi037 bash[69907]: f94f9c88a7e9d2e79cd5b45469928340ace9f927f40a701855beb221988a4240 2024-09-21T05:50:38.165 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 05:50:37 smithi037 systemd[1]: Started Ceph mds.a for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:50:38.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:38 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:38.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:38 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:38.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:38 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:38 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:38 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:38 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:38 smithi067 ceph-mon[34443]: Deploying daemon mds.b on smithi067 2024-09-21T05:50:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:38 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.37:6840/1236048708,v1:172.21.15.37:6841/1236048708] up:boot 2024-09-21T05:50:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:38 smithi067 ceph-mon[34443]: fsmap 11 up:standby 2024-09-21T05:50:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:38 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T05:50:39.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:38 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:39.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:38 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:38 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:38 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:38 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:38 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:38 smithi037 ceph-mon[30631]: Deploying daemon mds.b on smithi067 2024-09-21T05:50:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:38 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.37:6840/1236048708,v1:172.21.15.37:6841/1236048708] up:boot 2024-09-21T05:50:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:38 smithi037 ceph-mon[30631]: fsmap 11 up:standby 2024-09-21T05:50:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:38 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T05:50:39.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:38 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:39.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:38 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:39.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:38 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:39.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:38 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T05:50:39.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:38 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T05:50:39.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:38 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:39.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:38 smithi144 ceph-mon[34351]: Deploying daemon mds.b on smithi067 2024-09-21T05:50:39.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:38 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.37:6840/1236048708,v1:172.21.15.37:6841/1236048708] up:boot 2024-09-21T05:50:39.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:38 smithi144 ceph-mon[34351]: fsmap 11 up:standby 2024-09-21T05:50:39.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:38 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T05:50:39.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:50:39.943 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:40.193 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:39 smithi067 ceph-mon[34443]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:40.193 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 05:50:39 smithi067 systemd[1]: Starting Ceph mds.b for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T05:50:40.221 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:39 smithi037 ceph-mon[30631]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:40.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:39 smithi144 ceph-mon[34351]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:40.496 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 05:50:40 smithi067 podman[62779]: 2024-09-21 05:50:40.093683508 +0000 UTC m=+0.016018073 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T05:50:40.496 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 05:50:40 smithi067 podman[62779]: 2024-09-21 05:50:40.366535161 +0000 UTC m=+0.288869726 container create 7ea473fb763d376ceeb5f4bfaaf1393250c0bf90b168e80b42f0ad1c371b4d9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T05:50:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.568+0000 7f5d66600640 1 -- 172.21.15.37:0/818182588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6010ff10 msgr2=0x7f5d60112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.568+0000 7f5d66600640 1 --2- 172.21.15.37:0/818182588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6010ff10 0x7f5d60112350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d58009900 tx=0x7f5d5802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:50:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.568+0000 7f5d66600640 1 -- 172.21.15.37:0/818182588 shutdown_connections 2024-09-21T05:50:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.568+0000 7f5d66600640 1 --2- 172.21.15.37:0/818182588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6010ff10 0x7f5d60112350 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.568+0000 7f5d66600640 1 --2- 172.21.15.37:0/818182588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d60076100 0x7f5d6010f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:40.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.568+0000 7f5d66600640 1 --2- 172.21.15.37:0/818182588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d600757b0 0x7f5d60075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:40.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.568+0000 7f5d66600640 1 -- 172.21.15.37:0/818182588 >> 172.21.15.37:0/818182588 conn(0x7f5d600ff440 msgr2=0x7f5d60101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:40.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.568+0000 7f5d66600640 1 -- 172.21.15.37:0/818182588 shutdown_connections 2024-09-21T05:50:40.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.568+0000 7f5d66600640 1 -- 172.21.15.37:0/818182588 wait complete. 2024-09-21T05:50:40.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.570+0000 7f5d66600640 1 Processor -- start 2024-09-21T05:50:40.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.570+0000 7f5d66600640 1 -- start start 2024-09-21T05:50:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.570+0000 7f5d66600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d600757b0 0x7f5d6019c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.570+0000 7f5d66600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d60076100 0x7f5d6019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d66600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6010ff10 0x7f5d601a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d66600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5d60115ac0 con 0x7f5d600757b0 2024-09-21T05:50:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d66600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5d60115940 con 0x7f5d6010ff10 2024-09-21T05:50:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d66600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5d60115c40 con 0x7f5d60076100 2024-09-21T05:50:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d65200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d600757b0 0x7f5d6019c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d5fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d60076100 0x7f5d6019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d65c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6010ff10 0x7f5d601a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d5fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d60076100 0x7f5d6019c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:54404/0 (socket says 172.21.15.37:54404) 2024-09-21T05:50:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d65200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d600757b0 0x7f5d6019c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57852/0 (socket says 172.21.15.37:57852) 2024-09-21T05:50:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d5fe00640 1 -- 172.21.15.37:0/3095880322 learned_addr learned my addr 172.21.15.37:0/3095880322 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d65200640 1 -- 172.21.15.37:0/3095880322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d60076100 msgr2=0x7f5d6019c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d65200640 1 --2- 172.21.15.37:0/3095880322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d60076100 0x7f5d6019c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d65200640 1 -- 172.21.15.37:0/3095880322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6010ff10 msgr2=0x7f5d601a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:40.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d65200640 1 --2- 172.21.15.37:0/3095880322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6010ff10 0x7f5d601a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:40.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d65200640 1 -- 172.21.15.37:0/3095880322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d601a23c0 con 0x7f5d600757b0 2024-09-21T05:50:40.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.571+0000 7f5d65c00640 1 --2- 172.21.15.37:0/3095880322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6010ff10 0x7f5d601a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:50:40.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.572+0000 7f5d65200640 1 --2- 172.21.15.37:0/3095880322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d600757b0 0x7f5d6019c450 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000ec80 tx=0x7f5d5000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:40.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.572+0000 7f5d5d600640 1 -- 172.21.15.37:0/3095880322 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50003b70 con 0x7f5d600757b0 2024-09-21T05:50:40.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.572+0000 7f5d5d600640 1 -- 172.21.15.37:0/3095880322 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d50003d10 con 0x7f5d600757b0 2024-09-21T05:50:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.572+0000 7f5d66600640 1 -- 172.21.15.37:0/3095880322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d601a26b0 con 0x7f5d600757b0 2024-09-21T05:50:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.572+0000 7f5d5d600640 1 -- 172.21.15.37:0/3095880322 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50010910 con 0x7f5d600757b0 2024-09-21T05:50:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.572+0000 7f5d66600640 1 -- 172.21.15.37:0/3095880322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d601a8e10 con 0x7f5d600757b0 2024-09-21T05:50:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.573+0000 7f5d66600640 1 -- 172.21.15.37:0/3095880322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d60075bc0 con 0x7f5d600757b0 2024-09-21T05:50:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.576+0000 7f5d5d600640 1 -- 172.21.15.37:0/3095880322 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f5d50004560 con 0x7f5d600757b0 2024-09-21T05:50:40.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.578+0000 7f5d5d600640 1 --2- 172.21.15.37:0/3095880322 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5d440b6590 0x7f5d440b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:40.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.578+0000 7f5d5d600640 1 -- 172.21.15.37:0/3095880322 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f5d500e75a0 con 0x7f5d600757b0 2024-09-21T05:50:40.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.579+0000 7f5d5fe00640 1 --2- 172.21.15.37:0/3095880322 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5d440b6590 0x7f5d440b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:40.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.579+0000 7f5d5fe00640 1 --2- 172.21.15.37:0/3095880322 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5d440b6590 0x7f5d440b8aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5d60112080 tx=0x7f5d4c005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:40.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.583+0000 7f5d5d600640 1 -- 172.21.15.37:0/3095880322 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5d500ae230 con 0x7f5d600757b0 2024-09-21T05:50:40.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.828+0000 7f5d66600640 1 -- 172.21.15.37:0/3095880322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d6019d580 con 0x7f5d600757b0 2024-09-21T05:50:40.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.829+0000 7f5d5d600640 1 -- 172.21.15.37:0/3095880322 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9701 (secure 0 0 0) 0x7f5d500b2610 con 0x7f5d600757b0 2024-09-21T05:50:40.831 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:50:40.831 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":12,"btime":"2024-09-21T05:50:38:267917+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24706,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T05:50:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 12 2024-09-21T05:50:40.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.831+0000 7f5d66600640 1 -- 172.21.15.37:0/3095880322 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5d440b6590 msgr2=0x7f5d440b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:40.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.831+0000 7f5d66600640 1 --2- 172.21.15.37:0/3095880322 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5d440b6590 0x7f5d440b8aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5d60112080 tx=0x7f5d4c005f90 comp rx=0 tx=0).stop 2024-09-21T05:50:40.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.831+0000 7f5d66600640 1 -- 172.21.15.37:0/3095880322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d600757b0 msgr2=0x7f5d6019c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:40.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.831+0000 7f5d66600640 1 --2- 172.21.15.37:0/3095880322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d600757b0 0x7f5d6019c450 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000ec80 tx=0x7f5d5000c6a0 comp rx=0 tx=0).stop 2024-09-21T05:50:40.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.832+0000 7f5d66600640 1 -- 172.21.15.37:0/3095880322 shutdown_connections 2024-09-21T05:50:40.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.832+0000 7f5d66600640 1 --2- 172.21.15.37:0/3095880322 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5d440b6590 0x7f5d440b8aa0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:40.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.832+0000 7f5d66600640 1 --2- 172.21.15.37:0/3095880322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d6010ff10 0x7f5d601a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:40.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.832+0000 7f5d66600640 1 --2- 172.21.15.37:0/3095880322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d60076100 0x7f5d6019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:40.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.832+0000 7f5d66600640 1 --2- 172.21.15.37:0/3095880322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d600757b0 0x7f5d6019c450 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:40.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.832+0000 7f5d66600640 1 -- 172.21.15.37:0/3095880322 >> 172.21.15.37:0/3095880322 conn(0x7f5d600ff440 msgr2=0x7f5d60109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:40.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.832+0000 7f5d66600640 1 -- 172.21.15.37:0/3095880322 shutdown_connections 2024-09-21T05:50:40.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:40.832+0000 7f5d66600640 1 -- 172.21.15.37:0/3095880322 wait complete. 2024-09-21T05:50:40.996 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 05:50:40 smithi067 podman[62779]: 2024-09-21 05:50:40.634728851 +0000 UTC m=+0.557063418 container init 7ea473fb763d376ceeb5f4bfaaf1393250c0bf90b168e80b42f0ad1c371b4d9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T05:50:40.996 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 05:50:40 smithi067 podman[62779]: 2024-09-21 05:50:40.637523238 +0000 UTC m=+0.559857803 container start 7ea473fb763d376ceeb5f4bfaaf1393250c0bf90b168e80b42f0ad1c371b4d9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T05:50:40.996 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 05:50:40 smithi067 ceph-mds[62799]: -- 172.21.15.67:0/2663595120 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5611ad4c7860 con 0x5611b166f600 2024-09-21T05:50:40.997 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 05:50:40 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-b[62795]: starting mds.b at 2024-09-21T05:50:40.997 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 05:50:40 smithi067 bash[62779]: 7ea473fb763d376ceeb5f4bfaaf1393250c0bf90b168e80b42f0ad1c371b4d9d 2024-09-21T05:50:40.997 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 05:50:40 smithi067 systemd[1]: Started Ceph mds.b for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T05:50:41.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:41 smithi037 ceph-mon[30631]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:42.019 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.019 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.019 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.019 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.019 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.019 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:41 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3095880322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:42.019 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:42.019 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:41 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] up:boot 2024-09-21T05:50:42.020 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:41 smithi037 ceph-mon[30631]: fsmap 12 up:standby 2024-09-21T05:50:42.020 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T05:50:42.020 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:41 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:41 smithi144 ceph-mon[34351]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:41 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3095880322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:42.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:42.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:41 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] up:boot 2024-09-21T05:50:42.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:41 smithi144 ceph-mon[34351]: fsmap 12 up:standby 2024-09-21T05:50:42.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T05:50:42.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:41 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:41 smithi067 ceph-mon[34443]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:42.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:42.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:41 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3095880322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:42.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:42.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:41 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] up:boot 2024-09-21T05:50:42.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:41 smithi067 ceph-mon[34443]: fsmap 12 up:standby 2024-09-21T05:50:42.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T05:50:42.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:41 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:43 smithi144 ceph-mon[34351]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:43 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:43.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:50:43.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:43 smithi037 ceph-mon[30631]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:43.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:43.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:43.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:43.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:43 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:43.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:43 smithi067 ceph-mon[34443]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:43.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:43.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:43.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:43.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:43 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:44.100 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:44.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:44.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:44.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:44.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:44.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:44.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:44 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:44.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:44.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:44.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:44.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:44.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:44.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:44 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:44.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:44.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:44.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:44.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:44.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:44.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:44 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:50:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.334+0000 7f6496000640 1 -- 172.21.15.37:0/2996211011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6490103990 msgr2=0x7f6490103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.334+0000 7f6496000640 1 --2- 172.21.15.37:0/2996211011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6490103990 0x7f6490103da0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6484009900 tx=0x7f648402a410 comp rx=0 tx=0).stop 2024-09-21T05:50:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.334+0000 7f6496000640 1 -- 172.21.15.37:0/2996211011 shutdown_connections 2024-09-21T05:50:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.334+0000 7f6496000640 1 --2- 172.21.15.37:0/2996211011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6490109c20 0x7f6490110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.334+0000 7f6496000640 1 --2- 172.21.15.37:0/2996211011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64901092d0 0x7f64901096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.334+0000 7f6496000640 1 --2- 172.21.15.37:0/2996211011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6490103990 0x7f6490103da0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.334+0000 7f6496000640 1 -- 172.21.15.37:0/2996211011 >> 172.21.15.37:0/2996211011 conn(0x7f64900ff440 msgr2=0x7f6490101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:45.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.334+0000 7f6496000640 1 -- 172.21.15.37:0/2996211011 shutdown_connections 2024-09-21T05:50:45.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.334+0000 7f6496000640 1 -- 172.21.15.37:0/2996211011 wait complete. 2024-09-21T05:50:45.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.335+0000 7f6496000640 1 Processor -- start 2024-09-21T05:50:45.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.336+0000 7f6496000640 1 -- start start 2024-09-21T05:50:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.336+0000 7f6496000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6490103990 0x7f649019c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.336+0000 7f6496000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64901092d0 0x7f649019caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.336+0000 7f6496000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6490109c20 0x7f64901a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.336+0000 7f6496000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6490113930 con 0x7f6490109c20 2024-09-21T05:50:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.336+0000 7f6496000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f64901137b0 con 0x7f6490103990 2024-09-21T05:50:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.336+0000 7f6496000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6490113ab0 con 0x7f64901092d0 2024-09-21T05:50:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.336+0000 7f6494c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6490103990 0x7f649019c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.337+0000 7f6494c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6490103990 0x7f649019c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:47032/0 (socket says 172.21.15.37:47032) 2024-09-21T05:50:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.337+0000 7f6494c00640 1 -- 172.21.15.37:0/969562762 learned_addr learned my addr 172.21.15.37:0/969562762 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.337+0000 7f6495600640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6490109c20 0x7f64901a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.337+0000 7f648fe00640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64901092d0 0x7f649019caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.337+0000 7f6494c00640 1 -- 172.21.15.37:0/969562762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64901092d0 msgr2=0x7f649019caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.337+0000 7f6494c00640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64901092d0 0x7f649019caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.337+0000 7f6494c00640 1 -- 172.21.15.37:0/969562762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6490109c20 msgr2=0x7f64901a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.337+0000 7f6494c00640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6490109c20 0x7f64901a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.337+0000 7f6494c00640 1 -- 172.21.15.37:0/969562762 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64901a2470 con 0x7f6490103990 2024-09-21T05:50:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.338+0000 7f6494c00640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6490103990 0x7f649019c500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6484005ab0 tx=0x7f6484003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.338+0000 7f648d600640 1 -- 172.21.15.37:0/969562762 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648403f070 con 0x7f6490103990 2024-09-21T05:50:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.338+0000 7f648d600640 1 -- 172.21.15.37:0/969562762 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6484031b60 con 0x7f6490103990 2024-09-21T05:50:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.338+0000 7f648d600640 1 -- 172.21.15.37:0/969562762 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6484035030 con 0x7f6490103990 2024-09-21T05:50:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.338+0000 7f6496000640 1 -- 172.21.15.37:0/969562762 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64901a2700 con 0x7f6490103990 2024-09-21T05:50:45.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.338+0000 7f6496000640 1 -- 172.21.15.37:0/969562762 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64901a8ec0 con 0x7f6490103990 2024-09-21T05:50:45.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.339+0000 7f6496000640 1 -- 172.21.15.37:0/969562762 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6490103da0 con 0x7f6490103990 2024-09-21T05:50:45.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.341+0000 7f648d600640 1 -- 172.21.15.37:0/969562762 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f6484042070 con 0x7f6490103990 2024-09-21T05:50:45.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.343+0000 7f648d600640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f64780b6590 0x7f64780b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:45.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.343+0000 7f648d600640 1 -- 172.21.15.37:0/969562762 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f64841075a0 con 0x7f6490103990 2024-09-21T05:50:45.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.343+0000 7f648fe00640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f64780b6590 0x7f64780b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:45.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.344+0000 7f648fe00640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f64780b6590 0x7f64780b8aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6490109b40 tx=0x7f647c005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:45.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.347+0000 7f648d600640 1 -- 172.21.15.37:0/969562762 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f64840d2610 con 0x7f6490103990 2024-09-21T05:50:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.599+0000 7f6496000640 1 -- 172.21.15.37:0/969562762 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64901a9090 con 0x7f6490103990 2024-09-21T05:50:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.600+0000 7f648d600640 1 -- 172.21.15.37:0/969562762 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10527 (secure 0 0 0) 0x7f64840d7550 con 0x7f6490103990 2024-09-21T05:50:45.603 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:50:45.603 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"btime":"2024-09-21T05:50:40:922177+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24706,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24731,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T05:50:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 13 2024-09-21T05:50:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.603+0000 7f6496000640 1 -- 172.21.15.37:0/969562762 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f64780b6590 msgr2=0x7f64780b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.603+0000 7f6496000640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f64780b6590 0x7f64780b8aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6490109b40 tx=0x7f647c005f90 comp rx=0 tx=0).stop 2024-09-21T05:50:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.603+0000 7f6496000640 1 -- 172.21.15.37:0/969562762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6490103990 msgr2=0x7f649019c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.603+0000 7f6496000640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6490103990 0x7f649019c500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6484005ab0 tx=0x7f6484003c10 comp rx=0 tx=0).stop 2024-09-21T05:50:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.603+0000 7f6496000640 1 -- 172.21.15.37:0/969562762 shutdown_connections 2024-09-21T05:50:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.603+0000 7f6496000640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6490109c20 0x7f64901a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.603+0000 7f6496000640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64901092d0 0x7f649019caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.603+0000 7f6496000640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f64780b6590 0x7f64780b8aa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.603+0000 7f6496000640 1 --2- 172.21.15.37:0/969562762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6490103990 0x7f649019c500 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.603+0000 7f6496000640 1 -- 172.21.15.37:0/969562762 >> 172.21.15.37:0/969562762 conn(0x7f64900ff440 msgr2=0x7f6490108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.604+0000 7f6496000640 1 -- 172.21.15.37:0/969562762 shutdown_connections 2024-09-21T05:50:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:45.604+0000 7f6496000640 1 -- 172.21.15.37:0/969562762 wait complete. 2024-09-21T05:50:46.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:45 smithi067 ceph-mon[34443]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:46.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:45 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:46.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:45 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:46.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:45 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:46.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:45 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:46.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:45 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/969562762' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:46.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:45 smithi144 ceph-mon[34351]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:46.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:45 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:46.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:45 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:46.375 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:45 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:46.375 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:45 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:46.375 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:45 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/969562762' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:46.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:45 smithi037 ceph-mon[30631]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:45 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:45 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:45 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:45 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:46.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:45 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/969562762' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:50:46.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T05:50:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:47.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.517+0000 7f7859800640 1 -- 172.21.15.37:0/623772939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78541092d0 msgr2=0x7f78541096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:47.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.517+0000 7f7859800640 1 --2- 172.21.15.37:0/623772939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78541092d0 0x7f78541096e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f783c009900 tx=0x7f783c02a3f0 comp rx=0 tx=0).stop 2024-09-21T05:50:47.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.517+0000 7f7859800640 1 -- 172.21.15.37:0/623772939 shutdown_connections 2024-09-21T05:50:47.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.517+0000 7f7859800640 1 --2- 172.21.15.37:0/623772939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7854109c20 0x7f7854110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:47.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.517+0000 7f7859800640 1 --2- 172.21.15.37:0/623772939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78541092d0 0x7f78541096e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:47.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.517+0000 7f7859800640 1 --2- 172.21.15.37:0/623772939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7854103990 0x7f7854103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:47.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.517+0000 7f7859800640 1 -- 172.21.15.37:0/623772939 >> 172.21.15.37:0/623772939 conn(0x7f78540ff3e0 msgr2=0x7f7854101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:47.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.517+0000 7f7859800640 1 -- 172.21.15.37:0/623772939 shutdown_connections 2024-09-21T05:50:47.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.517+0000 7f7859800640 1 -- 172.21.15.37:0/623772939 wait complete. 2024-09-21T05:50:47.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.518+0000 7f7859800640 1 Processor -- start 2024-09-21T05:50:47.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.518+0000 7f7859800640 1 -- start start 2024-09-21T05:50:47.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.519+0000 7f7859800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7854103990 0x7f7854075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:47.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.519+0000 7f7859800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78541092d0 0x7f7854075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:47.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.519+0000 7f7859800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7854109c20 0x7f7854076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:47.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.519+0000 7f7859800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f78541138e0 con 0x7f7854109c20 2024-09-21T05:50:47.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.519+0000 7f7859800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7854113760 con 0x7f7854103990 2024-09-21T05:50:47.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.519+0000 7f7859800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7854113a60 con 0x7f78541092d0 2024-09-21T05:50:47.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.519+0000 7f7858e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7854109c20 0x7f7854076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:47.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.519+0000 7f7858e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7854109c20 0x7f7854076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33636/0 (socket says 172.21.15.37:33636) 2024-09-21T05:50:47.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.519+0000 7f7858e00640 1 -- 172.21.15.37:0/53167890 learned_addr learned my addr 172.21.15.37:0/53167890 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:47.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.519+0000 7f7853e00640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7854103990 0x7f7854075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:47.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.519+0000 7f784be00640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78541092d0 0x7f7854075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:47.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.520+0000 7f7853e00640 1 -- 172.21.15.37:0/53167890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78541092d0 msgr2=0x7f7854075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:47.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.520+0000 7f7853e00640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78541092d0 0x7f7854075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:47.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.520+0000 7f7853e00640 1 -- 172.21.15.37:0/53167890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7854109c20 msgr2=0x7f7854076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:47.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.520+0000 7f7853e00640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7854109c20 0x7f7854076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:47.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.520+0000 7f7853e00640 1 -- 172.21.15.37:0/53167890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78541a85b0 con 0x7f7854103990 2024-09-21T05:50:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.520+0000 7f7858e00640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7854109c20 0x7f7854076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:50:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.520+0000 7f7853e00640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7854103990 0x7f7854075710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f784400e9f0 tx=0x7f784400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.521+0000 7f7851600640 1 -- 172.21.15.37:0/53167890 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784400ccc0 con 0x7f7854103990 2024-09-21T05:50:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.521+0000 7f7851600640 1 -- 172.21.15.37:0/53167890 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78440108e0 con 0x7f7854103990 2024-09-21T05:50:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.521+0000 7f7859800640 1 -- 172.21.15.37:0/53167890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78541a88a0 con 0x7f7854103990 2024-09-21T05:50:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.521+0000 7f7851600640 1 -- 172.21.15.37:0/53167890 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844018880 con 0x7f7854103990 2024-09-21T05:50:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.521+0000 7f7859800640 1 -- 172.21.15.37:0/53167890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78541a8db0 con 0x7f7854103990 2024-09-21T05:50:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.522+0000 7f7859800640 1 -- 172.21.15.37:0/53167890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7854103da0 con 0x7f7854103990 2024-09-21T05:50:47.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.524+0000 7f7851600640 1 -- 172.21.15.37:0/53167890 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f7844010430 con 0x7f7854103990 2024-09-21T05:50:47.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.526+0000 7f7851600640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f78380b6510 0x7f78380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:47.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.526+0000 7f7851600640 1 -- 172.21.15.37:0/53167890 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f78440e75a0 con 0x7f7854103990 2024-09-21T05:50:47.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.526+0000 7f784be00640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f78380b6510 0x7f78380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:47.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.527+0000 7f784be00640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f78380b6510 0x7f78380b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f783c009230 tx=0x7f783c031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:47.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.528+0000 7f7851600640 1 -- 172.21.15.37:0/53167890 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78440b26b0 con 0x7f7854103990 2024-09-21T05:50:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.728+0000 7f7859800640 1 -- 172.21.15.37:0/53167890 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f785402e640 con 0x7f7854103990 2024-09-21T05:50:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.729+0000 7f7851600640 1 -- 172.21.15.37:0/53167890 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7f78440b75f0 con 0x7f7854103990 2024-09-21T05:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-09-21T05:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T05:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-09-21T05:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-09-21T05:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-09-21T05:50:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.732+0000 7f7859800640 1 -- 172.21.15.37:0/53167890 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f78380b6510 msgr2=0x7f78380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.732+0000 7f7859800640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f78380b6510 0x7f78380b8a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f783c009230 tx=0x7f783c031400 comp rx=0 tx=0).stop 2024-09-21T05:50:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.732+0000 7f7859800640 1 -- 172.21.15.37:0/53167890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7854103990 msgr2=0x7f7854075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.732+0000 7f7859800640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7854103990 0x7f7854075710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f784400e9f0 tx=0x7f784400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:50:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.732+0000 7f7859800640 1 -- 172.21.15.37:0/53167890 shutdown_connections 2024-09-21T05:50:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.732+0000 7f7859800640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7854109c20 0x7f7854076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.732+0000 7f7859800640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78541092d0 0x7f7854075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.732+0000 7f7859800640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f78380b6510 0x7f78380b8a20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.732+0000 7f7859800640 1 --2- 172.21.15.37:0/53167890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7854103990 0x7f7854075710 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.732+0000 7f7859800640 1 -- 172.21.15.37:0/53167890 >> 172.21.15.37:0/53167890 conn(0x7f78540ff3e0 msgr2=0x7f7854101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.732+0000 7f7859800640 1 -- 172.21.15.37:0/53167890 shutdown_connections 2024-09-21T05:50:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:47.732+0000 7f7859800640 1 -- 172.21.15.37:0/53167890 wait complete. 2024-09-21T05:50:48.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:47 smithi037 ceph-mon[30631]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:48.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:48.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:48.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:48.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:48.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:48.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:47 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/53167890' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T05:50:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:47 smithi144 ceph-mon[34351]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:47 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/53167890' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T05:50:48.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:47 smithi067 ceph-mon[34443]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:48.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:48.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:48.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:50:48.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:50:48.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:50:48.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:47 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/53167890' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T05:50:48.558 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T05:50:48.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T05:50:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.565+0000 7f17a9800640 1 -- 172.21.15.37:0/2923800794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a4109c20 msgr2=0x7f17a4110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.565+0000 7f17a9800640 1 --2- 172.21.15.37:0/2923800794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a4109c20 0x7f17a4110450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f179c009ca0 tx=0x7f179c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:50:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.565+0000 7f17a9800640 1 -- 172.21.15.37:0/2923800794 shutdown_connections 2024-09-21T05:50:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.565+0000 7f17a9800640 1 --2- 172.21.15.37:0/2923800794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a4109c20 0x7f17a4110450 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.565+0000 7f17a9800640 1 --2- 172.21.15.37:0/2923800794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17a41092d0 0x7f17a41096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.565+0000 7f17a9800640 1 --2- 172.21.15.37:0/2923800794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a4103990 0x7f17a4103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.565+0000 7f17a9800640 1 -- 172.21.15.37:0/2923800794 >> 172.21.15.37:0/2923800794 conn(0x7f17a40ff3e0 msgr2=0x7f17a4101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.565+0000 7f17a9800640 1 -- 172.21.15.37:0/2923800794 shutdown_connections 2024-09-21T05:50:49.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.565+0000 7f17a9800640 1 -- 172.21.15.37:0/2923800794 wait complete. 2024-09-21T05:50:49.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.566+0000 7f17a9800640 1 Processor -- start 2024-09-21T05:50:49.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.566+0000 7f17a9800640 1 -- start start 2024-09-21T05:50:49.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.566+0000 7f17a9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17a4103990 0x7f17a4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:49.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a41092d0 0x7f17a4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:49.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a4109c20 0x7f17a4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:49.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a9800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f17a41138e0 con 0x7f17a41092d0 2024-09-21T05:50:49.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a9800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f17a4113760 con 0x7f17a4109c20 2024-09-21T05:50:49.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a9800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f17a4113a60 con 0x7f17a4103990 2024-09-21T05:50:49.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a41092d0 0x7f17a4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:49.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17a4103990 0x7f17a4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:49.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a41092d0 0x7f17a4075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33652/0 (socket says 172.21.15.37:33652) 2024-09-21T05:50:49.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a3400640 1 -- 172.21.15.37:0/3163787440 learned_addr learned my addr 172.21.15.37:0/3163787440 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:49.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a8e00640 1 --2- 172.21.15.37:0/3163787440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a4109c20 0x7f17a4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:49.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a3e00640 1 -- 172.21.15.37:0/3163787440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a4109c20 msgr2=0x7f17a4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:49.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a3e00640 1 --2- 172.21.15.37:0/3163787440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a4109c20 0x7f17a4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:49.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a3e00640 1 -- 172.21.15.37:0/3163787440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a41092d0 msgr2=0x7f17a4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:49.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a3e00640 1 --2- 172.21.15.37:0/3163787440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a41092d0 0x7f17a4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:49.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.567+0000 7f17a3e00640 1 -- 172.21.15.37:0/3163787440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a41a8590 con 0x7f17a4103990 2024-09-21T05:50:49.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.568+0000 7f17a3e00640 1 --2- 172.21.15.37:0/3163787440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17a4103990 0x7f17a4075710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f179400d6d0 tx=0x7f179400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:49.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.568+0000 7f17a0c00640 1 -- 172.21.15.37:0/3163787440 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1794017070 con 0x7f17a4103990 2024-09-21T05:50:49.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.568+0000 7f17a0c00640 1 -- 172.21.15.37:0/3163787440 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1794009820 con 0x7f17a4103990 2024-09-21T05:50:49.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.568+0000 7f17a0c00640 1 -- 172.21.15.37:0/3163787440 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1794004c40 con 0x7f17a4103990 2024-09-21T05:50:49.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.568+0000 7f17a9800640 1 -- 172.21.15.37:0/3163787440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a41a8880 con 0x7f17a4103990 2024-09-21T05:50:49.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.568+0000 7f17a9800640 1 -- 172.21.15.37:0/3163787440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a41a8d70 con 0x7f17a4103990 2024-09-21T05:50:49.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.569+0000 7f17a9800640 1 -- 172.21.15.37:0/3163787440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a4103da0 con 0x7f17a4103990 2024-09-21T05:50:49.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.572+0000 7f17a0c00640 1 -- 172.21.15.37:0/3163787440 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f1794005220 con 0x7f17a4103990 2024-09-21T05:50:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.573+0000 7f17a0c00640 1 --2- 172.21.15.37:0/3163787440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f17880b6590 0x7f17880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.573+0000 7f17a0c00640 1 -- 172.21.15.37:0/3163787440 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f17940e6d40 con 0x7f17a4103990 2024-09-21T05:50:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.574+0000 7f17a3400640 1 --2- 172.21.15.37:0/3163787440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f17880b6590 0x7f17880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.574+0000 7f17a3400640 1 --2- 172.21.15.37:0/3163787440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f17880b6590 0x7f17880b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17a4108dd0 tx=0x7f1790005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:49.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.575+0000 7f17a0c00640 1 -- 172.21.15.37:0/3163787440 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f17940b1e30 con 0x7f17a4103990 2024-09-21T05:50:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.777+0000 7f17a9800640 1 -- 172.21.15.37:0/3163787440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f17a4076a10 con 0x7f17a4103990 2024-09-21T05:50:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.834+0000 7f17a0c00640 1 -- 172.21.15.37:0/3163787440 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7f17a4076a10 con 0x7f17a4103990 2024-09-21T05:50:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-09-21T05:50:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.839+0000 7f17a9800640 1 -- 172.21.15.37:0/3163787440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f17880b6590 msgr2=0x7f17880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.839+0000 7f17a9800640 1 --2- 172.21.15.37:0/3163787440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f17880b6590 0x7f17880b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17a4108dd0 tx=0x7f1790005f90 comp rx=0 tx=0).stop 2024-09-21T05:50:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.839+0000 7f17a9800640 1 -- 172.21.15.37:0/3163787440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17a4103990 msgr2=0x7f17a4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.839+0000 7f17a9800640 1 --2- 172.21.15.37:0/3163787440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17a4103990 0x7f17a4075710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f179400d6d0 tx=0x7f179400db90 comp rx=0 tx=0).stop 2024-09-21T05:50:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.839+0000 7f17a9800640 1 -- 172.21.15.37:0/3163787440 shutdown_connections 2024-09-21T05:50:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.839+0000 7f17a9800640 1 --2- 172.21.15.37:0/3163787440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f17880b6590 0x7f17880b8aa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.839+0000 7f17a9800640 1 --2- 172.21.15.37:0/3163787440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17a4109c20 0x7f17a4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.839+0000 7f17a9800640 1 --2- 172.21.15.37:0/3163787440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a41092d0 0x7f17a4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.839+0000 7f17a9800640 1 --2- 172.21.15.37:0/3163787440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17a4103990 0x7f17a4075710 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.839+0000 7f17a9800640 1 -- 172.21.15.37:0/3163787440 >> 172.21.15.37:0/3163787440 conn(0x7f17a40ff3e0 msgr2=0x7f17a4101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.839+0000 7f17a9800640 1 -- 172.21.15.37:0/3163787440 shutdown_connections 2024-09-21T05:50:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:49.840+0000 7f17a9800640 1 -- 172.21.15.37:0/3163787440 wait complete. 2024-09-21T05:50:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:49 smithi144 ceph-mon[34351]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:49 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3163787440' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T05:50:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:49 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T05:50:50.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:49 smithi037 ceph-mon[30631]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:50.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:49 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3163787440' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T05:50:50.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:49 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T05:50:50.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:49 smithi067 ceph-mon[34443]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:50.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:49 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3163787440' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T05:50:50.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:49 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T05:50:50.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T05:50:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:51.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:50 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T05:50:51.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:50 smithi144 ceph-mon[34351]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T05:50:51.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:50 smithi144 ceph-mon[34351]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T05:50:51.146 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:50 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T05:50:51.146 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:50 smithi037 ceph-mon[30631]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T05:50:51.146 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:50 smithi037 ceph-mon[30631]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T05:50:51.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:50 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T05:50:51.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:50 smithi067 ceph-mon[34443]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T05:50:51.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:50 smithi067 ceph-mon[34443]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T05:50:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.652+0000 7f5b39200640 1 -- 172.21.15.37:0/755100789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b34114740 msgr2=0x7f5b34116b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.652+0000 7f5b39200640 1 --2- 172.21.15.37:0/755100789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b34114740 0x7f5b34116b60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009ca0 tx=0x7f5b2c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:50:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.652+0000 7f5b39200640 1 -- 172.21.15.37:0/755100789 shutdown_connections 2024-09-21T05:50:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.652+0000 7f5b39200640 1 --2- 172.21.15.37:0/755100789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b34114740 0x7f5b34116b60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.652+0000 7f5b39200640 1 --2- 172.21.15.37:0/755100789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b34078290 0x7f5b34114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.652+0000 7f5b39200640 1 --2- 172.21.15.37:0/755100789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b34077940 0x7f5b34077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.652+0000 7f5b39200640 1 -- 172.21.15.37:0/755100789 >> 172.21.15.37:0/755100789 conn(0x7f5b34101810 msgr2=0x7f5b34103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.652+0000 7f5b39200640 1 -- 172.21.15.37:0/755100789 shutdown_connections 2024-09-21T05:50:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.652+0000 7f5b39200640 1 -- 172.21.15.37:0/755100789 wait complete. 2024-09-21T05:50:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.653+0000 7f5b39200640 1 Processor -- start 2024-09-21T05:50:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.653+0000 7f5b39200640 1 -- start start 2024-09-21T05:50:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.653+0000 7f5b39200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b34077940 0x7f5b341a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.653+0000 7f5b39200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b34078290 0x7f5b341a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.653+0000 7f5b39200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b34114740 0x7f5b341a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.653+0000 7f5b39200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3411a0d0 con 0x7f5b34078290 2024-09-21T05:50:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.653+0000 7f5b39200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5b34119f50 con 0x7f5b34077940 2024-09-21T05:50:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.653+0000 7f5b39200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3411a250 con 0x7f5b34114740 2024-09-21T05:50:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.654+0000 7f5b31400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b34078290 0x7f5b341a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.654+0000 7f5b31e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b34077940 0x7f5b341a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.654+0000 7f5b31400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b34078290 0x7f5b341a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50774/0 (socket says 172.21.15.37:50774) 2024-09-21T05:50:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.654+0000 7f5b31400640 1 -- 172.21.15.37:0/2542711252 learned_addr learned my addr 172.21.15.37:0/2542711252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.654+0000 7f5b32800640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b34114740 0x7f5b341a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.654+0000 7f5b31e00640 1 -- 172.21.15.37:0/2542711252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b34114740 msgr2=0x7f5b341a62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.654+0000 7f5b31e00640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b34114740 0x7f5b341a62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.654+0000 7f5b31e00640 1 -- 172.21.15.37:0/2542711252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b34078290 msgr2=0x7f5b341a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.654+0000 7f5b31e00640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b34078290 0x7f5b341a1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.654+0000 7f5b31e00640 1 -- 172.21.15.37:0/2542711252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b341a69f0 con 0x7f5b34077940 2024-09-21T05:50:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.654+0000 7f5b31400640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b34078290 0x7f5b341a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:50:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.655+0000 7f5b31e00640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b34077940 0x7f5b341a0a80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400e9f0 tx=0x7f5b2400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.655+0000 7f5b2aa00640 1 -- 172.21.15.37:0/2542711252 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2400ccc0 con 0x7f5b34077940 2024-09-21T05:50:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.655+0000 7f5b39200640 1 -- 172.21.15.37:0/2542711252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b341a6ce0 con 0x7f5b34077940 2024-09-21T05:50:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.655+0000 7f5b2aa00640 1 -- 172.21.15.37:0/2542711252 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b240108e0 con 0x7f5b34077940 2024-09-21T05:50:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.655+0000 7f5b2aa00640 1 -- 172.21.15.37:0/2542711252 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24018880 con 0x7f5b34077940 2024-09-21T05:50:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.655+0000 7f5b39200640 1 -- 172.21.15.37:0/2542711252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b341ad440 con 0x7f5b34077940 2024-09-21T05:50:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.656+0000 7f5b39200640 1 -- 172.21.15.37:0/2542711252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b34077d50 con 0x7f5b34077940 2024-09-21T05:50:51.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.659+0000 7f5b2aa00640 1 -- 172.21.15.37:0/2542711252 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f5b24010430 con 0x7f5b34077940 2024-09-21T05:50:51.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.660+0000 7f5b2aa00640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5b180b6510 0x7f5b180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:51.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.661+0000 7f5b2aa00640 1 -- 172.21.15.37:0/2542711252 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7497+0+0 (secure 0 0 0) 0x7f5b240e7880 con 0x7f5b34077940 2024-09-21T05:50:51.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.661+0000 7f5b31400640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5b180b6510 0x7f5b180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:51.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.661+0000 7f5b31400640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5b180b6510 0x7f5b180b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5b3407b210 tx=0x7f5b20005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.662+0000 7f5b2aa00640 1 -- 172.21.15.37:0/2542711252 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5b240b2780 con 0x7f5b34077940 2024-09-21T05:50:51.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:51.863+0000 7f5b39200640 1 -- 172.21.15.37:0/2542711252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f5b341a1bb0 con 0x7f5b34077940 2024-09-21T05:50:52.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:51 smithi144 ceph-mon[34351]: pgmap v305: 33 pgs: 8 creating+peering, 24 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:52.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:51 smithi144 ceph-mon[34351]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T05:50:52.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:51 smithi037 ceph-mon[30631]: pgmap v305: 33 pgs: 8 creating+peering, 24 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:52.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:51 smithi037 ceph-mon[30631]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T05:50:52.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:51 smithi067 ceph-mon[34443]: pgmap v305: 33 pgs: 8 creating+peering, 24 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:52.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:51 smithi067 ceph-mon[34443]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T05:50:52.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:52.865+0000 7f5b2aa00640 1 -- 172.21.15.37:0/2542711252 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v76) ==== 171+0+0 (secure 0 0 0) 0x7f5b341a1bb0 con 0x7f5b34077940 2024-09-21T05:50:52.871 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-09-21T05:50:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:52.872+0000 7f5b39200640 1 -- 172.21.15.37:0/2542711252 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5b180b6510 msgr2=0x7f5b180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:52.872+0000 7f5b39200640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5b180b6510 0x7f5b180b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5b3407b210 tx=0x7f5b20005f90 comp rx=0 tx=0).stop 2024-09-21T05:50:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:52.872+0000 7f5b39200640 1 -- 172.21.15.37:0/2542711252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b34077940 msgr2=0x7f5b341a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:52.872+0000 7f5b39200640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b34077940 0x7f5b341a0a80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400e9f0 tx=0x7f5b2400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:50:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:52.873+0000 7f5b39200640 1 -- 172.21.15.37:0/2542711252 shutdown_connections 2024-09-21T05:50:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:52.873+0000 7f5b39200640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b34114740 0x7f5b341a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:52.873+0000 7f5b39200640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b34078290 0x7f5b341a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:52.873+0000 7f5b39200640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5b180b6510 0x7f5b180b8a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:52.873+0000 7f5b39200640 1 --2- 172.21.15.37:0/2542711252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b34077940 0x7f5b341a0a80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:52.873+0000 7f5b39200640 1 -- 172.21.15.37:0/2542711252 >> 172.21.15.37:0/2542711252 conn(0x7f5b34101810 msgr2=0x7f5b34116760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:52.874+0000 7f5b39200640 1 -- 172.21.15.37:0/2542711252 shutdown_connections 2024-09-21T05:50:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:52.875+0000 7f5b39200640 1 -- 172.21.15.37:0/2542711252 wait complete. 2024-09-21T05:50:53.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:52 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2542711252' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T05:50:53.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:52 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T05:50:53.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:52 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2542711252' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T05:50:53.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:52 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T05:50:53.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:52 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2542711252' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T05:50:53.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:52 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T05:50:53.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T05:50:54.046 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:54.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:53 smithi144 ceph-mon[34351]: pgmap v308: 33 pgs: 1 creating+activating, 14 creating+peering, 10 unknown, 8 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:54.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:53 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T05:50:54.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:53 smithi144 ceph-mon[34351]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T05:50:54.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:53 smithi037 ceph-mon[30631]: pgmap v308: 33 pgs: 1 creating+activating, 14 creating+peering, 10 unknown, 8 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:54.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:53 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T05:50:54.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:53 smithi037 ceph-mon[30631]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T05:50:54.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:53 smithi067 ceph-mon[34443]: pgmap v308: 33 pgs: 1 creating+activating, 14 creating+peering, 10 unknown, 8 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:54.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:53 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T05:50:54.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:53 smithi067 ceph-mon[34443]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T05:50:54.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.719+0000 7fcd92800640 1 -- 172.21.15.37:0/1771122749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd8c1094c0 msgr2=0x7fcd8c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:54.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.719+0000 7fcd92800640 1 --2- 172.21.15.37:0/1771122749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd8c1094c0 0x7fcd8c1098d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009900 tx=0x7fcd7402a3f0 comp rx=0 tx=0).stop 2024-09-21T05:50:54.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.719+0000 7fcd92800640 1 -- 172.21.15.37:0/1771122749 shutdown_connections 2024-09-21T05:50:54.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.719+0000 7fcd92800640 1 --2- 172.21.15.37:0/1771122749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd8c109e10 0x7fcd8c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.719+0000 7fcd92800640 1 --2- 172.21.15.37:0/1771122749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd8c1094c0 0x7fcd8c1098d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.719+0000 7fcd92800640 1 --2- 172.21.15.37:0/1771122749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd8c103b80 0x7fcd8c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.719+0000 7fcd92800640 1 -- 172.21.15.37:0/1771122749 >> 172.21.15.37:0/1771122749 conn(0x7fcd8c0ff610 msgr2=0x7fcd8c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.719+0000 7fcd92800640 1 -- 172.21.15.37:0/1771122749 shutdown_connections 2024-09-21T05:50:54.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.719+0000 7fcd92800640 1 -- 172.21.15.37:0/1771122749 wait complete. 2024-09-21T05:50:54.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.721+0000 7fcd92800640 1 Processor -- start 2024-09-21T05:50:54.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.721+0000 7fcd92800640 1 -- start start 2024-09-21T05:50:54.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.721+0000 7fcd92800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd8c103b80 0x7fcd8c19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:54.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.721+0000 7fcd92800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd8c1094c0 0x7fcd8c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:54.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.721+0000 7fcd92800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd8c109e10 0x7fcd8c1a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:54.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.721+0000 7fcd92800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c113ad0 con 0x7fcd8c1094c0 2024-09-21T05:50:54.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.721+0000 7fcd92800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c113950 con 0x7fcd8c109e10 2024-09-21T05:50:54.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.721+0000 7fcd92800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c113c50 con 0x7fcd8c103b80 2024-09-21T05:50:54.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.722+0000 7fcd8b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd8c103b80 0x7fcd8c19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:54.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.722+0000 7fcd82a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd8c1094c0 0x7fcd8c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:54.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.722+0000 7fcd8b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd8c103b80 0x7fcd8c19c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47436/0 (socket says 172.21.15.37:47436) 2024-09-21T05:50:54.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.722+0000 7fcd8b400640 1 -- 172.21.15.37:0/1919608406 learned_addr learned my addr 172.21.15.37:0/1919608406 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:54.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.722+0000 7fcd8be00640 1 --2- 172.21.15.37:0/1919608406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd8c109e10 0x7fcd8c1a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:54.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.722+0000 7fcd8b400640 1 -- 172.21.15.37:0/1919608406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd8c109e10 msgr2=0x7fcd8c1a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.722+0000 7fcd8b400640 1 --2- 172.21.15.37:0/1919608406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd8c109e10 0x7fcd8c1a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.722+0000 7fcd8b400640 1 -- 172.21.15.37:0/1919608406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd8c1094c0 msgr2=0x7fcd8c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.722+0000 7fcd8b400640 1 --2- 172.21.15.37:0/1919608406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd8c1094c0 0x7fcd8c19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.722+0000 7fcd8b400640 1 -- 172.21.15.37:0/1919608406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c1a2670 con 0x7fcd8c103b80 2024-09-21T05:50:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.722+0000 7fcd8b400640 1 --2- 172.21.15.37:0/1919608406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd8c103b80 0x7fcd8c19c700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00e9f0 tx=0x7fcd7c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.723+0000 7fcd88c00640 1 -- 172.21.15.37:0/1919608406 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c00cd80 con 0x7fcd8c103b80 2024-09-21T05:50:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.723+0000 7fcd92800640 1 -- 172.21.15.37:0/1919608406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8c1a2960 con 0x7fcd8c103b80 2024-09-21T05:50:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.723+0000 7fcd88c00640 1 -- 172.21.15.37:0/1919608406 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd7c0054d0 con 0x7fcd8c103b80 2024-09-21T05:50:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.723+0000 7fcd88c00640 1 -- 172.21.15.37:0/1919608406 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c010690 con 0x7fcd8c103b80 2024-09-21T05:50:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.723+0000 7fcd92800640 1 -- 172.21.15.37:0/1919608406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd8c1a90c0 con 0x7fcd8c103b80 2024-09-21T05:50:54.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.724+0000 7fcd92800640 1 -- 172.21.15.37:0/1919608406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd8c104e00 con 0x7fcd8c103b80 2024-09-21T05:50:54.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.727+0000 7fcd88c00640 1 -- 172.21.15.37:0/1919608406 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fcd7c004e30 con 0x7fcd8c103b80 2024-09-21T05:50:54.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.728+0000 7fcd88c00640 1 --2- 172.21.15.37:0/1919608406 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcd700b6510 0x7fcd700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:54.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.728+0000 7fcd88c00640 1 -- 172.21.15.37:0/1919608406 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7879+0+0 (secure 0 0 0) 0x7fcd7c0e7790 con 0x7fcd8c103b80 2024-09-21T05:50:54.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.728+0000 7fcd82a00640 1 --2- 172.21.15.37:0/1919608406 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcd700b6510 0x7fcd700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:54.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.729+0000 7fcd82a00640 1 --2- 172.21.15.37:0/1919608406 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcd700b6510 0x7fcd700b8a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009230 tx=0x7fcd74031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:54.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.730+0000 7fcd88c00640 1 -- 172.21.15.37:0/1919608406 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd7c0ae130 con 0x7fcd8c103b80 2024-09-21T05:50:54.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:54.971+0000 7fcd92800640 1 -- 172.21.15.37:0/1919608406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcd8c103f90 con 0x7fcd8c103b80 2024-09-21T05:50:55.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:54 smithi037 ceph-mon[30631]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T05:50:55.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:54 smithi067 ceph-mon[34443]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T05:50:55.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:54 smithi144 ceph-mon[34351]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T05:50:55.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:55.894+0000 7fcd88c00640 1 -- 172.21.15.37:0/1919608406 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fcd8c103f90 con 0x7fcd8c103b80 2024-09-21T05:50:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T05:50:55.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:55.897+0000 7fcd92800640 1 -- 172.21.15.37:0/1919608406 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcd700b6510 msgr2=0x7fcd700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:55.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:55.897+0000 7fcd92800640 1 --2- 172.21.15.37:0/1919608406 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcd700b6510 0x7fcd700b8a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009230 tx=0x7fcd74031400 comp rx=0 tx=0).stop 2024-09-21T05:50:55.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:55.897+0000 7fcd92800640 1 -- 172.21.15.37:0/1919608406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd8c103b80 msgr2=0x7fcd8c19c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:55.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:55.897+0000 7fcd92800640 1 --2- 172.21.15.37:0/1919608406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd8c103b80 0x7fcd8c19c700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00e9f0 tx=0x7fcd7c00edf0 comp rx=0 tx=0).stop 2024-09-21T05:50:55.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:55.898+0000 7fcd92800640 1 -- 172.21.15.37:0/1919608406 shutdown_connections 2024-09-21T05:50:55.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:55.898+0000 7fcd92800640 1 --2- 172.21.15.37:0/1919608406 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcd700b6510 0x7fcd700b8a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:55.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:55.898+0000 7fcd92800640 1 --2- 172.21.15.37:0/1919608406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd8c109e10 0x7fcd8c1a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:55.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:55.898+0000 7fcd92800640 1 --2- 172.21.15.37:0/1919608406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd8c1094c0 0x7fcd8c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:55.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:55.898+0000 7fcd92800640 1 --2- 172.21.15.37:0/1919608406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd8c103b80 0x7fcd8c19c700 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:55.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:55.898+0000 7fcd92800640 1 -- 172.21.15.37:0/1919608406 >> 172.21.15.37:0/1919608406 conn(0x7fcd8c0ff610 msgr2=0x7fcd8c106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:55.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:55.898+0000 7fcd92800640 1 -- 172.21.15.37:0/1919608406 shutdown_connections 2024-09-21T05:50:55.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:55.898+0000 7fcd92800640 1 -- 172.21.15.37:0/1919608406 wait complete. 2024-09-21T05:50:56.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:55 smithi037 ceph-mon[30631]: pgmap v311: 97 pgs: 1 creating+activating, 14 creating+peering, 67 unknown, 15 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:56.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:55 smithi037 ceph-mon[30631]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T05:50:56.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:55 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1919608406' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T05:50:56.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:55 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T05:50:56.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:55 smithi037 ceph-mon[30631]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T05:50:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:55 smithi067 ceph-mon[34443]: pgmap v311: 97 pgs: 1 creating+activating, 14 creating+peering, 67 unknown, 15 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:55 smithi067 ceph-mon[34443]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T05:50:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:55 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1919608406' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T05:50:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:55 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T05:50:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:55 smithi067 ceph-mon[34443]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T05:50:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:55 smithi144 ceph-mon[34351]: pgmap v311: 97 pgs: 1 creating+activating, 14 creating+peering, 67 unknown, 15 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:55 smithi144 ceph-mon[34351]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T05:50:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:55 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1919608406' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T05:50:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:55 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T05:50:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:55 smithi144 ceph-mon[34351]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T05:50:56.821 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T05:50:56.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T05:50:57.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:56 smithi037 ceph-mon[30631]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T05:50:57.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:56 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T05:50:57.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:56 smithi037 ceph-mon[30631]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T05:50:57.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:56 smithi037 ceph-mon[30631]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T05:50:57.206 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:50:57.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:56 smithi067 ceph-mon[34443]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T05:50:57.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:56 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T05:50:57.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:56 smithi067 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T05:50:57.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:56 smithi067 ceph-mon[34443]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T05:50:57.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:56 smithi144 ceph-mon[34351]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T05:50:57.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:56 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T05:50:57.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:56 smithi144 ceph-mon[34351]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T05:50:57.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:56 smithi144 ceph-mon[34351]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T05:50:57.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.837+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3043330985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd4105bb0 msgr2=0x7f5fd4105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:57.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.837+0000 7f5fd9a00640 1 --2- 172.21.15.37:0/3043330985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd4105bb0 0x7f5fd4105fc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009900 tx=0x7f5fc402a410 comp rx=0 tx=0).stop 2024-09-21T05:50:57.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.837+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3043330985 shutdown_connections 2024-09-21T05:50:57.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.837+0000 7f5fd9a00640 1 --2- 172.21.15.37:0/3043330985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd410be40 0x7f5fd4112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:57.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.837+0000 7f5fd9a00640 1 --2- 172.21.15.37:0/3043330985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd410b4f0 0x7f5fd410b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:57.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.837+0000 7f5fd9a00640 1 --2- 172.21.15.37:0/3043330985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd4105bb0 0x7f5fd4105fc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:57.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.837+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3043330985 >> 172.21.15.37:0/3043330985 conn(0x7f5fd4101680 msgr2=0x7f5fd4103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:57.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.837+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3043330985 shutdown_connections 2024-09-21T05:50:57.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.837+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3043330985 wait complete. 2024-09-21T05:50:57.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.838+0000 7f5fd9a00640 1 Processor -- start 2024-09-21T05:50:57.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.838+0000 7f5fd9a00640 1 -- start start 2024-09-21T05:50:57.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.839+0000 7f5fd9a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd4105bb0 0x7f5fd419c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:57.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.839+0000 7f5fd9a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd410b4f0 0x7f5fd419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:57.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.839+0000 7f5fd9a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd410be40 0x7f5fd41a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:57.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.839+0000 7f5fd9a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd4115b50 con 0x7f5fd4105bb0 2024-09-21T05:50:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.839+0000 7f5fd9a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd41159d0 con 0x7f5fd410be40 2024-09-21T05:50:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.839+0000 7f5fd9a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd4115cd0 con 0x7f5fd410b4f0 2024-09-21T05:50:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.839+0000 7f5fd3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd4105bb0 0x7f5fd419c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.839+0000 7f5fd3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd4105bb0 0x7f5fd419c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50812/0 (socket says 172.21.15.37:50812) 2024-09-21T05:50:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.839+0000 7f5fd3e00640 1 -- 172.21.15.37:0/3102322625 learned_addr learned my addr 172.21.15.37:0/3102322625 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:50:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.839+0000 7f5fd9000640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd410be40 0x7f5fd41a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.839+0000 7f5fcb400640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd410b4f0 0x7f5fd419cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.840+0000 7f5fd3e00640 1 -- 172.21.15.37:0/3102322625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd410b4f0 msgr2=0x7f5fd419cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.840+0000 7f5fd3e00640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd410b4f0 0x7f5fd419cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.840+0000 7f5fd3e00640 1 -- 172.21.15.37:0/3102322625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd410be40 msgr2=0x7f5fd41a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.840+0000 7f5fd3e00640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd410be40 0x7f5fd41a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.840+0000 7f5fd3e00640 1 -- 172.21.15.37:0/3102322625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd41a24b0 con 0x7f5fd4105bb0 2024-09-21T05:50:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.840+0000 7f5fd3e00640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd4105bb0 0x7f5fd419c540 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4005ab0 tx=0x7f5fc4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.840+0000 7f5fd1600640 1 -- 172.21.15.37:0/3102322625 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc403f070 con 0x7f5fd4105bb0 2024-09-21T05:50:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.840+0000 7f5fd1600640 1 -- 172.21.15.37:0/3102322625 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fc4031d60 con 0x7f5fd4105bb0 2024-09-21T05:50:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.840+0000 7f5fd1600640 1 -- 172.21.15.37:0/3102322625 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4035030 con 0x7f5fd4105bb0 2024-09-21T05:50:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.840+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3102322625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd41a2740 con 0x7f5fd4105bb0 2024-09-21T05:50:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.840+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3102322625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd41a8f00 con 0x7f5fd4105bb0 2024-09-21T05:50:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.841+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3102322625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd4106e30 con 0x7f5fd4105bb0 2024-09-21T05:50:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.844+0000 7f5fd1600640 1 -- 172.21.15.37:0/3102322625 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f5fc4042070 con 0x7f5fd4105bb0 2024-09-21T05:50:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.846+0000 7f5fd1600640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5fb80b6510 0x7f5fb80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:50:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.846+0000 7f5fd1600640 1 -- 172.21.15.37:0/3102322625 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f5fc4108050 con 0x7f5fd4105bb0 2024-09-21T05:50:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.846+0000 7f5fcb400640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5fb80b6510 0x7f5fb80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:50:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.847+0000 7f5fcb400640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5fb80b6510 0x7f5fb80b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4104ed0 tx=0x7f5fbc00b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:50:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:57.848+0000 7f5fd1600640 1 -- 172.21.15.37:0/3102322625 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5fc40d2d70 con 0x7f5fd4105bb0 2024-09-21T05:50:57.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:57 smithi037 ceph-mon[30631]: pgmap v314: 97 pgs: 31 unknown, 66 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:57.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:57 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] up:active 2024-09-21T05:50:57.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:57 smithi037 ceph-mon[30631]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:50:57.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:57 smithi037 ceph-mon[30631]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:50:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.060+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3102322625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f5fd410dc10 con 0x7f5fd4105bb0 2024-09-21T05:50:58.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:57 smithi067 ceph-mon[34443]: pgmap v314: 97 pgs: 31 unknown, 66 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:58.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:57 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] up:active 2024-09-21T05:50:58.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:57 smithi067 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:50:58.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:57 smithi067 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:50:58.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:57 smithi144 ceph-mon[34351]: pgmap v314: 97 pgs: 31 unknown, 66 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:50:58.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:57 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] up:active 2024-09-21T05:50:58.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:57 smithi144 ceph-mon[34351]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:50:58.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:57 smithi144 ceph-mon[34351]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:50:58.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.905+0000 7f5fd1600640 1 -- 172.21.15.37:0/3102322625 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v80) ==== 157+0+0 (secure 0 0 0) 0x7f5fc40d7cb0 con 0x7f5fd4105bb0 2024-09-21T05:50:58.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.909+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3102322625 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5fb80b6510 msgr2=0x7f5fb80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.909+0000 7f5fd9a00640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5fb80b6510 0x7f5fb80b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4104ed0 tx=0x7f5fbc00b410 comp rx=0 tx=0).stop 2024-09-21T05:50:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.909+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3102322625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd4105bb0 msgr2=0x7f5fd419c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:50:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.909+0000 7f5fd9a00640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd4105bb0 0x7f5fd419c540 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4005ab0 tx=0x7f5fc4003c80 comp rx=0 tx=0).stop 2024-09-21T05:50:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.910+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3102322625 shutdown_connections 2024-09-21T05:50:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.910+0000 7f5fd9a00640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5fb80b6510 0x7f5fb80b8a20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.910+0000 7f5fd9a00640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fd410be40 0x7f5fd41a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.910+0000 7f5fd9a00640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd410b4f0 0x7f5fd419cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.910+0000 7f5fd9a00640 1 --2- 172.21.15.37:0/3102322625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd4105bb0 0x7f5fd419c540 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:50:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.910+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3102322625 >> 172.21.15.37:0/3102322625 conn(0x7f5fd4101680 msgr2=0x7f5fd410ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:50:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.910+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3102322625 shutdown_connections 2024-09-21T05:50:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:50:58.910+0000 7f5fd9a00640 1 -- 172.21.15.37:0/3102322625 wait complete. 2024-09-21T05:50:59.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:58 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3102322625' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T05:50:59.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:58 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3102322625' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T05:50:59.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:58 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3102322625' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T05:50:59.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T05:51:00.164 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:00.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:59 smithi037 ceph-mon[30631]: pgmap v315: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-21T05:51:00.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:59 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3102322625' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T05:51:00.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:50:59 smithi037 ceph-mon[30631]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T05:51:00.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:59 smithi067 ceph-mon[34443]: pgmap v315: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-21T05:51:00.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:59 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3102322625' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T05:51:00.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:50:59 smithi067 ceph-mon[34443]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T05:51:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:59 smithi144 ceph-mon[34351]: pgmap v315: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-21T05:51:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:59 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3102322625' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T05:51:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:50:59 smithi144 ceph-mon[34351]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T05:51:00.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.810+0000 7ff43f200640 1 -- 172.21.15.37:0/17248416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff438077940 msgr2=0x7ff438077d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:00.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.810+0000 7ff43f200640 1 --2- 172.21.15.37:0/17248416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff438077940 0x7ff438077d50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff428009900 tx=0x7ff42802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.810+0000 7ff43f200640 1 -- 172.21.15.37:0/17248416 shutdown_connections 2024-09-21T05:51:00.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.810+0000 7ff43f200640 1 --2- 172.21.15.37:0/17248416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff438114740 0x7ff438116b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.810+0000 7ff43f200640 1 --2- 172.21.15.37:0/17248416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff438078290 0x7ff438114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.810+0000 7ff43f200640 1 --2- 172.21.15.37:0/17248416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff438077940 0x7ff438077d50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.810+0000 7ff43f200640 1 -- 172.21.15.37:0/17248416 >> 172.21.15.37:0/17248416 conn(0x7ff4381017d0 msgr2=0x7ff438103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:00.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.810+0000 7ff43f200640 1 -- 172.21.15.37:0/17248416 shutdown_connections 2024-09-21T05:51:00.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.810+0000 7ff43f200640 1 -- 172.21.15.37:0/17248416 wait complete. 2024-09-21T05:51:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.812+0000 7ff43f200640 1 Processor -- start 2024-09-21T05:51:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.812+0000 7ff43f200640 1 -- start start 2024-09-21T05:51:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.812+0000 7ff43f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff438077940 0x7ff4381a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.812+0000 7ff43f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff438078290 0x7ff4381a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.812+0000 7ff43f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff438114740 0x7ff4381a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.812+0000 7ff43f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff43811a0d0 con 0x7ff438078290 2024-09-21T05:51:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.812+0000 7ff43f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff438119f50 con 0x7ff438114740 2024-09-21T05:51:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.812+0000 7ff43f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff43811a250 con 0x7ff438077940 2024-09-21T05:51:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.812+0000 7ff43d200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff438114740 0x7ff4381a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.813+0000 7ff43d200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff438114740 0x7ff4381a6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:54120/0 (socket says 172.21.15.37:54120) 2024-09-21T05:51:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.813+0000 7ff43d200640 1 -- 172.21.15.37:0/752820703 learned_addr learned my addr 172.21.15.37:0/752820703 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:00.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.813+0000 7ff437400640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff438078290 0x7ff4381a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.813+0000 7ff437e00640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff438077940 0x7ff4381a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.813+0000 7ff43d200640 1 -- 172.21.15.37:0/752820703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff438077940 msgr2=0x7ff4381a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.813+0000 7ff43d200640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff438077940 0x7ff4381a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.813+0000 7ff43d200640 1 -- 172.21.15.37:0/752820703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff438078290 msgr2=0x7ff4381a1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.813+0000 7ff43d200640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff438078290 0x7ff4381a1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.813+0000 7ff43d200640 1 -- 172.21.15.37:0/752820703 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4381a6a50 con 0x7ff438114740 2024-09-21T05:51:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.813+0000 7ff43d200640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff438114740 0x7ff4381a6320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff43000eb10 tx=0x7ff43000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.814+0000 7ff434c00640 1 -- 172.21.15.37:0/752820703 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430004b20 con 0x7ff438114740 2024-09-21T05:51:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.814+0000 7ff43f200640 1 -- 172.21.15.37:0/752820703 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4381a6d40 con 0x7ff438114740 2024-09-21T05:51:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.814+0000 7ff434c00640 1 -- 172.21.15.37:0/752820703 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff430004cc0 con 0x7ff438114740 2024-09-21T05:51:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.814+0000 7ff434c00640 1 -- 172.21.15.37:0/752820703 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430010690 con 0x7ff438114740 2024-09-21T05:51:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.814+0000 7ff43f200640 1 -- 172.21.15.37:0/752820703 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4381ad4a0 con 0x7ff438114740 2024-09-21T05:51:00.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.815+0000 7ff43f200640 1 -- 172.21.15.37:0/752820703 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff438077d50 con 0x7ff438114740 2024-09-21T05:51:00.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.818+0000 7ff434c00640 1 -- 172.21.15.37:0/752820703 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7ff430005020 con 0x7ff438114740 2024-09-21T05:51:00.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.819+0000 7ff434c00640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff41c0b6510 0x7ff41c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:00.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.820+0000 7ff434c00640 1 -- 172.21.15.37:0/752820703 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8277+0+0 (secure 0 0 0) 0x7ff4300e7c60 con 0x7ff438114740 2024-09-21T05:51:00.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.820+0000 7ff437e00640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff41c0b6510 0x7ff41c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:00.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.821+0000 7ff437e00640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff41c0b6510 0x7ff41c0b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff428031440 tx=0x7ff428009560 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:00.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:00.821+0000 7ff434c00640 1 -- 172.21.15.37:0/752820703 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4300ae460 con 0x7ff438114740 2024-09-21T05:51:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:01.021+0000 7ff43f200640 1 -- 172.21.15.37:0/752820703 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff4381a1c10 con 0x7ff438114740 2024-09-21T05:51:01.246 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 05:51:00 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-b[62795]: 2024-09-21T05:51:00.934+0000 7f261779b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T05:51:02.185 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:01 smithi144 ceph-mon[34351]: pgmap v317: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 2 op/s 2024-09-21T05:51:02.185 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:01 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/752820703' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T05:51:02.185 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:01 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T05:51:02.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:01 smithi067 ceph-mon[34443]: pgmap v317: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 2 op/s 2024-09-21T05:51:02.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:01 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/752820703' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T05:51:02.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:01 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T05:51:02.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:01 smithi037 ceph-mon[30631]: pgmap v317: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 2 op/s 2024-09-21T05:51:02.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:01 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/752820703' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T05:51:02.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:01 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T05:51:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:02.920+0000 7ff434c00640 1 -- 172.21.15.37:0/752820703 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v82) ==== 228+0+0 (secure 0 0 0) 0x7ff4300b2840 con 0x7ff438114740 2024-09-21T05:51:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' created 2024-09-21T05:51:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:02.930+0000 7ff43f200640 1 -- 172.21.15.37:0/752820703 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff41c0b6510 msgr2=0x7ff41c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:02.930+0000 7ff43f200640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff41c0b6510 0x7ff41c0b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff428031440 tx=0x7ff428009560 comp rx=0 tx=0).stop 2024-09-21T05:51:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:02.930+0000 7ff43f200640 1 -- 172.21.15.37:0/752820703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff438114740 msgr2=0x7ff4381a6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:02.930+0000 7ff43f200640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff438114740 0x7ff4381a6320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff43000eb10 tx=0x7ff43000c2d0 comp rx=0 tx=0).stop 2024-09-21T05:51:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:02.931+0000 7ff43f200640 1 -- 172.21.15.37:0/752820703 shutdown_connections 2024-09-21T05:51:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:02.931+0000 7ff43f200640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff41c0b6510 0x7ff41c0b8a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:02.931+0000 7ff43f200640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff438114740 0x7ff4381a6320 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:02.931+0000 7ff43f200640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff438078290 0x7ff4381a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:02.931+0000 7ff43f200640 1 --2- 172.21.15.37:0/752820703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff438077940 0x7ff4381a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:02.931+0000 7ff43f200640 1 -- 172.21.15.37:0/752820703 >> 172.21.15.37:0/752820703 conn(0x7ff4381017d0 msgr2=0x7ff438116880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:02.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:02.932+0000 7ff43f200640 1 -- 172.21.15.37:0/752820703 shutdown_connections 2024-09-21T05:51:02.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:02.932+0000 7ff43f200640 1 -- 172.21.15.37:0/752820703 wait complete. 2024-09-21T05:51:03.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:02 smithi067 ceph-mon[34443]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T05:51:03.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:02 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T05:51:03.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:02 smithi067 ceph-mon[34443]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T05:51:03.303 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:02 smithi037 ceph-mon[30631]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T05:51:03.303 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:02 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T05:51:03.303 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:02 smithi037 ceph-mon[30631]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T05:51:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:02 smithi144 ceph-mon[34351]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T05:51:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:02 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T05:51:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:02 smithi144 ceph-mon[34351]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T05:51:03.706 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T05:51:04.111 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:03 smithi067 ceph-mon[34443]: pgmap v319: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-21T05:51:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:03 smithi067 ceph-mon[34443]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T05:51:04.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:03 smithi037 ceph-mon[30631]: pgmap v319: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-21T05:51:04.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:03 smithi037 ceph-mon[30631]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T05:51:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:03 smithi144 ceph-mon[34351]: pgmap v319: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-21T05:51:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:03 smithi144 ceph-mon[34351]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T05:51:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.833+0000 7fadbd000640 1 -- 172.21.15.37:0/696857643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb810be40 msgr2=0x7fadb8112670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.833+0000 7fadbd000640 1 --2- 172.21.15.37:0/696857643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb810be40 0x7fadb8112670 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009ca0 tx=0x7fadb002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.833+0000 7fadbd000640 1 -- 172.21.15.37:0/696857643 shutdown_connections 2024-09-21T05:51:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.833+0000 7fadbd000640 1 --2- 172.21.15.37:0/696857643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb810be40 0x7fadb8112670 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.833+0000 7fadbd000640 1 --2- 172.21.15.37:0/696857643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadb810b4f0 0x7fadb810b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.833+0000 7fadbd000640 1 --2- 172.21.15.37:0/696857643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8105bb0 0x7fadb8105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.833+0000 7fadbd000640 1 -- 172.21.15.37:0/696857643 >> 172.21.15.37:0/696857643 conn(0x7fadb8101680 msgr2=0x7fadb8103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.833+0000 7fadbd000640 1 -- 172.21.15.37:0/696857643 shutdown_connections 2024-09-21T05:51:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.833+0000 7fadbd000640 1 -- 172.21.15.37:0/696857643 wait complete. 2024-09-21T05:51:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.835+0000 7fadbd000640 1 Processor -- start 2024-09-21T05:51:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.835+0000 7fadbd000640 1 -- start start 2024-09-21T05:51:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.835+0000 7fadbd000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb8105bb0 0x7fadb819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.835+0000 7fadbd000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadb810b4f0 0x7fadb819ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.835+0000 7fadbd000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb810be40 0x7fadb81a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.835+0000 7fadbd000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fadb8115b00 con 0x7fadb810be40 2024-09-21T05:51:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.835+0000 7fadbd000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fadb8115980 con 0x7fadb810b4f0 2024-09-21T05:51:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.835+0000 7fadbd000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fadb8115c80 con 0x7fadb8105bb0 2024-09-21T05:51:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.836+0000 7fadb7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb810be40 0x7fadb81a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.836+0000 7fadb7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb8105bb0 0x7fadb819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.836+0000 7fadb7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb8105bb0 0x7fadb819c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:54018/0 (socket says 172.21.15.37:54018) 2024-09-21T05:51:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.836+0000 7fadb7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb810be40 0x7fadb81a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41914/0 (socket says 172.21.15.37:41914) 2024-09-21T05:51:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.836+0000 7fadb7400640 1 -- 172.21.15.37:0/182664599 learned_addr learned my addr 172.21.15.37:0/182664599 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.836+0000 7fadaea00640 1 --2- 172.21.15.37:0/182664599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadb810b4f0 0x7fadb819ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.836+0000 7fadb7400640 1 -- 172.21.15.37:0/182664599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadb810b4f0 msgr2=0x7fadb819ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.836+0000 7fadb7400640 1 --2- 172.21.15.37:0/182664599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadb810b4f0 0x7fadb819ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:04.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.836+0000 7fadb7400640 1 -- 172.21.15.37:0/182664599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb810be40 msgr2=0x7fadb81a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:04.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.836+0000 7fadb7400640 1 --2- 172.21.15.37:0/182664599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb810be40 0x7fadb81a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:04.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.836+0000 7fadb7400640 1 -- 172.21.15.37:0/182664599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb81a2440 con 0x7fadb8105bb0 2024-09-21T05:51:04.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.836+0000 7fadb7400640 1 --2- 172.21.15.37:0/182664599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb8105bb0 0x7fadb819c4d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fada800e9f0 tx=0x7fada800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:04.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.837+0000 7fadb4c00640 1 -- 172.21.15.37:0/182664599 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada800cd80 con 0x7fadb8105bb0 2024-09-21T05:51:04.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.837+0000 7fadb4c00640 1 -- 172.21.15.37:0/182664599 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fada80108e0 con 0x7fadb8105bb0 2024-09-21T05:51:04.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.837+0000 7fadb4c00640 1 -- 172.21.15.37:0/182664599 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada8018980 con 0x7fadb8105bb0 2024-09-21T05:51:04.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.837+0000 7fadbd000640 1 -- 172.21.15.37:0/182664599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb81a2730 con 0x7fadb8105bb0 2024-09-21T05:51:04.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.837+0000 7fadbd000640 1 -- 172.21.15.37:0/182664599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb81a8e90 con 0x7fadb8105bb0 2024-09-21T05:51:04.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.838+0000 7fadbd000640 1 -- 172.21.15.37:0/182664599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb8105fc0 con 0x7fadb8105bb0 2024-09-21T05:51:04.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.841+0000 7fadb4c00640 1 -- 172.21.15.37:0/182664599 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fada8010430 con 0x7fadb8105bb0 2024-09-21T05:51:04.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.842+0000 7fadb4c00640 1 --2- 172.21.15.37:0/182664599 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fad9c0b6510 0x7fad9c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:04.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.842+0000 7fadb4c00640 1 -- 172.21.15.37:0/182664599 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8770+0+0 (secure 0 0 0) 0x7fada80e7d20 con 0x7fadb8105bb0 2024-09-21T05:51:04.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.842+0000 7fadaea00640 1 --2- 172.21.15.37:0/182664599 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fad9c0b6510 0x7fad9c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:04.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.843+0000 7fadaea00640 1 --2- 172.21.15.37:0/182664599 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fad9c0b6510 0x7fad9c0b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fadb8104ed0 tx=0x7fada0005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:04.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:04.844+0000 7fadb4c00640 1 -- 172.21.15.37:0/182664599 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fada80b2710 con 0x7fadb8105bb0 2024-09-21T05:51:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.047+0000 7fadbd000640 1 -- 172.21.15.37:0/182664599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fadb819d600 con 0x7fadb8105bb0 2024-09-21T05:51:05.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.952+0000 7fadb4c00640 1 -- 172.21.15.37:0/182664599 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v85) ==== 169+0+0 (secure 0 0 0) 0x7fada80b7650 con 0x7fadb8105bb0 2024-09-21T05:51:05.958 INFO:teuthology.orchestra.run.smithi037.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T05:51:05.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.956+0000 7fadbd000640 1 -- 172.21.15.37:0/182664599 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fad9c0b6510 msgr2=0x7fad9c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:05.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.956+0000 7fadbd000640 1 --2- 172.21.15.37:0/182664599 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fad9c0b6510 0x7fad9c0b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fadb8104ed0 tx=0x7fada0005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:05.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.956+0000 7fadbd000640 1 -- 172.21.15.37:0/182664599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb8105bb0 msgr2=0x7fadb819c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:05.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.956+0000 7fadbd000640 1 --2- 172.21.15.37:0/182664599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb8105bb0 0x7fadb819c4d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fada800e9f0 tx=0x7fada800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.957+0000 7fadbd000640 1 -- 172.21.15.37:0/182664599 shutdown_connections 2024-09-21T05:51:05.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.957+0000 7fadbd000640 1 --2- 172.21.15.37:0/182664599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb810be40 0x7fadb81a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.957+0000 7fadbd000640 1 --2- 172.21.15.37:0/182664599 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fad9c0b6510 0x7fad9c0b8a20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.957+0000 7fadbd000640 1 --2- 172.21.15.37:0/182664599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fadb810b4f0 0x7fadb819ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.957+0000 7fadbd000640 1 --2- 172.21.15.37:0/182664599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb8105bb0 0x7fadb819c4d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:05.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.957+0000 7fadbd000640 1 -- 172.21.15.37:0/182664599 >> 172.21.15.37:0/182664599 conn(0x7fadb8101680 msgr2=0x7fadb810ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:05.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.957+0000 7fadbd000640 1 -- 172.21.15.37:0/182664599 shutdown_connections 2024-09-21T05:51:05.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:05.957+0000 7fadbd000640 1 -- 172.21.15.37:0/182664599 wait complete. 2024-09-21T05:51:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:05 smithi067 ceph-mon[34443]: pgmap v322: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 7 op/s 2024-09-21T05:51:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:05 smithi067 ceph-mon[34443]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T05:51:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:05 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/182664599' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T05:51:06.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:05 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T05:51:06.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:05 smithi037 ceph-mon[30631]: pgmap v322: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 7 op/s 2024-09-21T05:51:06.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:05 smithi037 ceph-mon[30631]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T05:51:06.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:05 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/182664599' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T05:51:06.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:05 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T05:51:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:05 smithi144 ceph-mon[34351]: pgmap v322: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 7 op/s 2024-09-21T05:51:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:05 smithi144 ceph-mon[34351]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T05:51:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:05 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/182664599' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T05:51:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:05 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T05:51:06.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T05:51:07.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:06 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T05:51:07.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:06 smithi037 ceph-mon[30631]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T05:51:07.198 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:07.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:06 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T05:51:07.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:06 smithi067 ceph-mon[34443]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T05:51:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:06 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T05:51:07.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:06 smithi144 ceph-mon[34351]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T05:51:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.859+0000 7ff97a800640 1 -- 172.21.15.37:0/2554747515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff974109c40 msgr2=0x7ff974110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.859+0000 7ff97a800640 1 --2- 172.21.15.37:0/2554747515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff974109c40 0x7ff974110470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009ca0 tx=0x7ff96c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.859+0000 7ff97a800640 1 -- 172.21.15.37:0/2554747515 shutdown_connections 2024-09-21T05:51:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.859+0000 7ff97a800640 1 --2- 172.21.15.37:0/2554747515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff974109c40 0x7ff974110470 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.859+0000 7ff97a800640 1 --2- 172.21.15.37:0/2554747515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9741092f0 0x7ff974109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.859+0000 7ff97a800640 1 --2- 172.21.15.37:0/2554747515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9741039b0 0x7ff974103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.859+0000 7ff97a800640 1 -- 172.21.15.37:0/2554747515 >> 172.21.15.37:0/2554747515 conn(0x7ff9740ff400 msgr2=0x7ff974101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.859+0000 7ff97a800640 1 -- 172.21.15.37:0/2554747515 shutdown_connections 2024-09-21T05:51:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.859+0000 7ff97a800640 1 -- 172.21.15.37:0/2554747515 wait complete. 2024-09-21T05:51:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.860+0000 7ff97a800640 1 Processor -- start 2024-09-21T05:51:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.860+0000 7ff97a800640 1 -- start start 2024-09-21T05:51:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.860+0000 7ff97a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9741039b0 0x7ff97419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.860+0000 7ff97a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9741092f0 0x7ff97419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff97a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff974109c40 0x7ff97419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff97a800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff974113950 con 0x7ff974109c40 2024-09-21T05:51:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff97a800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff9741137d0 con 0x7ff9741092f0 2024-09-21T05:51:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff97a800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff974113ad0 con 0x7ff9741039b0 2024-09-21T05:51:07.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff979400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9741039b0 0x7ff97419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:07.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff979e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff974109c40 0x7ff97419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:07.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff979400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9741039b0 0x7ff97419a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:54028/0 (socket says 172.21.15.37:54028) 2024-09-21T05:51:07.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff979400640 1 -- 172.21.15.37:0/3995706409 learned_addr learned my addr 172.21.15.37:0/3995706409 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:07.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff978a00640 1 --2- 172.21.15.37:0/3995706409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9741092f0 0x7ff97419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff979400640 1 -- 172.21.15.37:0/3995706409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9741092f0 msgr2=0x7ff97419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff979400640 1 --2- 172.21.15.37:0/3995706409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9741092f0 0x7ff97419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff979400640 1 -- 172.21.15.37:0/3995706409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff974109c40 msgr2=0x7ff97419fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff979400640 1 --2- 172.21.15.37:0/3995706409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff974109c40 0x7ff97419fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.861+0000 7ff979400640 1 -- 172.21.15.37:0/3995706409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9741a0290 con 0x7ff9741039b0 2024-09-21T05:51:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.862+0000 7ff979400640 1 --2- 172.21.15.37:0/3995706409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9741039b0 0x7ff97419a320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff96800e9f0 tx=0x7ff96800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.862+0000 7ff972000640 1 -- 172.21.15.37:0/3995706409 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96800cd80 con 0x7ff9741039b0 2024-09-21T05:51:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.862+0000 7ff97a800640 1 -- 172.21.15.37:0/3995706409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9741a0580 con 0x7ff9741039b0 2024-09-21T05:51:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.862+0000 7ff972000640 1 -- 172.21.15.37:0/3995706409 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9680054d0 con 0x7ff9741039b0 2024-09-21T05:51:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.862+0000 7ff972000640 1 -- 172.21.15.37:0/3995706409 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff968010690 con 0x7ff9741039b0 2024-09-21T05:51:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.862+0000 7ff97a800640 1 -- 172.21.15.37:0/3995706409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9741a6ce0 con 0x7ff9741039b0 2024-09-21T05:51:07.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.863+0000 7ff97a800640 1 -- 172.21.15.37:0/3995706409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff974103dc0 con 0x7ff9741039b0 2024-09-21T05:51:07.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.866+0000 7ff972000640 1 -- 172.21.15.37:0/3995706409 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7ff968004e30 con 0x7ff9741039b0 2024-09-21T05:51:07.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.867+0000 7ff972000640 1 --2- 172.21.15.37:0/3995706409 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff95c0b6510 0x7ff95c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:07.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.867+0000 7ff972000640 1 -- 172.21.15.37:0/3995706409 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8770+0+0 (secure 0 0 0) 0x7ff9680e7b20 con 0x7ff9741039b0 2024-09-21T05:51:07.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.867+0000 7ff978a00640 1 --2- 172.21.15.37:0/3995706409 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff95c0b6510 0x7ff95c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:07.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.868+0000 7ff978a00640 1 --2- 172.21.15.37:0/3995706409 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff95c0b6510 0x7ff95c0b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff974102b00 tx=0x7ff960005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:07.869+0000 7ff972000640 1 -- 172.21.15.37:0/3995706409 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff9680ae130 con 0x7ff9741039b0 2024-09-21T05:51:08.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.113+0000 7ff97a800640 1 -- 172.21.15.37:0/3995706409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7ff97402e640 con 0x7ff9741039b0 2024-09-21T05:51:08.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:07 smithi067 ceph-mon[34443]: pgmap v325: 129 pgs: 13 unknown, 116 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:08.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:07 smithi144 ceph-mon[34351]: pgmap v325: 129 pgs: 13 unknown, 116 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:08.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:07 smithi037 ceph-mon[30631]: pgmap v325: 129 pgs: 13 unknown, 116 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:08.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.974+0000 7ff972000640 1 -- 172.21.15.37:0/3995706409 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7ff9680b2510 con 0x7ff9741039b0 2024-09-21T05:51:08.977 INFO:teuthology.orchestra.run.smithi037.stderr:added data pool 4 to fsmap 2024-09-21T05:51:08.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.977+0000 7ff97a800640 1 -- 172.21.15.37:0/3995706409 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff95c0b6510 msgr2=0x7ff95c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:08.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.977+0000 7ff97a800640 1 --2- 172.21.15.37:0/3995706409 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff95c0b6510 0x7ff95c0b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff974102b00 tx=0x7ff960005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:08.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.977+0000 7ff97a800640 1 -- 172.21.15.37:0/3995706409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9741039b0 msgr2=0x7ff97419a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:08.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.977+0000 7ff97a800640 1 --2- 172.21.15.37:0/3995706409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9741039b0 0x7ff97419a320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff96800e9f0 tx=0x7ff96800edf0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.977+0000 7ff97a800640 1 -- 172.21.15.37:0/3995706409 shutdown_connections 2024-09-21T05:51:08.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.977+0000 7ff97a800640 1 --2- 172.21.15.37:0/3995706409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff974109c40 0x7ff97419fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.977+0000 7ff97a800640 1 --2- 172.21.15.37:0/3995706409 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff95c0b6510 0x7ff95c0b8a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.977+0000 7ff97a800640 1 --2- 172.21.15.37:0/3995706409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9741092f0 0x7ff97419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.977+0000 7ff97a800640 1 --2- 172.21.15.37:0/3995706409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9741039b0 0x7ff97419a320 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:08.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.977+0000 7ff97a800640 1 -- 172.21.15.37:0/3995706409 >> 172.21.15.37:0/3995706409 conn(0x7ff9740ff400 msgr2=0x7ff9741068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:08.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.977+0000 7ff97a800640 1 -- 172.21.15.37:0/3995706409 shutdown_connections 2024-09-21T05:51:08.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:08.978+0000 7ff97a800640 1 -- 172.21.15.37:0/3995706409 wait complete. 2024-09-21T05:51:09.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:08 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3995706409' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T05:51:09.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:08 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T05:51:09.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:08 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3995706409' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T05:51:09.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:08 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T05:51:09.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:08 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3995706409' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T05:51:09.393 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:08 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T05:51:09.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:51:10.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:09 smithi037 ceph-mon[30631]: pgmap v326: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:10.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:09 smithi037 ceph-mon[30631]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T05:51:10.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:09 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T05:51:10.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:09 smithi037 ceph-mon[30631]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:51:10.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:09 smithi067 ceph-mon[34443]: pgmap v326: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:10.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:09 smithi067 ceph-mon[34443]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T05:51:10.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:09 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T05:51:10.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:09 smithi067 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:51:10.273 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:10.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:09 smithi144 ceph-mon[34351]: pgmap v326: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:10.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:09 smithi144 ceph-mon[34351]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T05:51:10.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:09 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T05:51:10.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:09 smithi144 ceph-mon[34351]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:51:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.917+0000 7f8b83e00640 1 -- 172.21.15.37:0/3117751155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b841092f0 msgr2=0x7f8b84109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.917+0000 7f8b83e00640 1 --2- 172.21.15.37:0/3117751155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b841092f0 0x7f8b84109700 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009900 tx=0x7f8b7002a410 comp rx=0 tx=0).stop 2024-09-21T05:51:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.917+0000 7f8b83e00640 1 -- 172.21.15.37:0/3117751155 shutdown_connections 2024-09-21T05:51:10.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.917+0000 7f8b83e00640 1 --2- 172.21.15.37:0/3117751155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b84109c40 0x7f8b84110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.917+0000 7f8b83e00640 1 --2- 172.21.15.37:0/3117751155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b841092f0 0x7f8b84109700 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.917+0000 7f8b83e00640 1 --2- 172.21.15.37:0/3117751155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b841039b0 0x7f8b84103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.917+0000 7f8b83e00640 1 -- 172.21.15.37:0/3117751155 >> 172.21.15.37:0/3117751155 conn(0x7f8b840ff440 msgr2=0x7f8b84101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:10.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.918+0000 7f8b83e00640 1 -- 172.21.15.37:0/3117751155 shutdown_connections 2024-09-21T05:51:10.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.918+0000 7f8b83e00640 1 -- 172.21.15.37:0/3117751155 wait complete. 2024-09-21T05:51:10.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.919+0000 7f8b83e00640 1 Processor -- start 2024-09-21T05:51:10.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.919+0000 7f8b83e00640 1 -- start start 2024-09-21T05:51:10.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.919+0000 7f8b83e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b841039b0 0x7f8b84075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:10.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.919+0000 7f8b83e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b841092f0 0x7f8b84075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:10.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.919+0000 7f8b83e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b84109c40 0x7f8b84076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:10.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.919+0000 7f8b83e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84113900 con 0x7f8b84109c40 2024-09-21T05:51:10.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.919+0000 7f8b83e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84113780 con 0x7f8b841092f0 2024-09-21T05:51:10.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.919+0000 7f8b83e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84113a80 con 0x7f8b841039b0 2024-09-21T05:51:10.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.920+0000 7f8b83400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b84109c40 0x7f8b84076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:10.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.920+0000 7f8b82000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b841092f0 0x7f8b84075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:10.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.920+0000 7f8b82a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b841039b0 0x7f8b84075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:10.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.920+0000 7f8b82000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b841092f0 0x7f8b84075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:40542/0 (socket says 172.21.15.37:40542) 2024-09-21T05:51:10.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.920+0000 7f8b82000640 1 -- 172.21.15.37:0/1551375100 learned_addr learned my addr 172.21.15.37:0/1551375100 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:10.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.920+0000 7f8b82000640 1 -- 172.21.15.37:0/1551375100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b841039b0 msgr2=0x7f8b84075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:10.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.920+0000 7f8b82000640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b841039b0 0x7f8b84075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.920+0000 7f8b82000640 1 -- 172.21.15.37:0/1551375100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b84109c40 msgr2=0x7f8b84076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:10.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.920+0000 7f8b82000640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b84109c40 0x7f8b84076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:10.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.920+0000 7f8b82000640 1 -- 172.21.15.37:0/1551375100 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b841a8650 con 0x7f8b841092f0 2024-09-21T05:51:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.920+0000 7f8b82a00640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b841039b0 0x7f8b84075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:51:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.920+0000 7f8b83400640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b84109c40 0x7f8b84076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:51:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.921+0000 7f8b82000640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b841092f0 0x7f8b84075c50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b7002a930 tx=0x7f8b70031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.921+0000 7f8b7b400640 1 -- 172.21.15.37:0/1551375100 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7003f030 con 0x7f8b841092f0 2024-09-21T05:51:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.921+0000 7f8b83e00640 1 -- 172.21.15.37:0/1551375100 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b841a88e0 con 0x7f8b841092f0 2024-09-21T05:51:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.921+0000 7f8b7b400640 1 -- 172.21.15.37:0/1551375100 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b70004490 con 0x7f8b841092f0 2024-09-21T05:51:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.921+0000 7f8b7b400640 1 -- 172.21.15.37:0/1551375100 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70035070 con 0x7f8b841092f0 2024-09-21T05:51:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.921+0000 7f8b83e00640 1 -- 172.21.15.37:0/1551375100 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b841a8dc0 con 0x7f8b841092f0 2024-09-21T05:51:10.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.922+0000 7f8b83e00640 1 -- 172.21.15.37:0/1551375100 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b84103dc0 con 0x7f8b841092f0 2024-09-21T05:51:10.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.925+0000 7f8b7b400640 1 -- 172.21.15.37:0/1551375100 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f8b70042030 con 0x7f8b841092f0 2024-09-21T05:51:10.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.926+0000 7f8b7b400640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b680b6510 0x7f8b680b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:10.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.926+0000 7f8b7b400640 1 -- 172.21.15.37:0/1551375100 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f8b70107c60 con 0x7f8b841092f0 2024-09-21T05:51:10.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.926+0000 7f8b82a00640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b680b6510 0x7f8b680b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:10.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.927+0000 7f8b82a00640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b680b6510 0x7f8b680b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8b84077160 tx=0x7f8b74005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:10.928+0000 7f8b7b400640 1 -- 172.21.15.37:0/1551375100 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b700d2630 con 0x7f8b841092f0 2024-09-21T05:51:11.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.167+0000 7f8b83e00640 1 -- 172.21.15.37:0/1551375100 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b84076a10 con 0x7f8b841092f0 2024-09-21T05:51:11.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.168+0000 7f8b7b400640 1 -- 172.21.15.37:0/1551375100 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11845 (secure 0 0 0) 0x7f8b84076a10 con 0x7f8b841092f0 2024-09-21T05:51:11.171 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:51:11.171 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"btime":"2024-09-21T05:51:08:958759+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24706,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:08.115849+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:51:11.171 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2024-09-21T05:51:11.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.171+0000 7f8b83e00640 1 -- 172.21.15.37:0/1551375100 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b680b6510 msgr2=0x7f8b680b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.171+0000 7f8b83e00640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b680b6510 0x7f8b680b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8b84077160 tx=0x7f8b74005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.171+0000 7f8b83e00640 1 -- 172.21.15.37:0/1551375100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b841092f0 msgr2=0x7f8b84075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.171+0000 7f8b83e00640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b841092f0 0x7f8b84075c50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8b7002a930 tx=0x7f8b70031a20 comp rx=0 tx=0).stop 2024-09-21T05:51:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.171+0000 7f8b83e00640 1 -- 172.21.15.37:0/1551375100 shutdown_connections 2024-09-21T05:51:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.171+0000 7f8b83e00640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b84109c40 0x7f8b84076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.171+0000 7f8b83e00640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b680b6510 0x7f8b680b8a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.171+0000 7f8b83e00640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b841092f0 0x7f8b84075c50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.171+0000 7f8b83e00640 1 --2- 172.21.15.37:0/1551375100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b841039b0 0x7f8b84075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.171+0000 7f8b83e00640 1 -- 172.21.15.37:0/1551375100 >> 172.21.15.37:0/1551375100 conn(0x7f8b840ff440 msgr2=0x7f8b84101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.171+0000 7f8b83e00640 1 -- 172.21.15.37:0/1551375100 shutdown_connections 2024-09-21T05:51:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:11.171+0000 7f8b83e00640 1 -- 172.21.15.37:0/1551375100 wait complete. 2024-09-21T05:51:11.954 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:51:12.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:11 smithi037 ceph-mon[30631]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:12.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:11 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1551375100' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:12.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:11 smithi067 ceph-mon[34443]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:12.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:11 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1551375100' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:12.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:11 smithi144 ceph-mon[34351]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:12.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:11 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1551375100' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.003+0000 7f9b88200640 1 -- 172.21.15.37:0/3164860824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b800757b0 msgr2=0x7f9b80075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.003+0000 7f9b88200640 1 --2- 172.21.15.37:0/3164860824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b800757b0 0x7f9b80075bc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009900 tx=0x7f9b7402a410 comp rx=0 tx=0).stop 2024-09-21T05:51:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.003+0000 7f9b88200640 1 -- 172.21.15.37:0/3164860824 shutdown_connections 2024-09-21T05:51:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.003+0000 7f9b88200640 1 --2- 172.21.15.37:0/3164860824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b801100c0 0x7f9b80112500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.003+0000 7f9b88200640 1 --2- 172.21.15.37:0/3164860824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b80076100 0x7f9b8010fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.003+0000 7f9b88200640 1 --2- 172.21.15.37:0/3164860824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b800757b0 0x7f9b80075bc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.003+0000 7f9b88200640 1 -- 172.21.15.37:0/3164860824 >> 172.21.15.37:0/3164860824 conn(0x7f9b8007b850 msgr2=0x7f9b8007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.003+0000 7f9b88200640 1 -- 172.21.15.37:0/3164860824 shutdown_connections 2024-09-21T05:51:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.003+0000 7f9b88200640 1 -- 172.21.15.37:0/3164860824 wait complete. 2024-09-21T05:51:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.004+0000 7f9b88200640 1 Processor -- start 2024-09-21T05:51:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.004+0000 7f9b88200640 1 -- start start 2024-09-21T05:51:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.004+0000 7f9b88200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b800757b0 0x7f9b8019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.004+0000 7f9b88200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b80076100 0x7f9b8019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.004+0000 7f9b88200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b801100c0 0x7f9b801a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.004+0000 7f9b88200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b80115cc0 con 0x7f9b800757b0 2024-09-21T05:51:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.004+0000 7f9b88200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9b80115b40 con 0x7f9b801100c0 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.004+0000 7f9b88200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9b80115e40 con 0x7f9b80076100 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.005+0000 7f9b85800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b800757b0 0x7f9b8019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.005+0000 7f9b86200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b801100c0 0x7f9b801a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.005+0000 7f9b85800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b800757b0 0x7f9b8019c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39148/0 (socket says 172.21.15.37:39148) 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.005+0000 7f9b86200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b801100c0 0x7f9b801a1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:40552/0 (socket says 172.21.15.37:40552) 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.005+0000 7f9b84e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b80076100 0x7f9b8019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.005+0000 7f9b86200640 1 -- 172.21.15.37:0/2811699933 learned_addr learned my addr 172.21.15.37:0/2811699933 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.005+0000 7f9b84e00640 1 -- 172.21.15.37:0/2811699933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b801100c0 msgr2=0x7f9b801a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.005+0000 7f9b84e00640 1 --2- 172.21.15.37:0/2811699933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b801100c0 0x7f9b801a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.005+0000 7f9b84e00640 1 -- 172.21.15.37:0/2811699933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b800757b0 msgr2=0x7f9b8019c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.005+0000 7f9b84e00640 1 --2- 172.21.15.37:0/2811699933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b800757b0 0x7f9b8019c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.005+0000 7f9b84e00640 1 -- 172.21.15.37:0/2811699933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b801a25c0 con 0x7f9b80076100 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.006+0000 7f9b84e00640 1 --2- 172.21.15.37:0/2811699933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b80076100 0x7f9b8019cbf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00e9c0 tx=0x7f9b6c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.006+0000 7f9b7e000640 1 -- 172.21.15.37:0/2811699933 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c00ccc0 con 0x7f9b80076100 2024-09-21T05:51:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.006+0000 7f9b7e000640 1 -- 172.21.15.37:0/2811699933 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b6c0035f0 con 0x7f9b80076100 2024-09-21T05:51:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.006+0000 7f9b7e000640 1 -- 172.21.15.37:0/2811699933 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c00ce60 con 0x7f9b80076100 2024-09-21T05:51:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.006+0000 7f9b88200640 1 -- 172.21.15.37:0/2811699933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b801a28b0 con 0x7f9b80076100 2024-09-21T05:51:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.006+0000 7f9b88200640 1 -- 172.21.15.37:0/2811699933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b801a9010 con 0x7f9b80076100 2024-09-21T05:51:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.007+0000 7f9b88200640 1 -- 172.21.15.37:0/2811699933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b80075bc0 con 0x7f9b80076100 2024-09-21T05:51:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.010+0000 7f9b7e000640 1 -- 172.21.15.37:0/2811699933 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f9b6c004000 con 0x7f9b80076100 2024-09-21T05:51:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.012+0000 7f9b7e000640 1 --2- 172.21.15.37:0/2811699933 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9b680b6590 0x7f9b680b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.012+0000 7f9b7e000640 1 -- 172.21.15.37:0/2811699933 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f9b6c0e7850 con 0x7f9b80076100 2024-09-21T05:51:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.012+0000 7f9b85800640 1 --2- 172.21.15.37:0/2811699933 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9b680b6590 0x7f9b680b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.012+0000 7f9b85800640 1 --2- 172.21.15.37:0/2811699933 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9b680b6590 0x7f9b680b8aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9b74005ab0 tx=0x7f9b74005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:13.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.015+0000 7f9b7e000640 1 -- 172.21.15.37:0/2811699933 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9b6c0ade40 con 0x7f9b80076100 2024-09-21T05:51:13.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.215+0000 7f9b88200640 1 -- 172.21.15.37:0/2811699933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b801a9310 con 0x7f9b80076100 2024-09-21T05:51:13.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.217+0000 7f9b7e000640 1 -- 172.21.15.37:0/2811699933 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24176 (secure 0 0 0) 0x7f9b6c0b2220 con 0x7f9b80076100 2024-09-21T05:51:13.219 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:51:13.219 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:51:08.115686+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:50:49.791290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:50:51.877662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:51:01.928796+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:51:13.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.219+0000 7f9b88200640 1 -- 172.21.15.37:0/2811699933 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9b680b6590 msgr2=0x7f9b680b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:13.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.219+0000 7f9b88200640 1 --2- 172.21.15.37:0/2811699933 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9b680b6590 0x7f9b680b8aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9b74005ab0 tx=0x7f9b74005a20 comp rx=0 tx=0).stop 2024-09-21T05:51:13.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.219+0000 7f9b88200640 1 -- 172.21.15.37:0/2811699933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b80076100 msgr2=0x7f9b8019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:13.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.219+0000 7f9b88200640 1 --2- 172.21.15.37:0/2811699933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b80076100 0x7f9b8019cbf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00e9c0 tx=0x7f9b6c00ee80 comp rx=0 tx=0).stop 2024-09-21T05:51:13.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.220+0000 7f9b88200640 1 -- 172.21.15.37:0/2811699933 shutdown_connections 2024-09-21T05:51:13.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.220+0000 7f9b88200640 1 --2- 172.21.15.37:0/2811699933 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9b680b6590 0x7f9b680b8aa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:13.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.220+0000 7f9b88200640 1 --2- 172.21.15.37:0/2811699933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b801100c0 0x7f9b801a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:13.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.220+0000 7f9b88200640 1 --2- 172.21.15.37:0/2811699933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b80076100 0x7f9b8019cbf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:13.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.220+0000 7f9b88200640 1 --2- 172.21.15.37:0/2811699933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b800757b0 0x7f9b8019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:13.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.220+0000 7f9b88200640 1 -- 172.21.15.37:0/2811699933 >> 172.21.15.37:0/2811699933 conn(0x7f9b8007b850 msgr2=0x7f9b80109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:13.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.220+0000 7f9b88200640 1 -- 172.21.15.37:0/2811699933 shutdown_connections 2024-09-21T05:51:13.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:13.220+0000 7f9b88200640 1 -- 172.21.15.37:0/2811699933 wait complete. 2024-09-21T05:51:14.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:51:14.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:13 smithi067 ceph-mon[34443]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:14.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:13 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2811699933' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:14.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:13 smithi144 ceph-mon[34351]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:14.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:13 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2811699933' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:14.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:13 smithi037 ceph-mon[30631]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:14.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:13 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2811699933' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.003+0000 7f18ed800640 1 -- 172.21.15.37:0/439013616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e8075dd0 msgr2=0x7f18e80761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.004+0000 7f18ed800640 1 --2- 172.21.15.37:0/439013616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e8075dd0 0x7f18e80761e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009900 tx=0x7f18d402a3f0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.004+0000 7f18ed800640 1 -- 172.21.15.37:0/439013616 shutdown_connections 2024-09-21T05:51:15.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.004+0000 7f18ed800640 1 --2- 172.21.15.37:0/439013616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e8114430 0x7f18e8116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.004+0000 7f18ed800640 1 --2- 172.21.15.37:0/439013616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e8075dd0 0x7f18e80761e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.004+0000 7f18ed800640 1 --2- 172.21.15.37:0/439013616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e8077380 0x7f18e80757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.004+0000 7f18ed800640 1 -- 172.21.15.37:0/439013616 >> 172.21.15.37:0/439013616 conn(0x7f18e807b850 msgr2=0x7f18e807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:15.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.004+0000 7f18ed800640 1 -- 172.21.15.37:0/439013616 shutdown_connections 2024-09-21T05:51:15.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.004+0000 7f18ed800640 1 -- 172.21.15.37:0/439013616 wait complete. 2024-09-21T05:51:15.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.005+0000 7f18ed800640 1 Processor -- start 2024-09-21T05:51:15.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.005+0000 7f18ed800640 1 -- start start 2024-09-21T05:51:15.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.005+0000 7f18ed800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e8075dd0 0x7f18e81a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:15.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.005+0000 7f18ed800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e8077380 0x7f18e81a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:15.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.005+0000 7f18ed800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e8114430 0x7f18e81a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:15.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.005+0000 7f18ed800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18e811a0a0 con 0x7f18e8114430 2024-09-21T05:51:15.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.005+0000 7f18ed800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f18e8119f20 con 0x7f18e8077380 2024-09-21T05:51:15.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.005+0000 7f18ed800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f18e811a220 con 0x7f18e8075dd0 2024-09-21T05:51:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.006+0000 7f18e6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e8075dd0 0x7f18e81a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.006+0000 7f18e6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e8075dd0 0x7f18e81a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:42702/0 (socket says 172.21.15.37:42702) 2024-09-21T05:51:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.006+0000 7f18e7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e8114430 0x7f18e81a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.006+0000 7f18e6a00640 1 -- 172.21.15.37:0/2693966591 learned_addr learned my addr 172.21.15.37:0/2693966591 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.006+0000 7f18e6000640 1 --2- 172.21.15.37:0/2693966591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e8077380 0x7f18e81a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.006+0000 7f18e6a00640 1 -- 172.21.15.37:0/2693966591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e8077380 msgr2=0x7f18e81a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.006+0000 7f18e6a00640 1 --2- 172.21.15.37:0/2693966591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e8077380 0x7f18e81a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.006+0000 7f18e6a00640 1 -- 172.21.15.37:0/2693966591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e8114430 msgr2=0x7f18e81a6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.006+0000 7f18e6a00640 1 --2- 172.21.15.37:0/2693966591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e8114430 0x7f18e81a6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.006+0000 7f18e6a00640 1 -- 172.21.15.37:0/2693966591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e81a69c0 con 0x7f18e8075dd0 2024-09-21T05:51:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.007+0000 7f18e6a00640 1 --2- 172.21.15.37:0/2693966591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e8075dd0 0x7f18e81a0a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18d800d770 tx=0x7f18d800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.007+0000 7f18df400640 1 -- 172.21.15.37:0/2693966591 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8017070 con 0x7f18e8075dd0 2024-09-21T05:51:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.007+0000 7f18ed800640 1 -- 172.21.15.37:0/2693966591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e81a6cb0 con 0x7f18e8075dd0 2024-09-21T05:51:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.007+0000 7f18df400640 1 -- 172.21.15.37:0/2693966591 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18d80054d0 con 0x7f18e8075dd0 2024-09-21T05:51:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.007+0000 7f18df400640 1 -- 172.21.15.37:0/2693966591 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8004c30 con 0x7f18e8075dd0 2024-09-21T05:51:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.007+0000 7f18ed800640 1 -- 172.21.15.37:0/2693966591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e81ad410 con 0x7f18e8075dd0 2024-09-21T05:51:15.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.008+0000 7f18ed800640 1 -- 172.21.15.37:0/2693966591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e80761e0 con 0x7f18e8075dd0 2024-09-21T05:51:15.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.011+0000 7f18df400640 1 -- 172.21.15.37:0/2693966591 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f18d8004dd0 con 0x7f18e8075dd0 2024-09-21T05:51:15.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.012+0000 7f18df400640 1 --2- 172.21.15.37:0/2693966591 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f18cc0b6510 0x7f18cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:15.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.012+0000 7f18df400640 1 -- 172.21.15.37:0/2693966591 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f18d80e7380 con 0x7f18e8075dd0 2024-09-21T05:51:15.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.012+0000 7f18e6000640 1 --2- 172.21.15.37:0/2693966591 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f18cc0b6510 0x7f18cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:15.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.013+0000 7f18e6000640 1 --2- 172.21.15.37:0/2693966591 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f18cc0b6510 0x7f18cc0b8a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18d4031440 tx=0x7f18d4005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:15.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.014+0000 7f18df400640 1 -- 172.21.15.37:0/2693966591 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f18d80b1d50 con 0x7f18e8075dd0 2024-09-21T05:51:15.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:15 smithi037 ceph-mon[30631]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:15.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.217+0000 7f18ed800640 1 -- 172.21.15.37:0/2693966591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18e81ad640 con 0x7f18e8075dd0 2024-09-21T05:51:15.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.219+0000 7f18df400640 1 -- 172.21.15.37:0/2693966591 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24176 (secure 0 0 0) 0x7f18d80b6c90 con 0x7f18e8075dd0 2024-09-21T05:51:15.222 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:51:15.222 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:51:08.115686+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:50:49.791290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:50:51.877662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:51:01.928796+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:51:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.222+0000 7f18ed800640 1 -- 172.21.15.37:0/2693966591 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f18cc0b6510 msgr2=0x7f18cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.222+0000 7f18ed800640 1 --2- 172.21.15.37:0/2693966591 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f18cc0b6510 0x7f18cc0b8a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18d4031440 tx=0x7f18d4005a20 comp rx=0 tx=0).stop 2024-09-21T05:51:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.222+0000 7f18ed800640 1 -- 172.21.15.37:0/2693966591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e8075dd0 msgr2=0x7f18e81a0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.222+0000 7f18ed800640 1 --2- 172.21.15.37:0/2693966591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e8075dd0 0x7f18e81a0a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18d800d770 tx=0x7f18d800dc30 comp rx=0 tx=0).stop 2024-09-21T05:51:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.222+0000 7f18ed800640 1 -- 172.21.15.37:0/2693966591 shutdown_connections 2024-09-21T05:51:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.222+0000 7f18ed800640 1 --2- 172.21.15.37:0/2693966591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e8114430 0x7f18e81a6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.222+0000 7f18ed800640 1 --2- 172.21.15.37:0/2693966591 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f18cc0b6510 0x7f18cc0b8a20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.222+0000 7f18ed800640 1 --2- 172.21.15.37:0/2693966591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18e8077380 0x7f18e81a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.222+0000 7f18ed800640 1 --2- 172.21.15.37:0/2693966591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e8075dd0 0x7f18e81a0a50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.222+0000 7f18ed800640 1 -- 172.21.15.37:0/2693966591 >> 172.21.15.37:0/2693966591 conn(0x7f18e807b850 msgr2=0x7f18e8112d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.222+0000 7f18ed800640 1 -- 172.21.15.37:0/2693966591 shutdown_connections 2024-09-21T05:51:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:15.222+0000 7f18ed800640 1 -- 172.21.15.37:0/2693966591 wait complete. 2024-09-21T05:51:15.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:15 smithi144 ceph-mon[34351]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:15.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:15 smithi067 ceph-mon[34443]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:16.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:51:16.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:16 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2693966591' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:16.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:16 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2693966591' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:16.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:16 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2693966591' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.070+0000 7f6056a00640 1 -- 172.21.15.37:0/2532835278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60501100c0 msgr2=0x7f6050112500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.070+0000 7f6056a00640 1 --2- 172.21.15.37:0/2532835278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60501100c0 0x7f6050112500 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6048009ca0 tx=0x7f604802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.070+0000 7f6056a00640 1 -- 172.21.15.37:0/2532835278 shutdown_connections 2024-09-21T05:51:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.070+0000 7f6056a00640 1 --2- 172.21.15.37:0/2532835278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60501100c0 0x7f6050112500 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.070+0000 7f6056a00640 1 --2- 172.21.15.37:0/2532835278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6050076100 0x7f605010fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.070+0000 7f6056a00640 1 --2- 172.21.15.37:0/2532835278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60500757b0 0x7f6050075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.070+0000 7f6056a00640 1 -- 172.21.15.37:0/2532835278 >> 172.21.15.37:0/2532835278 conn(0x7f605007b850 msgr2=0x7f605007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.070+0000 7f6056a00640 1 -- 172.21.15.37:0/2532835278 shutdown_connections 2024-09-21T05:51:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.070+0000 7f6056a00640 1 -- 172.21.15.37:0/2532835278 wait complete. 2024-09-21T05:51:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.071+0000 7f6056a00640 1 Processor -- start 2024-09-21T05:51:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.071+0000 7f6056a00640 1 -- start start 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f6056a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60500757b0 0x7f605019c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f6056a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6050076100 0x7f605019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f6056a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60501100c0 0x7f60501a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f6056a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6050115c40 con 0x7f6050076100 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f6056a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6050115ac0 con 0x7f60501100c0 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f6056a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6050115dc0 con 0x7f60500757b0 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f604fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60500757b0 0x7f605019c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f604fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60500757b0 0x7f605019c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:42718/0 (socket says 172.21.15.37:42718) 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f604fe00640 1 -- 172.21.15.37:0/1549757442 learned_addr learned my addr 172.21.15.37:0/1549757442 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f6047e00640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6050076100 0x7f605019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f6054a00640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60501100c0 0x7f60501a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f604fe00640 1 -- 172.21.15.37:0/1549757442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60501100c0 msgr2=0x7f60501a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f604fe00640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60501100c0 0x7f60501a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f604fe00640 1 -- 172.21.15.37:0/1549757442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6050076100 msgr2=0x7f605019cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f604fe00640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6050076100 0x7f605019cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.072+0000 7f604fe00640 1 -- 172.21.15.37:0/1549757442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60501a2540 con 0x7f60500757b0 2024-09-21T05:51:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.073+0000 7f604fe00640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60500757b0 0x7f605019c5d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f604000e9f0 tx=0x7f604000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.073+0000 7f604d600640 1 -- 172.21.15.37:0/1549757442 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604000cd80 con 0x7f60500757b0 2024-09-21T05:51:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.073+0000 7f6056a00640 1 -- 172.21.15.37:0/1549757442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60501a2830 con 0x7f60500757b0 2024-09-21T05:51:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.073+0000 7f604d600640 1 -- 172.21.15.37:0/1549757442 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60400108e0 con 0x7f60500757b0 2024-09-21T05:51:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.073+0000 7f604d600640 1 -- 172.21.15.37:0/1549757442 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040018980 con 0x7f60500757b0 2024-09-21T05:51:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.073+0000 7f6056a00640 1 -- 172.21.15.37:0/1549757442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60501a8f90 con 0x7f60500757b0 2024-09-21T05:51:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.074+0000 7f6056a00640 1 -- 172.21.15.37:0/1549757442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6050075bc0 con 0x7f60500757b0 2024-09-21T05:51:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.076+0000 7f604d600640 1 -- 172.21.15.37:0/1549757442 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f6040010430 con 0x7f60500757b0 2024-09-21T05:51:17.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.078+0000 7f604d600640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f60340b6510 0x7f60340b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:17.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.078+0000 7f604d600640 1 -- 172.21.15.37:0/1549757442 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f60400e7e10 con 0x7f60500757b0 2024-09-21T05:51:17.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.078+0000 7f6047e00640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f60340b6510 0x7f60340b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:17.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.079+0000 7f6047e00640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f60340b6510 0x7f60340b8a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6050111d30 tx=0x7f603800b390 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:17.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.080+0000 7f604d600640 1 -- 172.21.15.37:0/1549757442 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60400ae400 con 0x7f60500757b0 2024-09-21T05:51:17.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:17 smithi037 ceph-mon[30631]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:17.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.319+0000 7f6056a00640 1 -- 172.21.15.37:0/1549757442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f605019d700 con 0x7f60500757b0 2024-09-21T05:51:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.321+0000 7f604d600640 1 -- 172.21.15.37:0/1549757442 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11845 (secure 0 0 0) 0x7f60400b27e0 con 0x7f60500757b0 2024-09-21T05:51:17.323 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:51:17.324 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"btime":"2024-09-21T05:51:08:958759+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24706,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:08.115849+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:51:17.324 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2024-09-21T05:51:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.324+0000 7f6056a00640 1 -- 172.21.15.37:0/1549757442 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f60340b6510 msgr2=0x7f60340b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.324+0000 7f6056a00640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f60340b6510 0x7f60340b8a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6050111d30 tx=0x7f603800b390 comp rx=0 tx=0).stop 2024-09-21T05:51:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.324+0000 7f6056a00640 1 -- 172.21.15.37:0/1549757442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60500757b0 msgr2=0x7f605019c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.324+0000 7f6056a00640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60500757b0 0x7f605019c5d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f604000e9f0 tx=0x7f604000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.324+0000 7f6056a00640 1 -- 172.21.15.37:0/1549757442 shutdown_connections 2024-09-21T05:51:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.324+0000 7f6056a00640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f60340b6510 0x7f60340b8a20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.324+0000 7f6056a00640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60501100c0 0x7f60501a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.324+0000 7f6056a00640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6050076100 0x7f605019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.324+0000 7f6056a00640 1 --2- 172.21.15.37:0/1549757442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60500757b0 0x7f605019c5d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.324+0000 7f6056a00640 1 -- 172.21.15.37:0/1549757442 >> 172.21.15.37:0/1549757442 conn(0x7f605007b850 msgr2=0x7f6050100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.324+0000 7f6056a00640 1 -- 172.21.15.37:0/1549757442 shutdown_connections 2024-09-21T05:51:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:17.324+0000 7f6056a00640 1 -- 172.21.15.37:0/1549757442 wait complete. 2024-09-21T05:51:17.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:17 smithi144 ceph-mon[34351]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:17.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:17 smithi067 ceph-mon[34443]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:18.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:51:18.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:18 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1549757442' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:18.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:18 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1549757442' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:18.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:18 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1549757442' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:51:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.206+0000 7f8891400640 1 -- 172.21.15.37:0/1042254754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c078290 msgr2=0x7f888c114200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.206+0000 7f8891400640 1 --2- 172.21.15.37:0/1042254754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c078290 0x7f888c114200 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8874009900 tx=0x7f887402a410 comp rx=0 tx=0).stop 2024-09-21T05:51:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.206+0000 7f8891400640 1 -- 172.21.15.37:0/1042254754 shutdown_connections 2024-09-21T05:51:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.206+0000 7f8891400640 1 --2- 172.21.15.37:0/1042254754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f888c114740 0x7f888c116b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.206+0000 7f8891400640 1 --2- 172.21.15.37:0/1042254754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c078290 0x7f888c114200 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.206+0000 7f8891400640 1 --2- 172.21.15.37:0/1042254754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f888c077940 0x7f888c077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.206+0000 7f8891400640 1 -- 172.21.15.37:0/1042254754 >> 172.21.15.37:0/1042254754 conn(0x7f888c101810 msgr2=0x7f888c103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.206+0000 7f8891400640 1 -- 172.21.15.37:0/1042254754 shutdown_connections 2024-09-21T05:51:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.206+0000 7f8891400640 1 -- 172.21.15.37:0/1042254754 wait complete. 2024-09-21T05:51:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.207+0000 7f8891400640 1 Processor -- start 2024-09-21T05:51:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.207+0000 7f8891400640 1 -- start start 2024-09-21T05:51:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f8891400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c077940 0x7f888c1a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f8891400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f888c078290 0x7f888c1a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f8891400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f888c114740 0x7f888c1a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f8891400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f888c11a070 con 0x7f888c077940 2024-09-21T05:51:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f8891400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f888c119ef0 con 0x7f888c078290 2024-09-21T05:51:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f8891400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f888c11a1f0 con 0x7f888c114740 2024-09-21T05:51:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f888a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c077940 0x7f888c1a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f888a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c077940 0x7f888c1a0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39198/0 (socket says 172.21.15.37:39198) 2024-09-21T05:51:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f888a800640 1 -- 172.21.15.37:0/517605895 learned_addr learned my addr 172.21.15.37:0/517605895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f888b200640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f888c114740 0x7f888c1a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:19.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f8881e00640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f888c078290 0x7f888c1a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:19.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f888a800640 1 -- 172.21.15.37:0/517605895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f888c114740 msgr2=0x7f888c1a63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:19.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f888a800640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f888c114740 0x7f888c1a63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f888a800640 1 -- 172.21.15.37:0/517605895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f888c078290 msgr2=0x7f888c1a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:19.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f888a800640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f888c078290 0x7f888c1a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.208+0000 7f888a800640 1 -- 172.21.15.37:0/517605895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888c1a6af0 con 0x7f888c077940 2024-09-21T05:51:19.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.209+0000 7f888a800640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c077940 0x7f888c1a0b80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f887c00e9f0 tx=0x7f887c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:19.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.209+0000 7f8883e00640 1 -- 172.21.15.37:0/517605895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c00cd80 con 0x7f888c077940 2024-09-21T05:51:19.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.209+0000 7f8883e00640 1 -- 172.21.15.37:0/517605895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f887c0108e0 con 0x7f888c077940 2024-09-21T05:51:19.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.209+0000 7f8883e00640 1 -- 172.21.15.37:0/517605895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c018980 con 0x7f888c077940 2024-09-21T05:51:19.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.209+0000 7f8891400640 1 -- 172.21.15.37:0/517605895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f888c1a6de0 con 0x7f888c077940 2024-09-21T05:51:19.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.209+0000 7f8891400640 1 -- 172.21.15.37:0/517605895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f888c1ad540 con 0x7f888c077940 2024-09-21T05:51:19.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.210+0000 7f8891400640 1 -- 172.21.15.37:0/517605895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f888c077d50 con 0x7f888c077940 2024-09-21T05:51:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.215+0000 7f8883e00640 1 -- 172.21.15.37:0/517605895 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f887c010430 con 0x7f888c077940 2024-09-21T05:51:19.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.216+0000 7f8883e00640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f88700b6590 0x7f88700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.216+0000 7f8883e00640 1 -- 172.21.15.37:0/517605895 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f887c0e7cc0 con 0x7f888c077940 2024-09-21T05:51:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.216+0000 7f8881e00640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f88700b6590 0x7f88700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.217+0000 7f8881e00640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f88700b6590 0x7f88700b8aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8874009230 tx=0x7f8874031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.219+0000 7f8883e00640 1 -- 172.21.15.37:0/517605895 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f887c0b2690 con 0x7f888c077940 2024-09-21T05:51:19.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:19 smithi144 ceph-mon[34351]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:19.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:19 smithi037 ceph-mon[30631]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:19.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.417+0000 7f8891400640 1 -- 172.21.15.37:0/517605895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f888c02e640 con 0x7f888c077940 2024-09-21T05:51:19.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.419+0000 7f8883e00640 1 -- 172.21.15.37:0/517605895 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24176 (secure 0 0 0) 0x7f887c0b75d0 con 0x7f888c077940 2024-09-21T05:51:19.421 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:51:19.422 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:51:08.115686+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:50:49.791290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:50:51.877662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:51:01.928796+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:51:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.421+0000 7f8891400640 1 -- 172.21.15.37:0/517605895 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f88700b6590 msgr2=0x7f88700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.421+0000 7f8891400640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f88700b6590 0x7f88700b8aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8874009230 tx=0x7f8874031400 comp rx=0 tx=0).stop 2024-09-21T05:51:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.421+0000 7f8891400640 1 -- 172.21.15.37:0/517605895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c077940 msgr2=0x7f888c1a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.421+0000 7f8891400640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c077940 0x7f888c1a0b80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f887c00e9f0 tx=0x7f887c00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.421+0000 7f8891400640 1 -- 172.21.15.37:0/517605895 shutdown_connections 2024-09-21T05:51:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.421+0000 7f8891400640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f888c114740 0x7f888c1a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.421+0000 7f8891400640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f88700b6590 0x7f88700b8aa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.421+0000 7f8891400640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f888c078290 0x7f888c1a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.421+0000 7f8891400640 1 --2- 172.21.15.37:0/517605895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c077940 0x7f888c1a0b80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.421+0000 7f8891400640 1 -- 172.21.15.37:0/517605895 >> 172.21.15.37:0/517605895 conn(0x7f888c101810 msgr2=0x7f888c116840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.422+0000 7f8891400640 1 -- 172.21.15.37:0/517605895 shutdown_connections 2024-09-21T05:51:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:19.422+0000 7f8891400640 1 -- 172.21.15.37:0/517605895 wait complete. 2024-09-21T05:51:19.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:19 smithi067 ceph-mon[34443]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:20.122 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T05:50:54.973656+0000', 'modified': '2024-09-21T05:51:08.115849+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24731}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24731': {'gid': 24731, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.67:6839/2815536303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6838', 'nonce': 2815536303}, {'type': 'v1', 'addr': '172.21.15.67:6839', 'nonce': 2815536303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24731, 'qdb_cluster': [24731]} 2024-09-21T05:51:20.122 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T05:51:20.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T05:51:20.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:20 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/517605895' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:20.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:20 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/517605895' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:20.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:20 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/517605895' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:20.500 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.113+0000 7ff280600640 1 -- 172.21.15.37:0/1437142790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27810b6c0 msgr2=0x7ff27810bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:21.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.113+0000 7ff280600640 1 --2- 172.21.15.37:0/1437142790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27810b6c0 0x7ff27810bad0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff264009900 tx=0x7ff26402a3f0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.113+0000 7ff280600640 1 -- 172.21.15.37:0/1437142790 shutdown_connections 2024-09-21T05:51:21.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.113+0000 7ff280600640 1 --2- 172.21.15.37:0/1437142790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff27810c010 0x7ff278112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.113+0000 7ff280600640 1 --2- 172.21.15.37:0/1437142790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27810b6c0 0x7ff27810bad0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.113+0000 7ff280600640 1 --2- 172.21.15.37:0/1437142790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff278105d80 0x7ff278106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.113+0000 7ff280600640 1 -- 172.21.15.37:0/1437142790 >> 172.21.15.37:0/1437142790 conn(0x7ff278101810 msgr2=0x7ff278103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:21.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.113+0000 7ff280600640 1 -- 172.21.15.37:0/1437142790 shutdown_connections 2024-09-21T05:51:21.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.113+0000 7ff280600640 1 -- 172.21.15.37:0/1437142790 wait complete. 2024-09-21T05:51:21.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.115+0000 7ff280600640 1 Processor -- start 2024-09-21T05:51:21.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.115+0000 7ff280600640 1 -- start start 2024-09-21T05:51:21.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.115+0000 7ff280600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff278105d80 0x7ff27819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.115+0000 7ff280600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27810b6c0 0x7ff27819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.115+0000 7ff280600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff27810c010 0x7ff2781a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.115+0000 7ff280600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff278115d20 con 0x7ff27810b6c0 2024-09-21T05:51:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.115+0000 7ff280600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff278115ba0 con 0x7ff278105d80 2024-09-21T05:51:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.115+0000 7ff280600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff278115ea0 con 0x7ff27810c010 2024-09-21T05:51:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.116+0000 7ff27d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27810b6c0 0x7ff27819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.116+0000 7ff27dc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff278105d80 0x7ff27819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.116+0000 7ff27d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27810b6c0 0x7ff27819cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56200/0 (socket says 172.21.15.37:56200) 2024-09-21T05:51:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.116+0000 7ff27e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff27810c010 0x7ff2781a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.116+0000 7ff27d200640 1 -- 172.21.15.37:0/3316013573 learned_addr learned my addr 172.21.15.37:0/3316013573 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.116+0000 7ff27e600640 1 -- 172.21.15.37:0/3316013573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff278105d80 msgr2=0x7ff27819c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.116+0000 7ff27e600640 1 --2- 172.21.15.37:0/3316013573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff278105d80 0x7ff27819c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.116+0000 7ff27e600640 1 -- 172.21.15.37:0/3316013573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27810b6c0 msgr2=0x7ff27819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.116+0000 7ff27e600640 1 --2- 172.21.15.37:0/3316013573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27810b6c0 0x7ff27819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.116+0000 7ff27e600640 1 -- 172.21.15.37:0/3316013573 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2781a2640 con 0x7ff27810c010 2024-09-21T05:51:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.116+0000 7ff27e600640 1 --2- 172.21.15.37:0/3316013573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff27810c010 0x7ff2781a1f10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff270009fd0 tx=0x7ff27000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.117+0000 7ff276000640 1 -- 172.21.15.37:0/3316013573 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27000ce20 con 0x7ff27810c010 2024-09-21T05:51:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.117+0000 7ff276000640 1 -- 172.21.15.37:0/3316013573 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff270005020 con 0x7ff27810c010 2024-09-21T05:51:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.117+0000 7ff276000640 1 -- 172.21.15.37:0/3316013573 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270010690 con 0x7ff27810c010 2024-09-21T05:51:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.117+0000 7ff280600640 1 -- 172.21.15.37:0/3316013573 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2781a2930 con 0x7ff27810c010 2024-09-21T05:51:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.117+0000 7ff280600640 1 -- 172.21.15.37:0/3316013573 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2781a9090 con 0x7ff27810c010 2024-09-21T05:51:21.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.120+0000 7ff28722b740 1 Processor -- start 2024-09-21T05:51:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.121+0000 7ff276000640 1 -- 172.21.15.37:0/3316013573 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7ff2700054d0 con 0x7ff27810c010 2024-09-21T05:51:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.121+0000 7ff28722b740 1 -- start start 2024-09-21T05:51:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.121+0000 7ff28722b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c491f60 0x55e72c838490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.121+0000 7ff28722b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c4690a0 0x55e72c8389d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.121+0000 7ff28722b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c471280 0x55e72c838f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.121+0000 7ff28722b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e72c7afd50 con 0x55e72c4690a0 2024-09-21T05:51:21.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.121+0000 7ff28722b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e72c79f180 con 0x55e72c491f60 2024-09-21T05:51:21.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.121+0000 7ff28722b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e72c7a2f90 con 0x55e72c471280 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.122+0000 7ff27dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c4690a0 0x55e72c8389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.122+0000 7ff27d200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c491f60 0x55e72c838490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.122+0000 7ff27d200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c491f60 0x55e72c838490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:47496/0 (socket says 172.21.15.37:47496) 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.122+0000 7ff27dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c4690a0 0x55e72c8389d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56202/0 (socket says 172.21.15.37:56202) 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.122+0000 7ff27d200640 1 -- 172.21.15.37:0/1760978473 learned_addr learned my addr 172.21.15.37:0/1760978473 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.122+0000 7ff27d200640 1 --2- 172.21.15.37:0/1760978473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c471280 0x55e72c838f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.122+0000 7ff27dc00640 1 -- 172.21.15.37:0/1760978473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c471280 msgr2=0x55e72c838f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.122+0000 7ff27dc00640 1 --2- 172.21.15.37:0/1760978473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c471280 0x55e72c838f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.122+0000 7ff27dc00640 1 -- 172.21.15.37:0/1760978473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c491f60 msgr2=0x55e72c838490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.122+0000 7ff27dc00640 1 --2- 172.21.15.37:0/1760978473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c491f60 0x55e72c838490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.122+0000 7ff27dc00640 1 -- 172.21.15.37:0/1760978473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72c769a70 con 0x55e72c4690a0 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.122+0000 7ff27d200640 1 --2- 172.21.15.37:0/1760978473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c471280 0x55e72c838f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.122+0000 7ff27dc00640 1 --2- 172.21.15.37:0/1760978473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c4690a0 0x55e72c8389d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009c00 tx=0x7ff26c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556cd683633caabc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.123+0000 7ff276000640 1 --2- 172.21.15.37:0/3316013573 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff2600b6590 0x7ff2600b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.123+0000 7ff276000640 1 -- 172.21.15.37:0/3316013573 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7ff2700e7c00 con 0x7ff27810c010 2024-09-21T05:51:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.123+0000 7ff26aa00640 1 -- 172.21.15.37:0/1760978473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c004230 con 0x55e72c4690a0 2024-09-21T05:51:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.123+0000 7ff27d200640 1 --2- 172.21.15.37:0/3316013573 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff2600b6590 0x7ff2600b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.123+0000 7ff26aa00640 1 -- 172.21.15.37:0/1760978473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff26c0043d0 con 0x55e72c4690a0 2024-09-21T05:51:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.123+0000 7ff26aa00640 1 -- 172.21.15.37:0/1760978473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c004c70 con 0x55e72c4690a0 2024-09-21T05:51:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.124+0000 7ff28722b740 1 -- 172.21.15.37:0/1760978473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c4690a0 msgr2=0x55e72c8389d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.124+0000 7ff27d200640 1 --2- 172.21.15.37:0/3316013573 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff2600b6590 0x7ff2600b8aa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff264005f70 tx=0x7ff264041040 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.124+0000 7ff28722b740 1 --2- 172.21.15.37:0/1760978473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c4690a0 0x55e72c8389d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009c00 tx=0x7ff26c011810 comp rx=0 tx=0).stop 2024-09-21T05:51:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.124+0000 7ff28722b740 1 -- 172.21.15.37:0/1760978473 shutdown_connections 2024-09-21T05:51:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.124+0000 7ff28722b740 1 --2- 172.21.15.37:0/1760978473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c471280 0x55e72c838f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.124+0000 7ff28722b740 1 --2- 172.21.15.37:0/1760978473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c4690a0 0x55e72c8389d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.124+0000 7ff28722b740 1 --2- 172.21.15.37:0/1760978473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c491f60 0x55e72c838490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.124+0000 7ff28722b740 1 -- 172.21.15.37:0/1760978473 >> 172.21.15.37:0/1760978473 conn(0x55e72c486350 msgr2=0x55e72c836380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.124+0000 7ff28722b740 1 -- 172.21.15.37:0/1760978473 shutdown_connections 2024-09-21T05:51:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.124+0000 7ff28722b740 1 -- 172.21.15.37:0/1760978473 wait complete. 2024-09-21T05:51:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.125+0000 7ff28722b740 1 -- start start 2024-09-21T05:51:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.125+0000 7ff28722b740 1 Processor -- start 2024-09-21T05:51:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.126+0000 7ff28722b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c4690a0 0x55e72c8440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.126+0000 7ff28722b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c471280 0x55e72c844630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.126+0000 7ff28722b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c491f60 0x55e72c84ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.126+0000 7ff28722b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e72c6005f0 con 0x55e72c491f60 2024-09-21T05:51:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.126+0000 7ff28722b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e72c73a460 con 0x55e72c471280 2024-09-21T05:51:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.126+0000 7ff28722b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e72c846c70 con 0x55e72c4690a0 2024-09-21T05:51:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.126+0000 7ff28722b740 10 client.0 _ll_register_callbacks cb 0x55e72c74a210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:51:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.126+0000 7ff27e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c491f60 0x55e72c84ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.126+0000 7ff27dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c4690a0 0x55e72c8440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.126+0000 7ff27e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c491f60 0x55e72c84ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56216/0 (socket says 172.21.15.37:56216) 2024-09-21T05:51:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.126+0000 7ff27e600640 1 -- 172.21.15.37:0/2438688419 learned_addr learned my addr 172.21.15.37:0/2438688419 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.126+0000 7ff27d200640 1 --2- 172.21.15.37:0/2438688419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c471280 0x55e72c844630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.127+0000 7ff27e600640 1 -- 172.21.15.37:0/2438688419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c4690a0 msgr2=0x55e72c8440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.127+0000 7ff27e600640 1 --2- 172.21.15.37:0/2438688419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c4690a0 0x55e72c8440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.127+0000 7ff27e600640 1 -- 172.21.15.37:0/2438688419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c471280 msgr2=0x55e72c844630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.127+0000 7ff27e600640 1 --2- 172.21.15.37:0/2438688419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c471280 0x55e72c844630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.127+0000 7ff27e600640 1 -- 172.21.15.37:0/2438688419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e72c4fd540 con 0x55e72c491f60 2024-09-21T05:51:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.127+0000 7ff27e600640 1 --2- 172.21.15.37:0/2438688419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c491f60 0x55e72c84ff90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff2700aa0c0 tx=0x7ff2700ad320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbe59e557092b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.127+0000 7ff25f400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T05:51:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.127+0000 7ff25f400640 1 -- 172.21.15.37:0/2438688419 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2700b22f0 con 0x55e72c491f60 2024-09-21T05:51:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.127+0000 7ff25f400640 1 -- 172.21.15.37:0/2438688419 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7ff2700acd50 con 0x55e72c491f60 2024-09-21T05:51:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.127+0000 7ff28722b740 1 -- 172.21.15.37:0/2438688419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e72c73ca70 con 0x55e72c491f60 2024-09-21T05:51:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.128+0000 7ff25f400640 1 -- 172.21.15.37:0/2438688419 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7ff2700b25d0 con 0x55e72c491f60 2024-09-21T05:51:21.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.128+0000 7ff28722b740 10 client.14799 fetch_fsmap learned FSMap version 17 2024-09-21T05:51:21.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.128+0000 7ff28722b740 1 -- 172.21.15.37:0/2438688419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55e72c7576f0 con 0x55e72c491f60 2024-09-21T05:51:21.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.128+0000 7ff25f400640 1 -- 172.21.15.37:0/2438688419 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e72c73ca70 con 0x55e72c491f60 2024-09-21T05:51:21.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.128+0000 7ff25f400640 1 -- 172.21.15.37:0/2438688419 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7ff2700a9560 con 0x55e72c491f60 2024-09-21T05:51:21.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.128+0000 7ff28722b740 10 client.14799 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T05:51:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.128+0000 7ff28722b740 10 client.14799 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:51:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.128+0000 7ff28722b740 20 client.14799 populate_metadata read hostname 'smithi037' 2024-09-21T05:51:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.128+0000 7ff28722b740 1 --2- 172.21.15.37:0/2438688419 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e72c4508e0 0x55e72c856530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.128+0000 7ff28722b740 4 client.14799 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:51:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.128+0000 7ff28722b740 1 -- 172.21.15.37:0/2438688419 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e72c7b1ca0 con 0x55e72c4508e0 2024-09-21T05:51:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.129+0000 7ff27dc00640 1 --2- 172.21.15.37:0/2438688419 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e72c4508e0 0x55e72c856530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.129+0000 7ff27dc00640 1 --2- 172.21.15.37:0/2438688419 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e72c4508e0 0x55e72c856530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f8aa95112bc1541 server_cookie=423c25a06ca50ac9 in_seq=0 out_seq=0 2024-09-21T05:51:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.129+0000 7ff25f400640 10 client.14799 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:51:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.130+0000 7ff25f400640 1 -- 172.21.15.37:0/2438688419 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e72c7b1ca0 con 0x55e72c4508e0 2024-09-21T05:51:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.130+0000 7ff25f400640 10 client.14799 handle_command_reply: tid=0 2024-09-21T05:51:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.131+0000 7ff28722b740 1 client.14799 shutdown 2024-09-21T05:51:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.131+0000 7ff28722b740 1 -- 172.21.15.37:0/2438688419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c491f60 msgr2=0x55e72c84ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.131+0000 7ff28722b740 1 --2- 172.21.15.37:0/2438688419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c491f60 0x55e72c84ff90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff2700aa0c0 tx=0x7ff2700ad320 comp rx=0 tx=0).stop 2024-09-21T05:51:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.131+0000 7ff28722b740 1 -- 172.21.15.37:0/2438688419 shutdown_connections 2024-09-21T05:51:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.131+0000 7ff28722b740 1 --2- 172.21.15.37:0/2438688419 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e72c4508e0 0x55e72c856530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.131+0000 7ff28722b740 1 --2- 172.21.15.37:0/2438688419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c491f60 0x55e72c84ff90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.131+0000 7ff28722b740 1 --2- 172.21.15.37:0/2438688419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c471280 0x55e72c844630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.131+0000 7ff28722b740 1 --2- 172.21.15.37:0/2438688419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c4690a0 0x55e72c8440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.131+0000 7ff25f400640 0 client.14799 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:51:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.131+0000 7ff28722b740 1 -- 172.21.15.37:0/2438688419 >> 172.21.15.37:0/2438688419 conn(0x55e72c486350 msgr2=0x55e72c83b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.131+0000 7ff28722b740 1 -- 172.21.15.37:0/2438688419 shutdown_connections 2024-09-21T05:51:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.131+0000 7ff28722b740 1 -- 172.21.15.37:0/2438688419 wait complete. 2024-09-21T05:51:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.131+0000 7ff28722b740 20 client.14799 trim_cache size 0 max 16384 2024-09-21T05:51:21.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.150+0000 7ff28722b740 1 Processor -- start 2024-09-21T05:51:21.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.150+0000 7ff28722b740 1 -- start start 2024-09-21T05:51:21.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff28722b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c4690a0 0x55e72c83f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff28722b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c471280 0x55e72c83f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff28722b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c491f60 0x55e72c842750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff28722b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e72c854870 con 0x55e72c4690a0 2024-09-21T05:51:21.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff28722b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e72c854f40 con 0x55e72c471280 2024-09-21T05:51:21.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff28722b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e72c855610 con 0x55e72c491f60 2024-09-21T05:51:21.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff27dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c4690a0 0x55e72c83f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff27d200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c471280 0x55e72c83f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff27d200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c471280 0x55e72c83f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:47510/0 (socket says 172.21.15.37:47510) 2024-09-21T05:51:21.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff27d200640 1 -- 172.21.15.37:0/654929308 learned_addr learned my addr 172.21.15.37:0/654929308 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:21.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff27e600640 1 --2- 172.21.15.37:0/654929308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c491f60 0x55e72c842750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff27d200640 1 -- 172.21.15.37:0/654929308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c491f60 msgr2=0x55e72c842750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff27d200640 1 --2- 172.21.15.37:0/654929308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c491f60 0x55e72c842750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff27d200640 1 -- 172.21.15.37:0/654929308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c4690a0 msgr2=0x55e72c83f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff27d200640 1 --2- 172.21.15.37:0/654929308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c4690a0 0x55e72c83f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff27d200640 1 -- 172.21.15.37:0/654929308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72c844f70 con 0x55e72c471280 2024-09-21T05:51:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.151+0000 7ff27e600640 1 --2- 172.21.15.37:0/654929308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c491f60 0x55e72c842750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:51:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.152+0000 7ff27d200640 1 --2- 172.21.15.37:0/654929308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c471280 0x55e72c83f550 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff26402a9e0 tx=0x7ff264005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dddf1f314f9a64e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.152+0000 7ff26a000640 1 -- 172.21.15.37:0/654929308 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264046070 con 0x55e72c471280 2024-09-21T05:51:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.152+0000 7ff26a000640 1 -- 172.21.15.37:0/654929308 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff264051070 con 0x55e72c471280 2024-09-21T05:51:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.152+0000 7ff26a000640 1 -- 172.21.15.37:0/654929308 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264056b40 con 0x55e72c471280 2024-09-21T05:51:21.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.153+0000 7ff28722b740 1 -- 172.21.15.37:0/654929308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c471280 msgr2=0x55e72c83f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.153+0000 7ff28722b740 1 --2- 172.21.15.37:0/654929308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c471280 0x55e72c83f550 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff26402a9e0 tx=0x7ff264005a20 comp rx=0 tx=0).stop 2024-09-21T05:51:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.153+0000 7ff28722b740 1 -- 172.21.15.37:0/654929308 shutdown_connections 2024-09-21T05:51:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.153+0000 7ff28722b740 1 --2- 172.21.15.37:0/654929308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c491f60 0x55e72c842750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.153+0000 7ff28722b740 1 --2- 172.21.15.37:0/654929308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c471280 0x55e72c83f550 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.153+0000 7ff28722b740 1 --2- 172.21.15.37:0/654929308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c4690a0 0x55e72c83f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.153+0000 7ff28722b740 1 -- 172.21.15.37:0/654929308 >> 172.21.15.37:0/654929308 conn(0x55e72c486350 msgr2=0x55e72c83e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.153+0000 7ff28722b740 1 -- 172.21.15.37:0/654929308 shutdown_connections 2024-09-21T05:51:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.153+0000 7ff28722b740 1 -- 172.21.15.37:0/654929308 wait complete. 2024-09-21T05:51:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.153+0000 7ff28722b740 1 -- start start 2024-09-21T05:51:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.154+0000 7ff28722b740 1 Processor -- start 2024-09-21T05:51:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.154+0000 7ff28722b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c4690a0 0x55e72c858a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.154+0000 7ff28722b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c471280 0x55e72c858fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.154+0000 7ff28722b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c491f60 0x55e72c85e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.154+0000 7ff28722b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e72c8563b0 con 0x55e72c471280 2024-09-21T05:51:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.154+0000 7ff28722b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e72c855ce0 con 0x55e72c491f60 2024-09-21T05:51:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.154+0000 7ff28722b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e72c856a80 con 0x55e72c4690a0 2024-09-21T05:51:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.154+0000 7ff28722b740 10 client.0 _ll_register_callbacks cb 0x7ff2700a9a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:51:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.154+0000 7ff27d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c471280 0x55e72c858fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.155+0000 7ff27d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c471280 0x55e72c858fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56230/0 (socket says 172.21.15.37:56230) 2024-09-21T05:51:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.155+0000 7ff27d200640 1 -- 172.21.15.37:0/590771697 learned_addr learned my addr 172.21.15.37:0/590771697 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.155+0000 7ff27dc00640 1 --2- 172.21.15.37:0/590771697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c4690a0 0x55e72c858a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.155+0000 7ff27e600640 1 --2- 172.21.15.37:0/590771697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c491f60 0x55e72c85e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.155+0000 7ff27d200640 1 -- 172.21.15.37:0/590771697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c4690a0 msgr2=0x55e72c858a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.155+0000 7ff27d200640 1 --2- 172.21.15.37:0/590771697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c4690a0 0x55e72c858a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.155+0000 7ff27d200640 1 -- 172.21.15.37:0/590771697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c491f60 msgr2=0x55e72c85e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.155+0000 7ff27d200640 1 --2- 172.21.15.37:0/590771697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c491f60 0x55e72c85e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.155+0000 7ff27d200640 1 -- 172.21.15.37:0/590771697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e72c859840 con 0x55e72c471280 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.155+0000 7ff27d200640 1 --2- 172.21.15.37:0/590771697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c471280 0x55e72c858fa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff264000c00 tx=0x7ff264009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1648176454cf890f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.155+0000 7ff25f400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.156+0000 7ff25f400640 1 -- 172.21.15.37:0/590771697 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26405f060 con 0x55e72c471280 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.156+0000 7ff28722b740 1 -- 172.21.15.37:0/590771697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff264051070 con 0x55e72c471280 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.156+0000 7ff25f400640 1 -- 172.21.15.37:0/590771697 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7ff264056d90 con 0x55e72c471280 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.156+0000 7ff25f400640 1 -- 172.21.15.37:0/590771697 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7ff264066050 con 0x55e72c471280 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.156+0000 7ff28722b740 10 client.14805 fetch_fsmap learned FSMap version 17 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.156+0000 7ff28722b740 1 -- 172.21.15.37:0/590771697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55e72c8c1f30 con 0x55e72c471280 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.156+0000 7ff25f400640 1 -- 172.21.15.37:0/590771697 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff264051070 con 0x55e72c471280 2024-09-21T05:51:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.156+0000 7ff25f400640 1 -- 172.21.15.37:0/590771697 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7ff26403d6c0 con 0x55e72c471280 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.156+0000 7ff28722b740 10 client.14805 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.157+0000 7ff28722b740 10 client.14805 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.157+0000 7ff28722b740 20 client.14805 populate_metadata read hostname 'smithi037' 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.157+0000 7ff28722b740 1 --2- 172.21.15.37:0/590771697 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e72c425c90 0x55e72c8c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.157+0000 7ff28722b740 4 client.14805 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.157+0000 7ff28722b740 1 -- 172.21.15.37:0/590771697 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "status"}) -- 0x55e72c7ad750 con 0x55e72c425c90 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.157+0000 7ff27dc00640 1 --2- 172.21.15.37:0/590771697 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e72c425c90 0x55e72c8c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.157+0000 7ff27dc00640 1 --2- 172.21.15.37:0/590771697 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e72c425c90 0x55e72c8c52f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f194e63706df4d0 server_cookie=671ee5f79e9dd210 in_seq=0 out_seq=0 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.157+0000 7ff25f400640 10 client.14805 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff25f400640 1 -- 172.21.15.37:0/590771697 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e72c7ad750 con 0x55e72c425c90 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff25f400640 10 client.14805 handle_command_reply: tid=0 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff28722b740 1 client.14805 shutdown 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff28722b740 1 -- 172.21.15.37:0/590771697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c471280 msgr2=0x55e72c858fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff28722b740 1 --2- 172.21.15.37:0/590771697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c471280 0x55e72c858fa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff264000c00 tx=0x7ff264009650 comp rx=0 tx=0).stop 2024-09-21T05:51:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff28722b740 1 -- 172.21.15.37:0/590771697 shutdown_connections 2024-09-21T05:51:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff28722b740 1 --2- 172.21.15.37:0/590771697 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e72c425c90 0x55e72c8c52f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff28722b740 1 --2- 172.21.15.37:0/590771697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e72c491f60 0x55e72c85e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff28722b740 1 --2- 172.21.15.37:0/590771697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e72c471280 0x55e72c858fa0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff28722b740 1 --2- 172.21.15.37:0/590771697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e72c4690a0 0x55e72c858a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff28722b740 1 -- 172.21.15.37:0/590771697 >> 172.21.15.37:0/590771697 conn(0x55e72c486350 msgr2=0x55e72c842350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff25f400640 0 client.14805 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:51:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff28722b740 1 -- 172.21.15.37:0/590771697 shutdown_connections 2024-09-21T05:51:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff28722b740 1 -- 172.21.15.37:0/590771697 wait complete. 2024-09-21T05:51:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.158+0000 7ff28722b740 20 client.14805 trim_cache size 0 max 16384 2024-09-21T05:51:21.164 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:51:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "0c10cdda-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:51:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-09-21T05:51:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24731, 2024-09-21T05:51:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T05:51:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T05:51:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T05:51:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 25.265838543000001, 2024-09-21T05:51:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 17, 2024-09-21T05:51:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 86, 2024-09-21T05:51:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T05:51:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 40.485515581000001 2024-09-21T05:51:21.164 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:51:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.159+0000 7ff280600640 1 -- 172.21.15.37:0/3316013573 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff2600b6590 msgr2=0x7ff2600b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.159+0000 7ff280600640 1 --2- 172.21.15.37:0/3316013573 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff2600b6590 0x7ff2600b8aa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff264005f70 tx=0x7ff264041040 comp rx=0 tx=0).stop 2024-09-21T05:51:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.159+0000 7ff280600640 1 -- 172.21.15.37:0/3316013573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff27810c010 msgr2=0x7ff2781a1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.159+0000 7ff280600640 1 --2- 172.21.15.37:0/3316013573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff27810c010 0x7ff2781a1f10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff270009fd0 tx=0x7ff27000ef10 comp rx=0 tx=0).stop 2024-09-21T05:51:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.159+0000 7ff280600640 1 -- 172.21.15.37:0/3316013573 shutdown_connections 2024-09-21T05:51:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.159+0000 7ff280600640 1 --2- 172.21.15.37:0/3316013573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff27810c010 0x7ff2781a1f10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.159+0000 7ff280600640 1 --2- 172.21.15.37:0/3316013573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27810b6c0 0x7ff27819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.159+0000 7ff280600640 1 --2- 172.21.15.37:0/3316013573 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff2600b6590 0x7ff2600b8aa0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.159+0000 7ff280600640 1 --2- 172.21.15.37:0/3316013573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff278105d80 0x7ff27819c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.159+0000 7ff280600640 1 -- 172.21.15.37:0/3316013573 >> 172.21.15.37:0/3316013573 conn(0x7ff278101810 msgr2=0x7ff278103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.159+0000 7ff280600640 1 -- 172.21.15.37:0/3316013573 shutdown_connections 2024-09-21T05:51:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:21.159+0000 7ff280600640 1 -- 172.21.15.37:0/3316013573 wait complete. 2024-09-21T05:51:21.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:21 smithi037 ceph-mon[30631]: pgmap v333: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:21.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:21 smithi144 ceph-mon[34351]: pgmap v333: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:21.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:21 smithi067 ceph-mon[34443]: pgmap v333: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:22.036 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T05:51:22.036 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:51:22.036 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T05:51:22.416 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.029+0000 7fa09be00640 1 -- 172.21.15.37:0/606377173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa09c1092d0 msgr2=0x7fa09c1096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.029+0000 7fa09be00640 1 --2- 172.21.15.37:0/606377173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa09c1092d0 0x7fa09c1096e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa084009900 tx=0x7fa08402a410 comp rx=0 tx=0).stop 2024-09-21T05:51:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.030+0000 7fa09be00640 1 -- 172.21.15.37:0/606377173 shutdown_connections 2024-09-21T05:51:23.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.030+0000 7fa09be00640 1 --2- 172.21.15.37:0/606377173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa09c109c20 0x7fa09c110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.030+0000 7fa09be00640 1 --2- 172.21.15.37:0/606377173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa09c1092d0 0x7fa09c1096e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.030+0000 7fa09be00640 1 --2- 172.21.15.37:0/606377173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c103990 0x7fa09c103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.030+0000 7fa09be00640 1 -- 172.21.15.37:0/606377173 >> 172.21.15.37:0/606377173 conn(0x7fa09c0ff440 msgr2=0x7fa09c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.030+0000 7fa09be00640 1 -- 172.21.15.37:0/606377173 shutdown_connections 2024-09-21T05:51:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.030+0000 7fa09be00640 1 -- 172.21.15.37:0/606377173 wait complete. 2024-09-21T05:51:23.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.031+0000 7fa09be00640 1 Processor -- start 2024-09-21T05:51:23.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.031+0000 7fa09be00640 1 -- start start 2024-09-21T05:51:23.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.032+0000 7fa09be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa09c103990 0x7fa09c19a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:23.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.032+0000 7fa09be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa09c1092d0 0x7fa09c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:23.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.032+0000 7fa09be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c109c20 0x7fa09c19fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:23.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.032+0000 7fa09be00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c1138e0 con 0x7fa09c103990 2024-09-21T05:51:23.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.032+0000 7fa09be00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c113760 con 0x7fa09c109c20 2024-09-21T05:51:23.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.032+0000 7fa09be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c113a60 con 0x7fa09c1092d0 2024-09-21T05:51:23.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.032+0000 7fa09aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa09c103990 0x7fa09c19a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:23.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.032+0000 7fa09aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa09c103990 0x7fa09c19a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56246/0 (socket says 172.21.15.37:56246) 2024-09-21T05:51:23.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.032+0000 7fa09aa00640 1 -- 172.21.15.37:0/198443787 learned_addr learned my addr 172.21.15.37:0/198443787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:23.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.032+0000 7fa093e00640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa09c1092d0 0x7fa09c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:23.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.032+0000 7fa09b400640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c109c20 0x7fa09c19fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:23.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.033+0000 7fa09aa00640 1 -- 172.21.15.37:0/198443787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa09c1092d0 msgr2=0x7fa09c19a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:23.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.033+0000 7fa09aa00640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa09c1092d0 0x7fa09c19a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:23.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.033+0000 7fa09aa00640 1 -- 172.21.15.37:0/198443787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c109c20 msgr2=0x7fa09c19fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:23.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.033+0000 7fa09aa00640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c109c20 0x7fa09c19fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:23.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.033+0000 7fa09aa00640 1 -- 172.21.15.37:0/198443787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09c1a0240 con 0x7fa09c103990 2024-09-21T05:51:23.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.033+0000 7fa09b400640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c109c20 0x7fa09c19fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:51:23.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.033+0000 7fa09aa00640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa09c103990 0x7fa09c19a2d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00e9f0 tx=0x7fa08c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:23.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.033+0000 7fa0a0a00640 1 -- 172.21.15.37:0/198443787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c00cd80 con 0x7fa09c103990 2024-09-21T05:51:23.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.033+0000 7fa0a0a00640 1 -- 172.21.15.37:0/198443787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa08c0108e0 con 0x7fa09c103990 2024-09-21T05:51:23.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.033+0000 7fa0a0a00640 1 -- 172.21.15.37:0/198443787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c018980 con 0x7fa09c103990 2024-09-21T05:51:23.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.033+0000 7fa09be00640 1 -- 172.21.15.37:0/198443787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09c1a0530 con 0x7fa09c103990 2024-09-21T05:51:23.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.034+0000 7fa09be00640 1 -- 172.21.15.37:0/198443787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09c1a6c90 con 0x7fa09c103990 2024-09-21T05:51:23.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.035+0000 7fa09be00640 1 -- 172.21.15.37:0/198443787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09c103da0 con 0x7fa09c103990 2024-09-21T05:51:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.039+0000 7fa0a0a00640 1 -- 172.21.15.37:0/198443787 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fa08c010430 con 0x7fa09c103990 2024-09-21T05:51:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.040+0000 7fa0a0a00640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa0800b6590 0x7fa0800b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.040+0000 7fa0a0a00640 1 -- 172.21.15.37:0/198443787 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fa08c0e7d70 con 0x7fa09c103990 2024-09-21T05:51:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.040+0000 7fa093e00640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa0800b6590 0x7fa0800b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.041+0000 7fa093e00640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa0800b6590 0x7fa0800b8aa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa084009230 tx=0x7fa084031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.043+0000 7fa0a0a00640 1 -- 172.21.15.37:0/198443787 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa08c0ae360 con 0x7fa09c103990 2024-09-21T05:51:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.281+0000 7fa09be00640 1 -- 172.21.15.37:0/198443787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa09c02e640 con 0x7fa09c103990 2024-09-21T05:51:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.283+0000 7fa0a0a00640 1 -- 172.21.15.37:0/198443787 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fa08c0b2740 con 0x7fa09c103990 2024-09-21T05:51:23.285 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T05:51:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.285+0000 7fa09be00640 1 -- 172.21.15.37:0/198443787 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa0800b6590 msgr2=0x7fa0800b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.285+0000 7fa09be00640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa0800b6590 0x7fa0800b8aa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa084009230 tx=0x7fa084031400 comp rx=0 tx=0).stop 2024-09-21T05:51:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.285+0000 7fa09be00640 1 -- 172.21.15.37:0/198443787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa09c103990 msgr2=0x7fa09c19a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.285+0000 7fa09be00640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa09c103990 0x7fa09c19a2d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00e9f0 tx=0x7fa08c00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:51:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.285+0000 7fa09be00640 1 -- 172.21.15.37:0/198443787 shutdown_connections 2024-09-21T05:51:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.285+0000 7fa09be00640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa0800b6590 0x7fa0800b8aa0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.285+0000 7fa09be00640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c109c20 0x7fa09c19fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.285+0000 7fa09be00640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa09c1092d0 0x7fa09c19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.286+0000 7fa09be00640 1 --2- 172.21.15.37:0/198443787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa09c103990 0x7fa09c19a2d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.286+0000 7fa09be00640 1 -- 172.21.15.37:0/198443787 >> 172.21.15.37:0/198443787 conn(0x7fa09c0ff440 msgr2=0x7fa09c101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.286+0000 7fa09be00640 1 -- 172.21.15.37:0/198443787 shutdown_connections 2024-09-21T05:51:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:23.286+0000 7fa09be00640 1 -- 172.21.15.37:0/198443787 wait complete. 2024-09-21T05:51:23.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:23 smithi144 ceph-mon[34351]: pgmap v334: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:23.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:23 smithi037 ceph-mon[30631]: pgmap v334: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:23.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:23 smithi067 ceph-mon[34443]: pgmap v334: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:24.015 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T05:51:24.015 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T05:51:24.015 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-09-21T05:51:24.015 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T05:51:24.015 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:51:24.015 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T05:51:24.015 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T05:51:24.015 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T05:51:24.015 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T05:51:24.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:51:24.016 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-09-21T05:51:24.051 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T05:51:24.051 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T05:51:24.052 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T05:51:24.052 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:51:24.052 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-09-21T05:51:24.052 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:51:24.052 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:51:24.052 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:51:24.052 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-09-21T05:51:24.052 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:51:24.052 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:51:24.052 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-09-21T05:51:24.052 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T05:51:24.052 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:51:24.052 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-09-21T05:51:24.053 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T05:51:24.053 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42145sec preferred_lft 42145sec 2024-09-21T05:51:24.053 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-09-21T05:51:24.053 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:51:24.053 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:51:24.053 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:51:24.053 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-09-21T05:51:24.054 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T05:51:24.055 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:51:24.055 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T05:51:24.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-09-21T05:51:24.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-09-21T05:51:24.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-09-21T05:51:24.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T05:51:24.055 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T05:51:24.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:51:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:51:24.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:51:24.494 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T05:51:24.545 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:24 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/198443787' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:51:24.551 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-09-21T05:51:24.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:51:24.555 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-09-21T05:51:24.608 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-09-21T05:51:24.608 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T05:51:24.608 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T05:51:24.608 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T05:51:24.608 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T05:51:24.609 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:51:24.609 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T05:51:24.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T05:51:24.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T05:51:24.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T05:51:24.609 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T05:51:24.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:24 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/198443787' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:51:24.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:51:24.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:24 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/198443787' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:51:25.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:51:25.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:51:25.196 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-21T05:51:25.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:51:25.232 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-09-21T05:51:25.308 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:51:25.308 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T05:51:25.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:51:25.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T05:51:25.308 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T05:51:25.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:51:25.443 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:25 smithi037 ceph-mon[30631]: pgmap v335: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:25.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:51:25.487 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T05:51:25.488 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:51:25.488 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T05:51:25.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T05:51:25.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T05:51:25.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T05:51:25.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T05:51:25.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T05:51:25.488 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T05:51:25.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:51:25.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:25 smithi144 ceph-mon[34351]: pgmap v335: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:51:25.730 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:51:25.730 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T05:51:25.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-09-21T05:51:25.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T05:51:25.730 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T05:51:25.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:25 smithi067 ceph-mon[34443]: pgmap v335: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:25.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:51:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:51:25.900 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T05:51:25.900 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T05:51:25.900 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:51:25.937 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T05:51:25.937 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T05:51:25.937 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:51:26.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-09-21T05:51:26.109 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T05:51:26.145 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-09-21T05:51:26.146 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-09-21T05:51:26.146 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-09-21T05:51:26.146 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-09-21T05:51:26.146 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-09-21T05:51:26.146 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-09-21T05:51:26.146 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-09-21T05:51:26.146 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-09-21T05:51:26.146 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-09-21T05:51:26.146 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-09-21T05:51:26.146 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-09-21T05:51:26.146 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-09-21T05:51:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1ec673a60c222ca3a3084e4f3265d0373139a998f0f4cc7c0aa9030537b69431/merged 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b84687fa25ddada084c9205f704b605c930842fbeec03bb3638423d1cdf9d2c1/merged 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/aa14083f35d7e5d3100805b8e2f08f23834f7d827724c85d6087fdb5e67d4491/merged 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/eb459af071ea6ddb509ffc16b3760afc1ec4c1cd7088903447afbb97af04d394/merged 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b175cc0b0f910b46fe0d8057261257eee49df2dc9020d79b6da50bc807b09b53/merged 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1ef6ac619ceda36e748b33d4108f9cecea5b76edcf1e1e78e7351578515f52b7/merged 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/92aef279831944adc17e5c8f5eca107b7abd9166bcd962555ab44dc21410a554/merged 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/d3ee2f2badddc72d599b5129f8a8f1c1e2a7b6762bffe36e7ec81530bc7823e2/merged 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/17d55334bd25cc666cece731a312374ec6a98e834f3b53e481e20d568649ff04/merged 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/92bf352d3bbddccb1d910022fbcc4965f02942e9572bd5c5e81c8c8173069abf/merged 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:51:26.148 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:51:26.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:51:26.149 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-09-21T05:51:26.228 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T05:51:26.229 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T05:51:26.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-09-21T05:51:26.331 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T05:51:26.367 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-09-21T05:51:26.367 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-09-21T05:51:26.367 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-09-21T05:51:26.367 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-09-21T05:51:26.367 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-09-21T05:51:26.367 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-09-21T05:51:26.367 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-09-21T05:51:26.367 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T05:51:26.368 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1ec673a60c222ca3a3084e4f3265d0373139a998f0f4cc7c0aa9030537b69431/merged 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b84687fa25ddada084c9205f704b605c930842fbeec03bb3638423d1cdf9d2c1/merged 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/aa14083f35d7e5d3100805b8e2f08f23834f7d827724c85d6087fdb5e67d4491/merged 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/eb459af071ea6ddb509ffc16b3760afc1ec4c1cd7088903447afbb97af04d394/merged 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b175cc0b0f910b46fe0d8057261257eee49df2dc9020d79b6da50bc807b09b53/merged 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1ef6ac619ceda36e748b33d4108f9cecea5b76edcf1e1e78e7351578515f52b7/merged 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/92aef279831944adc17e5c8f5eca107b7abd9166bcd962555ab44dc21410a554/merged 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/d3ee2f2badddc72d599b5129f8a8f1c1e2a7b6762bffe36e7ec81530bc7823e2/merged 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/17d55334bd25cc666cece731a312374ec6a98e834f3b53e481e20d568649ff04/merged 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/92bf352d3bbddccb1d910022fbcc4965f02942e9572bd5c5e81c8c8173069abf/merged 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-09-21T05:51:26.369 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:51:26.370 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:51:26.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:51:26.370 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-09-21T05:51:26.611 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:2024-09-21T05:51:26.609+0000 7f7eeaa87480 -1 init, newargv = 0x7f7ed0054370 newargc=15 2024-09-21T05:51:26.612 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[72990]: starting ceph client 2024-09-21T05:51:26.622 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[72990]: starting fuse 2024-09-21T05:51:27.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-09-21T05:51:27.601 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:27 smithi037 ceph-mon[30631]: pgmap v336: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:27.611 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T05:51:27.622 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:27 smithi144 ceph-mon[34351]: pgmap v336: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:27.649 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-09-21T05:51:27.650 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-09-21T05:51:27.650 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-09-21T05:51:27.650 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-09-21T05:51:27.650 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-09-21T05:51:27.650 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-09-21T05:51:27.650 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-09-21T05:51:27.650 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-09-21T05:51:27.650 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-09-21T05:51:27.650 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-09-21T05:51:27.650 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-09-21T05:51:27.650 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-09-21T05:51:27.651 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1ec673a60c222ca3a3084e4f3265d0373139a998f0f4cc7c0aa9030537b69431/merged 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b84687fa25ddada084c9205f704b605c930842fbeec03bb3638423d1cdf9d2c1/merged 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/aa14083f35d7e5d3100805b8e2f08f23834f7d827724c85d6087fdb5e67d4491/merged 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/eb459af071ea6ddb509ffc16b3760afc1ec4c1cd7088903447afbb97af04d394/merged 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b175cc0b0f910b46fe0d8057261257eee49df2dc9020d79b6da50bc807b09b53/merged 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1ef6ac619ceda36e748b33d4108f9cecea5b76edcf1e1e78e7351578515f52b7/merged 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/92aef279831944adc17e5c8f5eca107b7abd9166bcd962555ab44dc21410a554/merged 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/d3ee2f2badddc72d599b5129f8a8f1c1e2a7b6762bffe36e7ec81530bc7823e2/merged 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/17d55334bd25cc666cece731a312374ec6a98e834f3b53e481e20d568649ff04/merged 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/92bf352d3bbddccb1d910022fbcc4965f02942e9572bd5c5e81c8c8173069abf/merged 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:51:27.652 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:51:27.653 INFO:teuthology.orchestra.run.smithi037.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-21T05:51:27.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:51:27.653 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-09-21T05:51:27.731 INFO:teuthology.orchestra.run.smithi037.stdout:108 2024-09-21T05:51:27.731 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [108] 2024-09-21T05:51:27.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo stdin-killer -- python3 -c ' 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> import re 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2024-09-21T05:51:27.732 DEBUG:teuthology.orchestra.run.smithi037:> 2024-09-21T05:51:27.733 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2024-09-21T05:51:27.733 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T05:51:27.733 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T05:51:27.733 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T05:51:27.733 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2024-09-21T05:51:27.733 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2024-09-21T05:51:27.733 DEBUG:teuthology.orchestra.run.smithi037:> return f 2024-09-21T05:51:27.733 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T05:51:27.733 DEBUG:teuthology.orchestra.run.smithi037:> 2024-09-21T05:51:27.733 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.admin")) 2024-09-21T05:51:27.733 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-09-21T05:51:27.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:27 smithi067 ceph-mon[34443]: pgmap v336: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:27.897 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.admin.72990.asok 2024-09-21T05:51:27.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:51:27.911 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.72990.asok 2024-09-21T05:51:27.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:51:27.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.72990.asok status 2024-09-21T05:51:28.163 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:51:28.163 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2024-09-21T05:51:28.163 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T05:51:28.163 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T05:51:28.163 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "admin", 2024-09-21T05:51:28.163 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2024-09-21T05:51:28.163 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "72990", 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24845, 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 24845 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-21T05:51:28.164 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3387026322 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3387026322 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.24845 172.21.15.37:0/3387026322", 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "172.21.15.37:0/3387026322", 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 17, 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 86, 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2024-09-21T05:51:28.165 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2024-09-21T05:51:28.166 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2024-09-21T05:51:28.166 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:51:28.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:51:28.182 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2024-09-21T05:51:28.182 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:51:28.218 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2024-09-21T05:51:28.218 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:51:28.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:51:28.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:51:28.316 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T05:51:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T05:51:28.420 INFO:teuthology.orchestra.run.smithi037.stdout:# file: . 2024-09-21T05:51:28.420 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T05:51:28.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:51:28.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:51:28.428 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:51:28.428 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T05:51:28.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T05:51:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:29.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.520+0000 7f0878e00640 1 -- 172.21.15.37:0/207910755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0874078290 msgr2=0x7f0874114200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:29.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.520+0000 7f0878e00640 1 --2- 172.21.15.37:0/207910755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0874078290 0x7f0874114200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f085c009900 tx=0x7f085c02a3f0 comp rx=0 tx=0).stop 2024-09-21T05:51:29.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.520+0000 7f0878e00640 1 -- 172.21.15.37:0/207910755 shutdown_connections 2024-09-21T05:51:29.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.520+0000 7f0878e00640 1 --2- 172.21.15.37:0/207910755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874114740 0x7f0874116b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:29.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.520+0000 7f0878e00640 1 --2- 172.21.15.37:0/207910755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0874078290 0x7f0874114200 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:29.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.521+0000 7f0878e00640 1 --2- 172.21.15.37:0/207910755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0874077940 0x7f0874077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:29.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.521+0000 7f0878e00640 1 -- 172.21.15.37:0/207910755 >> 172.21.15.37:0/207910755 conn(0x7f08741017d0 msgr2=0x7f0874103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:29.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.521+0000 7f0878e00640 1 -- 172.21.15.37:0/207910755 shutdown_connections 2024-09-21T05:51:29.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.521+0000 7f0878e00640 1 -- 172.21.15.37:0/207910755 wait complete. 2024-09-21T05:51:29.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.522+0000 7f0878e00640 1 Processor -- start 2024-09-21T05:51:29.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.522+0000 7f0878e00640 1 -- start start 2024-09-21T05:51:29.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.522+0000 7f0878e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874077940 0x7f08741a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:29.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.522+0000 7f0878e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0874078290 0x7f08741a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:29.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.522+0000 7f0878e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0874114740 0x7f08741a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.522+0000 7f0878e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f087411a070 con 0x7f0874078290 2024-09-21T05:51:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.522+0000 7f0878e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0874119ef0 con 0x7f0874077940 2024-09-21T05:51:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.522+0000 7f0878e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f087411a1f0 con 0x7f0874114740 2024-09-21T05:51:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.523+0000 7f0871e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874077940 0x7f08741a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.523+0000 7f086be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0874078290 0x7f08741a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.523+0000 7f0871e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874077940 0x7f08741a0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:47568/0 (socket says 172.21.15.37:47568) 2024-09-21T05:51:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.523+0000 7f0871e00640 1 -- 172.21.15.37:0/2569933259 learned_addr learned my addr 172.21.15.37:0/2569933259 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.523+0000 7f0872800640 1 --2- 172.21.15.37:0/2569933259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0874114740 0x7f08741a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.523+0000 7f0871e00640 1 -- 172.21.15.37:0/2569933259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0874114740 msgr2=0x7f08741a62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.523+0000 7f0871e00640 1 --2- 172.21.15.37:0/2569933259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0874114740 0x7f08741a62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.523+0000 7f0871e00640 1 -- 172.21.15.37:0/2569933259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0874078290 msgr2=0x7f08741a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.523+0000 7f0871e00640 1 --2- 172.21.15.37:0/2569933259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0874078290 0x7f08741a1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.523+0000 7f0871e00640 1 -- 172.21.15.37:0/2569933259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08741a69f0 con 0x7f0874077940 2024-09-21T05:51:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.523+0000 7f0871e00640 1 --2- 172.21.15.37:0/2569933259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874077940 0x7f08741a0a80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f086400e9f0 tx=0x7f086400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.524+0000 7f086aa00640 1 -- 172.21.15.37:0/2569933259 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086400cd80 con 0x7f0874077940 2024-09-21T05:51:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.524+0000 7f0878e00640 1 -- 172.21.15.37:0/2569933259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08741a6ce0 con 0x7f0874077940 2024-09-21T05:51:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.524+0000 7f086aa00640 1 -- 172.21.15.37:0/2569933259 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08640108e0 con 0x7f0874077940 2024-09-21T05:51:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.524+0000 7f086aa00640 1 -- 172.21.15.37:0/2569933259 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864018980 con 0x7f0874077940 2024-09-21T05:51:29.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.524+0000 7f0878e00640 1 -- 172.21.15.37:0/2569933259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08741ad440 con 0x7f0874077940 2024-09-21T05:51:29.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.525+0000 7f0878e00640 1 -- 172.21.15.37:0/2569933259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0874077d50 con 0x7f0874077940 2024-09-21T05:51:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.527+0000 7f086aa00640 1 -- 172.21.15.37:0/2569933259 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f0864010430 con 0x7f0874077940 2024-09-21T05:51:29.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.529+0000 7f086aa00640 1 --2- 172.21.15.37:0/2569933259 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f08580b6510 0x7f08580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:29.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.529+0000 7f086aa00640 1 -- 172.21.15.37:0/2569933259 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f08640e7890 con 0x7f0874077940 2024-09-21T05:51:29.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.529+0000 7f086be00640 1 --2- 172.21.15.37:0/2569933259 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f08580b6510 0x7f08580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:29.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.530+0000 7f086be00640 1 --2- 172.21.15.37:0/2569933259 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f08580b6510 0x7f08580b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f085c009230 tx=0x7f085c031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:29.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.533+0000 7f086aa00640 1 -- 172.21.15.37:0/2569933259 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08640b2260 con 0x7f0874077940 2024-09-21T05:51:29.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:29 smithi144 ceph-mon[34351]: pgmap v337: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:29.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:29 smithi037 ceph-mon[30631]: pgmap v337: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:29.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:29 smithi067 ceph-mon[34443]: pgmap v337: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:29.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.746+0000 7f0878e00640 1 -- 172.21.15.37:0/2569933259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f087402e640 con 0x7f0874077940 2024-09-21T05:51:29.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.747+0000 7f086aa00640 1 -- 172.21.15.37:0/2569933259 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) ==== 81+0+590 (secure 0 0 0) 0x7f08640b71a0 con 0x7f0874077940 2024-09-21T05:51:29.750 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3445479674 2024-09-22T05:42:46.114425+0000 2024-09-21T05:51:29.750 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3127564274 2024-09-22T05:42:46.114425+0000 2024-09-21T05:51:29.750 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3632867796 2024-09-22T05:42:46.114425+0000 2024-09-21T05:51:29.750 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/802100173 2024-09-22T05:42:16.118181+0000 2024-09-21T05:51:29.750 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1221065954 2024-09-22T05:42:46.114425+0000 2024-09-21T05:51:29.750 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3632867796 2024-09-22T05:42:46.114425+0000 2024-09-21T05:51:29.750 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/831572416 2024-09-22T05:42:16.118181+0000 2024-09-21T05:51:29.750 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3921659116 2024-09-22T05:42:16.118181+0000 2024-09-21T05:51:29.750 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/1872213512 2024-09-22T05:42:16.118181+0000 2024-09-21T05:51:29.750 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/1872213512 2024-09-22T05:42:16.118181+0000 2024-09-21T05:51:29.750 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-09-21T05:51:29.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.750+0000 7f0878e00640 1 -- 172.21.15.37:0/2569933259 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f08580b6510 msgr2=0x7f08580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:29.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.750+0000 7f0878e00640 1 --2- 172.21.15.37:0/2569933259 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f08580b6510 0x7f08580b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f085c009230 tx=0x7f085c031400 comp rx=0 tx=0).stop 2024-09-21T05:51:29.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.750+0000 7f0878e00640 1 -- 172.21.15.37:0/2569933259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874077940 msgr2=0x7f08741a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:29.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.750+0000 7f0878e00640 1 --2- 172.21.15.37:0/2569933259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874077940 0x7f08741a0a80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f086400e9f0 tx=0x7f086400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:51:29.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.750+0000 7f0878e00640 1 -- 172.21.15.37:0/2569933259 shutdown_connections 2024-09-21T05:51:29.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.750+0000 7f0878e00640 1 --2- 172.21.15.37:0/2569933259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0874114740 0x7f08741a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:29.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.750+0000 7f0878e00640 1 --2- 172.21.15.37:0/2569933259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0874078290 0x7f08741a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:29.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.750+0000 7f0878e00640 1 --2- 172.21.15.37:0/2569933259 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f08580b6510 0x7f08580b8a20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:29.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.750+0000 7f0878e00640 1 --2- 172.21.15.37:0/2569933259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874077940 0x7f08741a0a80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:29.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.750+0000 7f0878e00640 1 -- 172.21.15.37:0/2569933259 >> 172.21.15.37:0/2569933259 conn(0x7f08741017d0 msgr2=0x7f0874103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:29.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.750+0000 7f0878e00640 1 -- 172.21.15.37:0/2569933259 shutdown_connections 2024-09-21T05:51:29.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:29.750+0000 7f0878e00640 1 -- 172.21.15.37:0/2569933259 wait complete. 2024-09-21T05:51:30.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:30 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2569933259' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:51:30.526 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:51:30.526 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T05:51:30.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T05:51:30.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:30 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2569933259' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:51:30.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:30 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2569933259' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:51:30.983 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:31.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:31 smithi037 ceph-mon[30631]: pgmap v338: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:31.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:31 smithi144 ceph-mon[34351]: pgmap v338: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:31.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.647+0000 7f3026c00640 1 -- 172.21.15.37:0/1798161412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3020077380 msgr2=0x7f30200757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:31.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.647+0000 7f3026c00640 1 --2- 172.21.15.37:0/1798161412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3020077380 0x7f30200757b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3010009900 tx=0x7f301002a410 comp rx=0 tx=0).stop 2024-09-21T05:51:31.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.647+0000 7f3026c00640 1 -- 172.21.15.37:0/1798161412 shutdown_connections 2024-09-21T05:51:31.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.647+0000 7f3026c00640 1 --2- 172.21.15.37:0/1798161412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3020114450 0x7f3020116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:31.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.647+0000 7f3026c00640 1 --2- 172.21.15.37:0/1798161412 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3020075dd0 0x7f30200761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:31.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.648+0000 7f3026c00640 1 --2- 172.21.15.37:0/1798161412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3020077380 0x7f30200757b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:31.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.648+0000 7f3026c00640 1 -- 172.21.15.37:0/1798161412 >> 172.21.15.37:0/1798161412 conn(0x7f30200ff610 msgr2=0x7f3020101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:31.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.648+0000 7f3026c00640 1 -- 172.21.15.37:0/1798161412 shutdown_connections 2024-09-21T05:51:31.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.648+0000 7f3026c00640 1 -- 172.21.15.37:0/1798161412 wait complete. 2024-09-21T05:51:31.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.649+0000 7f3026c00640 1 Processor -- start 2024-09-21T05:51:31.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.649+0000 7f3026c00640 1 -- start start 2024-09-21T05:51:31.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.650+0000 7f3026c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3020075dd0 0x7f30201a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:31.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.650+0000 7f3026c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3020077380 0x7f30201a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:31.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.650+0000 7f3026c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3020114450 0x7f30201a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:31.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.650+0000 7f3026c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f302011a0a0 con 0x7f3020075dd0 2024-09-21T05:51:31.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.650+0000 7f3026c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3020119f20 con 0x7f3020077380 2024-09-21T05:51:31.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.650+0000 7f3026c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f302011a220 con 0x7f3020114450 2024-09-21T05:51:31.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.650+0000 7f301fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3020075dd0 0x7f30201a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:31.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.650+0000 7f301fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3020075dd0 0x7f30201a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53606/0 (socket says 172.21.15.37:53606) 2024-09-21T05:51:31.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.650+0000 7f301fe00640 1 -- 172.21.15.37:0/1061847721 learned_addr learned my addr 172.21.15.37:0/1061847721 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:31.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.650+0000 7f3017400640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3020077380 0x7f30201a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:31.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.650+0000 7f3024c00640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3020114450 0x7f30201a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:31.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.651+0000 7f301fe00640 1 -- 172.21.15.37:0/1061847721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3020114450 msgr2=0x7f30201a6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:31.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.651+0000 7f301fe00640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3020114450 0x7f30201a6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:31.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.651+0000 7f301fe00640 1 -- 172.21.15.37:0/1061847721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3020077380 msgr2=0x7f30201a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:31.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.651+0000 7f301fe00640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3020077380 0x7f30201a1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:31.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.651+0000 7f301fe00640 1 -- 172.21.15.37:0/1061847721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30201a6a40 con 0x7f3020075dd0 2024-09-21T05:51:31.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.651+0000 7f3017400640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3020077380 0x7f30201a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:51:31.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.651+0000 7f301fe00640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3020075dd0 0x7f30201a0ad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3010005940 tx=0x7f30100040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:31.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.651+0000 7f301d600640 1 -- 172.21.15.37:0/1061847721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301003f030 con 0x7f3020075dd0 2024-09-21T05:51:31.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.652+0000 7f301d600640 1 -- 172.21.15.37:0/1061847721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30100044c0 con 0x7f3020075dd0 2024-09-21T05:51:31.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.652+0000 7f301d600640 1 -- 172.21.15.37:0/1061847721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3010035070 con 0x7f3020075dd0 2024-09-21T05:51:31.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.652+0000 7f3026c00640 1 -- 172.21.15.37:0/1061847721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30201a6cd0 con 0x7f3020075dd0 2024-09-21T05:51:31.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.652+0000 7f3026c00640 1 -- 172.21.15.37:0/1061847721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30201ad490 con 0x7f3020075dd0 2024-09-21T05:51:31.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.654+0000 7f3026c00640 1 -- 172.21.15.37:0/1061847721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3020076cc0 con 0x7f3020075dd0 2024-09-21T05:51:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.656+0000 7f301d600640 1 -- 172.21.15.37:0/1061847721 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f3010042030 con 0x7f3020075dd0 2024-09-21T05:51:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.657+0000 7f301d600640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f30040b6590 0x7f30040b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:31.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.657+0000 7f301d600640 1 -- 172.21.15.37:0/1061847721 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f3010107840 con 0x7f3020075dd0 2024-09-21T05:51:31.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.657+0000 7f3017400640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f30040b6590 0x7f30040b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.658+0000 7f3017400640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f30040b6590 0x7f30040b8aa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3020116360 tx=0x7f3008005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.662+0000 7f301d600640 1 -- 172.21.15.37:0/1061847721 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30100d2210 con 0x7f3020075dd0 2024-09-21T05:51:31.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:31 smithi067 ceph-mon[34443]: pgmap v338: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:31.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.875+0000 7f3026c00640 1 -- 172.21.15.37:0/1061847721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f30200761e0 con 0x7f3020075dd0 2024-09-21T05:51:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.875+0000 7f301d600640 1 -- 172.21.15.37:0/1061847721 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) ==== 81+0+590 (secure 0 0 0) 0x7f30200761e0 con 0x7f3020075dd0 2024-09-21T05:51:31.877 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3445479674 2024-09-22T05:42:46.114425+0000 2024-09-21T05:51:31.877 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3127564274 2024-09-22T05:42:46.114425+0000 2024-09-21T05:51:31.877 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3632867796 2024-09-22T05:42:46.114425+0000 2024-09-21T05:51:31.877 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/802100173 2024-09-22T05:42:16.118181+0000 2024-09-21T05:51:31.877 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1221065954 2024-09-22T05:42:46.114425+0000 2024-09-21T05:51:31.878 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3632867796 2024-09-22T05:42:46.114425+0000 2024-09-21T05:51:31.878 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/831572416 2024-09-22T05:42:16.118181+0000 2024-09-21T05:51:31.878 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3921659116 2024-09-22T05:42:16.118181+0000 2024-09-21T05:51:31.878 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/1872213512 2024-09-22T05:42:16.118181+0000 2024-09-21T05:51:31.878 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/1872213512 2024-09-22T05:42:16.118181+0000 2024-09-21T05:51:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-09-21T05:51:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.878+0000 7f3026c00640 1 -- 172.21.15.37:0/1061847721 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f30040b6590 msgr2=0x7f30040b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.878+0000 7f3026c00640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f30040b6590 0x7f30040b8aa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3020116360 tx=0x7f3008005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.878+0000 7f3026c00640 1 -- 172.21.15.37:0/1061847721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3020075dd0 msgr2=0x7f30201a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.878+0000 7f3026c00640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3020075dd0 0x7f30201a0ad0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3010005940 tx=0x7f30100040c0 comp rx=0 tx=0).stop 2024-09-21T05:51:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.878+0000 7f3026c00640 1 -- 172.21.15.37:0/1061847721 shutdown_connections 2024-09-21T05:51:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.878+0000 7f3026c00640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3020114450 0x7f30201a6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.878+0000 7f3026c00640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f30040b6590 0x7f30040b8aa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.878+0000 7f3026c00640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3020077380 0x7f30201a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.878+0000 7f3026c00640 1 --2- 172.21.15.37:0/1061847721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3020075dd0 0x7f30201a0ad0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.878+0000 7f3026c00640 1 -- 172.21.15.37:0/1061847721 >> 172.21.15.37:0/1061847721 conn(0x7f30200ff610 msgr2=0x7f3020110350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:31.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.878+0000 7f3026c00640 1 -- 172.21.15.37:0/1061847721 shutdown_connections 2024-09-21T05:51:31.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:31.879+0000 7f3026c00640 1 -- 172.21.15.37:0/1061847721 wait complete. 2024-09-21T05:51:32.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:32 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1061847721' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:51:32.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:32 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1061847721' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:51:32.643 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2024-09-21T05:51:32.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:51:32.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T05:51:32.700 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[72990]: fuse finished with error 0 and tester_r 0 2024-09-21T05:51:32.704 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T05:51:32.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:32 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1061847721' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T05:51:33.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:33 smithi144 ceph-mon[34351]: pgmap v339: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T05:51:33.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:33 smithi037 ceph-mon[30631]: pgmap v339: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T05:51:33.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:33 smithi067 ceph-mon[34443]: pgmap v339: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T05:51:35.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:35 smithi144 ceph-mon[34351]: pgmap v340: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T05:51:35.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:35 smithi037 ceph-mon[30631]: pgmap v340: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T05:51:35.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:35 smithi067 ceph-mon[34443]: pgmap v340: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T05:51:37.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:37 smithi144 ceph-mon[34351]: pgmap v341: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T05:51:37.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:37 smithi037 ceph-mon[30631]: pgmap v341: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T05:51:37.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:37 smithi067 ceph-mon[34443]: pgmap v341: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T05:51:38.805 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T05:51:38.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:51:38.805 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T05:51:38.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:51:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:39.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:39 smithi037 ceph-mon[30631]: pgmap v342: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T05:51:39.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:39 smithi144 ceph-mon[34351]: pgmap v342: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T05:51:39.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:39 smithi067 ceph-mon[34443]: pgmap v342: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T05:51:39.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.872+0000 7f08e7e00640 1 -- 172.21.15.37:0/2608599837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e81039b0 msgr2=0x7f08e8103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:39.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.872+0000 7f08e7e00640 1 --2- 172.21.15.37:0/2608599837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e81039b0 0x7f08e8103dc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009900 tx=0x7f08d802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:51:39.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.872+0000 7f08e7e00640 1 -- 172.21.15.37:0/2608599837 shutdown_connections 2024-09-21T05:51:39.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.872+0000 7f08e7e00640 1 --2- 172.21.15.37:0/2608599837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08e8109c40 0x7f08e8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:39.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.872+0000 7f08e7e00640 1 --2- 172.21.15.37:0/2608599837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08e81092f0 0x7f08e8109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.872+0000 7f08e7e00640 1 --2- 172.21.15.37:0/2608599837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e81039b0 0x7f08e8103dc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.872+0000 7f08e7e00640 1 -- 172.21.15.37:0/2608599837 >> 172.21.15.37:0/2608599837 conn(0x7f08e80ff440 msgr2=0x7f08e8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.872+0000 7f08e7e00640 1 -- 172.21.15.37:0/2608599837 shutdown_connections 2024-09-21T05:51:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.872+0000 7f08e7e00640 1 -- 172.21.15.37:0/2608599837 wait complete. 2024-09-21T05:51:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.873+0000 7f08e7e00640 1 Processor -- start 2024-09-21T05:51:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.874+0000 7f08e7e00640 1 -- start start 2024-09-21T05:51:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.874+0000 7f08e7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e81039b0 0x7f08e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.874+0000 7f08e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08e81092f0 0x7f08e8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.874+0000 7f08e7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08e8109c40 0x7f08e8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.874+0000 7f08e7e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f08e8113950 con 0x7f08e81039b0 2024-09-21T05:51:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.874+0000 7f08e7e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f08e81137d0 con 0x7f08e8109c40 2024-09-21T05:51:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.874+0000 7f08e7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f08e8113ad0 con 0x7f08e81092f0 2024-09-21T05:51:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.874+0000 7f08e6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e81039b0 0x7f08e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.874+0000 7f08e7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08e8109c40 0x7f08e8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.875+0000 7f08dfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08e81092f0 0x7f08e8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:39.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.875+0000 7f08e7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08e8109c40 0x7f08e8076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:51352/0 (socket says 172.21.15.37:51352) 2024-09-21T05:51:39.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.875+0000 7f08e7400640 1 -- 172.21.15.37:0/4252482181 learned_addr learned my addr 172.21.15.37:0/4252482181 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:39.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.875+0000 7f08e6a00640 1 -- 172.21.15.37:0/4252482181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08e81092f0 msgr2=0x7f08e8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:39.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.875+0000 7f08e6a00640 1 --2- 172.21.15.37:0/4252482181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08e81092f0 0x7f08e8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:39.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.875+0000 7f08e6a00640 1 -- 172.21.15.37:0/4252482181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08e8109c40 msgr2=0x7f08e8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:39.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.875+0000 7f08e6a00640 1 --2- 172.21.15.37:0/4252482181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08e8109c40 0x7f08e8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:39.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.875+0000 7f08e6a00640 1 -- 172.21.15.37:0/4252482181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e81a8660 con 0x7f08e81039b0 2024-09-21T05:51:39.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.875+0000 7f08e6a00640 1 --2- 172.21.15.37:0/4252482181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e81039b0 0x7f08e8075710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f08d802a9e0 tx=0x7f08d8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:39.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.876+0000 7f08eca00640 1 -- 172.21.15.37:0/4252482181 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d803f070 con 0x7f08e81039b0 2024-09-21T05:51:39.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.876+0000 7f08eca00640 1 -- 172.21.15.37:0/4252482181 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08d8031b50 con 0x7f08e81039b0 2024-09-21T05:51:39.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.876+0000 7f08eca00640 1 -- 172.21.15.37:0/4252482181 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d8035030 con 0x7f08e81039b0 2024-09-21T05:51:39.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.876+0000 7f08e7e00640 1 -- 172.21.15.37:0/4252482181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e81a88f0 con 0x7f08e81039b0 2024-09-21T05:51:39.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.876+0000 7f08e7e00640 1 -- 172.21.15.37:0/4252482181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e81a8da0 con 0x7f08e81039b0 2024-09-21T05:51:39.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.877+0000 7f08e7e00640 1 -- 172.21.15.37:0/4252482181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e8103dc0 con 0x7f08e81039b0 2024-09-21T05:51:39.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.879+0000 7f08eca00640 1 -- 172.21.15.37:0/4252482181 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f08d8042070 con 0x7f08e81039b0 2024-09-21T05:51:39.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.881+0000 7f08eca00640 1 --2- 172.21.15.37:0/4252482181 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f08cc0b6510 0x7f08cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:39.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.881+0000 7f08eca00640 1 -- 172.21.15.37:0/4252482181 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f08d8107d90 con 0x7f08e81039b0 2024-09-21T05:51:39.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.881+0000 7f08dfe00640 1 --2- 172.21.15.37:0/4252482181 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f08cc0b6510 0x7f08cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:39.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.882+0000 7f08dfe00640 1 --2- 172.21.15.37:0/4252482181 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f08cc0b6510 0x7f08cc0b8a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f08e8108e90 tx=0x7f08d0005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:39.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:39.883+0000 7f08eca00640 1 -- 172.21.15.37:0/4252482181 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08d8031d00 con 0x7f08e81039b0 2024-09-21T05:51:40.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.082+0000 7f08e7e00640 1 -- 172.21.15.37:0/4252482181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08e802e640 con 0x7f08e81039b0 2024-09-21T05:51:40.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.084+0000 7f08eca00640 1 -- 172.21.15.37:0/4252482181 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24176 (secure 0 0 0) 0x7f08d80d2760 con 0x7f08e81039b0 2024-09-21T05:51:40.087 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:51:40.087 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:51:08.115686+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:50:49.791290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:50:51.877662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:51:01.928796+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:51:40.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.087+0000 7f08e7e00640 1 -- 172.21.15.37:0/4252482181 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f08cc0b6510 msgr2=0x7f08cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.087+0000 7f08e7e00640 1 --2- 172.21.15.37:0/4252482181 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f08cc0b6510 0x7f08cc0b8a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f08e8108e90 tx=0x7f08d0005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.087+0000 7f08e7e00640 1 -- 172.21.15.37:0/4252482181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e81039b0 msgr2=0x7f08e8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.087+0000 7f08e7e00640 1 --2- 172.21.15.37:0/4252482181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e81039b0 0x7f08e8075710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f08d802a9e0 tx=0x7f08d8003b90 comp rx=0 tx=0).stop 2024-09-21T05:51:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.087+0000 7f08e7e00640 1 -- 172.21.15.37:0/4252482181 shutdown_connections 2024-09-21T05:51:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.087+0000 7f08e7e00640 1 --2- 172.21.15.37:0/4252482181 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f08cc0b6510 0x7f08cc0b8a20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.087+0000 7f08e7e00640 1 --2- 172.21.15.37:0/4252482181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08e8109c40 0x7f08e8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.087+0000 7f08e7e00640 1 --2- 172.21.15.37:0/4252482181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08e81092f0 0x7f08e8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.087+0000 7f08e7e00640 1 --2- 172.21.15.37:0/4252482181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e81039b0 0x7f08e8075710 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.087+0000 7f08e7e00640 1 -- 172.21.15.37:0/4252482181 >> 172.21.15.37:0/4252482181 conn(0x7f08e80ff440 msgr2=0x7f08e8101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.087+0000 7f08e7e00640 1 -- 172.21.15.37:0/4252482181 shutdown_connections 2024-09-21T05:51:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:40.087+0000 7f08e7e00640 1 -- 172.21.15.37:0/4252482181 wait complete. 2024-09-21T05:51:40.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:40 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/4252482181' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:40.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:40 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/4252482181' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:40.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:40 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/4252482181' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:40.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:51:41.280 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:41.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:41 smithi037 ceph-mon[30631]: pgmap v343: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T05:51:41.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:41 smithi144 ceph-mon[34351]: pgmap v343: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T05:51:41.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:41 smithi067 ceph-mon[34443]: pgmap v343: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T05:51:41.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.932+0000 7fa277600640 1 -- 172.21.15.37:0/3926658866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2701094a0 msgr2=0x7fa2701098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:41.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.932+0000 7fa277600640 1 --2- 172.21.15.37:0/3926658866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2701094a0 0x7fa2701098b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009860 tx=0x7fa25c02a340 comp rx=0 tx=0).stop 2024-09-21T05:51:41.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.933+0000 7fa277600640 1 -- 172.21.15.37:0/3926658866 shutdown_connections 2024-09-21T05:51:41.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.933+0000 7fa277600640 1 --2- 172.21.15.37:0/3926658866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa270109df0 0x7fa270110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:41.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.933+0000 7fa277600640 1 --2- 172.21.15.37:0/3926658866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2701094a0 0x7fa2701098b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:41.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.933+0000 7fa277600640 1 --2- 172.21.15.37:0/3926658866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa270103b60 0x7fa270103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:41.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.933+0000 7fa277600640 1 -- 172.21.15.37:0/3926658866 >> 172.21.15.37:0/3926658866 conn(0x7fa27007b850 msgr2=0x7fa27007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:41.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.933+0000 7fa277600640 1 -- 172.21.15.37:0/3926658866 shutdown_connections 2024-09-21T05:51:41.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.933+0000 7fa277600640 1 -- 172.21.15.37:0/3926658866 wait complete. 2024-09-21T05:51:41.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.934+0000 7fa277600640 1 Processor -- start 2024-09-21T05:51:41.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.934+0000 7fa277600640 1 -- start start 2024-09-21T05:51:41.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.934+0000 7fa277600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa270103b60 0x7fa27019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:41.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.934+0000 7fa277600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2701094a0 0x7fa27019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:41.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.934+0000 7fa277600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa270109df0 0x7fa27019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:41.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.934+0000 7fa277600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa270113ab0 con 0x7fa2701094a0 2024-09-21T05:51:41.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.934+0000 7fa277600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa270113930 con 0x7fa270103b60 2024-09-21T05:51:41.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.934+0000 7fa277600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa270113c30 con 0x7fa270109df0 2024-09-21T05:51:41.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.935+0000 7fa26fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2701094a0 0x7fa27019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:41.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.935+0000 7fa275600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa270109df0 0x7fa27019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:41.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.935+0000 7fa26fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2701094a0 0x7fa27019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42770/0 (socket says 172.21.15.37:42770) 2024-09-21T05:51:41.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.935+0000 7fa26fe00640 1 -- 172.21.15.37:0/2276937986 learned_addr learned my addr 172.21.15.37:0/2276937986 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:41.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.935+0000 7fa274c00640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa270103b60 0x7fa27019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:41.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.935+0000 7fa26fe00640 1 -- 172.21.15.37:0/2276937986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa270109df0 msgr2=0x7fa27019fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.935+0000 7fa26fe00640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa270109df0 0x7fa27019fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.935+0000 7fa26fe00640 1 -- 172.21.15.37:0/2276937986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa270103b60 msgr2=0x7fa27019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.935+0000 7fa26fe00640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa270103b60 0x7fa27019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.935+0000 7fa26fe00640 1 -- 172.21.15.37:0/2276937986 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2701a03f0 con 0x7fa2701094a0 2024-09-21T05:51:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.935+0000 7fa274c00640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa270103b60 0x7fa27019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:51:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.936+0000 7fa26fe00640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2701094a0 0x7fa27019aa20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa25c035040 tx=0x7fa25c032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.936+0000 7fa26d600640 1 -- 172.21.15.37:0/2276937986 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c037040 con 0x7fa2701094a0 2024-09-21T05:51:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.936+0000 7fa26d600640 1 -- 172.21.15.37:0/2276937986 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa25c004050 con 0x7fa2701094a0 2024-09-21T05:51:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.936+0000 7fa277600640 1 -- 172.21.15.37:0/2276937986 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2701a0680 con 0x7fa2701094a0 2024-09-21T05:51:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.936+0000 7fa26d600640 1 -- 172.21.15.37:0/2276937986 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0035f0 con 0x7fa2701094a0 2024-09-21T05:51:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.936+0000 7fa277600640 1 -- 172.21.15.37:0/2276937986 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2701a0b00 con 0x7fa2701094a0 2024-09-21T05:51:41.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.937+0000 7fa277600640 1 -- 172.21.15.37:0/2276937986 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa270103f70 con 0x7fa2701094a0 2024-09-21T05:51:41.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.940+0000 7fa26d600640 1 -- 172.21.15.37:0/2276937986 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fa25c043020 con 0x7fa2701094a0 2024-09-21T05:51:41.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.941+0000 7fa26d600640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa2580b6510 0x7fa2580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:41.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.941+0000 7fa26d600640 1 -- 172.21.15.37:0/2276937986 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fa25c106ba0 con 0x7fa2701094a0 2024-09-21T05:51:41.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.941+0000 7fa274c00640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa2580b6510 0x7fa2580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:41.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.942+0000 7fa274c00640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa2580b6510 0x7fa2580b8a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa264005fd0 tx=0x7fa264009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:41.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:41.943+0000 7fa26d600640 1 -- 172.21.15.37:0/2276937986 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa25c106e20 con 0x7fa2701094a0 2024-09-21T05:51:42.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.143+0000 7fa277600640 1 -- 172.21.15.37:0/2276937986 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa27002e640 con 0x7fa2701094a0 2024-09-21T05:51:42.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.144+0000 7fa26d600640 1 -- 172.21.15.37:0/2276937986 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24176 (secure 0 0 0) 0x7fa25c04a060 con 0x7fa2701094a0 2024-09-21T05:51:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:51:42.147 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:51:08.115686+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:50:49.791290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:50:51.877662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:51:01.928796+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:51:42.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.147+0000 7fa277600640 1 -- 172.21.15.37:0/2276937986 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa2580b6510 msgr2=0x7fa2580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:42.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.147+0000 7fa277600640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa2580b6510 0x7fa2580b8a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa264005fd0 tx=0x7fa264009260 comp rx=0 tx=0).stop 2024-09-21T05:51:42.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.147+0000 7fa277600640 1 -- 172.21.15.37:0/2276937986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2701094a0 msgr2=0x7fa27019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:42.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.147+0000 7fa277600640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2701094a0 0x7fa27019aa20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa25c035040 tx=0x7fa25c032d50 comp rx=0 tx=0).stop 2024-09-21T05:51:42.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.147+0000 7fa277600640 1 -- 172.21.15.37:0/2276937986 shutdown_connections 2024-09-21T05:51:42.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.147+0000 7fa277600640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa270109df0 0x7fa27019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.147+0000 7fa277600640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2701094a0 0x7fa27019aa20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.147+0000 7fa277600640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa2580b6510 0x7fa2580b8a20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.147+0000 7fa277600640 1 --2- 172.21.15.37:0/2276937986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa270103b60 0x7fa27019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:42.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.147+0000 7fa277600640 1 -- 172.21.15.37:0/2276937986 >> 172.21.15.37:0/2276937986 conn(0x7fa27007b850 msgr2=0x7fa270107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:42.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.148+0000 7fa277600640 1 -- 172.21.15.37:0/2276937986 shutdown_connections 2024-09-21T05:51:42.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:42.148+0000 7fa277600640 1 -- 172.21.15.37:0/2276937986 wait complete. 2024-09-21T05:51:42.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:42 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2276937986' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:42.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:42 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2276937986' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:42.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:42 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2276937986' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:51:42.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T05:51:43.299 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:43.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:43 smithi037 ceph-mon[30631]: pgmap v344: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T05:51:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:43 smithi144 ceph-mon[34351]: pgmap v344: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T05:51:43.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:43 smithi067 ceph-mon[34443]: pgmap v344: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T05:51:43.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.923+0000 7f34b3200640 1 -- 172.21.15.37:0/4041921211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b40757b0 msgr2=0x7f34b4075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:43.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.923+0000 7f34b3200640 1 --2- 172.21.15.37:0/4041921211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b40757b0 0x7f34b4075bc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009900 tx=0x7f34a402a410 comp rx=0 tx=0).stop 2024-09-21T05:51:43.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.923+0000 7f34b3200640 1 -- 172.21.15.37:0/4041921211 shutdown_connections 2024-09-21T05:51:43.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.923+0000 7f34b3200640 1 --2- 172.21.15.37:0/4041921211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34b410fef0 0x7f34b4112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:43.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.923+0000 7f34b3200640 1 --2- 172.21.15.37:0/4041921211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b4076100 0x7f34b410f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:43.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.923+0000 7f34b3200640 1 --2- 172.21.15.37:0/4041921211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b40757b0 0x7f34b4075bc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:43.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.923+0000 7f34b3200640 1 -- 172.21.15.37:0/4041921211 >> 172.21.15.37:0/4041921211 conn(0x7f34b40ff3e0 msgr2=0x7f34b4101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:43.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.923+0000 7f34b3200640 1 -- 172.21.15.37:0/4041921211 shutdown_connections 2024-09-21T05:51:43.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.923+0000 7f34b3200640 1 -- 172.21.15.37:0/4041921211 wait complete. 2024-09-21T05:51:43.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.924+0000 7f34b3200640 1 Processor -- start 2024-09-21T05:51:43.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.924+0000 7f34b3200640 1 -- start start 2024-09-21T05:51:43.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.925+0000 7f34b3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34b40757b0 0x7f34b419c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:43.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.925+0000 7f34b3200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b4076100 0x7f34b419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:43.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.925+0000 7f34b3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b410fef0 0x7f34b41a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:43.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.925+0000 7f34b3200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4115aa0 con 0x7f34b410fef0 2024-09-21T05:51:43.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.925+0000 7f34b3200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4115920 con 0x7f34b4076100 2024-09-21T05:51:43.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.925+0000 7f34b3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4115c20 con 0x7f34b40757b0 2024-09-21T05:51:43.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.925+0000 7f34b1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b4076100 0x7f34b419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.925+0000 7f34b1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34b40757b0 0x7f34b419c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.925+0000 7f34b2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b410fef0 0x7f34b41a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.925+0000 7f34b1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b4076100 0x7f34b419ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:59256/0 (socket says 172.21.15.37:59256) 2024-09-21T05:51:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.925+0000 7f34b1400640 1 -- 172.21.15.37:0/3463752265 learned_addr learned my addr 172.21.15.37:0/3463752265 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.925+0000 7f34b1e00640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34b40757b0 0x7f34b419c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:44320/0 (socket says 172.21.15.37:44320) 2024-09-21T05:51:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.926+0000 7f34b1400640 1 -- 172.21.15.37:0/3463752265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34b40757b0 msgr2=0x7f34b419c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.926+0000 7f34b1400640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34b40757b0 0x7f34b419c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.926+0000 7f34b1400640 1 -- 172.21.15.37:0/3463752265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b410fef0 msgr2=0x7f34b41a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.926+0000 7f34b1400640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b410fef0 0x7f34b41a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.926+0000 7f34b1400640 1 -- 172.21.15.37:0/3463752265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b41a2440 con 0x7f34b4076100 2024-09-21T05:51:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.926+0000 7f34b2800640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b410fef0 0x7f34b41a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:51:43.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.926+0000 7f34b1400640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b4076100 0x7f34b419ca70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f34a000e9c0 tx=0x7f34a000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:43.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.926+0000 7f34aaa00640 1 -- 172.21.15.37:0/3463752265 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a000cd80 con 0x7f34b4076100 2024-09-21T05:51:43.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.926+0000 7f34b3200640 1 -- 172.21.15.37:0/3463752265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b41a2730 con 0x7f34b4076100 2024-09-21T05:51:43.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.926+0000 7f34aaa00640 1 -- 172.21.15.37:0/3463752265 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34a00035f0 con 0x7f34b4076100 2024-09-21T05:51:43.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.926+0000 7f34aaa00640 1 -- 172.21.15.37:0/3463752265 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a0010690 con 0x7f34b4076100 2024-09-21T05:51:43.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.926+0000 7f34b3200640 1 -- 172.21.15.37:0/3463752265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b41a8e90 con 0x7f34b4076100 2024-09-21T05:51:43.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.927+0000 7f34b3200640 1 -- 172.21.15.37:0/3463752265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b4075bc0 con 0x7f34b4076100 2024-09-21T05:51:43.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.930+0000 7f34aaa00640 1 -- 172.21.15.37:0/3463752265 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f34a00037a0 con 0x7f34b4076100 2024-09-21T05:51:43.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.932+0000 7f34aaa00640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f34980b6510 0x7f34980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:43.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.932+0000 7f34aaa00640 1 -- 172.21.15.37:0/3463752265 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f34a00e79d0 con 0x7f34b4076100 2024-09-21T05:51:43.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.932+0000 7f34b1e00640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f34980b6510 0x7f34980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:43.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.933+0000 7f34b1e00640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f34980b6510 0x7f34980b8a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f34a4031440 tx=0x7f34a4009560 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:43.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:43.934+0000 7f34aaa00640 1 -- 172.21.15.37:0/3463752265 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f34a00adfc0 con 0x7f34b4076100 2024-09-21T05:51:44.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.173+0000 7f34b3200640 1 -- 172.21.15.37:0/3463752265 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f34b41a9180 con 0x7f34b4076100 2024-09-21T05:51:44.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.348+0000 7f34aaa00640 1 -- 172.21.15.37:0/3463752265 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f34a00b23a0 con 0x7f34b4076100 2024-09-21T05:51:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.350+0000 7f34b3200640 1 -- 172.21.15.37:0/3463752265 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f34980b6510 msgr2=0x7f34980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.350+0000 7f34b3200640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f34980b6510 0x7f34980b8a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f34a4031440 tx=0x7f34a4009560 comp rx=0 tx=0).stop 2024-09-21T05:51:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.350+0000 7f34b3200640 1 -- 172.21.15.37:0/3463752265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b4076100 msgr2=0x7f34b419ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.350+0000 7f34b3200640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b4076100 0x7f34b419ca70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f34a000e9c0 tx=0x7f34a000ee80 comp rx=0 tx=0).stop 2024-09-21T05:51:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.350+0000 7f34b3200640 1 -- 172.21.15.37:0/3463752265 shutdown_connections 2024-09-21T05:51:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.350+0000 7f34b3200640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b410fef0 0x7f34b41a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.350+0000 7f34b3200640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f34980b6510 0x7f34980b8a20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.350+0000 7f34b3200640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34b4076100 0x7f34b419ca70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.350+0000 7f34b3200640 1 --2- 172.21.15.37:0/3463752265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34b40757b0 0x7f34b419c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.350+0000 7f34b3200640 1 -- 172.21.15.37:0/3463752265 >> 172.21.15.37:0/3463752265 conn(0x7f34b40ff3e0 msgr2=0x7f34b4109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.351+0000 7f34b3200640 1 -- 172.21.15.37:0/3463752265 shutdown_connections 2024-09-21T05:51:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:44.351+0000 7f34b3200640 1 -- 172.21.15.37:0/3463752265 wait complete. 2024-09-21T05:51:44.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:44 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3463752265' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T05:51:44.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:44 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T05:51:44.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:44 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3463752265' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T05:51:44.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:44 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T05:51:44.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:44 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3463752265' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T05:51:44.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:44 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T05:51:45.130 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-21T05:51:45.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T05:51:45.511 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:45.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:45 smithi144 ceph-mon[34351]: pgmap v345: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T05:51:45.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:45 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T05:51:45.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:45 smithi144 ceph-mon[34351]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:51:45.650 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:45 smithi037 ceph-mon[30631]: pgmap v345: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T05:51:45.650 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:45 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T05:51:45.650 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:45 smithi037 ceph-mon[30631]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:51:45.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:45 smithi067 ceph-mon[34443]: pgmap v345: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T05:51:45.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:45 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T05:51:45.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:45 smithi067 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:51:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.158+0000 7f3805e00640 1 -- 172.21.15.37:0/1877299770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3800076100 msgr2=0x7f380010f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.158+0000 7f3805e00640 1 --2- 172.21.15.37:0/1877299770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3800076100 0x7f380010f9d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009900 tx=0x7f37ec02a410 comp rx=0 tx=0).stop 2024-09-21T05:51:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.158+0000 7f3805e00640 1 -- 172.21.15.37:0/1877299770 shutdown_connections 2024-09-21T05:51:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.158+0000 7f3805e00640 1 --2- 172.21.15.37:0/1877299770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f380010ff10 0x7f3800112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.158+0000 7f3805e00640 1 --2- 172.21.15.37:0/1877299770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3800076100 0x7f380010f9d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.158+0000 7f3805e00640 1 --2- 172.21.15.37:0/1877299770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38000757b0 0x7f3800075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.158+0000 7f3805e00640 1 -- 172.21.15.37:0/1877299770 >> 172.21.15.37:0/1877299770 conn(0x7f38000ff440 msgr2=0x7f3800101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.158+0000 7f3805e00640 1 -- 172.21.15.37:0/1877299770 shutdown_connections 2024-09-21T05:51:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.159+0000 7f3805e00640 1 -- 172.21.15.37:0/1877299770 wait complete. 2024-09-21T05:51:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.160+0000 7f3805e00640 1 Processor -- start 2024-09-21T05:51:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.160+0000 7f3805e00640 1 -- start start 2024-09-21T05:51:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.160+0000 7f3805e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38000757b0 0x7f380019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.160+0000 7f3805e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3800076100 0x7f380019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.160+0000 7f3805e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f380010ff10 0x7f38001a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.160+0000 7f3805e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3800115ac0 con 0x7f38000757b0 2024-09-21T05:51:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.160+0000 7f3805e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3800115940 con 0x7f380010ff10 2024-09-21T05:51:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.160+0000 7f3805e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3800115c40 con 0x7f3800076100 2024-09-21T05:51:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.160+0000 7f3804a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38000757b0 0x7f380019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.161+0000 7f3804a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38000757b0 0x7f380019c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42800/0 (socket says 172.21.15.37:42800) 2024-09-21T05:51:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.161+0000 7f37ffe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3800076100 0x7f380019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.161+0000 7f3804a00640 1 -- 172.21.15.37:0/4271425005 learned_addr learned my addr 172.21.15.37:0/4271425005 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.161+0000 7f3805400640 1 --2- 172.21.15.37:0/4271425005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f380010ff10 0x7f38001a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.161+0000 7f3804a00640 1 -- 172.21.15.37:0/4271425005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3800076100 msgr2=0x7f380019cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.161+0000 7f3804a00640 1 --2- 172.21.15.37:0/4271425005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3800076100 0x7f380019cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.161+0000 7f3804a00640 1 -- 172.21.15.37:0/4271425005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f380010ff10 msgr2=0x7f38001a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.161+0000 7f3804a00640 1 --2- 172.21.15.37:0/4271425005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f380010ff10 0x7f38001a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.161+0000 7f3804a00640 1 -- 172.21.15.37:0/4271425005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38001a2480 con 0x7f38000757b0 2024-09-21T05:51:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.161+0000 7f3804a00640 1 --2- 172.21.15.37:0/4271425005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38000757b0 0x7f380019c510 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f37f400ea60 tx=0x7f37f400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.162+0000 7f37fd600640 1 -- 172.21.15.37:0/4271425005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f400cd20 con 0x7f38000757b0 2024-09-21T05:51:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.162+0000 7f37fd600640 1 -- 172.21.15.37:0/4271425005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37f40035f0 con 0x7f38000757b0 2024-09-21T05:51:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.162+0000 7f3805e00640 1 -- 172.21.15.37:0/4271425005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38001a2770 con 0x7f38000757b0 2024-09-21T05:51:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.162+0000 7f37fd600640 1 -- 172.21.15.37:0/4271425005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4010690 con 0x7f38000757b0 2024-09-21T05:51:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.162+0000 7f3805e00640 1 -- 172.21.15.37:0/4271425005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38001a8ed0 con 0x7f38000757b0 2024-09-21T05:51:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.163+0000 7f3805e00640 1 -- 172.21.15.37:0/4271425005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3800075bc0 con 0x7f38000757b0 2024-09-21T05:51:46.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.165+0000 7f37fd600640 1 -- 172.21.15.37:0/4271425005 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f37f40037a0 con 0x7f38000757b0 2024-09-21T05:51:46.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.168+0000 7f37fd600640 1 --2- 172.21.15.37:0/4271425005 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f37e80b6510 0x7f37e80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:46.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.168+0000 7f37fd600640 1 -- 172.21.15.37:0/4271425005 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f37f40e77e0 con 0x7f38000757b0 2024-09-21T05:51:46.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.168+0000 7f37ffe00640 1 --2- 172.21.15.37:0/4271425005 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f37e80b6510 0x7f37e80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:46.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.169+0000 7f37ffe00640 1 --2- 172.21.15.37:0/4271425005 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f37e80b6510 0x7f37e80b8a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f37ec000c00 tx=0x7f37ec031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:46.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.172+0000 7f37fd600640 1 -- 172.21.15.37:0/4271425005 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f37f40addd0 con 0x7f38000757b0 2024-09-21T05:51:46.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:46.419+0000 7f3805e00640 1 -- 172.21.15.37:0/4271425005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f38001a9100 con 0x7f38000757b0 2024-09-21T05:51:46.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]} : dispatch 2024-09-21T05:51:46.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T05:51:46.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]} : dispatch 2024-09-21T05:51:46.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]} : dispatch 2024-09-21T05:51:46.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-21T05:51:46.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]} : dispatch 2024-09-21T05:51:46.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2024-09-21T05:51:46.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-09-21T05:51:46.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-09-21T05:51:46.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-21T05:51:46.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]} : dispatch 2024-09-21T05:51:46.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T05:51:46.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]} : dispatch 2024-09-21T05:51:46.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]} : dispatch 2024-09-21T05:51:46.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-21T05:51:46.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]} : dispatch 2024-09-21T05:51:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2024-09-21T05:51:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-09-21T05:51:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-09-21T05:51:46.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-21T05:51:46.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]} : dispatch 2024-09-21T05:51:46.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T05:51:46.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]} : dispatch 2024-09-21T05:51:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]} : dispatch 2024-09-21T05:51:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-21T05:51:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]} : dispatch 2024-09-21T05:51:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2024-09-21T05:51:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-09-21T05:51:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-09-21T05:51:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-21T05:51:47.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:47.353+0000 7f37fd600640 1 -- 172.21.15.37:0/4271425005 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f37f40b21b0 con 0x7f38000757b0 2024-09-21T05:51:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:47.356+0000 7f3805e00640 1 -- 172.21.15.37:0/4271425005 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f37e80b6510 msgr2=0x7f37e80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:47.356+0000 7f3805e00640 1 --2- 172.21.15.37:0/4271425005 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f37e80b6510 0x7f37e80b8a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f37ec000c00 tx=0x7f37ec031400 comp rx=0 tx=0).stop 2024-09-21T05:51:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:47.356+0000 7f3805e00640 1 -- 172.21.15.37:0/4271425005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38000757b0 msgr2=0x7f380019c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:47.356+0000 7f3805e00640 1 --2- 172.21.15.37:0/4271425005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38000757b0 0x7f380019c510 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f37f400ea60 tx=0x7f37f400ee60 comp rx=0 tx=0).stop 2024-09-21T05:51:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:47.356+0000 7f3805e00640 1 -- 172.21.15.37:0/4271425005 shutdown_connections 2024-09-21T05:51:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:47.356+0000 7f3805e00640 1 --2- 172.21.15.37:0/4271425005 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f37e80b6510 0x7f37e80b8a20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:47.356+0000 7f3805e00640 1 --2- 172.21.15.37:0/4271425005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f380010ff10 0x7f38001a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:47.356+0000 7f3805e00640 1 --2- 172.21.15.37:0/4271425005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3800076100 0x7f380019cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:47.356+0000 7f3805e00640 1 --2- 172.21.15.37:0/4271425005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38000757b0 0x7f380019c510 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:47.356+0000 7f3805e00640 1 -- 172.21.15.37:0/4271425005 >> 172.21.15.37:0/4271425005 conn(0x7f38000ff440 msgr2=0x7f3800109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:47.357+0000 7f3805e00640 1 -- 172.21.15.37:0/4271425005 shutdown_connections 2024-09-21T05:51:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:47.357+0000 7f3805e00640 1 -- 172.21.15.37:0/4271425005 wait complete. 2024-09-21T05:51:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: pgmap v346: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T05:51:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-21T05:51:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T05:51:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-21T05:51:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-21T05:51:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-21T05:51:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-09-21T05:51:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-21T05:51:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-21T05:51:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-21T05:51:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-21T05:51:47.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T05:51:47.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/4271425005' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T05:51:47.624 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: pgmap v346: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/4271425005' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T05:51:47.638 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:47.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: pgmap v346: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-21T05:51:47.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-21T05:51:47.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T05:51:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-21T05:51:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-21T05:51:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-21T05:51:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2024-09-21T05:51:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-21T05:51:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-21T05:51:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-21T05:51:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-21T05:51:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T05:51:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/4271425005' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T05:51:47.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:51:48.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T05:51:48.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:48 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/4271425005' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T05:51:48.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:48 smithi144 ceph-mon[34351]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:51:48.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:48 smithi144 ceph-mon[34351]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T05:51:48.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:48 smithi144 ceph-mon[34351]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T05:51:48.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:48 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/4271425005' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T05:51:48.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:48 smithi037 ceph-mon[30631]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:51:48.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:48 smithi037 ceph-mon[30631]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T05:51:48.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:48 smithi037 ceph-mon[30631]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T05:51:48.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:48 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/4271425005' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T05:51:48.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:48 smithi067 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T05:51:48.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:48 smithi067 ceph-mon[34443]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T05:51:48.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:48 smithi067 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T05:51:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:49.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.602+0000 7fb5e2400640 1 -- 172.21.15.37:0/3138128427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0757b0 msgr2=0x7fb5dc075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:49.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.602+0000 7fb5e2400640 1 --2- 172.21.15.37:0/3138128427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0757b0 0x7fb5dc075bc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009900 tx=0x7fb5cc02a410 comp rx=0 tx=0).stop 2024-09-21T05:51:49.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.602+0000 7fb5e2400640 1 -- 172.21.15.37:0/3138128427 shutdown_connections 2024-09-21T05:51:49.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.602+0000 7fb5e2400640 1 --2- 172.21.15.37:0/3138128427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5dc1100d0 0x7fb5dc112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:49.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.602+0000 7fb5e2400640 1 --2- 172.21.15.37:0/3138128427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5dc076100 0x7fb5dc10fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:49.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.602+0000 7fb5e2400640 1 --2- 172.21.15.37:0/3138128427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0757b0 0x7fb5dc075bc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:49.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.602+0000 7fb5e2400640 1 -- 172.21.15.37:0/3138128427 >> 172.21.15.37:0/3138128427 conn(0x7fb5dc0ff5e0 msgr2=0x7fb5dc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:49.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.602+0000 7fb5e2400640 1 -- 172.21.15.37:0/3138128427 shutdown_connections 2024-09-21T05:51:49.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.602+0000 7fb5e2400640 1 -- 172.21.15.37:0/3138128427 wait complete. 2024-09-21T05:51:49.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.604+0000 7fb5e2400640 1 Processor -- start 2024-09-21T05:51:49.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.604+0000 7fb5e2400640 1 -- start start 2024-09-21T05:51:49.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.604+0000 7fb5e2400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0757b0 0x7fb5dc19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:49.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.604+0000 7fb5e2400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5dc076100 0x7fb5dc19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:49.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.604+0000 7fb5e2400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5dc1100d0 0x7fb5dc1a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:49.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.604+0000 7fb5e2400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc115cd0 con 0x7fb5dc0757b0 2024-09-21T05:51:49.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.604+0000 7fb5e2400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc115b50 con 0x7fb5dc076100 2024-09-21T05:51:49.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.604+0000 7fb5e2400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc115e50 con 0x7fb5dc1100d0 2024-09-21T05:51:49.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.605+0000 7fb5d3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5dc076100 0x7fb5dc19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:49.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.605+0000 7fb5db400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0757b0 0x7fb5dc19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:49.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.605+0000 7fb5d3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5dc076100 0x7fb5dc19cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:59282/0 (socket says 172.21.15.37:59282) 2024-09-21T05:51:49.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.605+0000 7fb5d3e00640 1 -- 172.21.15.37:0/3568080946 learned_addr learned my addr 172.21.15.37:0/3568080946 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:49.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.605+0000 7fb5dbe00640 1 --2- 172.21.15.37:0/3568080946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5dc1100d0 0x7fb5dc1a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:49.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.605+0000 7fb5d3e00640 1 -- 172.21.15.37:0/3568080946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5dc1100d0 msgr2=0x7fb5dc1a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:49.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.605+0000 7fb5d3e00640 1 --2- 172.21.15.37:0/3568080946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5dc1100d0 0x7fb5dc1a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:49.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.605+0000 7fb5d3e00640 1 -- 172.21.15.37:0/3568080946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0757b0 msgr2=0x7fb5dc19c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:49.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.605+0000 7fb5d3e00640 1 --2- 172.21.15.37:0/3568080946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0757b0 0x7fb5dc19c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:49.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.605+0000 7fb5d3e00640 1 -- 172.21.15.37:0/3568080946 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5dc1a25f0 con 0x7fb5dc076100 2024-09-21T05:51:49.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.606+0000 7fb5d3e00640 1 --2- 172.21.15.37:0/3568080946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5dc076100 0x7fb5dc19cc20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400e9c0 tx=0x7fb5c400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:49.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.606+0000 7fb5d8c00640 1 -- 172.21.15.37:0/3568080946 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c400cd80 con 0x7fb5dc076100 2024-09-21T05:51:49.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.606+0000 7fb5e2400640 1 -- 172.21.15.37:0/3568080946 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5dc1a28e0 con 0x7fb5dc076100 2024-09-21T05:51:49.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.606+0000 7fb5d8c00640 1 -- 172.21.15.37:0/3568080946 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5c40035f0 con 0x7fb5dc076100 2024-09-21T05:51:49.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.606+0000 7fb5d8c00640 1 -- 172.21.15.37:0/3568080946 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4010690 con 0x7fb5dc076100 2024-09-21T05:51:49.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.606+0000 7fb5e2400640 1 -- 172.21.15.37:0/3568080946 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5dc1a9040 con 0x7fb5dc076100 2024-09-21T05:51:49.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.607+0000 7fb5e2400640 1 -- 172.21.15.37:0/3568080946 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5dc075bc0 con 0x7fb5dc076100 2024-09-21T05:51:49.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.611+0000 7fb5d8c00640 1 -- 172.21.15.37:0/3568080946 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7fb5c40037a0 con 0x7fb5dc076100 2024-09-21T05:51:49.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.612+0000 7fb5d8c00640 1 --2- 172.21.15.37:0/3568080946 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb5c00b6510 0x7fb5c00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:49.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.613+0000 7fb5d8c00640 1 -- 172.21.15.37:0/3568080946 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fb5c40e7df0 con 0x7fb5dc076100 2024-09-21T05:51:49.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.613+0000 7fb5db400640 1 --2- 172.21.15.37:0/3568080946 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb5c00b6510 0x7fb5c00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:49.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.613+0000 7fb5db400640 1 --2- 172.21.15.37:0/3568080946 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb5c00b6510 0x7fb5c00b8a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc005ab0 tx=0x7fb5cc005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:49.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.613+0000 7fb5d8c00640 1 -- 172.21.15.37:0/3568080946 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5c40ae2c0 con 0x7fb5dc076100 2024-09-21T05:51:49.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:49 smithi067 ceph-mon[34443]: pgmap v349: 129 pgs: 3 peering, 126 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:49.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:49.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:49.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:49.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:49 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:49.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:49 smithi144 ceph-mon[34351]: pgmap v349: 129 pgs: 3 peering, 126 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:49.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:49.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:49.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:49.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:49 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:49.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:49.874+0000 7fb5e2400640 1 -- 172.21.15.37:0/3568080946 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fb5dc1a92d0 con 0x7fb5dc076100 2024-09-21T05:51:49.877 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:49 smithi037 ceph-mon[30631]: pgmap v349: 129 pgs: 3 peering, 126 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T05:51:49.877 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:49.877 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:49.877 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:49.877 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:49 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:50.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:50.457+0000 7fb5d8c00640 1 -- 172.21.15.37:0/3568080946 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7fb5c40b26a0 con 0x7fb5dc076100 2024-09-21T05:51:50.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:50.460+0000 7fb5e2400640 1 -- 172.21.15.37:0/3568080946 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb5c00b6510 msgr2=0x7fb5c00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:50.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:50.460+0000 7fb5e2400640 1 --2- 172.21.15.37:0/3568080946 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb5c00b6510 0x7fb5c00b8a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc005ab0 tx=0x7fb5cc005a20 comp rx=0 tx=0).stop 2024-09-21T05:51:50.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:50.460+0000 7fb5e2400640 1 -- 172.21.15.37:0/3568080946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5dc076100 msgr2=0x7fb5dc19cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:50.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:50.460+0000 7fb5e2400640 1 --2- 172.21.15.37:0/3568080946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5dc076100 0x7fb5dc19cc20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400e9c0 tx=0x7fb5c400ee80 comp rx=0 tx=0).stop 2024-09-21T05:51:50.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:50.460+0000 7fb5e2400640 1 -- 172.21.15.37:0/3568080946 shutdown_connections 2024-09-21T05:51:50.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:50.460+0000 7fb5e2400640 1 --2- 172.21.15.37:0/3568080946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5dc1100d0 0x7fb5dc1a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:50.460+0000 7fb5e2400640 1 --2- 172.21.15.37:0/3568080946 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb5c00b6510 0x7fb5c00b8a20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:50.460+0000 7fb5e2400640 1 --2- 172.21.15.37:0/3568080946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5dc076100 0x7fb5dc19cc20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:50.460+0000 7fb5e2400640 1 --2- 172.21.15.37:0/3568080946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0757b0 0x7fb5dc19c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:50.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:50.460+0000 7fb5e2400640 1 -- 172.21.15.37:0/3568080946 >> 172.21.15.37:0/3568080946 conn(0x7fb5dc0ff5e0 msgr2=0x7fb5dc109be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:50.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:50.460+0000 7fb5e2400640 1 -- 172.21.15.37:0/3568080946 shutdown_connections 2024-09-21T05:51:50.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:50.460+0000 7fb5e2400640 1 -- 172.21.15.37:0/3568080946 wait complete. 2024-09-21T05:51:50.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:50 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3568080946' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T05:51:50.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:50 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T05:51:50.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:50 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:50.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:50 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:50.832 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:50 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3568080946' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T05:51:50.832 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:50 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T05:51:50.832 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:50 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:50.832 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:50 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:50.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:50 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3568080946' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T05:51:50.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:50 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T05:51:50.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:50 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:50.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:50 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:51.255 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-21T05:51:51.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T05:51:51.638 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:51.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:51 smithi037 ceph-mon[30631]: pgmap v350: 129 pgs: 3 peering, 126 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 0 op/s 2024-09-21T05:51:51.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:51 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T05:51:51.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:51 smithi037 ceph-mon[30631]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T05:51:51.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:51.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:51.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:51 smithi037 ceph-mon[30631]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:51:51.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:51 smithi067 ceph-mon[34443]: pgmap v350: 129 pgs: 3 peering, 126 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 0 op/s 2024-09-21T05:51:51.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:51 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T05:51:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:51 smithi067 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T05:51:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:51.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:51 smithi067 ceph-mon[34443]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:51:51.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:51 smithi144 ceph-mon[34351]: pgmap v350: 129 pgs: 3 peering, 126 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s rd, 0 op/s 2024-09-21T05:51:51.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:51 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T05:51:51.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:51 smithi144 ceph-mon[34351]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T05:51:51.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:51:51.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:51:51.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:51:51.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:51 smithi144 ceph-mon[34351]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:51:52.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.320+0000 7f7e8f200640 1 -- 172.21.15.37:0/1794275897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e9010fef0 msgr2=0x7f7e90112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.320+0000 7f7e8f200640 1 --2- 172.21.15.37:0/1794275897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e9010fef0 0x7f7e90112330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009be0 tx=0x7f7e8802a6c0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.320+0000 7f7e8f200640 1 -- 172.21.15.37:0/1794275897 shutdown_connections 2024-09-21T05:51:52.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.320+0000 7f7e8f200640 1 --2- 172.21.15.37:0/1794275897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e9010fef0 0x7f7e90112330 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.320+0000 7f7e8f200640 1 --2- 172.21.15.37:0/1794275897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e90076100 0x7f7e9010f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.320+0000 7f7e8f200640 1 --2- 172.21.15.37:0/1794275897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e900757b0 0x7f7e90075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.320+0000 7f7e8f200640 1 -- 172.21.15.37:0/1794275897 >> 172.21.15.37:0/1794275897 conn(0x7f7e900ff3e0 msgr2=0x7f7e90101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:52.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.320+0000 7f7e8f200640 1 -- 172.21.15.37:0/1794275897 shutdown_connections 2024-09-21T05:51:52.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.320+0000 7f7e8f200640 1 -- 172.21.15.37:0/1794275897 wait complete. 2024-09-21T05:51:52.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.321+0000 7f7e8f200640 1 Processor -- start 2024-09-21T05:51:52.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.322+0000 7f7e8f200640 1 -- start start 2024-09-21T05:51:52.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.322+0000 7f7e8f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e900757b0 0x7f7e9019c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.322+0000 7f7e8f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90076100 0x7f7e9019c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.322+0000 7f7e8f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e9010fef0 0x7f7e901a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.322+0000 7f7e8f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7e90115a60 con 0x7f7e9010fef0 2024-09-21T05:51:52.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.322+0000 7f7e8f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901158e0 con 0x7f7e90076100 2024-09-21T05:51:52.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.322+0000 7f7e8f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7e90115be0 con 0x7f7e900757b0 2024-09-21T05:51:52.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.322+0000 7f7e8d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90076100 0x7f7e9019c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.322+0000 7f7e8e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e9010fef0 0x7f7e901a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.322+0000 7f7e8d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90076100 0x7f7e9019c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:36972/0 (socket says 172.21.15.37:36972) 2024-09-21T05:51:52.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.322+0000 7f7e8d400640 1 -- 172.21.15.37:0/2035403709 learned_addr learned my addr 172.21.15.37:0/2035403709 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:52.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.322+0000 7f7e8de00640 1 --2- 172.21.15.37:0/2035403709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e900757b0 0x7f7e9019c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.323+0000 7f7e8d400640 1 -- 172.21.15.37:0/2035403709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e900757b0 msgr2=0x7f7e9019c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.323+0000 7f7e8d400640 1 --2- 172.21.15.37:0/2035403709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e900757b0 0x7f7e9019c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.323+0000 7f7e8d400640 1 -- 172.21.15.37:0/2035403709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e9010fef0 msgr2=0x7f7e901a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.323+0000 7f7e8d400640 1 --2- 172.21.15.37:0/2035403709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e9010fef0 0x7f7e901a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.323+0000 7f7e8d400640 1 -- 172.21.15.37:0/2035403709 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e901a23a0 con 0x7f7e90076100 2024-09-21T05:51:52.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.323+0000 7f7e8d400640 1 --2- 172.21.15.37:0/2035403709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90076100 0x7f7e9019c9d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00e9a0 tx=0x7f7e7c00ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:52.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.324+0000 7f7e86a00640 1 -- 172.21.15.37:0/2035403709 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c00cd80 con 0x7f7e90076100 2024-09-21T05:51:52.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.324+0000 7f7e86a00640 1 -- 172.21.15.37:0/2035403709 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e7c0108e0 con 0x7f7e90076100 2024-09-21T05:51:52.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.324+0000 7f7e86a00640 1 -- 172.21.15.37:0/2035403709 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c018960 con 0x7f7e90076100 2024-09-21T05:51:52.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.324+0000 7f7e8f200640 1 -- 172.21.15.37:0/2035403709 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e901a2690 con 0x7f7e90076100 2024-09-21T05:51:52.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.324+0000 7f7e8f200640 1 -- 172.21.15.37:0/2035403709 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e901a8df0 con 0x7f7e90076100 2024-09-21T05:51:52.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.325+0000 7f7e8f200640 1 -- 172.21.15.37:0/2035403709 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e90075bc0 con 0x7f7e90076100 2024-09-21T05:51:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.328+0000 7f7e86a00640 1 -- 172.21.15.37:0/2035403709 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f7e7c010a90 con 0x7f7e90076100 2024-09-21T05:51:52.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.330+0000 7f7e86a00640 1 --2- 172.21.15.37:0/2035403709 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7e740b6590 0x7f7e740b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:52.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.330+0000 7f7e86a00640 1 -- 172.21.15.37:0/2035403709 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f7e7c0e7ff0 con 0x7f7e90076100 2024-09-21T05:51:52.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.330+0000 7f7e8de00640 1 --2- 172.21.15.37:0/2035403709 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7e740b6590 0x7f7e740b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:52.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.331+0000 7f7e8de00640 1 --2- 172.21.15.37:0/2035403709 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7e740b6590 0x7f7e740b8aa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009bd0 tx=0x7f7e80005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:52.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.331+0000 7f7e86a00640 1 -- 172.21.15.37:0/2035403709 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7e7c026070 con 0x7f7e90076100 2024-09-21T05:51:52.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.555+0000 7f7e8f200640 1 -- 172.21.15.37:0/2035403709 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7e9010a130 con 0x7f7e740b6590 2024-09-21T05:51:52.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.579+0000 7f7e86a00640 1 -- 172.21.15.37:0/2035403709 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7e9010a130 con 0x7f7e740b6590 2024-09-21T05:51:52.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.582+0000 7f7e8f200640 1 -- 172.21.15.37:0/2035403709 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7e740b6590 msgr2=0x7f7e740b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.582+0000 7f7e8f200640 1 --2- 172.21.15.37:0/2035403709 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7e740b6590 0x7f7e740b8aa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009bd0 tx=0x7f7e80005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:52.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.582+0000 7f7e8f200640 1 -- 172.21.15.37:0/2035403709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90076100 msgr2=0x7f7e9019c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:52.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.582+0000 7f7e8f200640 1 --2- 172.21.15.37:0/2035403709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90076100 0x7f7e9019c9d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00e9a0 tx=0x7f7e7c00ee60 comp rx=0 tx=0).stop 2024-09-21T05:51:52.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.582+0000 7f7e8f200640 1 -- 172.21.15.37:0/2035403709 shutdown_connections 2024-09-21T05:51:52.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.582+0000 7f7e8f200640 1 --2- 172.21.15.37:0/2035403709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e9010fef0 0x7f7e901a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.582+0000 7f7e8f200640 1 --2- 172.21.15.37:0/2035403709 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7e740b6590 0x7f7e740b8aa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.582+0000 7f7e8f200640 1 --2- 172.21.15.37:0/2035403709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90076100 0x7f7e9019c9d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.582+0000 7f7e8f200640 1 --2- 172.21.15.37:0/2035403709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e900757b0 0x7f7e9019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:52.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.582+0000 7f7e8f200640 1 -- 172.21.15.37:0/2035403709 >> 172.21.15.37:0/2035403709 conn(0x7f7e900ff3e0 msgr2=0x7f7e90109a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:52.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.582+0000 7f7e8f200640 1 -- 172.21.15.37:0/2035403709 shutdown_connections 2024-09-21T05:51:52.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:52.582+0000 7f7e8f200640 1 -- 172.21.15.37:0/2035403709 wait complete. 2024-09-21T05:51:52.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:52 smithi144 ceph-mon[34351]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-21T05:51:52.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:52 smithi144 ceph-mon[34351]: Cluster is now healthy 2024-09-21T05:51:52.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:52 smithi037 ceph-mon[30631]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-21T05:51:52.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:52 smithi037 ceph-mon[30631]: Cluster is now healthy 2024-09-21T05:51:52.914 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:51:52 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: 2024-09-21T05:51:52.562+0000 7fcad9400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:51:52.914 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:51:52 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: 2024-09-21T05:51:52.562+0000 7fcad9400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:51:52.915 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:51:52 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: 2024-09-21T05:51:52.562+0000 7fcad9400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:51:52.915 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:51:52 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: 2024-09-21T05:51:52.562+0000 7fcad9400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:51:52.915 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 05:51:52 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: 2024-09-21T05:51:52.562+0000 7fcad9400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T05:51:52.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:52 smithi067 ceph-mon[34443]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-21T05:51:52.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:52 smithi067 ceph-mon[34443]: Cluster is now healthy 2024-09-21T05:51:53.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T05:51:53.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:53 smithi037 ceph-mon[30631]: pgmap v351: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:51:53.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:53 smithi037 ceph-mon[30631]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:53.755 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:53.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:53 smithi144 ceph-mon[34351]: pgmap v351: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:51:53.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:53 smithi144 ceph-mon[34351]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:53.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:53 smithi067 ceph-mon[34443]: pgmap v351: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:51:53.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:53 smithi067 ceph-mon[34443]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:54.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.394+0000 7f2f66600640 1 -- 172.21.15.37:0/4233125463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f6010b6c0 msgr2=0x7f2f6010bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:54.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.394+0000 7f2f66600640 1 --2- 172.21.15.37:0/4233125463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f6010b6c0 0x7f2f6010bad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009900 tx=0x7f2f4c02a3f0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.395+0000 7f2f66600640 1 -- 172.21.15.37:0/4233125463 shutdown_connections 2024-09-21T05:51:54.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.395+0000 7f2f66600640 1 --2- 172.21.15.37:0/4233125463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f6010c010 0x7f2f60112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.395+0000 7f2f66600640 1 --2- 172.21.15.37:0/4233125463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f6010b6c0 0x7f2f6010bad0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.395+0000 7f2f66600640 1 --2- 172.21.15.37:0/4233125463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f60105d80 0x7f2f60106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.395+0000 7f2f66600640 1 -- 172.21.15.37:0/4233125463 >> 172.21.15.37:0/4233125463 conn(0x7f2f60101810 msgr2=0x7f2f60103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.395+0000 7f2f66600640 1 -- 172.21.15.37:0/4233125463 shutdown_connections 2024-09-21T05:51:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.395+0000 7f2f66600640 1 -- 172.21.15.37:0/4233125463 wait complete. 2024-09-21T05:51:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.396+0000 7f2f66600640 1 Processor -- start 2024-09-21T05:51:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.396+0000 7f2f66600640 1 -- start start 2024-09-21T05:51:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.396+0000 7f2f66600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f60105d80 0x7f2f6019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.396+0000 7f2f66600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6010b6c0 0x7f2f6019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.396+0000 7f2f66600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f6010c010 0x7f2f601a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.396+0000 7f2f66600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60115d20 con 0x7f2f60105d80 2024-09-21T05:51:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.396+0000 7f2f66600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60115ba0 con 0x7f2f6010b6c0 2024-09-21T05:51:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.396+0000 7f2f66600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60115ea0 con 0x7f2f6010c010 2024-09-21T05:51:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.397+0000 7f2f5f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f60105d80 0x7f2f6019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.397+0000 7f2f5ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6010b6c0 0x7f2f6019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.397+0000 7f2f5fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f6010c010 0x7f2f601a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.397+0000 7f2f5ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6010b6c0 0x7f2f6019cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:37018/0 (socket says 172.21.15.37:37018) 2024-09-21T05:51:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.397+0000 7f2f5ea00640 1 -- 172.21.15.37:0/2828819296 learned_addr learned my addr 172.21.15.37:0/2828819296 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.397+0000 7f2f5ea00640 1 -- 172.21.15.37:0/2828819296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f6010c010 msgr2=0x7f2f601a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.397+0000 7f2f5ea00640 1 --2- 172.21.15.37:0/2828819296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f6010c010 0x7f2f601a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.397+0000 7f2f5ea00640 1 -- 172.21.15.37:0/2828819296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f60105d80 msgr2=0x7f2f6019c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.397+0000 7f2f5ea00640 1 --2- 172.21.15.37:0/2828819296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f60105d80 0x7f2f6019c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.397+0000 7f2f5ea00640 1 -- 172.21.15.37:0/2828819296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f601a2620 con 0x7f2f6010b6c0 2024-09-21T05:51:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.398+0000 7f2f5ea00640 1 --2- 172.21.15.37:0/2828819296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6010b6c0 0x7f2f6019cc50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c005ab0 tx=0x7f2f4c003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.398+0000 7f2f57e00640 1 -- 172.21.15.37:0/2828819296 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c03f070 con 0x7f2f6010b6c0 2024-09-21T05:51:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.398+0000 7f2f66600640 1 -- 172.21.15.37:0/2828819296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f601a28b0 con 0x7f2f6010b6c0 2024-09-21T05:51:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.398+0000 7f2f57e00640 1 -- 172.21.15.37:0/2828819296 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f4c031b50 con 0x7f2f6010b6c0 2024-09-21T05:51:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.398+0000 7f2f57e00640 1 -- 172.21.15.37:0/2828819296 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c035030 con 0x7f2f6010b6c0 2024-09-21T05:51:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.398+0000 7f2f66600640 1 -- 172.21.15.37:0/2828819296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f601a9070 con 0x7f2f6010b6c0 2024-09-21T05:51:54.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.399+0000 7f2f66600640 1 -- 172.21.15.37:0/2828819296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f60106190 con 0x7f2f6010b6c0 2024-09-21T05:51:54.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.402+0000 7f2f57e00640 1 -- 172.21.15.37:0/2828819296 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 154512+0+0 (secure 0 0 0) 0x7f2f4c042070 con 0x7f2f6010b6c0 2024-09-21T05:51:54.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.403+0000 7f2f57e00640 1 --2- 172.21.15.37:0/2828819296 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2f440b6590 0x7f2f440b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:54.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.403+0000 7f2f57e00640 1 -- 172.21.15.37:0/2828819296 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f2f4c107fe0 con 0x7f2f6010b6c0 2024-09-21T05:51:54.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.403+0000 7f2f5f400640 1 --2- 172.21.15.37:0/2828819296 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2f440b6590 0x7f2f440b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:54.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.404+0000 7f2f5f400640 1 --2- 172.21.15.37:0/2828819296 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2f440b6590 0x7f2f440b8aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f500095f0 tx=0x7f2f50005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:54.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.405+0000 7f2f57e00640 1 -- 172.21.15.37:0/2828819296 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f4c0d2890 con 0x7f2f6010b6c0 2024-09-21T05:51:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.529+0000 7f2f57e00640 1 -- 172.21.15.37:0/2828819296 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f2f4c0ca0d0 con 0x7f2f6010b6c0 2024-09-21T05:51:54.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.638+0000 7f2f66600640 1 -- 172.21.15.37:0/2828819296 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2f60063800 con 0x7f2f440b6590 2024-09-21T05:51:54.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.666+0000 7f2f57e00640 1 -- 172.21.15.37:0/2828819296 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2f60063800 con 0x7f2f440b6590 2024-09-21T05:51:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.668+0000 7f2f66600640 1 -- 172.21.15.37:0/2828819296 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2f440b6590 msgr2=0x7f2f440b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.668+0000 7f2f66600640 1 --2- 172.21.15.37:0/2828819296 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2f440b6590 0x7f2f440b8aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f500095f0 tx=0x7f2f50005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.668+0000 7f2f66600640 1 -- 172.21.15.37:0/2828819296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6010b6c0 msgr2=0x7f2f6019cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.668+0000 7f2f66600640 1 --2- 172.21.15.37:0/2828819296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6010b6c0 0x7f2f6019cc50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c005ab0 tx=0x7f2f4c003b90 comp rx=0 tx=0).stop 2024-09-21T05:51:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.668+0000 7f2f66600640 1 -- 172.21.15.37:0/2828819296 shutdown_connections 2024-09-21T05:51:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.668+0000 7f2f66600640 1 --2- 172.21.15.37:0/2828819296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f6010c010 0x7f2f601a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.668+0000 7f2f66600640 1 --2- 172.21.15.37:0/2828819296 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2f440b6590 0x7f2f440b8aa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.668+0000 7f2f66600640 1 --2- 172.21.15.37:0/2828819296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6010b6c0 0x7f2f6019cc50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.668+0000 7f2f66600640 1 --2- 172.21.15.37:0/2828819296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f60105d80 0x7f2f6019c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.668+0000 7f2f66600640 1 -- 172.21.15.37:0/2828819296 >> 172.21.15.37:0/2828819296 conn(0x7f2f60101810 msgr2=0x7f2f60103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.669+0000 7f2f66600640 1 -- 172.21.15.37:0/2828819296 shutdown_connections 2024-09-21T05:51:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:54.669+0000 7f2f66600640 1 -- 172.21.15.37:0/2828819296 wait complete. 2024-09-21T05:51:55.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T05:51:55.838 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:55 smithi144 ceph-mon[34351]: pgmap v352: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:51:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:55 smithi144 ceph-mon[34351]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T05:51:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:55 smithi144 ceph-mon[34351]: from='client.24905 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:55.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:55 smithi037 ceph-mon[30631]: pgmap v352: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:51:55.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:55 smithi037 ceph-mon[30631]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T05:51:55.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:55 smithi037 ceph-mon[30631]: from='client.24905 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:55 smithi067 ceph-mon[34443]: pgmap v352: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:51:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:55 smithi067 ceph-mon[34443]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T05:51:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:55 smithi067 ceph-mon[34443]: from='client.24905 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:56.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.498+0000 7f24d9400640 1 -- 172.21.15.37:0/3201346047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d410be40 msgr2=0x7f24d4112670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:56.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.498+0000 7f24d9400640 1 --2- 172.21.15.37:0/3201346047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d410be40 0x7f24d4112670 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009ca0 tx=0x7f24cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.498+0000 7f24d9400640 1 -- 172.21.15.37:0/3201346047 shutdown_connections 2024-09-21T05:51:56.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.498+0000 7f24d9400640 1 --2- 172.21.15.37:0/3201346047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d410be40 0x7f24d4112670 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.498+0000 7f24d9400640 1 --2- 172.21.15.37:0/3201346047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d410b4f0 0x7f24d410b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.498+0000 7f24d9400640 1 --2- 172.21.15.37:0/3201346047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24d4105bb0 0x7f24d4105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.498+0000 7f24d9400640 1 -- 172.21.15.37:0/3201346047 >> 172.21.15.37:0/3201346047 conn(0x7f24d4101680 msgr2=0x7f24d4103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:56.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.498+0000 7f24d9400640 1 -- 172.21.15.37:0/3201346047 shutdown_connections 2024-09-21T05:51:56.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.498+0000 7f24d9400640 1 -- 172.21.15.37:0/3201346047 wait complete. 2024-09-21T05:51:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.499+0000 7f24d9400640 1 Processor -- start 2024-09-21T05:51:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.499+0000 7f24d9400640 1 -- start start 2024-09-21T05:51:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.500+0000 7f24d9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24d4105bb0 0x7f24d419c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.500+0000 7f24d9400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d410b4f0 0x7f24d419ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.500+0000 7f24d9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d410be40 0x7f24d41a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.500+0000 7f24d9400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4115b00 con 0x7f24d410be40 2024-09-21T05:51:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.500+0000 7f24d9400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4115980 con 0x7f24d410b4f0 2024-09-21T05:51:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.500+0000 7f24d9400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4115c80 con 0x7f24d4105bb0 2024-09-21T05:51:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.500+0000 7f24d8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d410be40 0x7f24d41a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.500+0000 7f24d8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d410be40 0x7f24d41a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49514/0 (socket says 172.21.15.37:49514) 2024-09-21T05:51:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.500+0000 7f24d8a00640 1 -- 172.21.15.37:0/4224424945 learned_addr learned my addr 172.21.15.37:0/4224424945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.500+0000 7f24cb400640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d410b4f0 0x7f24d419ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.500+0000 7f24d3e00640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24d4105bb0 0x7f24d419c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.501+0000 7f24cb400640 1 -- 172.21.15.37:0/4224424945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24d4105bb0 msgr2=0x7f24d419c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.501+0000 7f24cb400640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24d4105bb0 0x7f24d419c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.501+0000 7f24cb400640 1 -- 172.21.15.37:0/4224424945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d410be40 msgr2=0x7f24d41a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.501+0000 7f24cb400640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d410be40 0x7f24d41a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.501+0000 7f24cb400640 1 -- 172.21.15.37:0/4224424945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d41a2400 con 0x7f24d410b4f0 2024-09-21T05:51:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.501+0000 7f24d3e00640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24d4105bb0 0x7f24d419c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:51:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.501+0000 7f24cb400640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d410b4f0 0x7f24d419ca30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f24d406c8c0 tx=0x7f24bc00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.501+0000 7f24d1600640 1 -- 172.21.15.37:0/4224424945 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc00cc40 con 0x7f24d410b4f0 2024-09-21T05:51:56.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.501+0000 7f24d9400640 1 -- 172.21.15.37:0/4224424945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d41a26f0 con 0x7f24d410b4f0 2024-09-21T05:51:56.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.501+0000 7f24d1600640 1 -- 172.21.15.37:0/4224424945 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24bc00cde0 con 0x7f24d410b4f0 2024-09-21T05:51:56.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.501+0000 7f24d1600640 1 -- 172.21.15.37:0/4224424945 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc018760 con 0x7f24d410b4f0 2024-09-21T05:51:56.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.501+0000 7f24d9400640 1 -- 172.21.15.37:0/4224424945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d41a8e50 con 0x7f24d410b4f0 2024-09-21T05:51:56.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.502+0000 7f24d9400640 1 -- 172.21.15.37:0/4224424945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d4105fc0 con 0x7f24d410b4f0 2024-09-21T05:51:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.505+0000 7f24d1600640 1 -- 172.21.15.37:0/4224424945 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f24bc010a90 con 0x7f24d410b4f0 2024-09-21T05:51:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.506+0000 7f24d1600640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f24b80b6620 0x7f24b80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.507+0000 7f24d1600640 1 -- 172.21.15.37:0/4224424945 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f24bc0e7f30 con 0x7f24d410b4f0 2024-09-21T05:51:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.507+0000 7f24d3e00640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f24b80b6620 0x7f24b80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.508+0000 7f24d3e00640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f24b80b6620 0x7f24b80b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009fc0 tx=0x7f24c4005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:56.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.509+0000 7f24d1600640 1 -- 172.21.15.37:0/4224424945 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24bc0b2680 con 0x7f24d410b4f0 2024-09-21T05:51:56.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.738+0000 7f24d9400640 1 -- 172.21.15.37:0/4224424945 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f24d4063800 con 0x7f24b80b6620 2024-09-21T05:51:56.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.744+0000 7f24d1600640 1 -- 172.21.15.37:0/4224424945 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f24d4063800 con 0x7f24b80b6620 2024-09-21T05:51:56.747 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_0/b7a66b20-549d-4f9c-80b9-2dbdb2e3cea3 2024-09-21T05:51:56.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.747+0000 7f24d9400640 1 -- 172.21.15.37:0/4224424945 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f24b80b6620 msgr2=0x7f24b80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:56.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.747+0000 7f24d9400640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f24b80b6620 0x7f24b80b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009fc0 tx=0x7f24c4005f90 comp rx=0 tx=0).stop 2024-09-21T05:51:56.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.747+0000 7f24d9400640 1 -- 172.21.15.37:0/4224424945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d410b4f0 msgr2=0x7f24d419ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:56.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.747+0000 7f24d9400640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d410b4f0 0x7f24d419ca30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f24d406c8c0 tx=0x7f24bc00ee50 comp rx=0 tx=0).stop 2024-09-21T05:51:56.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.747+0000 7f24d9400640 1 -- 172.21.15.37:0/4224424945 shutdown_connections 2024-09-21T05:51:56.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.747+0000 7f24d9400640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d410be40 0x7f24d41a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.747+0000 7f24d9400640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f24b80b6620 0x7f24b80b8b30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.747+0000 7f24d9400640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24d410b4f0 0x7f24d419ca30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.747+0000 7f24d9400640 1 --2- 172.21.15.37:0/4224424945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24d4105bb0 0x7f24d419c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:56.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.747+0000 7f24d9400640 1 -- 172.21.15.37:0/4224424945 >> 172.21.15.37:0/4224424945 conn(0x7f24d4101680 msgr2=0x7f24d4103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:56.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.747+0000 7f24d9400640 1 -- 172.21.15.37:0/4224424945 shutdown_connections 2024-09-21T05:51:56.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:56.747+0000 7f24d9400640 1 -- 172.21.15.37:0/4224424945 wait complete. 2024-09-21T05:51:57.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T05:51:57.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:57 smithi037 ceph-mon[30631]: pgmap v353: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.5 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:51:57.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:57 smithi037 ceph-mon[30631]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:57.832 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:57.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:57 smithi144 ceph-mon[34351]: pgmap v353: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.5 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:51:57.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:57 smithi144 ceph-mon[34351]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:57 smithi067 ceph-mon[34443]: pgmap v353: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.5 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:51:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:57 smithi067 ceph-mon[34443]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:58.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.449+0000 7f5807200640 1 -- 172.21.15.37:0/2570486863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f580010b4f0 msgr2=0x7f580010b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.449+0000 7f5807200640 1 --2- 172.21.15.37:0/2570486863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f580010b4f0 0x7f580010b900 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009900 tx=0x7f57f002a410 comp rx=0 tx=0).stop 2024-09-21T05:51:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.449+0000 7f5807200640 1 -- 172.21.15.37:0/2570486863 shutdown_connections 2024-09-21T05:51:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.449+0000 7f5807200640 1 --2- 172.21.15.37:0/2570486863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f580010be40 0x7f5800112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.449+0000 7f5807200640 1 --2- 172.21.15.37:0/2570486863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f580010b4f0 0x7f580010b900 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.449+0000 7f5807200640 1 --2- 172.21.15.37:0/2570486863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5800105bb0 0x7f5800105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.449+0000 7f5807200640 1 -- 172.21.15.37:0/2570486863 >> 172.21.15.37:0/2570486863 conn(0x7f5800101680 msgr2=0x7f5800103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.449+0000 7f5807200640 1 -- 172.21.15.37:0/2570486863 shutdown_connections 2024-09-21T05:51:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.449+0000 7f5807200640 1 -- 172.21.15.37:0/2570486863 wait complete. 2024-09-21T05:51:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.450+0000 7f5807200640 1 Processor -- start 2024-09-21T05:51:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.450+0000 7f5807200640 1 -- start start 2024-09-21T05:51:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.450+0000 7f5807200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5800105bb0 0x7f580019c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.450+0000 7f5807200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f580010b4f0 0x7f580019cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5807200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f580010be40 0x7f58001a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5807200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5800115b50 con 0x7f5800105bb0 2024-09-21T05:51:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5807200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f58001159d0 con 0x7f580010b4f0 2024-09-21T05:51:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5807200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5800115cd0 con 0x7f580010be40 2024-09-21T05:51:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5805e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5800105bb0 0x7f580019c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5805e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5800105bb0 0x7f580019c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49538/0 (socket says 172.21.15.37:49538) 2024-09-21T05:51:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5805e00640 1 -- 172.21.15.37:0/103936646 learned_addr learned my addr 172.21.15.37:0/103936646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:51:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5806800640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f580010be40 0x7f58001a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5805400640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f580010b4f0 0x7f580019cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5805e00640 1 -- 172.21.15.37:0/103936646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f580010be40 msgr2=0x7f58001a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5805e00640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f580010be40 0x7f58001a1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5805e00640 1 -- 172.21.15.37:0/103936646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f580010b4f0 msgr2=0x7f580019cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5805e00640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f580010b4f0 0x7f580019cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5805e00640 1 -- 172.21.15.37:0/103936646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58001a2490 con 0x7f5800105bb0 2024-09-21T05:51:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5806800640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f580010be40 0x7f58001a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:51:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.451+0000 7f5805400640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f580010b4f0 0x7f580019cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:51:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.452+0000 7f5805e00640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5800105bb0 0x7f580019c520 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f57f400e9f0 tx=0x7f57f400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.452+0000 7f57faa00640 1 -- 172.21.15.37:0/103936646 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f400cd80 con 0x7f5800105bb0 2024-09-21T05:51:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.452+0000 7f57faa00640 1 -- 172.21.15.37:0/103936646 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57f40054d0 con 0x7f5800105bb0 2024-09-21T05:51:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.452+0000 7f57faa00640 1 -- 172.21.15.37:0/103936646 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f4010690 con 0x7f5800105bb0 2024-09-21T05:51:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.452+0000 7f5807200640 1 -- 172.21.15.37:0/103936646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58001a2780 con 0x7f5800105bb0 2024-09-21T05:51:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.452+0000 7f5807200640 1 -- 172.21.15.37:0/103936646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58001a8ee0 con 0x7f5800105bb0 2024-09-21T05:51:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.453+0000 7f5807200640 1 -- 172.21.15.37:0/103936646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5800105fc0 con 0x7f5800105bb0 2024-09-21T05:51:58.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.456+0000 7f57faa00640 1 -- 172.21.15.37:0/103936646 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f57f4004e30 con 0x7f5800105bb0 2024-09-21T05:51:58.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.457+0000 7f57faa00640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f57e80b6620 0x7f57e80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:51:58.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.457+0000 7f57faa00640 1 -- 172.21.15.37:0/103936646 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f57f40e7f10 con 0x7f5800105bb0 2024-09-21T05:51:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.457+0000 7f5805400640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f57e80b6620 0x7f57e80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:51:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.458+0000 7f5805400640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f57e80b6620 0x7f57e80b8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f57f002aa00 tx=0x7f57f0031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:51:58.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.459+0000 7f57faa00640 1 -- 172.21.15.37:0/103936646 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57f4056710 con 0x7f5800105bb0 2024-09-21T05:51:58.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.686+0000 7f5807200640 1 -- 172.21.15.37:0/103936646 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5800063800 con 0x7f57e80b6620 2024-09-21T05:51:58.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.716+0000 7f57faa00640 1 -- 172.21.15.37:0/103936646 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5800063800 con 0x7f57e80b6620 2024-09-21T05:51:58.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.718+0000 7f5807200640 1 -- 172.21.15.37:0/103936646 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f57e80b6620 msgr2=0x7f57e80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:58.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.718+0000 7f5807200640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f57e80b6620 0x7f57e80b8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f57f002aa00 tx=0x7f57f0031400 comp rx=0 tx=0).stop 2024-09-21T05:51:58.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.718+0000 7f5807200640 1 -- 172.21.15.37:0/103936646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5800105bb0 msgr2=0x7f580019c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:51:58.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.718+0000 7f5807200640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5800105bb0 0x7f580019c520 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f57f400e9f0 tx=0x7f57f400edf0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.719+0000 7f5807200640 1 -- 172.21.15.37:0/103936646 shutdown_connections 2024-09-21T05:51:58.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.719+0000 7f5807200640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f580010be40 0x7f58001a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.719+0000 7f5807200640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f57e80b6620 0x7f57e80b8b30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.719+0000 7f5807200640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f580010b4f0 0x7f580019cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.719+0000 7f5807200640 1 --2- 172.21.15.37:0/103936646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5800105bb0 0x7f580019c520 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:51:58.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.719+0000 7f5807200640 1 -- 172.21.15.37:0/103936646 >> 172.21.15.37:0/103936646 conn(0x7f5800101680 msgr2=0x7f5800103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:51:58.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.719+0000 7f5807200640 1 -- 172.21.15.37:0/103936646 shutdown_connections 2024-09-21T05:51:58.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:51:58.719+0000 7f5807200640 1 -- 172.21.15.37:0/103936646 wait complete. 2024-09-21T05:51:59.506 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T05:51:59.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:59 smithi144 ceph-mon[34351]: pgmap v354: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3.2 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:51:59.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:51:59 smithi144 ceph-mon[34351]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:59.885 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:51:59.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:59 smithi037 ceph-mon[30631]: pgmap v354: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3.2 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:51:59.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:51:59 smithi037 ceph-mon[30631]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:51:59.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:59 smithi067 ceph-mon[34443]: pgmap v354: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3.2 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:51:59.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:51:59 smithi067 ceph-mon[34443]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:00.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.530+0000 7f172ca00640 1 -- 172.21.15.37:0/680584745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17281100e0 msgr2=0x7f1728112520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:00.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.531+0000 7f172ca00640 1 --2- 172.21.15.37:0/680584745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17281100e0 0x7f1728112520 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1720009ca0 tx=0x7f172002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.531+0000 7f172ca00640 1 -- 172.21.15.37:0/680584745 shutdown_connections 2024-09-21T05:52:00.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.531+0000 7f172ca00640 1 --2- 172.21.15.37:0/680584745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17281100e0 0x7f1728112520 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.531+0000 7f172ca00640 1 --2- 172.21.15.37:0/680584745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1728076100 0x7f172810fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.531+0000 7f172ca00640 1 --2- 172.21.15.37:0/680584745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17280757b0 0x7f1728075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.531+0000 7f172ca00640 1 -- 172.21.15.37:0/680584745 >> 172.21.15.37:0/680584745 conn(0x7f17280ff5d0 msgr2=0x7f1728101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:00.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.531+0000 7f172ca00640 1 -- 172.21.15.37:0/680584745 shutdown_connections 2024-09-21T05:52:00.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.531+0000 7f172ca00640 1 -- 172.21.15.37:0/680584745 wait complete. 2024-09-21T05:52:00.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.532+0000 7f172ca00640 1 Processor -- start 2024-09-21T05:52:00.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.532+0000 7f172ca00640 1 -- start start 2024-09-21T05:52:00.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.532+0000 7f172ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17280757b0 0x7f172819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:00.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.532+0000 7f172ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1728076100 0x7f172819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:00.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.532+0000 7f172ca00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17281100e0 0x7f17281a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:00.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.532+0000 7f172ca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1728115c90 con 0x7f1728076100 2024-09-21T05:52:00.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.532+0000 7f172ca00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1728115b10 con 0x7f17281100e0 2024-09-21T05:52:00.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.532+0000 7f172ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1728115e10 con 0x7f17280757b0 2024-09-21T05:52:00.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.533+0000 7f1725e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17280757b0 0x7f172819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:00.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.533+0000 7f1725e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17280757b0 0x7f172819c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:39714/0 (socket says 172.21.15.37:39714) 2024-09-21T05:52:00.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.533+0000 7f1725400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1728076100 0x7f172819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:00.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.533+0000 7f1725e00640 1 -- 172.21.15.37:0/2132703799 learned_addr learned my addr 172.21.15.37:0/2132703799 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:00.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.533+0000 7f1726800640 1 --2- 172.21.15.37:0/2132703799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17281100e0 0x7f17281a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:00.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.533+0000 7f1725e00640 1 -- 172.21.15.37:0/2132703799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17281100e0 msgr2=0x7f17281a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:00.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.533+0000 7f1725e00640 1 --2- 172.21.15.37:0/2132703799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17281100e0 0x7f17281a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.533+0000 7f1725e00640 1 -- 172.21.15.37:0/2132703799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1728076100 msgr2=0x7f172819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:00.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.533+0000 7f1725e00640 1 --2- 172.21.15.37:0/2132703799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1728076100 0x7f172819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.533+0000 7f1725e00640 1 -- 172.21.15.37:0/2132703799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17281a25b0 con 0x7f17280757b0 2024-09-21T05:52:00.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.534+0000 7f1725e00640 1 --2- 172.21.15.37:0/2132703799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17280757b0 0x7f172819c640 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f171800e9f0 tx=0x7f171800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:00.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.534+0000 7f171ea00640 1 -- 172.21.15.37:0/2132703799 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171800cd80 con 0x7f17280757b0 2024-09-21T05:52:00.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.534+0000 7f172ca00640 1 -- 172.21.15.37:0/2132703799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17281a28a0 con 0x7f17280757b0 2024-09-21T05:52:00.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.534+0000 7f171ea00640 1 -- 172.21.15.37:0/2132703799 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17180108e0 con 0x7f17280757b0 2024-09-21T05:52:00.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.534+0000 7f171ea00640 1 -- 172.21.15.37:0/2132703799 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718018980 con 0x7f17280757b0 2024-09-21T05:52:00.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.534+0000 7f172ca00640 1 -- 172.21.15.37:0/2132703799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17281a9000 con 0x7f17280757b0 2024-09-21T05:52:00.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.535+0000 7f172ca00640 1 -- 172.21.15.37:0/2132703799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1728075bc0 con 0x7f17280757b0 2024-09-21T05:52:00.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.537+0000 7f171ea00640 1 -- 172.21.15.37:0/2132703799 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f1718010430 con 0x7f17280757b0 2024-09-21T05:52:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.539+0000 7f171ea00640 1 --2- 172.21.15.37:0/2132703799 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f170c0b65a0 0x7f170c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.539+0000 7f171ea00640 1 -- 172.21.15.37:0/2132703799 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f17180e7c40 con 0x7f17280757b0 2024-09-21T05:52:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.539+0000 7f1725400640 1 --2- 172.21.15.37:0/2132703799 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f170c0b65a0 0x7f170c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:00.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.540+0000 7f1725400640 1 --2- 172.21.15.37:0/2132703799 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f170c0b65a0 0x7f170c0b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1728112420 tx=0x7f1714005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:00.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.543+0000 7f171ea00640 1 -- 172.21.15.37:0/2132703799 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f17180adfb0 con 0x7f17280757b0 2024-09-21T05:52:00.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.769+0000 7f172ca00640 1 -- 172.21.15.37:0/2132703799 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f172810a320 con 0x7f170c0b65a0 2024-09-21T05:52:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.774+0000 7f171ea00640 1 -- 172.21.15.37:0/2132703799 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f172810a320 con 0x7f170c0b65a0 2024-09-21T05:52:00.776 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_1/3177fa0a-d66d-446f-8260-6a576a389877 2024-09-21T05:52:00.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.776+0000 7f172ca00640 1 -- 172.21.15.37:0/2132703799 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f170c0b65a0 msgr2=0x7f170c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.776+0000 7f172ca00640 1 --2- 172.21.15.37:0/2132703799 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f170c0b65a0 0x7f170c0b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1728112420 tx=0x7f1714005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.776+0000 7f172ca00640 1 -- 172.21.15.37:0/2132703799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17280757b0 msgr2=0x7f172819c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.776+0000 7f172ca00640 1 --2- 172.21.15.37:0/2132703799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17280757b0 0x7f172819c640 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f171800e9f0 tx=0x7f171800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.776+0000 7f172ca00640 1 -- 172.21.15.37:0/2132703799 shutdown_connections 2024-09-21T05:52:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.776+0000 7f172ca00640 1 --2- 172.21.15.37:0/2132703799 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f170c0b65a0 0x7f170c0b8ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.776+0000 7f172ca00640 1 --2- 172.21.15.37:0/2132703799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17281100e0 0x7f17281a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.776+0000 7f172ca00640 1 --2- 172.21.15.37:0/2132703799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1728076100 0x7f172819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.776+0000 7f172ca00640 1 --2- 172.21.15.37:0/2132703799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17280757b0 0x7f172819c640 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.776+0000 7f172ca00640 1 -- 172.21.15.37:0/2132703799 >> 172.21.15.37:0/2132703799 conn(0x7f17280ff5d0 msgr2=0x7f1728109c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.776+0000 7f172ca00640 1 -- 172.21.15.37:0/2132703799 shutdown_connections 2024-09-21T05:52:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:00.776+0000 7f172ca00640 1 -- 172.21.15.37:0/2132703799 wait complete. 2024-09-21T05:52:01.534 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:52:01.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:01 smithi144 ceph-mon[34351]: pgmap v355: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.0 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:52:01.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:01 smithi144 ceph-mon[34351]: from='client.24934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:01.913 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:01.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:01 smithi037 ceph-mon[30631]: pgmap v355: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.0 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:52:01.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:01 smithi037 ceph-mon[30631]: from='client.24934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:01.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:01 smithi067 ceph-mon[34443]: pgmap v355: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.0 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:52:01.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:01 smithi067 ceph-mon[34443]: from='client.24934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:52:02.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.556+0000 7f1212c00640 1 -- 172.21.15.37:0/863837902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f120c1094c0 msgr2=0x7f120c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:02.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.556+0000 7f1212c00640 1 --2- 172.21.15.37:0/863837902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f120c1094c0 0x7f120c1098d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009860 tx=0x7f11f802a340 comp rx=0 tx=0).stop 2024-09-21T05:52:02.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.556+0000 7f1212c00640 1 -- 172.21.15.37:0/863837902 shutdown_connections 2024-09-21T05:52:02.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.556+0000 7f1212c00640 1 --2- 172.21.15.37:0/863837902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c109e10 0x7f120c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.556+0000 7f1212c00640 1 --2- 172.21.15.37:0/863837902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f120c1094c0 0x7f120c1098d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.556+0000 7f1212c00640 1 --2- 172.21.15.37:0/863837902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120c103b80 0x7f120c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.556+0000 7f1212c00640 1 -- 172.21.15.37:0/863837902 >> 172.21.15.37:0/863837902 conn(0x7f120c0ff590 msgr2=0x7f120c1019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:02.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.556+0000 7f1212c00640 1 -- 172.21.15.37:0/863837902 shutdown_connections 2024-09-21T05:52:02.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.556+0000 7f1212c00640 1 -- 172.21.15.37:0/863837902 wait complete. 2024-09-21T05:52:02.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.557+0000 7f1212c00640 1 Processor -- start 2024-09-21T05:52:02.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.558+0000 7f1212c00640 1 -- start start 2024-09-21T05:52:02.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.558+0000 7f1212c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f120c103b80 0x7f120c19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:02.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.558+0000 7f1212c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120c1094c0 0x7f120c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:02.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.558+0000 7f1212c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c109e10 0x7f120c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:02.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.558+0000 7f1212c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f120c113ad0 con 0x7f120c1094c0 2024-09-21T05:52:02.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.558+0000 7f1212c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f120c113950 con 0x7f120c109e10 2024-09-21T05:52:02.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.558+0000 7f1212c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f120c113c50 con 0x7f120c103b80 2024-09-21T05:52:02.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.559+0000 7f120be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f120c103b80 0x7f120c19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:02.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.559+0000 7f120b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120c1094c0 0x7f120c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:02.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.559+0000 7f120be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f120c103b80 0x7f120c19a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:50284/0 (socket says 172.21.15.37:50284) 2024-09-21T05:52:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.559+0000 7f120b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120c1094c0 0x7f120c19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59270/0 (socket says 172.21.15.37:59270) 2024-09-21T05:52:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.559+0000 7f120be00640 1 -- 172.21.15.37:0/4242900015 learned_addr learned my addr 172.21.15.37:0/4242900015 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.559+0000 7f1210c00640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c109e10 0x7f120c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.559+0000 7f120be00640 1 -- 172.21.15.37:0/4242900015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c109e10 msgr2=0x7f120c19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.559+0000 7f120be00640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c109e10 0x7f120c19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.559+0000 7f120be00640 1 -- 172.21.15.37:0/4242900015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120c1094c0 msgr2=0x7f120c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.559+0000 7f120be00640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120c1094c0 0x7f120c19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.559+0000 7f120be00640 1 -- 172.21.15.37:0/4242900015 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120c1a04b0 con 0x7f120c103b80 2024-09-21T05:52:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.559+0000 7f120b400640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120c1094c0 0x7f120c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.560+0000 7f120be00640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f120c103b80 0x7f120c19a540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00e9c0 tx=0x7f11fc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.560+0000 7f1208c00640 1 -- 172.21.15.37:0/4242900015 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc00cde0 con 0x7f120c103b80 2024-09-21T05:52:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.560+0000 7f1212c00640 1 -- 172.21.15.37:0/4242900015 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120c1a07a0 con 0x7f120c103b80 2024-09-21T05:52:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.560+0000 7f1208c00640 1 -- 172.21.15.37:0/4242900015 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11fc0035f0 con 0x7f120c103b80 2024-09-21T05:52:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.560+0000 7f1212c00640 1 -- 172.21.15.37:0/4242900015 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f120c1a6f00 con 0x7f120c103b80 2024-09-21T05:52:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.560+0000 7f1208c00640 1 -- 172.21.15.37:0/4242900015 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc010690 con 0x7f120c103b80 2024-09-21T05:52:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.562+0000 7f1212c00640 1 -- 172.21.15.37:0/4242900015 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f120c103f90 con 0x7f120c103b80 2024-09-21T05:52:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.564+0000 7f1208c00640 1 -- 172.21.15.37:0/4242900015 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f11fc003aa0 con 0x7f120c103b80 2024-09-21T05:52:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.565+0000 7f1208c00640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11f00b6620 0x7f11f00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.565+0000 7f1208c00640 1 -- 172.21.15.37:0/4242900015 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f11fc0e7b30 con 0x7f120c103b80 2024-09-21T05:52:02.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.566+0000 7f120b400640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11f00b6620 0x7f11f00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:02.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.566+0000 7f120b400640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11f00b6620 0x7f11f00b8b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f11f8005940 tx=0x7f11f80058d0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:02.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.569+0000 7f1208c00640 1 -- 172.21.15.37:0/4242900015 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11fc0adea0 con 0x7f120c103b80 2024-09-21T05:52:02.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.835+0000 7f1212c00640 1 -- 172.21.15.37:0/4242900015 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f120c10bc30 con 0x7f120c103b80 2024-09-21T05:52:02.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.836+0000 7f1208c00640 1 -- 172.21.15.37:0/4242900015 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f11fc0b2280 con 0x7f120c103b80 2024-09-21T05:52:02.839 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:52:02.839 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:52:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:52:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.840+0000 7f1212c00640 1 -- 172.21.15.37:0/4242900015 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11f00b6620 msgr2=0x7f11f00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.840+0000 7f1212c00640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11f00b6620 0x7f11f00b8b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f11f8005940 tx=0x7f11f80058d0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.840+0000 7f1212c00640 1 -- 172.21.15.37:0/4242900015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f120c103b80 msgr2=0x7f120c19a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.840+0000 7f1212c00640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f120c103b80 0x7f120c19a540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00e9c0 tx=0x7f11fc00ee80 comp rx=0 tx=0).stop 2024-09-21T05:52:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.840+0000 7f1212c00640 1 -- 172.21.15.37:0/4242900015 shutdown_connections 2024-09-21T05:52:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.840+0000 7f1212c00640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11f00b6620 0x7f11f00b8b30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.840+0000 7f1212c00640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c109e10 0x7f120c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.840+0000 7f1212c00640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120c1094c0 0x7f120c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.840+0000 7f1212c00640 1 --2- 172.21.15.37:0/4242900015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f120c103b80 0x7f120c19a540 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.840+0000 7f1212c00640 1 -- 172.21.15.37:0/4242900015 >> 172.21.15.37:0/4242900015 conn(0x7f120c0ff590 msgr2=0x7f120c102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.840+0000 7f1212c00640 1 -- 172.21.15.37:0/4242900015 shutdown_connections 2024-09-21T05:52:02.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:02.841+0000 7f1212c00640 1 -- 172.21.15.37:0/4242900015 wait complete. 2024-09-21T05:52:03.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:52:03.804 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:03 smithi037 ceph-mon[30631]: pgmap v356: 129 pgs: 129 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.8 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:52:03.804 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:03 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/4242900015' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:03.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:03 smithi144 ceph-mon[34351]: pgmap v356: 129 pgs: 129 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.8 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:52:03.930 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:03 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/4242900015' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:03.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:03 smithi067 ceph-mon[34443]: pgmap v356: 129 pgs: 129 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.8 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:52:03.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:03 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/4242900015' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:04.000 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:04.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.634+0000 7f2e31800640 1 -- 172.21.15.37:0/2008856024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c077940 msgr2=0x7f2e2c077d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:04.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.634+0000 7f2e31800640 1 --2- 172.21.15.37:0/2008856024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c077940 0x7f2e2c077d50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009900 tx=0x7f2e1c02a3f0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.634+0000 7f2e31800640 1 -- 172.21.15.37:0/2008856024 shutdown_connections 2024-09-21T05:52:04.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.634+0000 7f2e31800640 1 --2- 172.21.15.37:0/2008856024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e2c114570 0x7f2e2c116990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.634+0000 7f2e31800640 1 --2- 172.21.15.37:0/2008856024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e2c078290 0x7f2e2c114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.634+0000 7f2e31800640 1 --2- 172.21.15.37:0/2008856024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c077940 0x7f2e2c077d50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.634+0000 7f2e31800640 1 -- 172.21.15.37:0/2008856024 >> 172.21.15.37:0/2008856024 conn(0x7f2e2c101680 msgr2=0x7f2e2c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:04.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.634+0000 7f2e31800640 1 -- 172.21.15.37:0/2008856024 shutdown_connections 2024-09-21T05:52:04.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.634+0000 7f2e31800640 1 -- 172.21.15.37:0/2008856024 wait complete. 2024-09-21T05:52:04.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.635+0000 7f2e31800640 1 Processor -- start 2024-09-21T05:52:04.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.635+0000 7f2e31800640 1 -- start start 2024-09-21T05:52:04.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.636+0000 7f2e31800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e2c077940 0x7f2e2c1a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:04.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.636+0000 7f2e31800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e2c078290 0x7f2e2c1a0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:04.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.636+0000 7f2e31800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c114570 0x7f2e2c1a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:04.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.636+0000 7f2e31800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c119ef0 con 0x7f2e2c114570 2024-09-21T05:52:04.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.636+0000 7f2e31800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c119d70 con 0x7f2e2c078290 2024-09-21T05:52:04.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.636+0000 7f2e31800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c11a070 con 0x7f2e2c077940 2024-09-21T05:52:04.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.636+0000 7f2e30e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c114570 0x7f2e2c1a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:04.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.636+0000 7f2e30e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c114570 0x7f2e2c1a6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59288/0 (socket says 172.21.15.37:59288) 2024-09-21T05:52:04.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.636+0000 7f2e30e00640 1 -- 172.21.15.37:0/1984003387 learned_addr learned my addr 172.21.15.37:0/1984003387 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:04.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.636+0000 7f2e2be00640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e2c077940 0x7f2e2c1a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:04.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.636+0000 7f2e23400640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e2c078290 0x7f2e2c1a0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:04.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.637+0000 7f2e30e00640 1 -- 172.21.15.37:0/1984003387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e2c077940 msgr2=0x7f2e2c1a0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:04.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.637+0000 7f2e30e00640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e2c077940 0x7f2e2c1a0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.637+0000 7f2e30e00640 1 -- 172.21.15.37:0/1984003387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e2c078290 msgr2=0x7f2e2c1a0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:04.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.637+0000 7f2e30e00640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e2c078290 0x7f2e2c1a0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.637+0000 7f2e30e00640 1 -- 172.21.15.37:0/1984003387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c1a6870 con 0x7f2e2c114570 2024-09-21T05:52:04.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.637+0000 7f2e30e00640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c114570 0x7f2e2c1a6140 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400eb10 tx=0x7f2e2400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:04.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.637+0000 7f2e29600640 1 -- 172.21.15.37:0/1984003387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24004b20 con 0x7f2e2c114570 2024-09-21T05:52:04.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.637+0000 7f2e29600640 1 -- 172.21.15.37:0/1984003387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e24004cc0 con 0x7f2e2c114570 2024-09-21T05:52:04.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.637+0000 7f2e31800640 1 -- 172.21.15.37:0/1984003387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2c1a6b60 con 0x7f2e2c114570 2024-09-21T05:52:04.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.637+0000 7f2e29600640 1 -- 172.21.15.37:0/1984003387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24010670 con 0x7f2e2c114570 2024-09-21T05:52:04.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.638+0000 7f2e31800640 1 -- 172.21.15.37:0/1984003387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e2c1ad2c0 con 0x7f2e2c114570 2024-09-21T05:52:04.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.639+0000 7f2e31800640 1 -- 172.21.15.37:0/1984003387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e2c077d50 con 0x7f2e2c114570 2024-09-21T05:52:04.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.641+0000 7f2e29600640 1 -- 172.21.15.37:0/1984003387 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f2e24005020 con 0x7f2e2c114570 2024-09-21T05:52:04.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.642+0000 7f2e29600640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2e100b6620 0x7f2e100b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:04.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.642+0000 7f2e29600640 1 -- 172.21.15.37:0/1984003387 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f2e240e7d60 con 0x7f2e2c114570 2024-09-21T05:52:04.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.643+0000 7f2e2be00640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2e100b6620 0x7f2e100b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:04.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.643+0000 7f2e2be00640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2e100b6620 0x7f2e100b8b30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c031440 tx=0x7f2e1c009560 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:04.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.647+0000 7f2e29600640 1 -- 172.21.15.37:0/1984003387 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e240ae0d0 con 0x7f2e2c114570 2024-09-21T05:52:04.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.845+0000 7f2e31800640 1 -- 172.21.15.37:0/1984003387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e2c02e640 con 0x7f2e2c114570 2024-09-21T05:52:04.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.847+0000 7f2e29600640 1 -- 172.21.15.37:0/1984003387 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24648 (secure 0 0 0) 0x7f2e240b24b0 con 0x7f2e2c114570 2024-09-21T05:52:04.850 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:52:04.850 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":88,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:51:47.353816+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:50:49.791290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:50:51.877662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:51:01.928796+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:52:04.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.851+0000 7f2e31800640 1 -- 172.21.15.37:0/1984003387 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2e100b6620 msgr2=0x7f2e100b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:04.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.851+0000 7f2e31800640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2e100b6620 0x7f2e100b8b30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c031440 tx=0x7f2e1c009560 comp rx=0 tx=0).stop 2024-09-21T05:52:04.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.851+0000 7f2e31800640 1 -- 172.21.15.37:0/1984003387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c114570 msgr2=0x7f2e2c1a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:04.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.851+0000 7f2e31800640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c114570 0x7f2e2c1a6140 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400eb10 tx=0x7f2e2400c2d0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.851+0000 7f2e31800640 1 -- 172.21.15.37:0/1984003387 shutdown_connections 2024-09-21T05:52:04.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.851+0000 7f2e31800640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e2c114570 0x7f2e2c1a6140 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.851+0000 7f2e31800640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2e100b6620 0x7f2e100b8b30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.851+0000 7f2e31800640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e2c078290 0x7f2e2c1a0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.851+0000 7f2e31800640 1 --2- 172.21.15.37:0/1984003387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e2c077940 0x7f2e2c1a0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:04.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.851+0000 7f2e31800640 1 -- 172.21.15.37:0/1984003387 >> 172.21.15.37:0/1984003387 conn(0x7f2e2c101680 msgr2=0x7f2e2c116600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:04.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.851+0000 7f2e31800640 1 -- 172.21.15.37:0/1984003387 shutdown_connections 2024-09-21T05:52:04.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:04.851+0000 7f2e31800640 1 -- 172.21.15.37:0/1984003387 wait complete. 2024-09-21T05:52:05.632 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T05:52:05.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:52:05.798 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:05 smithi067 ceph-mon[34443]: pgmap v357: 129 pgs: 129 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.8 KiB/s wr, 4 op/s 2024-09-21T05:52:05.799 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:05 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1984003387' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:05.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:05 smithi144 ceph-mon[34351]: pgmap v357: 129 pgs: 129 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.8 KiB/s wr, 4 op/s 2024-09-21T05:52:05.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:05 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1984003387' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:05.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:05 smithi037 ceph-mon[30631]: pgmap v357: 129 pgs: 129 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.8 KiB/s wr, 4 op/s 2024-09-21T05:52:05.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:05 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1984003387' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:06.016 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:06.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.675+0000 7fe6b2600640 1 -- 172.21.15.37:0/107453142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac10c010 msgr2=0x7fe6ac112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:06.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.675+0000 7fe6b2600640 1 --2- 172.21.15.37:0/107453142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac10c010 0x7fe6ac112840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009ca0 tx=0x7fe6a402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:06.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.675+0000 7fe6b2600640 1 -- 172.21.15.37:0/107453142 shutdown_connections 2024-09-21T05:52:06.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.675+0000 7fe6b2600640 1 --2- 172.21.15.37:0/107453142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac10c010 0x7fe6ac112840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:06.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.675+0000 7fe6b2600640 1 --2- 172.21.15.37:0/107453142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6ac10b6c0 0x7fe6ac10bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:06.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.675+0000 7fe6b2600640 1 --2- 172.21.15.37:0/107453142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ac105d80 0x7fe6ac106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:06.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.675+0000 7fe6b2600640 1 -- 172.21.15.37:0/107453142 >> 172.21.15.37:0/107453142 conn(0x7fe6ac101810 msgr2=0x7fe6ac103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:06.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.675+0000 7fe6b2600640 1 -- 172.21.15.37:0/107453142 shutdown_connections 2024-09-21T05:52:06.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.675+0000 7fe6b2600640 1 -- 172.21.15.37:0/107453142 wait complete. 2024-09-21T05:52:06.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.676+0000 7fe6b2600640 1 Processor -- start 2024-09-21T05:52:06.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.676+0000 7fe6b2600640 1 -- start start 2024-09-21T05:52:06.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.677+0000 7fe6b2600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ac105d80 0x7fe6ac19c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:06.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.677+0000 7fe6b2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6ac10b6c0 0x7fe6ac19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:06.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.677+0000 7fe6b2600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac10c010 0x7fe6ac1a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:06.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.677+0000 7fe6b2600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac115d20 con 0x7fe6ac10c010 2024-09-21T05:52:06.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.677+0000 7fe6b2600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac115ba0 con 0x7fe6ac105d80 2024-09-21T05:52:06.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.677+0000 7fe6b2600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac115ea0 con 0x7fe6ac10b6c0 2024-09-21T05:52:06.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.677+0000 7fe6a2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6ac10b6c0 0x7fe6ac19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:06.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.677+0000 7fe6ab400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ac105d80 0x7fe6ac19c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:06.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.677+0000 7fe6abe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac10c010 0x7fe6ac1a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:06.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.677+0000 7fe6a2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6ac10b6c0 0x7fe6ac19ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:50340/0 (socket says 172.21.15.37:50340) 2024-09-21T05:52:06.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.677+0000 7fe6ab400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ac105d80 0x7fe6ac19c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:35360/0 (socket says 172.21.15.37:35360) 2024-09-21T05:52:06.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.677+0000 7fe6a2a00640 1 -- 172.21.15.37:0/437554201 learned_addr learned my addr 172.21.15.37:0/437554201 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:06.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.678+0000 7fe6ab400640 1 -- 172.21.15.37:0/437554201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6ac10b6c0 msgr2=0x7fe6ac19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:06.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.678+0000 7fe6ab400640 1 --2- 172.21.15.37:0/437554201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6ac10b6c0 0x7fe6ac19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:06.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.678+0000 7fe6ab400640 1 -- 172.21.15.37:0/437554201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac10c010 msgr2=0x7fe6ac1a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:06.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.678+0000 7fe6ab400640 1 --2- 172.21.15.37:0/437554201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac10c010 0x7fe6ac1a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:06.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.678+0000 7fe6ab400640 1 -- 172.21.15.37:0/437554201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac1a26a0 con 0x7fe6ac105d80 2024-09-21T05:52:06.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.678+0000 7fe6ab400640 1 --2- 172.21.15.37:0/437554201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ac105d80 0x7fe6ac19c730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00e9f0 tx=0x7fe69c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:06.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.678+0000 7fe6a8c00640 1 -- 172.21.15.37:0/437554201 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c00ccc0 con 0x7fe6ac105d80 2024-09-21T05:52:06.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.678+0000 7fe6a8c00640 1 -- 172.21.15.37:0/437554201 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe69c0108e0 con 0x7fe6ac105d80 2024-09-21T05:52:06.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.678+0000 7fe6b2600640 1 -- 172.21.15.37:0/437554201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ac1a2990 con 0x7fe6ac105d80 2024-09-21T05:52:06.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.678+0000 7fe6a8c00640 1 -- 172.21.15.37:0/437554201 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c018880 con 0x7fe6ac105d80 2024-09-21T05:52:06.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.679+0000 7fe6b2600640 1 -- 172.21.15.37:0/437554201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ac1a90f0 con 0x7fe6ac105d80 2024-09-21T05:52:06.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.680+0000 7fe6b2600640 1 -- 172.21.15.37:0/437554201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ac106190 con 0x7fe6ac105d80 2024-09-21T05:52:06.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.682+0000 7fe6a8c00640 1 -- 172.21.15.37:0/437554201 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fe69c010430 con 0x7fe6ac105d80 2024-09-21T05:52:06.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.683+0000 7fe6a8c00640 1 --2- 172.21.15.37:0/437554201 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe6900b65a0 0x7fe6900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:06.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.684+0000 7fe6a8c00640 1 -- 172.21.15.37:0/437554201 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fe69c0e7d90 con 0x7fe6ac105d80 2024-09-21T05:52:06.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.684+0000 7fe6a2a00640 1 --2- 172.21.15.37:0/437554201 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe6900b65a0 0x7fe6900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:06.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.684+0000 7fe6a2a00640 1 --2- 172.21.15.37:0/437554201 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe6900b65a0 0x7fe6900b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac104f10 tx=0x7fe694005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:06.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.686+0000 7fe6a8c00640 1 -- 172.21.15.37:0/437554201 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe69c0b24e0 con 0x7fe6ac105d80 2024-09-21T05:52:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.883+0000 7fe6b2600640 1 -- 172.21.15.37:0/437554201 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6ac063800 con 0x7fe6900b65a0 2024-09-21T05:52:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.893+0000 7fe6a8c00640 1 -- 172.21.15.37:0/437554201 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340271 (secure 0 0 0) 0x7fe6ac063800 con 0x7fe6900b65a0 2024-09-21T05:52:06.899 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:52:06.900 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T05:52:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.898+0000 7fe6b2600640 1 -- 172.21.15.37:0/437554201 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe6900b65a0 msgr2=0x7fe6900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.898+0000 7fe6b2600640 1 --2- 172.21.15.37:0/437554201 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe6900b65a0 0x7fe6900b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac104f10 tx=0x7fe694005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.898+0000 7fe6b2600640 1 -- 172.21.15.37:0/437554201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ac105d80 msgr2=0x7fe6ac19c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.898+0000 7fe6b2600640 1 --2- 172.21.15.37:0/437554201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ac105d80 0x7fe6ac19c730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00e9f0 tx=0x7fe69c00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:52:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.898+0000 7fe6b2600640 1 -- 172.21.15.37:0/437554201 shutdown_connections 2024-09-21T05:52:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.898+0000 7fe6b2600640 1 --2- 172.21.15.37:0/437554201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac10c010 0x7fe6ac1a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.898+0000 7fe6b2600640 1 --2- 172.21.15.37:0/437554201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6ac10b6c0 0x7fe6ac19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.898+0000 7fe6b2600640 1 --2- 172.21.15.37:0/437554201 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe6900b65a0 0x7fe6900b8ab0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.898+0000 7fe6b2600640 1 --2- 172.21.15.37:0/437554201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ac105d80 0x7fe6ac19c730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.898+0000 7fe6b2600640 1 -- 172.21.15.37:0/437554201 >> 172.21.15.37:0/437554201 conn(0x7fe6ac101810 msgr2=0x7fe6ac10acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.899+0000 7fe6b2600640 1 -- 172.21.15.37:0/437554201 shutdown_connections 2024-09-21T05:52:06.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:06.899+0000 7fe6b2600640 1 -- 172.21.15.37:0/437554201 wait complete. 2024-09-21T05:52:07.801 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:07 smithi037 ceph-mon[30631]: pgmap v358: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-09-21T05:52:07.801 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:07 smithi037 ceph-mon[30631]: from='client.24941 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:07.803 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-09-21T05:52:06.240202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655264,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":127,"num_read_kb":150,"num_write":209,"num_write_kb":2244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383808,"kb_used_data":13748,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558016,"statfs":{"total":1151940427776,"available":1151547408384,"internally_reserved":0,"allocated":14077952,"data_stored":7968671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":60256,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":71,"num_write":37,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003628"},"pg_stats":[{"pgid":"2.1f","version":"79'4","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369749+0000","last_change":"2024-09-21T05:50:50.846365+0000","last_active":"2024-09-21T05:51:47.369749+0000","last_peered":"2024-09-21T05:51:47.369749+0000","last_clean":"2024-09-21T05:51:47.369749+0000","last_became_active":"2024-09-21T05:50:50.845924+0000","last_became_peered":"2024-09-21T05:50:50.845924+0000","last_unstale":"2024-09-21T05:51:47.369749+0000","last_undegraded":"2024-09-21T05:51:47.369749+0000","last_fullsized":"2024-09-21T05:51:47.369749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:39.056271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.378759+0000","last_change":"2024-09-21T05:51:47.377003+0000","last_active":"2024-09-21T05:51:47.378759+0000","last_peered":"2024-09-21T05:51:47.378759+0000","last_clean":"2024-09-21T05:51:47.378759+0000","last_became_active":"2024-09-21T05:51:47.376624+0000","last_became_peered":"2024-09-21T05:51:47.376624+0000","last_unstale":"2024-09-21T05:51:47.378759+0000","last_undegraded":"2024-09-21T05:51:47.378759+0000","last_fullsized":"2024-09-21T05:51:47.378759+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:20.569002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366645+0000","last_change":"2024-09-21T05:51:03.940107+0000","last_active":"2024-09-21T05:51:47.366645+0000","last_peered":"2024-09-21T05:51:47.366645+0000","last_clean":"2024-09-21T05:51:47.366645+0000","last_became_active":"2024-09-21T05:51:03.939723+0000","last_became_peered":"2024-09-21T05:51:03.939723+0000","last_unstale":"2024-09-21T05:51:47.366645+0000","last_undegraded":"2024-09-21T05:51:47.366645+0000","last_fullsized":"2024-09-21T05:51:47.366645+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:15.116461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366129+0000","last_change":"2024-09-21T05:50:51.162120+0000","last_active":"2024-09-21T05:51:47.366129+0000","last_peered":"2024-09-21T05:51:47.366129+0000","last_clean":"2024-09-21T05:51:47.366129+0000","last_became_active":"2024-09-21T05:50:51.161679+0000","last_became_peered":"2024-09-21T05:50:51.161679+0000","last_unstale":"2024-09-21T05:51:47.366129+0000","last_undegraded":"2024-09-21T05:51:47.366129+0000","last_fullsized":"2024-09-21T05:51:47.366129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:10.028536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.376261+0000","last_change":"2024-09-21T05:50:53.907800+0000","last_active":"2024-09-21T05:51:47.376261+0000","last_peered":"2024-09-21T05:51:47.376261+0000","last_clean":"2024-09-21T05:51:47.376261+0000","last_became_active":"2024-09-21T05:50:53.906695+0000","last_became_peered":"2024-09-21T05:50:53.906695+0000","last_unstale":"2024-09-21T05:51:47.376261+0000","last_undegraded":"2024-09-21T05:51:47.376261+0000","last_fullsized":"2024-09-21T05:51:47.376261+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:45.999010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586839+0000","last_change":"2024-09-21T05:51:03.947020+0000","last_active":"2024-09-21T05:51:47.586839+0000","last_peered":"2024-09-21T05:51:47.586839+0000","last_clean":"2024-09-21T05:51:47.586839+0000","last_became_active":"2024-09-21T05:51:03.946387+0000","last_became_peered":"2024-09-21T05:51:03.946387+0000","last_unstale":"2024-09-21T05:51:47.586839+0000","last_undegraded":"2024-09-21T05:51:47.586839+0000","last_fullsized":"2024-09-21T05:51:47.586839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:02.073199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371068+0000","last_change":"2024-09-21T05:50:50.850606+0000","last_active":"2024-09-21T05:51:47.371068+0000","last_peered":"2024-09-21T05:51:47.371068+0000","last_clean":"2024-09-21T05:51:47.371068+0000","last_became_active":"2024-09-21T05:50:50.850244+0000","last_became_peered":"2024-09-21T05:50:50.850244+0000","last_unstale":"2024-09-21T05:51:47.371068+0000","last_undegraded":"2024-09-21T05:51:47.371068+0000","last_fullsized":"2024-09-21T05:51:47.371068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:39.437099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373406+0000","last_change":"2024-09-21T05:50:53.897805+0000","last_active":"2024-09-21T05:51:47.373406+0000","last_peered":"2024-09-21T05:51:47.373406+0000","last_clean":"2024-09-21T05:51:47.373406+0000","last_became_active":"2024-09-21T05:50:53.896977+0000","last_became_peered":"2024-09-21T05:50:53.896977+0000","last_unstale":"2024-09-21T05:51:47.373406+0000","last_undegraded":"2024-09-21T05:51:47.373406+0000","last_fullsized":"2024-09-21T05:51:47.373406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:35.538322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.587757+0000","last_change":"2024-09-21T05:51:03.939519+0000","last_active":"2024-09-21T05:51:47.587757+0000","last_peered":"2024-09-21T05:51:47.587757+0000","last_clean":"2024-09-21T05:51:47.587757+0000","last_became_active":"2024-09-21T05:51:03.938429+0000","last_became_peered":"2024-09-21T05:51:03.938429+0000","last_unstale":"2024-09-21T05:51:47.587757+0000","last_undegraded":"2024-09-21T05:51:47.587757+0000","last_fullsized":"2024-09-21T05:51:47.587757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:09.236561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369602+0000","last_change":"2024-09-21T05:50:50.847640+0000","last_active":"2024-09-21T05:51:47.369602+0000","last_peered":"2024-09-21T05:51:47.369602+0000","last_clean":"2024-09-21T05:51:47.369602+0000","last_became_active":"2024-09-21T05:50:50.847101+0000","last_became_peered":"2024-09-21T05:50:50.847101+0000","last_unstale":"2024-09-21T05:51:47.369602+0000","last_undegraded":"2024-09-21T05:51:47.369602+0000","last_fullsized":"2024-09-21T05:51:47.369602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:09.087655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374139+0000","last_change":"2024-09-21T05:50:53.889855+0000","last_active":"2024-09-21T05:51:47.374139+0000","last_peered":"2024-09-21T05:51:47.374139+0000","last_clean":"2024-09-21T05:51:47.374139+0000","last_became_active":"2024-09-21T05:50:53.889444+0000","last_became_peered":"2024-09-21T05:50:53.889444+0000","last_unstale":"2024-09-21T05:51:47.374139+0000","last_undegraded":"2024-09-21T05:51:47.374139+0000","last_fullsized":"2024-09-21T05:51:47.374139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:47.480986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.587436+0000","last_change":"2024-09-21T05:51:03.946866+0000","last_active":"2024-09-21T05:51:47.587436+0000","last_peered":"2024-09-21T05:51:47.587436+0000","last_clean":"2024-09-21T05:51:47.587436+0000","last_became_active":"2024-09-21T05:51:03.946332+0000","last_became_peered":"2024-09-21T05:51:03.946332+0000","last_unstale":"2024-09-21T05:51:47.587436+0000","last_undegraded":"2024-09-21T05:51:47.587436+0000","last_fullsized":"2024-09-21T05:51:47.587436+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:43.527937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.587207+0000","last_change":"2024-09-21T05:50:53.900395+0000","last_active":"2024-09-21T05:51:47.587207+0000","last_peered":"2024-09-21T05:51:47.587207+0000","last_clean":"2024-09-21T05:51:47.587207+0000","last_became_active":"2024-09-21T05:50:53.894925+0000","last_became_peered":"2024-09-21T05:50:53.894925+0000","last_unstale":"2024-09-21T05:51:47.587207+0000","last_undegraded":"2024-09-21T05:51:47.587207+0000","last_fullsized":"2024-09-21T05:51:47.587207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.939120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369874+0000","last_change":"2024-09-21T05:50:50.851145+0000","last_active":"2024-09-21T05:51:47.369874+0000","last_peered":"2024-09-21T05:51:47.369874+0000","last_clean":"2024-09-21T05:51:47.369874+0000","last_became_active":"2024-09-21T05:50:50.850641+0000","last_became_peered":"2024-09-21T05:50:50.850641+0000","last_unstale":"2024-09-21T05:51:47.369874+0000","last_undegraded":"2024-09-21T05:51:47.369874+0000","last_fullsized":"2024-09-21T05:51:47.369874+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:34.560798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588783+0000","last_change":"2024-09-21T05:51:03.991798+0000","last_active":"2024-09-21T05:51:47.588783+0000","last_peered":"2024-09-21T05:51:47.588783+0000","last_clean":"2024-09-21T05:51:47.588783+0000","last_became_active":"2024-09-21T05:51:03.991173+0000","last_became_peered":"2024-09-21T05:51:03.991173+0000","last_unstale":"2024-09-21T05:51:47.588783+0000","last_undegraded":"2024-09-21T05:51:47.588783+0000","last_fullsized":"2024-09-21T05:51:47.588783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:46.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365996+0000","last_change":"2024-09-21T05:50:53.892293+0000","last_active":"2024-09-21T05:51:47.365996+0000","last_peered":"2024-09-21T05:51:47.365996+0000","last_clean":"2024-09-21T05:51:47.365996+0000","last_became_active":"2024-09-21T05:50:53.891814+0000","last_became_peered":"2024-09-21T05:50:53.891814+0000","last_unstale":"2024-09-21T05:51:47.365996+0000","last_undegraded":"2024-09-21T05:51:47.365996+0000","last_fullsized":"2024-09-21T05:51:47.365996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:14.810409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366736+0000","last_change":"2024-09-21T05:50:50.846360+0000","last_active":"2024-09-21T05:51:47.366736+0000","last_peered":"2024-09-21T05:51:47.366736+0000","last_clean":"2024-09-21T05:51:47.366736+0000","last_became_active":"2024-09-21T05:50:50.845972+0000","last_became_peered":"2024-09-21T05:50:50.845972+0000","last_unstale":"2024-09-21T05:51:47.366736+0000","last_undegraded":"2024-09-21T05:51:47.366736+0000","last_fullsized":"2024-09-21T05:51:47.366736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.023239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588086+0000","last_change":"2024-09-21T05:51:03.938903+0000","last_active":"2024-09-21T05:51:47.588086+0000","last_peered":"2024-09-21T05:51:47.588086+0000","last_clean":"2024-09-21T05:51:47.588086+0000","last_became_active":"2024-09-21T05:51:03.938312+0000","last_became_peered":"2024-09-21T05:51:03.938312+0000","last_unstale":"2024-09-21T05:51:47.588086+0000","last_undegraded":"2024-09-21T05:51:47.588086+0000","last_fullsized":"2024-09-21T05:51:47.588086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:01.851758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371265+0000","last_change":"2024-09-21T05:50:53.907529+0000","last_active":"2024-09-21T05:51:47.371265+0000","last_peered":"2024-09-21T05:51:47.371265+0000","last_clean":"2024-09-21T05:51:47.371265+0000","last_became_active":"2024-09-21T05:50:53.907154+0000","last_became_peered":"2024-09-21T05:50:53.907154+0000","last_unstale":"2024-09-21T05:51:47.371265+0000","last_undegraded":"2024-09-21T05:51:47.371265+0000","last_fullsized":"2024-09-21T05:51:47.371265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:22.586642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365856+0000","last_change":"2024-09-21T05:50:50.838939+0000","last_active":"2024-09-21T05:51:47.365856+0000","last_peered":"2024-09-21T05:51:47.365856+0000","last_clean":"2024-09-21T05:51:47.365856+0000","last_became_active":"2024-09-21T05:50:50.838457+0000","last_became_peered":"2024-09-21T05:50:50.838457+0000","last_unstale":"2024-09-21T05:51:47.365856+0000","last_undegraded":"2024-09-21T05:51:47.365856+0000","last_fullsized":"2024-09-21T05:51:47.365856+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:54.259046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369307+0000","last_change":"2024-09-21T05:51:03.944824+0000","last_active":"2024-09-21T05:51:47.369307+0000","last_peered":"2024-09-21T05:51:47.369307+0000","last_clean":"2024-09-21T05:51:47.369307+0000","last_became_active":"2024-09-21T05:51:03.938856+0000","last_became_peered":"2024-09-21T05:51:03.938856+0000","last_unstale":"2024-09-21T05:51:47.369307+0000","last_undegraded":"2024-09-21T05:51:47.369307+0000","last_fullsized":"2024-09-21T05:51:47.369307+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:12.111775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369662+0000","last_change":"2024-09-21T05:50:53.891676+0000","last_active":"2024-09-21T05:51:47.369662+0000","last_peered":"2024-09-21T05:51:47.369662+0000","last_clean":"2024-09-21T05:51:47.369662+0000","last_became_active":"2024-09-21T05:50:53.891339+0000","last_became_peered":"2024-09-21T05:50:53.891339+0000","last_unstale":"2024-09-21T05:51:47.369662+0000","last_undegraded":"2024-09-21T05:51:47.369662+0000","last_fullsized":"2024-09-21T05:51:47.369662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:41.707680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373779+0000","last_change":"2024-09-21T05:50:51.162492+0000","last_active":"2024-09-21T05:51:47.373779+0000","last_peered":"2024-09-21T05:51:47.373779+0000","last_clean":"2024-09-21T05:51:47.373779+0000","last_became_active":"2024-09-21T05:50:51.162108+0000","last_became_peered":"2024-09-21T05:50:51.162108+0000","last_unstale":"2024-09-21T05:51:47.373779+0000","last_undegraded":"2024-09-21T05:51:47.373779+0000","last_fullsized":"2024-09-21T05:51:47.373779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.387568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588801+0000","last_change":"2024-09-21T05:51:03.992550+0000","last_active":"2024-09-21T05:51:47.588801+0000","last_peered":"2024-09-21T05:51:47.588801+0000","last_clean":"2024-09-21T05:51:47.588801+0000","last_became_active":"2024-09-21T05:51:03.991865+0000","last_became_peered":"2024-09-21T05:51:03.991865+0000","last_unstale":"2024-09-21T05:51:47.588801+0000","last_undegraded":"2024-09-21T05:51:47.588801+0000","last_fullsized":"2024-09-21T05:51:47.588801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:50.204058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375601+0000","last_change":"2024-09-21T05:50:53.884376+0000","last_active":"2024-09-21T05:51:47.375601+0000","last_peered":"2024-09-21T05:51:47.375601+0000","last_clean":"2024-09-21T05:51:47.375601+0000","last_became_active":"2024-09-21T05:50:53.884033+0000","last_became_peered":"2024-09-21T05:50:53.884033+0000","last_unstale":"2024-09-21T05:51:47.375601+0000","last_undegraded":"2024-09-21T05:51:47.375601+0000","last_fullsized":"2024-09-21T05:51:47.375601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.359191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.589120+0000","last_change":"2024-09-21T05:50:50.869502+0000","last_active":"2024-09-21T05:51:47.589120+0000","last_peered":"2024-09-21T05:51:47.589120+0000","last_clean":"2024-09-21T05:51:47.589120+0000","last_became_active":"2024-09-21T05:50:50.869071+0000","last_became_peered":"2024-09-21T05:50:50.869071+0000","last_unstale":"2024-09-21T05:51:47.589120+0000","last_undegraded":"2024-09-21T05:51:47.589120+0000","last_fullsized":"2024-09-21T05:51:47.589120+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:48.364902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.367179+0000","last_change":"2024-09-21T05:51:03.931945+0000","last_active":"2024-09-21T05:51:47.367179+0000","last_peered":"2024-09-21T05:51:47.367179+0000","last_clean":"2024-09-21T05:51:47.367179+0000","last_became_active":"2024-09-21T05:51:03.931411+0000","last_became_peered":"2024-09-21T05:51:03.931411+0000","last_unstale":"2024-09-21T05:51:47.367179+0000","last_undegraded":"2024-09-21T05:51:47.367179+0000","last_fullsized":"2024-09-21T05:51:47.367179+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.910547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366483+0000","last_change":"2024-09-21T05:50:53.897995+0000","last_active":"2024-09-21T05:51:47.366483+0000","last_peered":"2024-09-21T05:51:47.366483+0000","last_clean":"2024-09-21T05:51:47.366483+0000","last_became_active":"2024-09-21T05:50:53.895797+0000","last_became_peered":"2024-09-21T05:50:53.895797+0000","last_unstale":"2024-09-21T05:51:47.366483+0000","last_undegraded":"2024-09-21T05:51:47.366483+0000","last_fullsized":"2024-09-21T05:51:47.366483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.484867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'8","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:52:02.908849+0000","last_change":"2024-09-21T05:50:50.845853+0000","last_active":"2024-09-21T05:52:02.908849+0000","last_peered":"2024-09-21T05:52:02.908849+0000","last_clean":"2024-09-21T05:52:02.908849+0000","last_became_active":"2024-09-21T05:50:50.845495+0000","last_became_peered":"2024-09-21T05:50:50.845495+0000","last_unstale":"2024-09-21T05:52:02.908849+0000","last_undegraded":"2024-09-21T05:52:02.908849+0000","last_fullsized":"2024-09-21T05:52:02.908849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:47.960498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365413+0000","last_change":"2024-09-21T05:51:03.991380+0000","last_active":"2024-09-21T05:51:47.365413+0000","last_peered":"2024-09-21T05:51:47.365413+0000","last_clean":"2024-09-21T05:51:47.365413+0000","last_became_active":"2024-09-21T05:51:03.990911+0000","last_became_peered":"2024-09-21T05:51:03.990911+0000","last_unstale":"2024-09-21T05:51:47.365413+0000","last_undegraded":"2024-09-21T05:51:47.365413+0000","last_fullsized":"2024-09-21T05:51:47.365413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:01.779692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372777+0000","last_change":"2024-09-21T05:50:53.910190+0000","last_active":"2024-09-21T05:51:47.372777+0000","last_peered":"2024-09-21T05:51:47.372777+0000","last_clean":"2024-09-21T05:51:47.372777+0000","last_became_active":"2024-09-21T05:50:53.909649+0000","last_became_peered":"2024-09-21T05:50:53.909649+0000","last_unstale":"2024-09-21T05:51:47.372777+0000","last_undegraded":"2024-09-21T05:51:47.372777+0000","last_fullsized":"2024-09-21T05:51:47.372777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:14.582217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.370932+0000","last_change":"2024-09-21T05:50:51.163512+0000","last_active":"2024-09-21T05:51:47.370932+0000","last_peered":"2024-09-21T05:51:47.370932+0000","last_clean":"2024-09-21T05:51:47.370932+0000","last_became_active":"2024-09-21T05:50:51.161959+0000","last_became_peered":"2024-09-21T05:50:51.161959+0000","last_unstale":"2024-09-21T05:51:47.370932+0000","last_undegraded":"2024-09-21T05:51:47.370932+0000","last_fullsized":"2024-09-21T05:51:47.370932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:51.701990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371419+0000","last_change":"2024-09-21T05:51:03.936815+0000","last_active":"2024-09-21T05:51:47.371419+0000","last_peered":"2024-09-21T05:51:47.371419+0000","last_clean":"2024-09-21T05:51:47.371419+0000","last_became_active":"2024-09-21T05:51:03.936365+0000","last_became_peered":"2024-09-21T05:51:03.936365+0000","last_unstale":"2024-09-21T05:51:47.371419+0000","last_undegraded":"2024-09-21T05:51:47.371419+0000","last_fullsized":"2024-09-21T05:51:47.371419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:59.820159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366723+0000","last_change":"2024-09-21T05:50:53.892772+0000","last_active":"2024-09-21T05:51:47.366723+0000","last_peered":"2024-09-21T05:51:47.366723+0000","last_clean":"2024-09-21T05:51:47.366723+0000","last_became_active":"2024-09-21T05:50:53.892378+0000","last_became_peered":"2024-09-21T05:50:53.892378+0000","last_unstale":"2024-09-21T05:51:47.366723+0000","last_undegraded":"2024-09-21T05:51:47.366723+0000","last_fullsized":"2024-09-21T05:51:47.366723+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:34.438067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.378249+0000","last_change":"2024-09-21T05:51:47.378160+0000","last_active":"2024-09-21T05:51:47.378249+0000","last_peered":"2024-09-21T05:51:47.378249+0000","last_clean":"2024-09-21T05:51:47.378249+0000","last_became_active":"2024-09-21T05:51:47.377779+0000","last_became_peered":"2024-09-21T05:51:47.377779+0000","last_unstale":"2024-09-21T05:51:47.378249+0000","last_undegraded":"2024-09-21T05:51:47.378249+0000","last_fullsized":"2024-09-21T05:51:47.378249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:27.780273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369167+0000","last_change":"2024-09-21T05:51:03.990917+0000","last_active":"2024-09-21T05:51:47.369167+0000","last_peered":"2024-09-21T05:51:47.369167+0000","last_clean":"2024-09-21T05:51:47.369167+0000","last_became_active":"2024-09-21T05:51:03.990358+0000","last_became_peered":"2024-09-21T05:51:03.990358+0000","last_unstale":"2024-09-21T05:51:47.369167+0000","last_undegraded":"2024-09-21T05:51:47.369167+0000","last_fullsized":"2024-09-21T05:51:47.369167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:34.477923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366753+0000","last_change":"2024-09-21T05:50:53.899306+0000","last_active":"2024-09-21T05:51:47.366753+0000","last_peered":"2024-09-21T05:51:47.366753+0000","last_clean":"2024-09-21T05:51:47.366753+0000","last_became_active":"2024-09-21T05:50:53.898921+0000","last_became_peered":"2024-09-21T05:50:53.898921+0000","last_unstale":"2024-09-21T05:51:47.366753+0000","last_undegraded":"2024-09-21T05:51:47.366753+0000","last_fullsized":"2024-09-21T05:51:47.366753+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:45.698584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.587317+0000","last_change":"2024-09-21T05:50:50.844394+0000","last_active":"2024-09-21T05:51:47.587317+0000","last_peered":"2024-09-21T05:51:47.587317+0000","last_clean":"2024-09-21T05:51:47.587317+0000","last_became_active":"2024-09-21T05:50:50.843771+0000","last_became_peered":"2024-09-21T05:50:50.843771+0000","last_unstale":"2024-09-21T05:51:47.587317+0000","last_undegraded":"2024-09-21T05:51:47.587317+0000","last_fullsized":"2024-09-21T05:51:47.587317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:14.372917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372541+0000","last_change":"2024-09-21T05:51:03.941277+0000","last_active":"2024-09-21T05:51:47.372541+0000","last_peered":"2024-09-21T05:51:47.372541+0000","last_clean":"2024-09-21T05:51:47.372541+0000","last_became_active":"2024-09-21T05:51:03.940659+0000","last_became_peered":"2024-09-21T05:51:03.940659+0000","last_unstale":"2024-09-21T05:51:47.372541+0000","last_undegraded":"2024-09-21T05:51:47.372541+0000","last_fullsized":"2024-09-21T05:51:47.372541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:40.217023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374308+0000","last_change":"2024-09-21T05:50:53.895399+0000","last_active":"2024-09-21T05:51:47.374308+0000","last_peered":"2024-09-21T05:51:47.374308+0000","last_clean":"2024-09-21T05:51:47.374308+0000","last_became_active":"2024-09-21T05:50:53.895022+0000","last_became_peered":"2024-09-21T05:50:53.895022+0000","last_unstale":"2024-09-21T05:51:47.374308+0000","last_undegraded":"2024-09-21T05:51:47.374308+0000","last_fullsized":"2024-09-21T05:51:47.374308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:02.056015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372089+0000","last_change":"2024-09-21T05:50:51.162215+0000","last_active":"2024-09-21T05:51:47.372089+0000","last_peered":"2024-09-21T05:51:47.372089+0000","last_clean":"2024-09-21T05:51:47.372089+0000","last_became_active":"2024-09-21T05:50:51.161812+0000","last_became_peered":"2024-09-21T05:50:51.161812+0000","last_unstale":"2024-09-21T05:51:47.372089+0000","last_undegraded":"2024-09-21T05:51:47.372089+0000","last_fullsized":"2024-09-21T05:51:47.372089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:05.237806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373023+0000","last_change":"2024-09-21T05:51:03.991488+0000","last_active":"2024-09-21T05:51:47.373023+0000","last_peered":"2024-09-21T05:51:47.373023+0000","last_clean":"2024-09-21T05:51:47.373023+0000","last_became_active":"2024-09-21T05:51:03.990866+0000","last_became_peered":"2024-09-21T05:51:03.990866+0000","last_unstale":"2024-09-21T05:51:47.373023+0000","last_undegraded":"2024-09-21T05:51:47.373023+0000","last_fullsized":"2024-09-21T05:51:47.373023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:41.061421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371826+0000","last_change":"2024-09-21T05:50:53.895076+0000","last_active":"2024-09-21T05:51:47.371826+0000","last_peered":"2024-09-21T05:51:47.371826+0000","last_clean":"2024-09-21T05:51:47.371826+0000","last_became_active":"2024-09-21T05:50:53.893888+0000","last_became_peered":"2024-09-21T05:50:53.893888+0000","last_unstale":"2024-09-21T05:51:47.371826+0000","last_undegraded":"2024-09-21T05:51:47.371826+0000","last_fullsized":"2024-09-21T05:51:47.371826+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:13.397806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.376650+0000","last_change":"2024-09-21T05:51:47.376540+0000","last_active":"2024-09-21T05:51:47.376650+0000","last_peered":"2024-09-21T05:51:47.376650+0000","last_clean":"2024-09-21T05:51:47.376650+0000","last_became_active":"2024-09-21T05:51:47.376163+0000","last_became_peered":"2024-09-21T05:51:47.376163+0000","last_unstale":"2024-09-21T05:51:47.376650+0000","last_undegraded":"2024-09-21T05:51:47.376650+0000","last_fullsized":"2024-09-21T05:51:47.376650+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:51.217674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374929+0000","last_change":"2024-09-21T05:51:03.991711+0000","last_active":"2024-09-21T05:51:47.374929+0000","last_peered":"2024-09-21T05:51:47.374929+0000","last_clean":"2024-09-21T05:51:47.374929+0000","last_became_active":"2024-09-21T05:51:03.991200+0000","last_became_peered":"2024-09-21T05:51:03.991200+0000","last_unstale":"2024-09-21T05:51:47.374929+0000","last_undegraded":"2024-09-21T05:51:47.374929+0000","last_fullsized":"2024-09-21T05:51:47.374929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:40.981303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365707+0000","last_change":"2024-09-21T05:50:53.887913+0000","last_active":"2024-09-21T05:51:47.365707+0000","last_peered":"2024-09-21T05:51:47.365707+0000","last_clean":"2024-09-21T05:51:47.365707+0000","last_became_active":"2024-09-21T05:50:53.887583+0000","last_became_peered":"2024-09-21T05:50:53.887583+0000","last_unstale":"2024-09-21T05:51:47.365707+0000","last_undegraded":"2024-09-21T05:51:47.365707+0000","last_fullsized":"2024-09-21T05:51:47.365707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:05.941780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588026+0000","last_change":"2024-09-21T05:50:50.846370+0000","last_active":"2024-09-21T05:51:47.588026+0000","last_peered":"2024-09-21T05:51:47.588026+0000","last_clean":"2024-09-21T05:51:47.588026+0000","last_became_active":"2024-09-21T05:50:50.845890+0000","last_became_peered":"2024-09-21T05:50:50.845890+0000","last_unstale":"2024-09-21T05:51:47.588026+0000","last_undegraded":"2024-09-21T05:51:47.588026+0000","last_fullsized":"2024-09-21T05:51:47.588026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:15.180734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":113,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586489+0000","last_change":"2024-09-21T05:49:33.762460+0000","last_active":"2024-09-21T05:51:47.586489+0000","last_peered":"2024-09-21T05:51:47.586489+0000","last_clean":"2024-09-21T05:51:47.586489+0000","last_became_active":"2024-09-21T05:49:33.705194+0000","last_became_peered":"2024-09-21T05:49:33.705194+0000","last_unstale":"2024-09-21T05:51:47.586489+0000","last_undegraded":"2024-09-21T05:51:47.586489+0000","last_fullsized":"2024-09-21T05:51:47.586489+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_clean_scrub_stamp":"2024-09-21T05:45:49.237325+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:39.194122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586837+0000","last_change":"2024-09-21T05:51:03.938790+0000","last_active":"2024-09-21T05:51:47.586837+0000","last_peered":"2024-09-21T05:51:47.586837+0000","last_clean":"2024-09-21T05:51:47.586837+0000","last_became_active":"2024-09-21T05:51:03.938214+0000","last_became_peered":"2024-09-21T05:51:03.938214+0000","last_unstale":"2024-09-21T05:51:47.586837+0000","last_undegraded":"2024-09-21T05:51:47.586837+0000","last_fullsized":"2024-09-21T05:51:47.586837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:11.512500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586886+0000","last_change":"2024-09-21T05:50:53.893475+0000","last_active":"2024-09-21T05:51:47.586886+0000","last_peered":"2024-09-21T05:51:47.586886+0000","last_clean":"2024-09-21T05:51:47.586886+0000","last_became_active":"2024-09-21T05:50:53.892946+0000","last_became_peered":"2024-09-21T05:50:53.892946+0000","last_unstale":"2024-09-21T05:51:47.586886+0000","last_undegraded":"2024-09-21T05:51:47.586886+0000","last_fullsized":"2024-09-21T05:51:47.586886+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:23.612285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.367338+0000","last_change":"2024-09-21T05:50:51.162170+0000","last_active":"2024-09-21T05:51:47.367338+0000","last_peered":"2024-09-21T05:51:47.367338+0000","last_clean":"2024-09-21T05:51:47.367338+0000","last_became_active":"2024-09-21T05:50:51.161685+0000","last_became_peered":"2024-09-21T05:50:51.161685+0000","last_unstale":"2024-09-21T05:51:47.367338+0000","last_undegraded":"2024-09-21T05:51:47.367338+0000","last_fullsized":"2024-09-21T05:51:47.367338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:14.922423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373166+0000","last_change":"2024-09-21T05:51:03.937061+0000","last_active":"2024-09-21T05:51:47.373166+0000","last_peered":"2024-09-21T05:51:47.373166+0000","last_clean":"2024-09-21T05:51:47.373166+0000","last_became_active":"2024-09-21T05:51:03.936306+0000","last_became_peered":"2024-09-21T05:51:03.936306+0000","last_unstale":"2024-09-21T05:51:47.373166+0000","last_undegraded":"2024-09-21T05:51:47.373166+0000","last_fullsized":"2024-09-21T05:51:47.373166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:51.057973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586666+0000","last_change":"2024-09-21T05:50:53.893930+0000","last_active":"2024-09-21T05:51:47.586666+0000","last_peered":"2024-09-21T05:51:47.586666+0000","last_clean":"2024-09-21T05:51:47.586666+0000","last_became_active":"2024-09-21T05:50:53.893155+0000","last_became_peered":"2024-09-21T05:50:53.893155+0000","last_unstale":"2024-09-21T05:51:47.586666+0000","last_undegraded":"2024-09-21T05:51:47.586666+0000","last_fullsized":"2024-09-21T05:51:47.586666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:46.097408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375436+0000","last_change":"2024-09-21T05:50:50.847890+0000","last_active":"2024-09-21T05:51:47.375436+0000","last_peered":"2024-09-21T05:51:47.375436+0000","last_clean":"2024-09-21T05:51:47.375436+0000","last_became_active":"2024-09-21T05:50:50.847549+0000","last_became_peered":"2024-09-21T05:50:50.847549+0000","last_unstale":"2024-09-21T05:51:47.375436+0000","last_undegraded":"2024-09-21T05:51:47.375436+0000","last_fullsized":"2024-09-21T05:51:47.375436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:14.998849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375137+0000","last_change":"2024-09-21T05:51:03.940674+0000","last_active":"2024-09-21T05:51:47.375137+0000","last_peered":"2024-09-21T05:51:47.375137+0000","last_clean":"2024-09-21T05:51:47.375137+0000","last_became_active":"2024-09-21T05:51:03.940222+0000","last_became_peered":"2024-09-21T05:51:03.940222+0000","last_unstale":"2024-09-21T05:51:47.375137+0000","last_undegraded":"2024-09-21T05:51:47.375137+0000","last_fullsized":"2024-09-21T05:51:47.375137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:58.497147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586887+0000","last_change":"2024-09-21T05:50:53.895191+0000","last_active":"2024-09-21T05:51:47.586887+0000","last_peered":"2024-09-21T05:51:47.586887+0000","last_clean":"2024-09-21T05:51:47.586887+0000","last_became_active":"2024-09-21T05:50:53.892894+0000","last_became_peered":"2024-09-21T05:50:53.892894+0000","last_unstale":"2024-09-21T05:51:47.586887+0000","last_undegraded":"2024-09-21T05:51:47.586887+0000","last_fullsized":"2024-09-21T05:51:47.586887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:41.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372859+0000","last_change":"2024-09-21T05:50:50.844301+0000","last_active":"2024-09-21T05:51:47.372859+0000","last_peered":"2024-09-21T05:51:47.372859+0000","last_clean":"2024-09-21T05:51:47.372859+0000","last_became_active":"2024-09-21T05:50:50.843878+0000","last_became_peered":"2024-09-21T05:50:50.843878+0000","last_unstale":"2024-09-21T05:51:47.372859+0000","last_undegraded":"2024-09-21T05:51:47.372859+0000","last_fullsized":"2024-09-21T05:51:47.372859+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:53.150300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373824+0000","last_change":"2024-09-21T05:51:03.931684+0000","last_active":"2024-09-21T05:51:47.373824+0000","last_peered":"2024-09-21T05:51:47.373824+0000","last_clean":"2024-09-21T05:51:47.373824+0000","last_became_active":"2024-09-21T05:51:03.931225+0000","last_became_peered":"2024-09-21T05:51:03.931225+0000","last_unstale":"2024-09-21T05:51:47.373824+0000","last_undegraded":"2024-09-21T05:51:47.373824+0000","last_fullsized":"2024-09-21T05:51:47.373824+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:51.993481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372066+0000","last_change":"2024-09-21T05:50:53.892740+0000","last_active":"2024-09-21T05:51:47.372066+0000","last_peered":"2024-09-21T05:51:47.372066+0000","last_clean":"2024-09-21T05:51:47.372066+0000","last_became_active":"2024-09-21T05:50:53.892381+0000","last_became_peered":"2024-09-21T05:50:53.892381+0000","last_unstale":"2024-09-21T05:51:47.372066+0000","last_undegraded":"2024-09-21T05:51:47.372066+0000","last_fullsized":"2024-09-21T05:51:47.372066+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:20.038644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.370292+0000","last_change":"2024-09-21T05:50:50.850077+0000","last_active":"2024-09-21T05:51:47.370292+0000","last_peered":"2024-09-21T05:51:47.370292+0000","last_clean":"2024-09-21T05:51:47.370292+0000","last_became_active":"2024-09-21T05:50:50.849553+0000","last_became_peered":"2024-09-21T05:50:50.849553+0000","last_unstale":"2024-09-21T05:51:47.370292+0000","last_undegraded":"2024-09-21T05:51:47.370292+0000","last_fullsized":"2024-09-21T05:51:47.370292+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:09.764465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373855+0000","last_change":"2024-09-21T05:51:03.930231+0000","last_active":"2024-09-21T05:51:47.373855+0000","last_peered":"2024-09-21T05:51:47.373855+0000","last_clean":"2024-09-21T05:51:47.373855+0000","last_became_active":"2024-09-21T05:51:03.929907+0000","last_became_peered":"2024-09-21T05:51:03.929907+0000","last_unstale":"2024-09-21T05:51:47.373855+0000","last_undegraded":"2024-09-21T05:51:47.373855+0000","last_fullsized":"2024-09-21T05:51:47.373855+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:18.829725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375259+0000","last_change":"2024-09-21T05:50:53.888988+0000","last_active":"2024-09-21T05:51:47.375259+0000","last_peered":"2024-09-21T05:51:47.375259+0000","last_clean":"2024-09-21T05:51:47.375259+0000","last_became_active":"2024-09-21T05:50:53.888599+0000","last_became_peered":"2024-09-21T05:50:53.888599+0000","last_unstale":"2024-09-21T05:51:47.375259+0000","last_undegraded":"2024-09-21T05:51:47.375259+0000","last_fullsized":"2024-09-21T05:51:47.375259+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:32.353201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.383596+0000","last_change":"2024-09-21T05:51:47.383528+0000","last_active":"2024-09-21T05:51:47.383596+0000","last_peered":"2024-09-21T05:51:47.383596+0000","last_clean":"2024-09-21T05:51:47.383596+0000","last_became_active":"2024-09-21T05:51:47.376325+0000","last_became_peered":"2024-09-21T05:51:47.376325+0000","last_unstale":"2024-09-21T05:51:47.383596+0000","last_undegraded":"2024-09-21T05:51:47.383596+0000","last_fullsized":"2024-09-21T05:51:47.383596+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:47.659961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372841+0000","last_change":"2024-09-21T05:51:03.946581+0000","last_active":"2024-09-21T05:51:47.372841+0000","last_peered":"2024-09-21T05:51:47.372841+0000","last_clean":"2024-09-21T05:51:47.372841+0000","last_became_active":"2024-09-21T05:51:03.946170+0000","last_became_peered":"2024-09-21T05:51:03.946170+0000","last_unstale":"2024-09-21T05:51:47.372841+0000","last_undegraded":"2024-09-21T05:51:47.372841+0000","last_fullsized":"2024-09-21T05:51:47.372841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:59.302647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586192+0000","last_change":"2024-09-21T05:50:53.890164+0000","last_active":"2024-09-21T05:51:47.586192+0000","last_peered":"2024-09-21T05:51:47.586192+0000","last_clean":"2024-09-21T05:51:47.586192+0000","last_became_active":"2024-09-21T05:50:53.889309+0000","last_became_peered":"2024-09-21T05:50:53.889309+0000","last_unstale":"2024-09-21T05:51:47.586192+0000","last_undegraded":"2024-09-21T05:51:47.586192+0000","last_fullsized":"2024-09-21T05:51:47.586192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:18.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.587893+0000","last_change":"2024-09-21T05:50:50.844080+0000","last_active":"2024-09-21T05:51:47.587893+0000","last_peered":"2024-09-21T05:51:47.587893+0000","last_clean":"2024-09-21T05:51:47.587893+0000","last_became_active":"2024-09-21T05:50:50.842929+0000","last_became_peered":"2024-09-21T05:50:50.842929+0000","last_unstale":"2024-09-21T05:51:47.587893+0000","last_undegraded":"2024-09-21T05:51:47.587893+0000","last_fullsized":"2024-09-21T05:51:47.587893+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:49.623189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369421+0000","last_change":"2024-09-21T05:51:03.939228+0000","last_active":"2024-09-21T05:51:47.369421+0000","last_peered":"2024-09-21T05:51:47.369421+0000","last_clean":"2024-09-21T05:51:47.369421+0000","last_became_active":"2024-09-21T05:51:03.937857+0000","last_became_peered":"2024-09-21T05:51:03.937857+0000","last_unstale":"2024-09-21T05:51:47.369421+0000","last_undegraded":"2024-09-21T05:51:47.369421+0000","last_fullsized":"2024-09-21T05:51:47.369421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:54.147008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586313+0000","last_change":"2024-09-21T05:50:53.890755+0000","last_active":"2024-09-21T05:51:47.586313+0000","last_peered":"2024-09-21T05:51:47.586313+0000","last_clean":"2024-09-21T05:51:47.586313+0000","last_became_active":"2024-09-21T05:50:53.890286+0000","last_became_peered":"2024-09-21T05:50:53.890286+0000","last_unstale":"2024-09-21T05:51:47.586313+0000","last_undegraded":"2024-09-21T05:51:47.586313+0000","last_fullsized":"2024-09-21T05:51:47.586313+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:50.767355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374399+0000","last_change":"2024-09-21T05:50:50.852722+0000","last_active":"2024-09-21T05:51:47.374399+0000","last_peered":"2024-09-21T05:51:47.374399+0000","last_clean":"2024-09-21T05:51:47.374399+0000","last_became_active":"2024-09-21T05:50:50.852211+0000","last_became_peered":"2024-09-21T05:50:50.852211+0000","last_unstale":"2024-09-21T05:51:47.374399+0000","last_undegraded":"2024-09-21T05:51:47.374399+0000","last_fullsized":"2024-09-21T05:51:47.374399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:44.392153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371509+0000","last_change":"2024-09-21T05:51:03.946552+0000","last_active":"2024-09-21T05:51:47.371509+0000","last_peered":"2024-09-21T05:51:47.371509+0000","last_clean":"2024-09-21T05:51:47.371509+0000","last_became_active":"2024-09-21T05:51:03.946093+0000","last_became_peered":"2024-09-21T05:51:03.946093+0000","last_unstale":"2024-09-21T05:51:47.371509+0000","last_undegraded":"2024-09-21T05:51:47.371509+0000","last_fullsized":"2024-09-21T05:51:47.371509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:46.897990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371647+0000","last_change":"2024-09-21T05:50:53.903935+0000","last_active":"2024-09-21T05:51:47.371647+0000","last_peered":"2024-09-21T05:51:47.371647+0000","last_clean":"2024-09-21T05:51:47.371647+0000","last_became_active":"2024-09-21T05:50:53.903604+0000","last_became_peered":"2024-09-21T05:50:53.903604+0000","last_unstale":"2024-09-21T05:51:47.371647+0000","last_undegraded":"2024-09-21T05:51:47.371647+0000","last_fullsized":"2024-09-21T05:51:47.371647+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:49.552901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.367135+0000","last_change":"2024-09-21T05:50:50.848254+0000","last_active":"2024-09-21T05:51:47.367135+0000","last_peered":"2024-09-21T05:51:47.367135+0000","last_clean":"2024-09-21T05:51:47.367135+0000","last_became_active":"2024-09-21T05:50:50.847834+0000","last_became_peered":"2024-09-21T05:50:50.847834+0000","last_unstale":"2024-09-21T05:51:47.367135+0000","last_undegraded":"2024-09-21T05:51:47.367135+0000","last_fullsized":"2024-09-21T05:51:47.367135+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:36.579763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375443+0000","last_change":"2024-09-21T05:51:03.941732+0000","last_active":"2024-09-21T05:51:47.375443+0000","last_peered":"2024-09-21T05:51:47.375443+0000","last_clean":"2024-09-21T05:51:47.375443+0000","last_became_active":"2024-09-21T05:51:03.941144+0000","last_became_peered":"2024-09-21T05:51:03.941144+0000","last_unstale":"2024-09-21T05:51:47.375443+0000","last_undegraded":"2024-09-21T05:51:47.375443+0000","last_fullsized":"2024-09-21T05:51:47.375443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:38.117642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.370797+0000","last_change":"2024-09-21T05:50:53.904574+0000","last_active":"2024-09-21T05:51:47.370797+0000","last_peered":"2024-09-21T05:51:47.370797+0000","last_clean":"2024-09-21T05:51:47.370797+0000","last_became_active":"2024-09-21T05:50:53.904215+0000","last_became_peered":"2024-09-21T05:50:53.904215+0000","last_unstale":"2024-09-21T05:51:47.370797+0000","last_undegraded":"2024-09-21T05:51:47.370797+0000","last_fullsized":"2024-09-21T05:51:47.370797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:49.662725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'30","reported_seq":116,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:52:05.418650+0000","last_change":"2024-09-21T05:50:50.850929+0000","last_active":"2024-09-21T05:52:05.418650+0000","last_peered":"2024-09-21T05:52:05.418650+0000","last_clean":"2024-09-21T05:52:05.418650+0000","last_became_active":"2024-09-21T05:50:50.850495+0000","last_became_peered":"2024-09-21T05:50:50.850495+0000","last_unstale":"2024-09-21T05:52:05.418650+0000","last_undegraded":"2024-09-21T05:52:05.418650+0000","last_fullsized":"2024-09-21T05:52:05.418650+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:45.224063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63864,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":45,"num_read_kb":80,"num_write":30,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369378+0000","last_change":"2024-09-21T05:51:03.944010+0000","last_active":"2024-09-21T05:51:47.369378+0000","last_peered":"2024-09-21T05:51:47.369378+0000","last_clean":"2024-09-21T05:51:47.369378+0000","last_became_active":"2024-09-21T05:51:03.942942+0000","last_became_peered":"2024-09-21T05:51:03.942942+0000","last_unstale":"2024-09-21T05:51:47.369378+0000","last_undegraded":"2024-09-21T05:51:47.369378+0000","last_fullsized":"2024-09-21T05:51:47.369378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:38.846493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.376451+0000","last_change":"2024-09-21T05:51:47.376326+0000","last_active":"2024-09-21T05:51:47.376451+0000","last_peered":"2024-09-21T05:51:47.376451+0000","last_clean":"2024-09-21T05:51:47.376451+0000","last_became_active":"2024-09-21T05:51:47.375993+0000","last_became_peered":"2024-09-21T05:51:47.375993+0000","last_unstale":"2024-09-21T05:51:47.376451+0000","last_undegraded":"2024-09-21T05:51:47.376451+0000","last_fullsized":"2024-09-21T05:51:47.376451+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:13.193571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374423+0000","last_change":"2024-09-21T05:50:51.162682+0000","last_active":"2024-09-21T05:51:47.374423+0000","last_peered":"2024-09-21T05:51:47.374423+0000","last_clean":"2024-09-21T05:51:47.374423+0000","last_became_active":"2024-09-21T05:50:51.162244+0000","last_became_peered":"2024-09-21T05:50:51.162244+0000","last_unstale":"2024-09-21T05:51:47.374423+0000","last_undegraded":"2024-09-21T05:51:47.374423+0000","last_fullsized":"2024-09-21T05:51:47.374423+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.595096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.587907+0000","last_change":"2024-09-21T05:51:03.939666+0000","last_active":"2024-09-21T05:51:47.587907+0000","last_peered":"2024-09-21T05:51:47.587907+0000","last_clean":"2024-09-21T05:51:47.587907+0000","last_became_active":"2024-09-21T05:51:03.938311+0000","last_became_peered":"2024-09-21T05:51:03.938311+0000","last_unstale":"2024-09-21T05:51:47.587907+0000","last_undegraded":"2024-09-21T05:51:47.587907+0000","last_fullsized":"2024-09-21T05:51:47.587907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:31.407900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588517+0000","last_change":"2024-09-21T05:51:47.588416+0000","last_active":"2024-09-21T05:51:47.588517+0000","last_peered":"2024-09-21T05:51:47.588517+0000","last_clean":"2024-09-21T05:51:47.588517+0000","last_became_active":"2024-09-21T05:51:47.587905+0000","last_became_peered":"2024-09-21T05:51:47.587905+0000","last_unstale":"2024-09-21T05:51:47.588517+0000","last_undegraded":"2024-09-21T05:51:47.588517+0000","last_fullsized":"2024-09-21T05:51:47.588517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:05.821048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586642+0000","last_change":"2024-09-21T05:50:50.846164+0000","last_active":"2024-09-21T05:51:47.586642+0000","last_peered":"2024-09-21T05:51:47.586642+0000","last_clean":"2024-09-21T05:51:47.586642+0000","last_became_active":"2024-09-21T05:50:50.845775+0000","last_became_peered":"2024-09-21T05:50:50.845775+0000","last_unstale":"2024-09-21T05:51:47.586642+0000","last_undegraded":"2024-09-21T05:51:47.586642+0000","last_fullsized":"2024-09-21T05:51:47.586642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:45.356626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369471+0000","last_change":"2024-09-21T05:51:03.938602+0000","last_active":"2024-09-21T05:51:47.369471+0000","last_peered":"2024-09-21T05:51:47.369471+0000","last_clean":"2024-09-21T05:51:47.369471+0000","last_became_active":"2024-09-21T05:51:03.938113+0000","last_became_peered":"2024-09-21T05:51:03.938113+0000","last_unstale":"2024-09-21T05:51:47.369471+0000","last_undegraded":"2024-09-21T05:51:47.369471+0000","last_fullsized":"2024-09-21T05:51:47.369471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:07:58.436244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373648+0000","last_change":"2024-09-21T05:50:53.903005+0000","last_active":"2024-09-21T05:51:47.373648+0000","last_peered":"2024-09-21T05:51:47.373648+0000","last_clean":"2024-09-21T05:51:47.373648+0000","last_became_active":"2024-09-21T05:50:53.902590+0000","last_became_peered":"2024-09-21T05:50:53.902590+0000","last_unstale":"2024-09-21T05:51:47.373648+0000","last_undegraded":"2024-09-21T05:51:47.373648+0000","last_fullsized":"2024-09-21T05:51:47.373648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:46.602723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366967+0000","last_change":"2024-09-21T05:50:50.846682+0000","last_active":"2024-09-21T05:51:47.366967+0000","last_peered":"2024-09-21T05:51:47.366967+0000","last_clean":"2024-09-21T05:51:47.366967+0000","last_became_active":"2024-09-21T05:50:50.846305+0000","last_became_peered":"2024-09-21T05:50:50.846305+0000","last_unstale":"2024-09-21T05:51:47.366967+0000","last_undegraded":"2024-09-21T05:51:47.366967+0000","last_fullsized":"2024-09-21T05:51:47.366967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:30.946247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365976+0000","last_change":"2024-09-21T05:51:03.931781+0000","last_active":"2024-09-21T05:51:47.365976+0000","last_peered":"2024-09-21T05:51:47.365976+0000","last_clean":"2024-09-21T05:51:47.365976+0000","last_became_active":"2024-09-21T05:51:03.930921+0000","last_became_peered":"2024-09-21T05:51:03.930921+0000","last_unstale":"2024-09-21T05:51:47.365976+0000","last_undegraded":"2024-09-21T05:51:47.365976+0000","last_fullsized":"2024-09-21T05:51:47.365976+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:03.284929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375485+0000","last_change":"2024-09-21T05:51:03.947521+0000","last_active":"2024-09-21T05:51:47.375485+0000","last_peered":"2024-09-21T05:51:47.375485+0000","last_clean":"2024-09-21T05:51:47.375485+0000","last_became_active":"2024-09-21T05:51:03.947074+0000","last_became_peered":"2024-09-21T05:51:03.947074+0000","last_unstale":"2024-09-21T05:51:47.375485+0000","last_undegraded":"2024-09-21T05:51:47.375485+0000","last_fullsized":"2024-09-21T05:51:47.375485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:51.313988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.368970+0000","last_change":"2024-09-21T05:50:53.911791+0000","last_active":"2024-09-21T05:51:47.368970+0000","last_peered":"2024-09-21T05:51:47.368970+0000","last_clean":"2024-09-21T05:51:47.368970+0000","last_became_active":"2024-09-21T05:50:53.911392+0000","last_became_peered":"2024-09-21T05:50:53.911392+0000","last_unstale":"2024-09-21T05:51:47.368970+0000","last_undegraded":"2024-09-21T05:51:47.368970+0000","last_fullsized":"2024-09-21T05:51:47.368970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:45.688626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374446+0000","last_change":"2024-09-21T05:50:50.853383+0000","last_active":"2024-09-21T05:51:47.374446+0000","last_peered":"2024-09-21T05:51:47.374446+0000","last_clean":"2024-09-21T05:51:47.374446+0000","last_became_active":"2024-09-21T05:50:50.853006+0000","last_became_peered":"2024-09-21T05:50:50.853006+0000","last_unstale":"2024-09-21T05:51:47.374446+0000","last_undegraded":"2024-09-21T05:51:47.374446+0000","last_fullsized":"2024-09-21T05:51:47.374446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:14.838953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372016+0000","last_change":"2024-09-21T05:51:03.945415+0000","last_active":"2024-09-21T05:51:47.372016+0000","last_peered":"2024-09-21T05:51:47.372016+0000","last_clean":"2024-09-21T05:51:47.372016+0000","last_became_active":"2024-09-21T05:51:03.945019+0000","last_became_peered":"2024-09-21T05:51:03.945019+0000","last_unstale":"2024-09-21T05:51:47.372016+0000","last_undegraded":"2024-09-21T05:51:47.372016+0000","last_fullsized":"2024-09-21T05:51:47.372016+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:27.006823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365558+0000","last_change":"2024-09-21T05:50:53.897515+0000","last_active":"2024-09-21T05:51:47.365558+0000","last_peered":"2024-09-21T05:51:47.365558+0000","last_clean":"2024-09-21T05:51:47.365558+0000","last_became_active":"2024-09-21T05:50:53.897070+0000","last_became_peered":"2024-09-21T05:50:53.897070+0000","last_unstale":"2024-09-21T05:51:47.365558+0000","last_undegraded":"2024-09-21T05:51:47.365558+0000","last_fullsized":"2024-09-21T05:51:47.365558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:16.971379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371965+0000","last_change":"2024-09-21T05:50:50.844937+0000","last_active":"2024-09-21T05:51:47.371965+0000","last_peered":"2024-09-21T05:51:47.371965+0000","last_clean":"2024-09-21T05:51:47.371965+0000","last_became_active":"2024-09-21T05:50:50.844048+0000","last_became_peered":"2024-09-21T05:50:50.844048+0000","last_unstale":"2024-09-21T05:51:47.371965+0000","last_undegraded":"2024-09-21T05:51:47.371965+0000","last_fullsized":"2024-09-21T05:51:47.371965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:28.764620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588032+0000","last_change":"2024-09-21T05:51:47.587919+0000","last_active":"2024-09-21T05:51:47.588032+0000","last_peered":"2024-09-21T05:51:47.588032+0000","last_clean":"2024-09-21T05:51:47.588032+0000","last_became_active":"2024-09-21T05:51:47.587418+0000","last_became_peered":"2024-09-21T05:51:47.587418+0000","last_unstale":"2024-09-21T05:51:47.588032+0000","last_undegraded":"2024-09-21T05:51:47.588032+0000","last_fullsized":"2024-09-21T05:51:47.588032+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:29.800848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374026+0000","last_change":"2024-09-21T05:50:53.890761+0000","last_active":"2024-09-21T05:51:47.374026+0000","last_peered":"2024-09-21T05:51:47.374026+0000","last_clean":"2024-09-21T05:51:47.374026+0000","last_became_active":"2024-09-21T05:50:53.890394+0000","last_became_peered":"2024-09-21T05:50:53.890394+0000","last_unstale":"2024-09-21T05:51:47.374026+0000","last_undegraded":"2024-09-21T05:51:47.374026+0000","last_fullsized":"2024-09-21T05:51:47.374026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.176920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366914+0000","last_change":"2024-09-21T05:51:03.941049+0000","last_active":"2024-09-21T05:51:47.366914+0000","last_peered":"2024-09-21T05:51:47.366914+0000","last_clean":"2024-09-21T05:51:47.366914+0000","last_became_active":"2024-09-21T05:51:03.940593+0000","last_became_peered":"2024-09-21T05:51:03.940593+0000","last_unstale":"2024-09-21T05:51:47.366914+0000","last_undegraded":"2024-09-21T05:51:47.366914+0000","last_fullsized":"2024-09-21T05:51:47.366914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:03.797582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374119+0000","last_change":"2024-09-21T05:50:50.852630+0000","last_active":"2024-09-21T05:51:47.374119+0000","last_peered":"2024-09-21T05:51:47.374119+0000","last_clean":"2024-09-21T05:51:47.374119+0000","last_became_active":"2024-09-21T05:50:50.852255+0000","last_became_peered":"2024-09-21T05:50:50.852255+0000","last_unstale":"2024-09-21T05:51:47.374119+0000","last_undegraded":"2024-09-21T05:51:47.374119+0000","last_fullsized":"2024-09-21T05:51:47.374119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:18.094082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369208+0000","last_change":"2024-09-21T05:50:53.902303+0000","last_active":"2024-09-21T05:51:47.369208+0000","last_peered":"2024-09-21T05:51:47.369208+0000","last_clean":"2024-09-21T05:51:47.369208+0000","last_became_active":"2024-09-21T05:50:53.901910+0000","last_became_peered":"2024-09-21T05:50:53.901910+0000","last_unstale":"2024-09-21T05:51:47.369208+0000","last_undegraded":"2024-09-21T05:51:47.369208+0000","last_fullsized":"2024-09-21T05:51:47.369208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:06.651235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.367205+0000","last_change":"2024-09-21T05:51:03.932268+0000","last_active":"2024-09-21T05:51:47.367205+0000","last_peered":"2024-09-21T05:51:47.367205+0000","last_clean":"2024-09-21T05:51:47.367205+0000","last_became_active":"2024-09-21T05:51:03.931849+0000","last_became_peered":"2024-09-21T05:51:03.931849+0000","last_unstale":"2024-09-21T05:51:47.367205+0000","last_undegraded":"2024-09-21T05:51:47.367205+0000","last_fullsized":"2024-09-21T05:51:47.367205+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:53.622621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371214+0000","last_change":"2024-09-21T05:50:53.897205+0000","last_active":"2024-09-21T05:51:47.371214+0000","last_peered":"2024-09-21T05:51:47.371214+0000","last_clean":"2024-09-21T05:51:47.371214+0000","last_became_active":"2024-09-21T05:50:53.896811+0000","last_became_peered":"2024-09-21T05:50:53.896811+0000","last_unstale":"2024-09-21T05:51:47.371214+0000","last_undegraded":"2024-09-21T05:51:47.371214+0000","last_fullsized":"2024-09-21T05:51:47.371214+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:13.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.376687+0000","last_change":"2024-09-21T05:51:47.376606+0000","last_active":"2024-09-21T05:51:47.376687+0000","last_peered":"2024-09-21T05:51:47.376687+0000","last_clean":"2024-09-21T05:51:47.376687+0000","last_became_active":"2024-09-21T05:51:47.376203+0000","last_became_peered":"2024-09-21T05:51:47.376203+0000","last_unstale":"2024-09-21T05:51:47.376687+0000","last_undegraded":"2024-09-21T05:51:47.376687+0000","last_fullsized":"2024-09-21T05:51:47.376687+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:34.698021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366716+0000","last_change":"2024-09-21T05:50:53.910991+0000","last_active":"2024-09-21T05:51:47.366716+0000","last_peered":"2024-09-21T05:51:47.366716+0000","last_clean":"2024-09-21T05:51:47.366716+0000","last_became_active":"2024-09-21T05:50:53.910720+0000","last_became_peered":"2024-09-21T05:50:53.910720+0000","last_unstale":"2024-09-21T05:51:47.366716+0000","last_undegraded":"2024-09-21T05:51:47.366716+0000","last_fullsized":"2024-09-21T05:51:47.366716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.653746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375259+0000","last_change":"2024-09-21T05:50:53.894065+0000","last_active":"2024-09-21T05:51:47.375259+0000","last_peered":"2024-09-21T05:51:47.375259+0000","last_clean":"2024-09-21T05:51:47.375259+0000","last_became_active":"2024-09-21T05:50:53.892630+0000","last_became_peered":"2024-09-21T05:50:53.892630+0000","last_unstale":"2024-09-21T05:51:47.375259+0000","last_undegraded":"2024-09-21T05:51:47.375259+0000","last_fullsized":"2024-09-21T05:51:47.375259+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:09.025667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372687+0000","last_change":"2024-09-21T05:50:53.899586+0000","last_active":"2024-09-21T05:51:47.372687+0000","last_peered":"2024-09-21T05:51:47.372687+0000","last_clean":"2024-09-21T05:51:47.372687+0000","last_became_active":"2024-09-21T05:50:53.899066+0000","last_became_peered":"2024-09-21T05:50:53.899066+0000","last_unstale":"2024-09-21T05:51:47.372687+0000","last_undegraded":"2024-09-21T05:51:47.372687+0000","last_fullsized":"2024-09-21T05:51:47.372687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:07.678164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375170+0000","last_change":"2024-09-21T05:51:47.375063+0000","last_active":"2024-09-21T05:51:47.375170+0000","last_peered":"2024-09-21T05:51:47.375170+0000","last_clean":"2024-09-21T05:51:47.375170+0000","last_became_active":"2024-09-21T05:51:47.374645+0000","last_became_peered":"2024-09-21T05:51:47.374645+0000","last_unstale":"2024-09-21T05:51:47.375170+0000","last_undegraded":"2024-09-21T05:51:47.375170+0000","last_fullsized":"2024-09-21T05:51:47.375170+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:29.572438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366992+0000","last_change":"2024-09-21T05:50:53.901688+0000","last_active":"2024-09-21T05:51:47.366992+0000","last_peered":"2024-09-21T05:51:47.366992+0000","last_clean":"2024-09-21T05:51:47.366992+0000","last_became_active":"2024-09-21T05:50:53.901245+0000","last_became_peered":"2024-09-21T05:50:53.901245+0000","last_unstale":"2024-09-21T05:51:47.366992+0000","last_undegraded":"2024-09-21T05:51:47.366992+0000","last_fullsized":"2024-09-21T05:51:47.366992+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:41.401357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366378+0000","last_change":"2024-09-21T05:50:53.908954+0000","last_active":"2024-09-21T05:51:47.366378+0000","last_peered":"2024-09-21T05:51:47.366378+0000","last_clean":"2024-09-21T05:51:47.366378+0000","last_became_active":"2024-09-21T05:50:53.897605+0000","last_became_peered":"2024-09-21T05:50:53.897605+0000","last_unstale":"2024-09-21T05:51:47.366378+0000","last_undegraded":"2024-09-21T05:51:47.366378+0000","last_fullsized":"2024-09-21T05:51:47.366378+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:15.634597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374142+0000","last_change":"2024-09-21T05:50:53.900106+0000","last_active":"2024-09-21T05:51:47.374142+0000","last_peered":"2024-09-21T05:51:47.374142+0000","last_clean":"2024-09-21T05:51:47.374142+0000","last_became_active":"2024-09-21T05:50:53.899697+0000","last_became_peered":"2024-09-21T05:50:53.899697+0000","last_unstale":"2024-09-21T05:51:47.374142+0000","last_undegraded":"2024-09-21T05:51:47.374142+0000","last_fullsized":"2024-09-21T05:51:47.374142+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.599501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365666+0000","last_change":"2024-09-21T05:50:53.899644+0000","last_active":"2024-09-21T05:51:47.365666+0000","last_peered":"2024-09-21T05:51:47.365666+0000","last_clean":"2024-09-21T05:51:47.365666+0000","last_became_active":"2024-09-21T05:50:53.899246+0000","last_became_peered":"2024-09-21T05:50:53.899246+0000","last_unstale":"2024-09-21T05:51:47.365666+0000","last_undegraded":"2024-09-21T05:51:47.365666+0000","last_fullsized":"2024-09-21T05:51:47.365666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:34.551489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373510+0000","last_change":"2024-09-21T05:50:53.904328+0000","last_active":"2024-09-21T05:51:47.373510+0000","last_peered":"2024-09-21T05:51:47.373510+0000","last_clean":"2024-09-21T05:51:47.373510+0000","last_became_active":"2024-09-21T05:50:53.903887+0000","last_became_peered":"2024-09-21T05:50:53.903887+0000","last_unstale":"2024-09-21T05:51:47.373510+0000","last_undegraded":"2024-09-21T05:51:47.373510+0000","last_fullsized":"2024-09-21T05:51:47.373510+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:27.659631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372271+0000","last_change":"2024-09-21T05:50:53.905278+0000","last_active":"2024-09-21T05:51:47.372271+0000","last_peered":"2024-09-21T05:51:47.372271+0000","last_clean":"2024-09-21T05:51:47.372271+0000","last_became_active":"2024-09-21T05:50:53.904633+0000","last_became_peered":"2024-09-21T05:50:53.904633+0000","last_unstale":"2024-09-21T05:51:47.372271+0000","last_undegraded":"2024-09-21T05:51:47.372271+0000","last_fullsized":"2024-09-21T05:51:47.372271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:26.802336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371630+0000","last_change":"2024-09-21T05:50:53.891621+0000","last_active":"2024-09-21T05:51:47.371630+0000","last_peered":"2024-09-21T05:51:47.371630+0000","last_clean":"2024-09-21T05:51:47.371630+0000","last_became_active":"2024-09-21T05:50:53.891246+0000","last_became_peered":"2024-09-21T05:50:53.891246+0000","last_unstale":"2024-09-21T05:51:47.371630+0000","last_undegraded":"2024-09-21T05:51:47.371630+0000","last_fullsized":"2024-09-21T05:51:47.371630+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:21.419789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.367243+0000","last_change":"2024-09-21T05:50:53.902964+0000","last_active":"2024-09-21T05:51:47.367243+0000","last_peered":"2024-09-21T05:51:47.367243+0000","last_clean":"2024-09-21T05:51:47.367243+0000","last_became_active":"2024-09-21T05:50:53.902574+0000","last_became_peered":"2024-09-21T05:50:53.902574+0000","last_unstale":"2024-09-21T05:51:47.367243+0000","last_undegraded":"2024-09-21T05:51:47.367243+0000","last_fullsized":"2024-09-21T05:51:47.367243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:35.552787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369657+0000","last_change":"2024-09-21T05:50:53.904717+0000","last_active":"2024-09-21T05:51:47.369657+0000","last_peered":"2024-09-21T05:51:47.369657+0000","last_clean":"2024-09-21T05:51:47.369657+0000","last_became_active":"2024-09-21T05:50:53.903152+0000","last_became_peered":"2024-09-21T05:50:53.903152+0000","last_unstale":"2024-09-21T05:51:47.369657+0000","last_undegraded":"2024-09-21T05:51:47.369657+0000","last_fullsized":"2024-09-21T05:51:47.369657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:56.808689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372634+0000","last_change":"2024-09-21T05:50:53.906336+0000","last_active":"2024-09-21T05:51:47.372634+0000","last_peered":"2024-09-21T05:51:47.372634+0000","last_clean":"2024-09-21T05:51:47.372634+0000","last_became_active":"2024-09-21T05:50:53.905942+0000","last_became_peered":"2024-09-21T05:50:53.905942+0000","last_unstale":"2024-09-21T05:51:47.372634+0000","last_undegraded":"2024-09-21T05:51:47.372634+0000","last_fullsized":"2024-09-21T05:51:47.372634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:26.824967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373752+0000","last_change":"2024-09-21T05:50:53.910772+0000","last_active":"2024-09-21T05:51:47.373752+0000","last_peered":"2024-09-21T05:51:47.373752+0000","last_clean":"2024-09-21T05:51:47.373752+0000","last_became_active":"2024-09-21T05:50:53.910394+0000","last_became_peered":"2024-09-21T05:50:53.910394+0000","last_unstale":"2024-09-21T05:51:47.373752+0000","last_undegraded":"2024-09-21T05:51:47.373752+0000","last_fullsized":"2024-09-21T05:51:47.373752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:00.338916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374606+0000","last_change":"2024-09-21T05:50:53.906454+0000","last_active":"2024-09-21T05:51:47.374606+0000","last_peered":"2024-09-21T05:51:47.374606+0000","last_clean":"2024-09-21T05:51:47.374606+0000","last_became_active":"2024-09-21T05:50:53.905947+0000","last_became_peered":"2024-09-21T05:50:53.905947+0000","last_unstale":"2024-09-21T05:51:47.374606+0000","last_undegraded":"2024-09-21T05:51:47.374606+0000","last_fullsized":"2024-09-21T05:51:47.374606+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:57.358615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374819+0000","last_change":"2024-09-21T05:50:53.903690+0000","last_active":"2024-09-21T05:51:47.374819+0000","last_peered":"2024-09-21T05:51:47.374819+0000","last_clean":"2024-09-21T05:51:47.374819+0000","last_became_active":"2024-09-21T05:50:53.900672+0000","last_became_peered":"2024-09-21T05:50:53.900672+0000","last_unstale":"2024-09-21T05:51:47.374819+0000","last_undegraded":"2024-09-21T05:51:47.374819+0000","last_fullsized":"2024-09-21T05:51:47.374819+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:42.005312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372264+0000","last_change":"2024-09-21T05:50:53.888711+0000","last_active":"2024-09-21T05:51:47.372264+0000","last_peered":"2024-09-21T05:51:47.372264+0000","last_clean":"2024-09-21T05:51:47.372264+0000","last_became_active":"2024-09-21T05:50:53.888302+0000","last_became_peered":"2024-09-21T05:50:53.888302+0000","last_unstale":"2024-09-21T05:51:47.372264+0000","last_undegraded":"2024-09-21T05:51:47.372264+0000","last_fullsized":"2024-09-21T05:51:47.372264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:25.766696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588817+0000","last_change":"2024-09-21T05:50:53.898848+0000","last_active":"2024-09-21T05:51:47.588817+0000","last_peered":"2024-09-21T05:51:47.588817+0000","last_clean":"2024-09-21T05:51:47.588817+0000","last_became_active":"2024-09-21T05:50:53.897785+0000","last_became_peered":"2024-09-21T05:50:53.897785+0000","last_unstale":"2024-09-21T05:51:47.588817+0000","last_undegraded":"2024-09-21T05:51:47.588817+0000","last_fullsized":"2024-09-21T05:51:47.588817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:25.099224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586885+0000","last_change":"2024-09-21T05:50:53.899051+0000","last_active":"2024-09-21T05:51:47.586885+0000","last_peered":"2024-09-21T05:51:47.586885+0000","last_clean":"2024-09-21T05:51:47.586885+0000","last_became_active":"2024-09-21T05:50:53.898381+0000","last_became_peered":"2024-09-21T05:50:53.898381+0000","last_unstale":"2024-09-21T05:51:47.586885+0000","last_undegraded":"2024-09-21T05:51:47.586885+0000","last_fullsized":"2024-09-21T05:51:47.586885+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:05.958547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.367168+0000","last_change":"2024-09-21T05:50:53.896079+0000","last_active":"2024-09-21T05:51:47.367168+0000","last_peered":"2024-09-21T05:51:47.367168+0000","last_clean":"2024-09-21T05:51:47.367168+0000","last_became_active":"2024-09-21T05:50:53.895659+0000","last_became_peered":"2024-09-21T05:50:53.895659+0000","last_unstale":"2024-09-21T05:51:47.367168+0000","last_undegraded":"2024-09-21T05:51:47.367168+0000","last_fullsized":"2024-09-21T05:51:47.367168+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:50.151899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373801+0000","last_change":"2024-09-21T05:50:53.894899+0000","last_active":"2024-09-21T05:51:47.373801+0000","last_peered":"2024-09-21T05:51:47.373801+0000","last_clean":"2024-09-21T05:51:47.373801+0000","last_became_active":"2024-09-21T05:50:53.894530+0000","last_became_peered":"2024-09-21T05:50:53.894530+0000","last_unstale":"2024-09-21T05:51:47.373801+0000","last_undegraded":"2024-09-21T05:51:47.373801+0000","last_fullsized":"2024-09-21T05:51:47.373801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:15.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.378837+0000","last_change":"2024-09-21T05:51:47.376927+0000","last_active":"2024-09-21T05:51:47.378837+0000","last_peered":"2024-09-21T05:51:47.378837+0000","last_clean":"2024-09-21T05:51:47.378837+0000","last_became_active":"2024-09-21T05:51:47.376534+0000","last_became_peered":"2024-09-21T05:51:47.376534+0000","last_unstale":"2024-09-21T05:51:47.378837+0000","last_undegraded":"2024-09-21T05:51:47.378837+0000","last_fullsized":"2024-09-21T05:51:47.378837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:26.353085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586552+0000","last_change":"2024-09-21T05:50:53.903196+0000","last_active":"2024-09-21T05:51:47.586552+0000","last_peered":"2024-09-21T05:51:47.586552+0000","last_clean":"2024-09-21T05:51:47.586552+0000","last_became_active":"2024-09-21T05:50:53.902825+0000","last_became_peered":"2024-09-21T05:50:53.902825+0000","last_unstale":"2024-09-21T05:51:47.586552+0000","last_undegraded":"2024-09-21T05:51:47.586552+0000","last_fullsized":"2024-09-21T05:51:47.586552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:13.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366681+0000","last_change":"2024-09-21T05:50:53.902249+0000","last_active":"2024-09-21T05:51:47.366681+0000","last_peered":"2024-09-21T05:51:47.366681+0000","last_clean":"2024-09-21T05:51:47.366681+0000","last_became_active":"2024-09-21T05:50:53.901828+0000","last_became_peered":"2024-09-21T05:50:53.901828+0000","last_unstale":"2024-09-21T05:51:47.366681+0000","last_undegraded":"2024-09-21T05:51:47.366681+0000","last_fullsized":"2024-09-21T05:51:47.366681+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:51.200179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369725+0000","last_change":"2024-09-21T05:50:53.897170+0000","last_active":"2024-09-21T05:51:47.369725+0000","last_peered":"2024-09-21T05:51:47.369725+0000","last_clean":"2024-09-21T05:51:47.369725+0000","last_became_active":"2024-09-21T05:50:53.895337+0000","last_became_peered":"2024-09-21T05:50:53.895337+0000","last_unstale":"2024-09-21T05:51:47.369725+0000","last_undegraded":"2024-09-21T05:51:47.369725+0000","last_fullsized":"2024-09-21T05:51:47.369725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:19.869698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588686+0000","last_change":"2024-09-21T05:50:53.899575+0000","last_active":"2024-09-21T05:51:47.588686+0000","last_peered":"2024-09-21T05:51:47.588686+0000","last_clean":"2024-09-21T05:51:47.588686+0000","last_became_active":"2024-09-21T05:50:53.898274+0000","last_became_peered":"2024-09-21T05:50:53.898274+0000","last_unstale":"2024-09-21T05:51:47.588686+0000","last_undegraded":"2024-09-21T05:51:47.588686+0000","last_fullsized":"2024-09-21T05:51:47.588686+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:28.188691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374942+0000","last_change":"2024-09-21T05:50:53.908381+0000","last_active":"2024-09-21T05:51:47.374942+0000","last_peered":"2024-09-21T05:51:47.374942+0000","last_clean":"2024-09-21T05:51:47.374942+0000","last_became_active":"2024-09-21T05:50:53.906731+0000","last_became_peered":"2024-09-21T05:50:53.906731+0000","last_unstale":"2024-09-21T05:51:47.374942+0000","last_undegraded":"2024-09-21T05:51:47.374942+0000","last_fullsized":"2024-09-21T05:51:47.374942+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:59.254561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375564+0000","last_change":"2024-09-21T05:50:53.904619+0000","last_active":"2024-09-21T05:51:47.375564+0000","last_peered":"2024-09-21T05:51:47.375564+0000","last_clean":"2024-09-21T05:51:47.375564+0000","last_became_active":"2024-09-21T05:50:53.903901+0000","last_became_peered":"2024-09-21T05:50:53.903901+0000","last_unstale":"2024-09-21T05:51:47.375564+0000","last_undegraded":"2024-09-21T05:51:47.375564+0000","last_fullsized":"2024-09-21T05:51:47.375564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:25.531973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372499+0000","last_change":"2024-09-21T05:50:53.903557+0000","last_active":"2024-09-21T05:51:47.372499+0000","last_peered":"2024-09-21T05:51:47.372499+0000","last_clean":"2024-09-21T05:51:47.372499+0000","last_became_active":"2024-09-21T05:50:53.903195+0000","last_became_peered":"2024-09-21T05:50:53.903195+0000","last_unstale":"2024-09-21T05:51:47.372499+0000","last_undegraded":"2024-09-21T05:51:47.372499+0000","last_fullsized":"2024-09-21T05:51:47.372499+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:32.268063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64662,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":51,"num_read_kb":86,"num_write":84,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":185456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":502730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874273,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28660,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716492,"statfs":{"total":95995035648,"available":95965687808,"internally_reserved":0,"allocated":1675264,"data_stored":1148795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037800,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":507408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234029,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":503334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430257,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32752,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712400,"statfs":{"total":95995035648,"available":95961497600,"internally_reserved":0,"allocated":1605632,"data_stored":1097776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626486,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":999424,"data_stored":498634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36916,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708236,"statfs":{"total":95995035648,"available":95957233664,"internally_reserved":0,"allocated":1609728,"data_stored":1093280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018946,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":502752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215174,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":498738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444109,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1073152,"data_stored":558267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1069056,"data_stored":558233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1003520,"data_stored":498724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:52:07.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:52:07.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:07 smithi144 ceph-mon[34351]: pgmap v358: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-09-21T05:52:07.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:07 smithi144 ceph-mon[34351]: from='client.24941 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:07 smithi067 ceph-mon[34443]: pgmap v358: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-09-21T05:52:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:07 smithi067 ceph-mon[34443]: from='client.24941 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:08.225 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:08.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.818+0000 7fe7e7200640 1 -- 172.21.15.37:0/3389690007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7e81092d0 msgr2=0x7fe7e81096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:08.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.818+0000 7fe7e7200640 1 --2- 172.21.15.37:0/3389690007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7e81092d0 0x7fe7e81096e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4009900 tx=0x7fe7d402a410 comp rx=0 tx=0).stop 2024-09-21T05:52:08.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.818+0000 7fe7e7200640 1 -- 172.21.15.37:0/3389690007 shutdown_connections 2024-09-21T05:52:08.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.818+0000 7fe7e7200640 1 --2- 172.21.15.37:0/3389690007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e8109c20 0x7fe7e8110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.818+0000 7fe7e7200640 1 --2- 172.21.15.37:0/3389690007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7e81092d0 0x7fe7e81096e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.818+0000 7fe7e7200640 1 --2- 172.21.15.37:0/3389690007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7e8103990 0x7fe7e8103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.818+0000 7fe7e7200640 1 -- 172.21.15.37:0/3389690007 >> 172.21.15.37:0/3389690007 conn(0x7fe7e80ff3e0 msgr2=0x7fe7e8101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:08.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.818+0000 7fe7e7200640 1 -- 172.21.15.37:0/3389690007 shutdown_connections 2024-09-21T05:52:08.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.818+0000 7fe7e7200640 1 -- 172.21.15.37:0/3389690007 wait complete. 2024-09-21T05:52:08.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.819+0000 7fe7e7200640 1 Processor -- start 2024-09-21T05:52:08.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.820+0000 7fe7e7200640 1 -- start start 2024-09-21T05:52:08.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.820+0000 7fe7e7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7e8103990 0x7fe7e819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:08.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.820+0000 7fe7e7200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7e81092d0 0x7fe7e819a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:08.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.820+0000 7fe7e7200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e8109c20 0x7fe7e819fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:08.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.820+0000 7fe7e7200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e81138e0 con 0x7fe7e81092d0 2024-09-21T05:52:08.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.820+0000 7fe7e7200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e8113760 con 0x7fe7e8109c20 2024-09-21T05:52:08.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.820+0000 7fe7e7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e8113a60 con 0x7fe7e8103990 2024-09-21T05:52:08.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.820+0000 7fe7e5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7e81092d0 0x7fe7e819a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:08.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.820+0000 7fe7e5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7e81092d0 0x7fe7e819a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59324/0 (socket says 172.21.15.37:59324) 2024-09-21T05:52:08.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.820+0000 7fe7e5400640 1 -- 172.21.15.37:0/3465401826 learned_addr learned my addr 172.21.15.37:0/3465401826 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:08.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.820+0000 7fe7e6800640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e8109c20 0x7fe7e819fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:08.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.821+0000 7fe7e5e00640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7e8103990 0x7fe7e819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:08.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.821+0000 7fe7e5400640 1 -- 172.21.15.37:0/3465401826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7e8103990 msgr2=0x7fe7e819a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:08.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.821+0000 7fe7e5400640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7e8103990 0x7fe7e819a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.821+0000 7fe7e5400640 1 -- 172.21.15.37:0/3465401826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e8109c20 msgr2=0x7fe7e819fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.821+0000 7fe7e5400640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e8109c20 0x7fe7e819fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.821+0000 7fe7e5400640 1 -- 172.21.15.37:0/3465401826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e81a02a0 con 0x7fe7e81092d0 2024-09-21T05:52:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.821+0000 7fe7e5400640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7e81092d0 0x7fe7e819a8d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4006010 tx=0x7fe7d4004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.821+0000 7fe7dea00640 1 -- 172.21.15.37:0/3465401826 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d403f030 con 0x7fe7e81092d0 2024-09-21T05:52:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.822+0000 7fe7dea00640 1 -- 172.21.15.37:0/3465401826 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7d4003aa0 con 0x7fe7e81092d0 2024-09-21T05:52:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.822+0000 7fe7dea00640 1 -- 172.21.15.37:0/3465401826 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4035070 con 0x7fe7e81092d0 2024-09-21T05:52:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.822+0000 7fe7e7200640 1 -- 172.21.15.37:0/3465401826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e81a0530 con 0x7fe7e81092d0 2024-09-21T05:52:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.822+0000 7fe7e7200640 1 -- 172.21.15.37:0/3465401826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e81a6cf0 con 0x7fe7e81092d0 2024-09-21T05:52:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.823+0000 7fe7e7200640 1 -- 172.21.15.37:0/3465401826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e8104c10 con 0x7fe7e81092d0 2024-09-21T05:52:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.825+0000 7fe7dea00640 1 -- 172.21.15.37:0/3465401826 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fe7d4042030 con 0x7fe7e81092d0 2024-09-21T05:52:08.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.827+0000 7fe7dea00640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe7cc0b6620 0x7fe7cc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:08.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.827+0000 7fe7dea00640 1 -- 172.21.15.37:0/3465401826 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fe7d4107ff0 con 0x7fe7e81092d0 2024-09-21T05:52:08.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.827+0000 7fe7e5e00640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe7cc0b6620 0x7fe7cc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:08.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.828+0000 7fe7e5e00640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe7cc0b6620 0x7fe7cc0b8b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009bd0 tx=0x7fe7d8005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:08.829+0000 7fe7dea00640 1 -- 172.21.15.37:0/3465401826 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7d40d27a0 con 0x7fe7e81092d0 2024-09-21T05:52:09.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.026+0000 7fe7e7200640 1 -- 172.21.15.37:0/3465401826 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7e8063800 con 0x7fe7cc0b6620 2024-09-21T05:52:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.032+0000 7fe7dea00640 1 -- 172.21.15.37:0/3465401826 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340271 (secure 0 0 0) 0x7fe7e8063800 con 0x7fe7cc0b6620 2024-09-21T05:52:09.038 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:52:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T05:52:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.037+0000 7fe7e7200640 1 -- 172.21.15.37:0/3465401826 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe7cc0b6620 msgr2=0x7fe7cc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.037+0000 7fe7e7200640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe7cc0b6620 0x7fe7cc0b8b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009bd0 tx=0x7fe7d8005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.037+0000 7fe7e7200640 1 -- 172.21.15.37:0/3465401826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7e81092d0 msgr2=0x7fe7e819a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.037+0000 7fe7e7200640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7e81092d0 0x7fe7e819a8d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4006010 tx=0x7fe7d4004060 comp rx=0 tx=0).stop 2024-09-21T05:52:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.037+0000 7fe7e7200640 1 -- 172.21.15.37:0/3465401826 shutdown_connections 2024-09-21T05:52:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.037+0000 7fe7e7200640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe7cc0b6620 0x7fe7cc0b8b30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.037+0000 7fe7e7200640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e8109c20 0x7fe7e819fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.037+0000 7fe7e7200640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7e81092d0 0x7fe7e819a8d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.037+0000 7fe7e7200640 1 --2- 172.21.15.37:0/3465401826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7e8103990 0x7fe7e819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.037+0000 7fe7e7200640 1 -- 172.21.15.37:0/3465401826 >> 172.21.15.37:0/3465401826 conn(0x7fe7e80ff3e0 msgr2=0x7fe7e8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.037+0000 7fe7e7200640 1 -- 172.21.15.37:0/3465401826 shutdown_connections 2024-09-21T05:52:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:09.037+0000 7fe7e7200640 1 -- 172.21.15.37:0/3465401826 wait complete. 2024-09-21T05:52:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:09 smithi144 ceph-mon[34351]: pgmap v359: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-21T05:52:09.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:09 smithi037 ceph-mon[30631]: pgmap v359: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-21T05:52:09.956 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2024-09-21T05:52:08.240834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655264,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":127,"num_read_kb":150,"num_write":209,"num_write_kb":2244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383816,"kb_used_data":13756,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558008,"statfs":{"total":1151940427776,"available":1151547400192,"internally_reserved":0,"allocated":14086144,"data_stored":7977201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":32704,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":43,"num_write":21,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003706"},"pg_stats":[{"pgid":"2.1f","version":"79'4","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369749+0000","last_change":"2024-09-21T05:50:50.846365+0000","last_active":"2024-09-21T05:51:47.369749+0000","last_peered":"2024-09-21T05:51:47.369749+0000","last_clean":"2024-09-21T05:51:47.369749+0000","last_became_active":"2024-09-21T05:50:50.845924+0000","last_became_peered":"2024-09-21T05:50:50.845924+0000","last_unstale":"2024-09-21T05:51:47.369749+0000","last_undegraded":"2024-09-21T05:51:47.369749+0000","last_fullsized":"2024-09-21T05:51:47.369749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:39.056271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.378759+0000","last_change":"2024-09-21T05:51:47.377003+0000","last_active":"2024-09-21T05:51:47.378759+0000","last_peered":"2024-09-21T05:51:47.378759+0000","last_clean":"2024-09-21T05:51:47.378759+0000","last_became_active":"2024-09-21T05:51:47.376624+0000","last_became_peered":"2024-09-21T05:51:47.376624+0000","last_unstale":"2024-09-21T05:51:47.378759+0000","last_undegraded":"2024-09-21T05:51:47.378759+0000","last_fullsized":"2024-09-21T05:51:47.378759+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:20.569002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366645+0000","last_change":"2024-09-21T05:51:03.940107+0000","last_active":"2024-09-21T05:51:47.366645+0000","last_peered":"2024-09-21T05:51:47.366645+0000","last_clean":"2024-09-21T05:51:47.366645+0000","last_became_active":"2024-09-21T05:51:03.939723+0000","last_became_peered":"2024-09-21T05:51:03.939723+0000","last_unstale":"2024-09-21T05:51:47.366645+0000","last_undegraded":"2024-09-21T05:51:47.366645+0000","last_fullsized":"2024-09-21T05:51:47.366645+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:15.116461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366129+0000","last_change":"2024-09-21T05:50:51.162120+0000","last_active":"2024-09-21T05:51:47.366129+0000","last_peered":"2024-09-21T05:51:47.366129+0000","last_clean":"2024-09-21T05:51:47.366129+0000","last_became_active":"2024-09-21T05:50:51.161679+0000","last_became_peered":"2024-09-21T05:50:51.161679+0000","last_unstale":"2024-09-21T05:51:47.366129+0000","last_undegraded":"2024-09-21T05:51:47.366129+0000","last_fullsized":"2024-09-21T05:51:47.366129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:10.028536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.376261+0000","last_change":"2024-09-21T05:50:53.907800+0000","last_active":"2024-09-21T05:51:47.376261+0000","last_peered":"2024-09-21T05:51:47.376261+0000","last_clean":"2024-09-21T05:51:47.376261+0000","last_became_active":"2024-09-21T05:50:53.906695+0000","last_became_peered":"2024-09-21T05:50:53.906695+0000","last_unstale":"2024-09-21T05:51:47.376261+0000","last_undegraded":"2024-09-21T05:51:47.376261+0000","last_fullsized":"2024-09-21T05:51:47.376261+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:45.999010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586839+0000","last_change":"2024-09-21T05:51:03.947020+0000","last_active":"2024-09-21T05:51:47.586839+0000","last_peered":"2024-09-21T05:51:47.586839+0000","last_clean":"2024-09-21T05:51:47.586839+0000","last_became_active":"2024-09-21T05:51:03.946387+0000","last_became_peered":"2024-09-21T05:51:03.946387+0000","last_unstale":"2024-09-21T05:51:47.586839+0000","last_undegraded":"2024-09-21T05:51:47.586839+0000","last_fullsized":"2024-09-21T05:51:47.586839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:02.073199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371068+0000","last_change":"2024-09-21T05:50:50.850606+0000","last_active":"2024-09-21T05:51:47.371068+0000","last_peered":"2024-09-21T05:51:47.371068+0000","last_clean":"2024-09-21T05:51:47.371068+0000","last_became_active":"2024-09-21T05:50:50.850244+0000","last_became_peered":"2024-09-21T05:50:50.850244+0000","last_unstale":"2024-09-21T05:51:47.371068+0000","last_undegraded":"2024-09-21T05:51:47.371068+0000","last_fullsized":"2024-09-21T05:51:47.371068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:39.437099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373406+0000","last_change":"2024-09-21T05:50:53.897805+0000","last_active":"2024-09-21T05:51:47.373406+0000","last_peered":"2024-09-21T05:51:47.373406+0000","last_clean":"2024-09-21T05:51:47.373406+0000","last_became_active":"2024-09-21T05:50:53.896977+0000","last_became_peered":"2024-09-21T05:50:53.896977+0000","last_unstale":"2024-09-21T05:51:47.373406+0000","last_undegraded":"2024-09-21T05:51:47.373406+0000","last_fullsized":"2024-09-21T05:51:47.373406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:35.538322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.587757+0000","last_change":"2024-09-21T05:51:03.939519+0000","last_active":"2024-09-21T05:51:47.587757+0000","last_peered":"2024-09-21T05:51:47.587757+0000","last_clean":"2024-09-21T05:51:47.587757+0000","last_became_active":"2024-09-21T05:51:03.938429+0000","last_became_peered":"2024-09-21T05:51:03.938429+0000","last_unstale":"2024-09-21T05:51:47.587757+0000","last_undegraded":"2024-09-21T05:51:47.587757+0000","last_fullsized":"2024-09-21T05:51:47.587757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:09.236561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369602+0000","last_change":"2024-09-21T05:50:50.847640+0000","last_active":"2024-09-21T05:51:47.369602+0000","last_peered":"2024-09-21T05:51:47.369602+0000","last_clean":"2024-09-21T05:51:47.369602+0000","last_became_active":"2024-09-21T05:50:50.847101+0000","last_became_peered":"2024-09-21T05:50:50.847101+0000","last_unstale":"2024-09-21T05:51:47.369602+0000","last_undegraded":"2024-09-21T05:51:47.369602+0000","last_fullsized":"2024-09-21T05:51:47.369602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:09.087655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374139+0000","last_change":"2024-09-21T05:50:53.889855+0000","last_active":"2024-09-21T05:51:47.374139+0000","last_peered":"2024-09-21T05:51:47.374139+0000","last_clean":"2024-09-21T05:51:47.374139+0000","last_became_active":"2024-09-21T05:50:53.889444+0000","last_became_peered":"2024-09-21T05:50:53.889444+0000","last_unstale":"2024-09-21T05:51:47.374139+0000","last_undegraded":"2024-09-21T05:51:47.374139+0000","last_fullsized":"2024-09-21T05:51:47.374139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:47.480986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.587436+0000","last_change":"2024-09-21T05:51:03.946866+0000","last_active":"2024-09-21T05:51:47.587436+0000","last_peered":"2024-09-21T05:51:47.587436+0000","last_clean":"2024-09-21T05:51:47.587436+0000","last_became_active":"2024-09-21T05:51:03.946332+0000","last_became_peered":"2024-09-21T05:51:03.946332+0000","last_unstale":"2024-09-21T05:51:47.587436+0000","last_undegraded":"2024-09-21T05:51:47.587436+0000","last_fullsized":"2024-09-21T05:51:47.587436+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:43.527937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.587207+0000","last_change":"2024-09-21T05:50:53.900395+0000","last_active":"2024-09-21T05:51:47.587207+0000","last_peered":"2024-09-21T05:51:47.587207+0000","last_clean":"2024-09-21T05:51:47.587207+0000","last_became_active":"2024-09-21T05:50:53.894925+0000","last_became_peered":"2024-09-21T05:50:53.894925+0000","last_unstale":"2024-09-21T05:51:47.587207+0000","last_undegraded":"2024-09-21T05:51:47.587207+0000","last_fullsized":"2024-09-21T05:51:47.587207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.939120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369874+0000","last_change":"2024-09-21T05:50:50.851145+0000","last_active":"2024-09-21T05:51:47.369874+0000","last_peered":"2024-09-21T05:51:47.369874+0000","last_clean":"2024-09-21T05:51:47.369874+0000","last_became_active":"2024-09-21T05:50:50.850641+0000","last_became_peered":"2024-09-21T05:50:50.850641+0000","last_unstale":"2024-09-21T05:51:47.369874+0000","last_undegraded":"2024-09-21T05:51:47.369874+0000","last_fullsized":"2024-09-21T05:51:47.369874+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:34.560798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588783+0000","last_change":"2024-09-21T05:51:03.991798+0000","last_active":"2024-09-21T05:51:47.588783+0000","last_peered":"2024-09-21T05:51:47.588783+0000","last_clean":"2024-09-21T05:51:47.588783+0000","last_became_active":"2024-09-21T05:51:03.991173+0000","last_became_peered":"2024-09-21T05:51:03.991173+0000","last_unstale":"2024-09-21T05:51:47.588783+0000","last_undegraded":"2024-09-21T05:51:47.588783+0000","last_fullsized":"2024-09-21T05:51:47.588783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:46.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365996+0000","last_change":"2024-09-21T05:50:53.892293+0000","last_active":"2024-09-21T05:51:47.365996+0000","last_peered":"2024-09-21T05:51:47.365996+0000","last_clean":"2024-09-21T05:51:47.365996+0000","last_became_active":"2024-09-21T05:50:53.891814+0000","last_became_peered":"2024-09-21T05:50:53.891814+0000","last_unstale":"2024-09-21T05:51:47.365996+0000","last_undegraded":"2024-09-21T05:51:47.365996+0000","last_fullsized":"2024-09-21T05:51:47.365996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:14.810409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366736+0000","last_change":"2024-09-21T05:50:50.846360+0000","last_active":"2024-09-21T05:51:47.366736+0000","last_peered":"2024-09-21T05:51:47.366736+0000","last_clean":"2024-09-21T05:51:47.366736+0000","last_became_active":"2024-09-21T05:50:50.845972+0000","last_became_peered":"2024-09-21T05:50:50.845972+0000","last_unstale":"2024-09-21T05:51:47.366736+0000","last_undegraded":"2024-09-21T05:51:47.366736+0000","last_fullsized":"2024-09-21T05:51:47.366736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.023239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588086+0000","last_change":"2024-09-21T05:51:03.938903+0000","last_active":"2024-09-21T05:51:47.588086+0000","last_peered":"2024-09-21T05:51:47.588086+0000","last_clean":"2024-09-21T05:51:47.588086+0000","last_became_active":"2024-09-21T05:51:03.938312+0000","last_became_peered":"2024-09-21T05:51:03.938312+0000","last_unstale":"2024-09-21T05:51:47.588086+0000","last_undegraded":"2024-09-21T05:51:47.588086+0000","last_fullsized":"2024-09-21T05:51:47.588086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:01.851758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371265+0000","last_change":"2024-09-21T05:50:53.907529+0000","last_active":"2024-09-21T05:51:47.371265+0000","last_peered":"2024-09-21T05:51:47.371265+0000","last_clean":"2024-09-21T05:51:47.371265+0000","last_became_active":"2024-09-21T05:50:53.907154+0000","last_became_peered":"2024-09-21T05:50:53.907154+0000","last_unstale":"2024-09-21T05:51:47.371265+0000","last_undegraded":"2024-09-21T05:51:47.371265+0000","last_fullsized":"2024-09-21T05:51:47.371265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:22.586642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365856+0000","last_change":"2024-09-21T05:50:50.838939+0000","last_active":"2024-09-21T05:51:47.365856+0000","last_peered":"2024-09-21T05:51:47.365856+0000","last_clean":"2024-09-21T05:51:47.365856+0000","last_became_active":"2024-09-21T05:50:50.838457+0000","last_became_peered":"2024-09-21T05:50:50.838457+0000","last_unstale":"2024-09-21T05:51:47.365856+0000","last_undegraded":"2024-09-21T05:51:47.365856+0000","last_fullsized":"2024-09-21T05:51:47.365856+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:54.259046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369307+0000","last_change":"2024-09-21T05:51:03.944824+0000","last_active":"2024-09-21T05:51:47.369307+0000","last_peered":"2024-09-21T05:51:47.369307+0000","last_clean":"2024-09-21T05:51:47.369307+0000","last_became_active":"2024-09-21T05:51:03.938856+0000","last_became_peered":"2024-09-21T05:51:03.938856+0000","last_unstale":"2024-09-21T05:51:47.369307+0000","last_undegraded":"2024-09-21T05:51:47.369307+0000","last_fullsized":"2024-09-21T05:51:47.369307+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:12.111775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369662+0000","last_change":"2024-09-21T05:50:53.891676+0000","last_active":"2024-09-21T05:51:47.369662+0000","last_peered":"2024-09-21T05:51:47.369662+0000","last_clean":"2024-09-21T05:51:47.369662+0000","last_became_active":"2024-09-21T05:50:53.891339+0000","last_became_peered":"2024-09-21T05:50:53.891339+0000","last_unstale":"2024-09-21T05:51:47.369662+0000","last_undegraded":"2024-09-21T05:51:47.369662+0000","last_fullsized":"2024-09-21T05:51:47.369662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:41.707680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373779+0000","last_change":"2024-09-21T05:50:51.162492+0000","last_active":"2024-09-21T05:51:47.373779+0000","last_peered":"2024-09-21T05:51:47.373779+0000","last_clean":"2024-09-21T05:51:47.373779+0000","last_became_active":"2024-09-21T05:50:51.162108+0000","last_became_peered":"2024-09-21T05:50:51.162108+0000","last_unstale":"2024-09-21T05:51:47.373779+0000","last_undegraded":"2024-09-21T05:51:47.373779+0000","last_fullsized":"2024-09-21T05:51:47.373779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.387568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588801+0000","last_change":"2024-09-21T05:51:03.992550+0000","last_active":"2024-09-21T05:51:47.588801+0000","last_peered":"2024-09-21T05:51:47.588801+0000","last_clean":"2024-09-21T05:51:47.588801+0000","last_became_active":"2024-09-21T05:51:03.991865+0000","last_became_peered":"2024-09-21T05:51:03.991865+0000","last_unstale":"2024-09-21T05:51:47.588801+0000","last_undegraded":"2024-09-21T05:51:47.588801+0000","last_fullsized":"2024-09-21T05:51:47.588801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:50.204058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375601+0000","last_change":"2024-09-21T05:50:53.884376+0000","last_active":"2024-09-21T05:51:47.375601+0000","last_peered":"2024-09-21T05:51:47.375601+0000","last_clean":"2024-09-21T05:51:47.375601+0000","last_became_active":"2024-09-21T05:50:53.884033+0000","last_became_peered":"2024-09-21T05:50:53.884033+0000","last_unstale":"2024-09-21T05:51:47.375601+0000","last_undegraded":"2024-09-21T05:51:47.375601+0000","last_fullsized":"2024-09-21T05:51:47.375601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.359191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.589120+0000","last_change":"2024-09-21T05:50:50.869502+0000","last_active":"2024-09-21T05:51:47.589120+0000","last_peered":"2024-09-21T05:51:47.589120+0000","last_clean":"2024-09-21T05:51:47.589120+0000","last_became_active":"2024-09-21T05:50:50.869071+0000","last_became_peered":"2024-09-21T05:50:50.869071+0000","last_unstale":"2024-09-21T05:51:47.589120+0000","last_undegraded":"2024-09-21T05:51:47.589120+0000","last_fullsized":"2024-09-21T05:51:47.589120+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:48.364902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.367179+0000","last_change":"2024-09-21T05:51:03.931945+0000","last_active":"2024-09-21T05:51:47.367179+0000","last_peered":"2024-09-21T05:51:47.367179+0000","last_clean":"2024-09-21T05:51:47.367179+0000","last_became_active":"2024-09-21T05:51:03.931411+0000","last_became_peered":"2024-09-21T05:51:03.931411+0000","last_unstale":"2024-09-21T05:51:47.367179+0000","last_undegraded":"2024-09-21T05:51:47.367179+0000","last_fullsized":"2024-09-21T05:51:47.367179+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.910547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366483+0000","last_change":"2024-09-21T05:50:53.897995+0000","last_active":"2024-09-21T05:51:47.366483+0000","last_peered":"2024-09-21T05:51:47.366483+0000","last_clean":"2024-09-21T05:51:47.366483+0000","last_became_active":"2024-09-21T05:50:53.895797+0000","last_became_peered":"2024-09-21T05:50:53.895797+0000","last_unstale":"2024-09-21T05:51:47.366483+0000","last_undegraded":"2024-09-21T05:51:47.366483+0000","last_fullsized":"2024-09-21T05:51:47.366483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.484867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'8","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:52:02.908849+0000","last_change":"2024-09-21T05:50:50.845853+0000","last_active":"2024-09-21T05:52:02.908849+0000","last_peered":"2024-09-21T05:52:02.908849+0000","last_clean":"2024-09-21T05:52:02.908849+0000","last_became_active":"2024-09-21T05:50:50.845495+0000","last_became_peered":"2024-09-21T05:50:50.845495+0000","last_unstale":"2024-09-21T05:52:02.908849+0000","last_undegraded":"2024-09-21T05:52:02.908849+0000","last_fullsized":"2024-09-21T05:52:02.908849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:47.960498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365413+0000","last_change":"2024-09-21T05:51:03.991380+0000","last_active":"2024-09-21T05:51:47.365413+0000","last_peered":"2024-09-21T05:51:47.365413+0000","last_clean":"2024-09-21T05:51:47.365413+0000","last_became_active":"2024-09-21T05:51:03.990911+0000","last_became_peered":"2024-09-21T05:51:03.990911+0000","last_unstale":"2024-09-21T05:51:47.365413+0000","last_undegraded":"2024-09-21T05:51:47.365413+0000","last_fullsized":"2024-09-21T05:51:47.365413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:01.779692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372777+0000","last_change":"2024-09-21T05:50:53.910190+0000","last_active":"2024-09-21T05:51:47.372777+0000","last_peered":"2024-09-21T05:51:47.372777+0000","last_clean":"2024-09-21T05:51:47.372777+0000","last_became_active":"2024-09-21T05:50:53.909649+0000","last_became_peered":"2024-09-21T05:50:53.909649+0000","last_unstale":"2024-09-21T05:51:47.372777+0000","last_undegraded":"2024-09-21T05:51:47.372777+0000","last_fullsized":"2024-09-21T05:51:47.372777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:14.582217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.370932+0000","last_change":"2024-09-21T05:50:51.163512+0000","last_active":"2024-09-21T05:51:47.370932+0000","last_peered":"2024-09-21T05:51:47.370932+0000","last_clean":"2024-09-21T05:51:47.370932+0000","last_became_active":"2024-09-21T05:50:51.161959+0000","last_became_peered":"2024-09-21T05:50:51.161959+0000","last_unstale":"2024-09-21T05:51:47.370932+0000","last_undegraded":"2024-09-21T05:51:47.370932+0000","last_fullsized":"2024-09-21T05:51:47.370932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:51.701990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371419+0000","last_change":"2024-09-21T05:51:03.936815+0000","last_active":"2024-09-21T05:51:47.371419+0000","last_peered":"2024-09-21T05:51:47.371419+0000","last_clean":"2024-09-21T05:51:47.371419+0000","last_became_active":"2024-09-21T05:51:03.936365+0000","last_became_peered":"2024-09-21T05:51:03.936365+0000","last_unstale":"2024-09-21T05:51:47.371419+0000","last_undegraded":"2024-09-21T05:51:47.371419+0000","last_fullsized":"2024-09-21T05:51:47.371419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:59.820159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366723+0000","last_change":"2024-09-21T05:50:53.892772+0000","last_active":"2024-09-21T05:51:47.366723+0000","last_peered":"2024-09-21T05:51:47.366723+0000","last_clean":"2024-09-21T05:51:47.366723+0000","last_became_active":"2024-09-21T05:50:53.892378+0000","last_became_peered":"2024-09-21T05:50:53.892378+0000","last_unstale":"2024-09-21T05:51:47.366723+0000","last_undegraded":"2024-09-21T05:51:47.366723+0000","last_fullsized":"2024-09-21T05:51:47.366723+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:34.438067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.378249+0000","last_change":"2024-09-21T05:51:47.378160+0000","last_active":"2024-09-21T05:51:47.378249+0000","last_peered":"2024-09-21T05:51:47.378249+0000","last_clean":"2024-09-21T05:51:47.378249+0000","last_became_active":"2024-09-21T05:51:47.377779+0000","last_became_peered":"2024-09-21T05:51:47.377779+0000","last_unstale":"2024-09-21T05:51:47.378249+0000","last_undegraded":"2024-09-21T05:51:47.378249+0000","last_fullsized":"2024-09-21T05:51:47.378249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:27.780273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369167+0000","last_change":"2024-09-21T05:51:03.990917+0000","last_active":"2024-09-21T05:51:47.369167+0000","last_peered":"2024-09-21T05:51:47.369167+0000","last_clean":"2024-09-21T05:51:47.369167+0000","last_became_active":"2024-09-21T05:51:03.990358+0000","last_became_peered":"2024-09-21T05:51:03.990358+0000","last_unstale":"2024-09-21T05:51:47.369167+0000","last_undegraded":"2024-09-21T05:51:47.369167+0000","last_fullsized":"2024-09-21T05:51:47.369167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:34.477923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366753+0000","last_change":"2024-09-21T05:50:53.899306+0000","last_active":"2024-09-21T05:51:47.366753+0000","last_peered":"2024-09-21T05:51:47.366753+0000","last_clean":"2024-09-21T05:51:47.366753+0000","last_became_active":"2024-09-21T05:50:53.898921+0000","last_became_peered":"2024-09-21T05:50:53.898921+0000","last_unstale":"2024-09-21T05:51:47.366753+0000","last_undegraded":"2024-09-21T05:51:47.366753+0000","last_fullsized":"2024-09-21T05:51:47.366753+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:45.698584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.587317+0000","last_change":"2024-09-21T05:50:50.844394+0000","last_active":"2024-09-21T05:51:47.587317+0000","last_peered":"2024-09-21T05:51:47.587317+0000","last_clean":"2024-09-21T05:51:47.587317+0000","last_became_active":"2024-09-21T05:50:50.843771+0000","last_became_peered":"2024-09-21T05:50:50.843771+0000","last_unstale":"2024-09-21T05:51:47.587317+0000","last_undegraded":"2024-09-21T05:51:47.587317+0000","last_fullsized":"2024-09-21T05:51:47.587317+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:14.372917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372541+0000","last_change":"2024-09-21T05:51:03.941277+0000","last_active":"2024-09-21T05:51:47.372541+0000","last_peered":"2024-09-21T05:51:47.372541+0000","last_clean":"2024-09-21T05:51:47.372541+0000","last_became_active":"2024-09-21T05:51:03.940659+0000","last_became_peered":"2024-09-21T05:51:03.940659+0000","last_unstale":"2024-09-21T05:51:47.372541+0000","last_undegraded":"2024-09-21T05:51:47.372541+0000","last_fullsized":"2024-09-21T05:51:47.372541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:40.217023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374308+0000","last_change":"2024-09-21T05:50:53.895399+0000","last_active":"2024-09-21T05:51:47.374308+0000","last_peered":"2024-09-21T05:51:47.374308+0000","last_clean":"2024-09-21T05:51:47.374308+0000","last_became_active":"2024-09-21T05:50:53.895022+0000","last_became_peered":"2024-09-21T05:50:53.895022+0000","last_unstale":"2024-09-21T05:51:47.374308+0000","last_undegraded":"2024-09-21T05:51:47.374308+0000","last_fullsized":"2024-09-21T05:51:47.374308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:02.056015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372089+0000","last_change":"2024-09-21T05:50:51.162215+0000","last_active":"2024-09-21T05:51:47.372089+0000","last_peered":"2024-09-21T05:51:47.372089+0000","last_clean":"2024-09-21T05:51:47.372089+0000","last_became_active":"2024-09-21T05:50:51.161812+0000","last_became_peered":"2024-09-21T05:50:51.161812+0000","last_unstale":"2024-09-21T05:51:47.372089+0000","last_undegraded":"2024-09-21T05:51:47.372089+0000","last_fullsized":"2024-09-21T05:51:47.372089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:05.237806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373023+0000","last_change":"2024-09-21T05:51:03.991488+0000","last_active":"2024-09-21T05:51:47.373023+0000","last_peered":"2024-09-21T05:51:47.373023+0000","last_clean":"2024-09-21T05:51:47.373023+0000","last_became_active":"2024-09-21T05:51:03.990866+0000","last_became_peered":"2024-09-21T05:51:03.990866+0000","last_unstale":"2024-09-21T05:51:47.373023+0000","last_undegraded":"2024-09-21T05:51:47.373023+0000","last_fullsized":"2024-09-21T05:51:47.373023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:41.061421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371826+0000","last_change":"2024-09-21T05:50:53.895076+0000","last_active":"2024-09-21T05:51:47.371826+0000","last_peered":"2024-09-21T05:51:47.371826+0000","last_clean":"2024-09-21T05:51:47.371826+0000","last_became_active":"2024-09-21T05:50:53.893888+0000","last_became_peered":"2024-09-21T05:50:53.893888+0000","last_unstale":"2024-09-21T05:51:47.371826+0000","last_undegraded":"2024-09-21T05:51:47.371826+0000","last_fullsized":"2024-09-21T05:51:47.371826+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:13.397806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.376650+0000","last_change":"2024-09-21T05:51:47.376540+0000","last_active":"2024-09-21T05:51:47.376650+0000","last_peered":"2024-09-21T05:51:47.376650+0000","last_clean":"2024-09-21T05:51:47.376650+0000","last_became_active":"2024-09-21T05:51:47.376163+0000","last_became_peered":"2024-09-21T05:51:47.376163+0000","last_unstale":"2024-09-21T05:51:47.376650+0000","last_undegraded":"2024-09-21T05:51:47.376650+0000","last_fullsized":"2024-09-21T05:51:47.376650+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:51.217674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374929+0000","last_change":"2024-09-21T05:51:03.991711+0000","last_active":"2024-09-21T05:51:47.374929+0000","last_peered":"2024-09-21T05:51:47.374929+0000","last_clean":"2024-09-21T05:51:47.374929+0000","last_became_active":"2024-09-21T05:51:03.991200+0000","last_became_peered":"2024-09-21T05:51:03.991200+0000","last_unstale":"2024-09-21T05:51:47.374929+0000","last_undegraded":"2024-09-21T05:51:47.374929+0000","last_fullsized":"2024-09-21T05:51:47.374929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:40.981303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365707+0000","last_change":"2024-09-21T05:50:53.887913+0000","last_active":"2024-09-21T05:51:47.365707+0000","last_peered":"2024-09-21T05:51:47.365707+0000","last_clean":"2024-09-21T05:51:47.365707+0000","last_became_active":"2024-09-21T05:50:53.887583+0000","last_became_peered":"2024-09-21T05:50:53.887583+0000","last_unstale":"2024-09-21T05:51:47.365707+0000","last_undegraded":"2024-09-21T05:51:47.365707+0000","last_fullsized":"2024-09-21T05:51:47.365707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:05.941780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588026+0000","last_change":"2024-09-21T05:50:50.846370+0000","last_active":"2024-09-21T05:51:47.588026+0000","last_peered":"2024-09-21T05:51:47.588026+0000","last_clean":"2024-09-21T05:51:47.588026+0000","last_became_active":"2024-09-21T05:50:50.845890+0000","last_became_peered":"2024-09-21T05:50:50.845890+0000","last_unstale":"2024-09-21T05:51:47.588026+0000","last_undegraded":"2024-09-21T05:51:47.588026+0000","last_fullsized":"2024-09-21T05:51:47.588026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:15.180734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":113,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586489+0000","last_change":"2024-09-21T05:49:33.762460+0000","last_active":"2024-09-21T05:51:47.586489+0000","last_peered":"2024-09-21T05:51:47.586489+0000","last_clean":"2024-09-21T05:51:47.586489+0000","last_became_active":"2024-09-21T05:49:33.705194+0000","last_became_peered":"2024-09-21T05:49:33.705194+0000","last_unstale":"2024-09-21T05:51:47.586489+0000","last_undegraded":"2024-09-21T05:51:47.586489+0000","last_fullsized":"2024-09-21T05:51:47.586489+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_clean_scrub_stamp":"2024-09-21T05:45:49.237325+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:39.194122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586837+0000","last_change":"2024-09-21T05:51:03.938790+0000","last_active":"2024-09-21T05:51:47.586837+0000","last_peered":"2024-09-21T05:51:47.586837+0000","last_clean":"2024-09-21T05:51:47.586837+0000","last_became_active":"2024-09-21T05:51:03.938214+0000","last_became_peered":"2024-09-21T05:51:03.938214+0000","last_unstale":"2024-09-21T05:51:47.586837+0000","last_undegraded":"2024-09-21T05:51:47.586837+0000","last_fullsized":"2024-09-21T05:51:47.586837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:11.512500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586886+0000","last_change":"2024-09-21T05:50:53.893475+0000","last_active":"2024-09-21T05:51:47.586886+0000","last_peered":"2024-09-21T05:51:47.586886+0000","last_clean":"2024-09-21T05:51:47.586886+0000","last_became_active":"2024-09-21T05:50:53.892946+0000","last_became_peered":"2024-09-21T05:50:53.892946+0000","last_unstale":"2024-09-21T05:51:47.586886+0000","last_undegraded":"2024-09-21T05:51:47.586886+0000","last_fullsized":"2024-09-21T05:51:47.586886+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:23.612285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.367338+0000","last_change":"2024-09-21T05:50:51.162170+0000","last_active":"2024-09-21T05:51:47.367338+0000","last_peered":"2024-09-21T05:51:47.367338+0000","last_clean":"2024-09-21T05:51:47.367338+0000","last_became_active":"2024-09-21T05:50:51.161685+0000","last_became_peered":"2024-09-21T05:50:51.161685+0000","last_unstale":"2024-09-21T05:51:47.367338+0000","last_undegraded":"2024-09-21T05:51:47.367338+0000","last_fullsized":"2024-09-21T05:51:47.367338+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:14.922423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373166+0000","last_change":"2024-09-21T05:51:03.937061+0000","last_active":"2024-09-21T05:51:47.373166+0000","last_peered":"2024-09-21T05:51:47.373166+0000","last_clean":"2024-09-21T05:51:47.373166+0000","last_became_active":"2024-09-21T05:51:03.936306+0000","last_became_peered":"2024-09-21T05:51:03.936306+0000","last_unstale":"2024-09-21T05:51:47.373166+0000","last_undegraded":"2024-09-21T05:51:47.373166+0000","last_fullsized":"2024-09-21T05:51:47.373166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:51.057973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586666+0000","last_change":"2024-09-21T05:50:53.893930+0000","last_active":"2024-09-21T05:51:47.586666+0000","last_peered":"2024-09-21T05:51:47.586666+0000","last_clean":"2024-09-21T05:51:47.586666+0000","last_became_active":"2024-09-21T05:50:53.893155+0000","last_became_peered":"2024-09-21T05:50:53.893155+0000","last_unstale":"2024-09-21T05:51:47.586666+0000","last_undegraded":"2024-09-21T05:51:47.586666+0000","last_fullsized":"2024-09-21T05:51:47.586666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:46.097408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375436+0000","last_change":"2024-09-21T05:50:50.847890+0000","last_active":"2024-09-21T05:51:47.375436+0000","last_peered":"2024-09-21T05:51:47.375436+0000","last_clean":"2024-09-21T05:51:47.375436+0000","last_became_active":"2024-09-21T05:50:50.847549+0000","last_became_peered":"2024-09-21T05:50:50.847549+0000","last_unstale":"2024-09-21T05:51:47.375436+0000","last_undegraded":"2024-09-21T05:51:47.375436+0000","last_fullsized":"2024-09-21T05:51:47.375436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:14.998849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375137+0000","last_change":"2024-09-21T05:51:03.940674+0000","last_active":"2024-09-21T05:51:47.375137+0000","last_peered":"2024-09-21T05:51:47.375137+0000","last_clean":"2024-09-21T05:51:47.375137+0000","last_became_active":"2024-09-21T05:51:03.940222+0000","last_became_peered":"2024-09-21T05:51:03.940222+0000","last_unstale":"2024-09-21T05:51:47.375137+0000","last_undegraded":"2024-09-21T05:51:47.375137+0000","last_fullsized":"2024-09-21T05:51:47.375137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:58.497147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586887+0000","last_change":"2024-09-21T05:50:53.895191+0000","last_active":"2024-09-21T05:51:47.586887+0000","last_peered":"2024-09-21T05:51:47.586887+0000","last_clean":"2024-09-21T05:51:47.586887+0000","last_became_active":"2024-09-21T05:50:53.892894+0000","last_became_peered":"2024-09-21T05:50:53.892894+0000","last_unstale":"2024-09-21T05:51:47.586887+0000","last_undegraded":"2024-09-21T05:51:47.586887+0000","last_fullsized":"2024-09-21T05:51:47.586887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:41.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372859+0000","last_change":"2024-09-21T05:50:50.844301+0000","last_active":"2024-09-21T05:51:47.372859+0000","last_peered":"2024-09-21T05:51:47.372859+0000","last_clean":"2024-09-21T05:51:47.372859+0000","last_became_active":"2024-09-21T05:50:50.843878+0000","last_became_peered":"2024-09-21T05:50:50.843878+0000","last_unstale":"2024-09-21T05:51:47.372859+0000","last_undegraded":"2024-09-21T05:51:47.372859+0000","last_fullsized":"2024-09-21T05:51:47.372859+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:53.150300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373824+0000","last_change":"2024-09-21T05:51:03.931684+0000","last_active":"2024-09-21T05:51:47.373824+0000","last_peered":"2024-09-21T05:51:47.373824+0000","last_clean":"2024-09-21T05:51:47.373824+0000","last_became_active":"2024-09-21T05:51:03.931225+0000","last_became_peered":"2024-09-21T05:51:03.931225+0000","last_unstale":"2024-09-21T05:51:47.373824+0000","last_undegraded":"2024-09-21T05:51:47.373824+0000","last_fullsized":"2024-09-21T05:51:47.373824+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:51.993481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372066+0000","last_change":"2024-09-21T05:50:53.892740+0000","last_active":"2024-09-21T05:51:47.372066+0000","last_peered":"2024-09-21T05:51:47.372066+0000","last_clean":"2024-09-21T05:51:47.372066+0000","last_became_active":"2024-09-21T05:50:53.892381+0000","last_became_peered":"2024-09-21T05:50:53.892381+0000","last_unstale":"2024-09-21T05:51:47.372066+0000","last_undegraded":"2024-09-21T05:51:47.372066+0000","last_fullsized":"2024-09-21T05:51:47.372066+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:20.038644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.370292+0000","last_change":"2024-09-21T05:50:50.850077+0000","last_active":"2024-09-21T05:51:47.370292+0000","last_peered":"2024-09-21T05:51:47.370292+0000","last_clean":"2024-09-21T05:51:47.370292+0000","last_became_active":"2024-09-21T05:50:50.849553+0000","last_became_peered":"2024-09-21T05:50:50.849553+0000","last_unstale":"2024-09-21T05:51:47.370292+0000","last_undegraded":"2024-09-21T05:51:47.370292+0000","last_fullsized":"2024-09-21T05:51:47.370292+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:09.764465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373855+0000","last_change":"2024-09-21T05:51:03.930231+0000","last_active":"2024-09-21T05:51:47.373855+0000","last_peered":"2024-09-21T05:51:47.373855+0000","last_clean":"2024-09-21T05:51:47.373855+0000","last_became_active":"2024-09-21T05:51:03.929907+0000","last_became_peered":"2024-09-21T05:51:03.929907+0000","last_unstale":"2024-09-21T05:51:47.373855+0000","last_undegraded":"2024-09-21T05:51:47.373855+0000","last_fullsized":"2024-09-21T05:51:47.373855+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:18.829725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375259+0000","last_change":"2024-09-21T05:50:53.888988+0000","last_active":"2024-09-21T05:51:47.375259+0000","last_peered":"2024-09-21T05:51:47.375259+0000","last_clean":"2024-09-21T05:51:47.375259+0000","last_became_active":"2024-09-21T05:50:53.888599+0000","last_became_peered":"2024-09-21T05:50:53.888599+0000","last_unstale":"2024-09-21T05:51:47.375259+0000","last_undegraded":"2024-09-21T05:51:47.375259+0000","last_fullsized":"2024-09-21T05:51:47.375259+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:32.353201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.383596+0000","last_change":"2024-09-21T05:51:47.383528+0000","last_active":"2024-09-21T05:51:47.383596+0000","last_peered":"2024-09-21T05:51:47.383596+0000","last_clean":"2024-09-21T05:51:47.383596+0000","last_became_active":"2024-09-21T05:51:47.376325+0000","last_became_peered":"2024-09-21T05:51:47.376325+0000","last_unstale":"2024-09-21T05:51:47.383596+0000","last_undegraded":"2024-09-21T05:51:47.383596+0000","last_fullsized":"2024-09-21T05:51:47.383596+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:47.659961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372841+0000","last_change":"2024-09-21T05:51:03.946581+0000","last_active":"2024-09-21T05:51:47.372841+0000","last_peered":"2024-09-21T05:51:47.372841+0000","last_clean":"2024-09-21T05:51:47.372841+0000","last_became_active":"2024-09-21T05:51:03.946170+0000","last_became_peered":"2024-09-21T05:51:03.946170+0000","last_unstale":"2024-09-21T05:51:47.372841+0000","last_undegraded":"2024-09-21T05:51:47.372841+0000","last_fullsized":"2024-09-21T05:51:47.372841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:59.302647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586192+0000","last_change":"2024-09-21T05:50:53.890164+0000","last_active":"2024-09-21T05:51:47.586192+0000","last_peered":"2024-09-21T05:51:47.586192+0000","last_clean":"2024-09-21T05:51:47.586192+0000","last_became_active":"2024-09-21T05:50:53.889309+0000","last_became_peered":"2024-09-21T05:50:53.889309+0000","last_unstale":"2024-09-21T05:51:47.586192+0000","last_undegraded":"2024-09-21T05:51:47.586192+0000","last_fullsized":"2024-09-21T05:51:47.586192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:18.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.587893+0000","last_change":"2024-09-21T05:50:50.844080+0000","last_active":"2024-09-21T05:51:47.587893+0000","last_peered":"2024-09-21T05:51:47.587893+0000","last_clean":"2024-09-21T05:51:47.587893+0000","last_became_active":"2024-09-21T05:50:50.842929+0000","last_became_peered":"2024-09-21T05:50:50.842929+0000","last_unstale":"2024-09-21T05:51:47.587893+0000","last_undegraded":"2024-09-21T05:51:47.587893+0000","last_fullsized":"2024-09-21T05:51:47.587893+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:49.623189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369421+0000","last_change":"2024-09-21T05:51:03.939228+0000","last_active":"2024-09-21T05:51:47.369421+0000","last_peered":"2024-09-21T05:51:47.369421+0000","last_clean":"2024-09-21T05:51:47.369421+0000","last_became_active":"2024-09-21T05:51:03.937857+0000","last_became_peered":"2024-09-21T05:51:03.937857+0000","last_unstale":"2024-09-21T05:51:47.369421+0000","last_undegraded":"2024-09-21T05:51:47.369421+0000","last_fullsized":"2024-09-21T05:51:47.369421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:54.147008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586313+0000","last_change":"2024-09-21T05:50:53.890755+0000","last_active":"2024-09-21T05:51:47.586313+0000","last_peered":"2024-09-21T05:51:47.586313+0000","last_clean":"2024-09-21T05:51:47.586313+0000","last_became_active":"2024-09-21T05:50:53.890286+0000","last_became_peered":"2024-09-21T05:50:53.890286+0000","last_unstale":"2024-09-21T05:51:47.586313+0000","last_undegraded":"2024-09-21T05:51:47.586313+0000","last_fullsized":"2024-09-21T05:51:47.586313+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:50.767355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374399+0000","last_change":"2024-09-21T05:50:50.852722+0000","last_active":"2024-09-21T05:51:47.374399+0000","last_peered":"2024-09-21T05:51:47.374399+0000","last_clean":"2024-09-21T05:51:47.374399+0000","last_became_active":"2024-09-21T05:50:50.852211+0000","last_became_peered":"2024-09-21T05:50:50.852211+0000","last_unstale":"2024-09-21T05:51:47.374399+0000","last_undegraded":"2024-09-21T05:51:47.374399+0000","last_fullsized":"2024-09-21T05:51:47.374399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:44.392153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371509+0000","last_change":"2024-09-21T05:51:03.946552+0000","last_active":"2024-09-21T05:51:47.371509+0000","last_peered":"2024-09-21T05:51:47.371509+0000","last_clean":"2024-09-21T05:51:47.371509+0000","last_became_active":"2024-09-21T05:51:03.946093+0000","last_became_peered":"2024-09-21T05:51:03.946093+0000","last_unstale":"2024-09-21T05:51:47.371509+0000","last_undegraded":"2024-09-21T05:51:47.371509+0000","last_fullsized":"2024-09-21T05:51:47.371509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:46.897990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371647+0000","last_change":"2024-09-21T05:50:53.903935+0000","last_active":"2024-09-21T05:51:47.371647+0000","last_peered":"2024-09-21T05:51:47.371647+0000","last_clean":"2024-09-21T05:51:47.371647+0000","last_became_active":"2024-09-21T05:50:53.903604+0000","last_became_peered":"2024-09-21T05:50:53.903604+0000","last_unstale":"2024-09-21T05:51:47.371647+0000","last_undegraded":"2024-09-21T05:51:47.371647+0000","last_fullsized":"2024-09-21T05:51:47.371647+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:49.552901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.367135+0000","last_change":"2024-09-21T05:50:50.848254+0000","last_active":"2024-09-21T05:51:47.367135+0000","last_peered":"2024-09-21T05:51:47.367135+0000","last_clean":"2024-09-21T05:51:47.367135+0000","last_became_active":"2024-09-21T05:50:50.847834+0000","last_became_peered":"2024-09-21T05:50:50.847834+0000","last_unstale":"2024-09-21T05:51:47.367135+0000","last_undegraded":"2024-09-21T05:51:47.367135+0000","last_fullsized":"2024-09-21T05:51:47.367135+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:36.579763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375443+0000","last_change":"2024-09-21T05:51:03.941732+0000","last_active":"2024-09-21T05:51:47.375443+0000","last_peered":"2024-09-21T05:51:47.375443+0000","last_clean":"2024-09-21T05:51:47.375443+0000","last_became_active":"2024-09-21T05:51:03.941144+0000","last_became_peered":"2024-09-21T05:51:03.941144+0000","last_unstale":"2024-09-21T05:51:47.375443+0000","last_undegraded":"2024-09-21T05:51:47.375443+0000","last_fullsized":"2024-09-21T05:51:47.375443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:38.117642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.370797+0000","last_change":"2024-09-21T05:50:53.904574+0000","last_active":"2024-09-21T05:51:47.370797+0000","last_peered":"2024-09-21T05:51:47.370797+0000","last_clean":"2024-09-21T05:51:47.370797+0000","last_became_active":"2024-09-21T05:50:53.904215+0000","last_became_peered":"2024-09-21T05:50:53.904215+0000","last_unstale":"2024-09-21T05:51:47.370797+0000","last_undegraded":"2024-09-21T05:51:47.370797+0000","last_fullsized":"2024-09-21T05:51:47.370797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:49.662725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'30","reported_seq":116,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:52:05.418650+0000","last_change":"2024-09-21T05:50:50.850929+0000","last_active":"2024-09-21T05:52:05.418650+0000","last_peered":"2024-09-21T05:52:05.418650+0000","last_clean":"2024-09-21T05:52:05.418650+0000","last_became_active":"2024-09-21T05:50:50.850495+0000","last_became_peered":"2024-09-21T05:50:50.850495+0000","last_unstale":"2024-09-21T05:52:05.418650+0000","last_undegraded":"2024-09-21T05:52:05.418650+0000","last_fullsized":"2024-09-21T05:52:05.418650+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:45.224063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63864,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":45,"num_read_kb":80,"num_write":30,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369378+0000","last_change":"2024-09-21T05:51:03.944010+0000","last_active":"2024-09-21T05:51:47.369378+0000","last_peered":"2024-09-21T05:51:47.369378+0000","last_clean":"2024-09-21T05:51:47.369378+0000","last_became_active":"2024-09-21T05:51:03.942942+0000","last_became_peered":"2024-09-21T05:51:03.942942+0000","last_unstale":"2024-09-21T05:51:47.369378+0000","last_undegraded":"2024-09-21T05:51:47.369378+0000","last_fullsized":"2024-09-21T05:51:47.369378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:38.846493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.376451+0000","last_change":"2024-09-21T05:51:47.376326+0000","last_active":"2024-09-21T05:51:47.376451+0000","last_peered":"2024-09-21T05:51:47.376451+0000","last_clean":"2024-09-21T05:51:47.376451+0000","last_became_active":"2024-09-21T05:51:47.375993+0000","last_became_peered":"2024-09-21T05:51:47.375993+0000","last_unstale":"2024-09-21T05:51:47.376451+0000","last_undegraded":"2024-09-21T05:51:47.376451+0000","last_fullsized":"2024-09-21T05:51:47.376451+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:13.193571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374423+0000","last_change":"2024-09-21T05:50:51.162682+0000","last_active":"2024-09-21T05:51:47.374423+0000","last_peered":"2024-09-21T05:51:47.374423+0000","last_clean":"2024-09-21T05:51:47.374423+0000","last_became_active":"2024-09-21T05:50:51.162244+0000","last_became_peered":"2024-09-21T05:50:51.162244+0000","last_unstale":"2024-09-21T05:51:47.374423+0000","last_undegraded":"2024-09-21T05:51:47.374423+0000","last_fullsized":"2024-09-21T05:51:47.374423+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.595096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.587907+0000","last_change":"2024-09-21T05:51:03.939666+0000","last_active":"2024-09-21T05:51:47.587907+0000","last_peered":"2024-09-21T05:51:47.587907+0000","last_clean":"2024-09-21T05:51:47.587907+0000","last_became_active":"2024-09-21T05:51:03.938311+0000","last_became_peered":"2024-09-21T05:51:03.938311+0000","last_unstale":"2024-09-21T05:51:47.587907+0000","last_undegraded":"2024-09-21T05:51:47.587907+0000","last_fullsized":"2024-09-21T05:51:47.587907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:31.407900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588517+0000","last_change":"2024-09-21T05:51:47.588416+0000","last_active":"2024-09-21T05:51:47.588517+0000","last_peered":"2024-09-21T05:51:47.588517+0000","last_clean":"2024-09-21T05:51:47.588517+0000","last_became_active":"2024-09-21T05:51:47.587905+0000","last_became_peered":"2024-09-21T05:51:47.587905+0000","last_unstale":"2024-09-21T05:51:47.588517+0000","last_undegraded":"2024-09-21T05:51:47.588517+0000","last_fullsized":"2024-09-21T05:51:47.588517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:05.821048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586642+0000","last_change":"2024-09-21T05:50:50.846164+0000","last_active":"2024-09-21T05:51:47.586642+0000","last_peered":"2024-09-21T05:51:47.586642+0000","last_clean":"2024-09-21T05:51:47.586642+0000","last_became_active":"2024-09-21T05:50:50.845775+0000","last_became_peered":"2024-09-21T05:50:50.845775+0000","last_unstale":"2024-09-21T05:51:47.586642+0000","last_undegraded":"2024-09-21T05:51:47.586642+0000","last_fullsized":"2024-09-21T05:51:47.586642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:45.356626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369471+0000","last_change":"2024-09-21T05:51:03.938602+0000","last_active":"2024-09-21T05:51:47.369471+0000","last_peered":"2024-09-21T05:51:47.369471+0000","last_clean":"2024-09-21T05:51:47.369471+0000","last_became_active":"2024-09-21T05:51:03.938113+0000","last_became_peered":"2024-09-21T05:51:03.938113+0000","last_unstale":"2024-09-21T05:51:47.369471+0000","last_undegraded":"2024-09-21T05:51:47.369471+0000","last_fullsized":"2024-09-21T05:51:47.369471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:07:58.436244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373648+0000","last_change":"2024-09-21T05:50:53.903005+0000","last_active":"2024-09-21T05:51:47.373648+0000","last_peered":"2024-09-21T05:51:47.373648+0000","last_clean":"2024-09-21T05:51:47.373648+0000","last_became_active":"2024-09-21T05:50:53.902590+0000","last_became_peered":"2024-09-21T05:50:53.902590+0000","last_unstale":"2024-09-21T05:51:47.373648+0000","last_undegraded":"2024-09-21T05:51:47.373648+0000","last_fullsized":"2024-09-21T05:51:47.373648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:46.602723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366967+0000","last_change":"2024-09-21T05:50:50.846682+0000","last_active":"2024-09-21T05:51:47.366967+0000","last_peered":"2024-09-21T05:51:47.366967+0000","last_clean":"2024-09-21T05:51:47.366967+0000","last_became_active":"2024-09-21T05:50:50.846305+0000","last_became_peered":"2024-09-21T05:50:50.846305+0000","last_unstale":"2024-09-21T05:51:47.366967+0000","last_undegraded":"2024-09-21T05:51:47.366967+0000","last_fullsized":"2024-09-21T05:51:47.366967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:30.946247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365976+0000","last_change":"2024-09-21T05:51:03.931781+0000","last_active":"2024-09-21T05:51:47.365976+0000","last_peered":"2024-09-21T05:51:47.365976+0000","last_clean":"2024-09-21T05:51:47.365976+0000","last_became_active":"2024-09-21T05:51:03.930921+0000","last_became_peered":"2024-09-21T05:51:03.930921+0000","last_unstale":"2024-09-21T05:51:47.365976+0000","last_undegraded":"2024-09-21T05:51:47.365976+0000","last_fullsized":"2024-09-21T05:51:47.365976+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:03.284929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375485+0000","last_change":"2024-09-21T05:51:03.947521+0000","last_active":"2024-09-21T05:51:47.375485+0000","last_peered":"2024-09-21T05:51:47.375485+0000","last_clean":"2024-09-21T05:51:47.375485+0000","last_became_active":"2024-09-21T05:51:03.947074+0000","last_became_peered":"2024-09-21T05:51:03.947074+0000","last_unstale":"2024-09-21T05:51:47.375485+0000","last_undegraded":"2024-09-21T05:51:47.375485+0000","last_fullsized":"2024-09-21T05:51:47.375485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:51.313988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.368970+0000","last_change":"2024-09-21T05:50:53.911791+0000","last_active":"2024-09-21T05:51:47.368970+0000","last_peered":"2024-09-21T05:51:47.368970+0000","last_clean":"2024-09-21T05:51:47.368970+0000","last_became_active":"2024-09-21T05:50:53.911392+0000","last_became_peered":"2024-09-21T05:50:53.911392+0000","last_unstale":"2024-09-21T05:51:47.368970+0000","last_undegraded":"2024-09-21T05:51:47.368970+0000","last_fullsized":"2024-09-21T05:51:47.368970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:45.688626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374446+0000","last_change":"2024-09-21T05:50:50.853383+0000","last_active":"2024-09-21T05:51:47.374446+0000","last_peered":"2024-09-21T05:51:47.374446+0000","last_clean":"2024-09-21T05:51:47.374446+0000","last_became_active":"2024-09-21T05:50:50.853006+0000","last_became_peered":"2024-09-21T05:50:50.853006+0000","last_unstale":"2024-09-21T05:51:47.374446+0000","last_undegraded":"2024-09-21T05:51:47.374446+0000","last_fullsized":"2024-09-21T05:51:47.374446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:14.838953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372016+0000","last_change":"2024-09-21T05:51:03.945415+0000","last_active":"2024-09-21T05:51:47.372016+0000","last_peered":"2024-09-21T05:51:47.372016+0000","last_clean":"2024-09-21T05:51:47.372016+0000","last_became_active":"2024-09-21T05:51:03.945019+0000","last_became_peered":"2024-09-21T05:51:03.945019+0000","last_unstale":"2024-09-21T05:51:47.372016+0000","last_undegraded":"2024-09-21T05:51:47.372016+0000","last_fullsized":"2024-09-21T05:51:47.372016+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:27.006823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365558+0000","last_change":"2024-09-21T05:50:53.897515+0000","last_active":"2024-09-21T05:51:47.365558+0000","last_peered":"2024-09-21T05:51:47.365558+0000","last_clean":"2024-09-21T05:51:47.365558+0000","last_became_active":"2024-09-21T05:50:53.897070+0000","last_became_peered":"2024-09-21T05:50:53.897070+0000","last_unstale":"2024-09-21T05:51:47.365558+0000","last_undegraded":"2024-09-21T05:51:47.365558+0000","last_fullsized":"2024-09-21T05:51:47.365558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:16.971379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371965+0000","last_change":"2024-09-21T05:50:50.844937+0000","last_active":"2024-09-21T05:51:47.371965+0000","last_peered":"2024-09-21T05:51:47.371965+0000","last_clean":"2024-09-21T05:51:47.371965+0000","last_became_active":"2024-09-21T05:50:50.844048+0000","last_became_peered":"2024-09-21T05:50:50.844048+0000","last_unstale":"2024-09-21T05:51:47.371965+0000","last_undegraded":"2024-09-21T05:51:47.371965+0000","last_fullsized":"2024-09-21T05:51:47.371965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:28.764620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588032+0000","last_change":"2024-09-21T05:51:47.587919+0000","last_active":"2024-09-21T05:51:47.588032+0000","last_peered":"2024-09-21T05:51:47.588032+0000","last_clean":"2024-09-21T05:51:47.588032+0000","last_became_active":"2024-09-21T05:51:47.587418+0000","last_became_peered":"2024-09-21T05:51:47.587418+0000","last_unstale":"2024-09-21T05:51:47.588032+0000","last_undegraded":"2024-09-21T05:51:47.588032+0000","last_fullsized":"2024-09-21T05:51:47.588032+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:29.800848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374026+0000","last_change":"2024-09-21T05:50:53.890761+0000","last_active":"2024-09-21T05:51:47.374026+0000","last_peered":"2024-09-21T05:51:47.374026+0000","last_clean":"2024-09-21T05:51:47.374026+0000","last_became_active":"2024-09-21T05:50:53.890394+0000","last_became_peered":"2024-09-21T05:50:53.890394+0000","last_unstale":"2024-09-21T05:51:47.374026+0000","last_undegraded":"2024-09-21T05:51:47.374026+0000","last_fullsized":"2024-09-21T05:51:47.374026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.176920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366914+0000","last_change":"2024-09-21T05:51:03.941049+0000","last_active":"2024-09-21T05:51:47.366914+0000","last_peered":"2024-09-21T05:51:47.366914+0000","last_clean":"2024-09-21T05:51:47.366914+0000","last_became_active":"2024-09-21T05:51:03.940593+0000","last_became_peered":"2024-09-21T05:51:03.940593+0000","last_unstale":"2024-09-21T05:51:47.366914+0000","last_undegraded":"2024-09-21T05:51:47.366914+0000","last_fullsized":"2024-09-21T05:51:47.366914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:03.797582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374119+0000","last_change":"2024-09-21T05:50:50.852630+0000","last_active":"2024-09-21T05:51:47.374119+0000","last_peered":"2024-09-21T05:51:47.374119+0000","last_clean":"2024-09-21T05:51:47.374119+0000","last_became_active":"2024-09-21T05:50:50.852255+0000","last_became_peered":"2024-09-21T05:50:50.852255+0000","last_unstale":"2024-09-21T05:51:47.374119+0000","last_undegraded":"2024-09-21T05:51:47.374119+0000","last_fullsized":"2024-09-21T05:51:47.374119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:18.094082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369208+0000","last_change":"2024-09-21T05:50:53.902303+0000","last_active":"2024-09-21T05:51:47.369208+0000","last_peered":"2024-09-21T05:51:47.369208+0000","last_clean":"2024-09-21T05:51:47.369208+0000","last_became_active":"2024-09-21T05:50:53.901910+0000","last_became_peered":"2024-09-21T05:50:53.901910+0000","last_unstale":"2024-09-21T05:51:47.369208+0000","last_undegraded":"2024-09-21T05:51:47.369208+0000","last_fullsized":"2024-09-21T05:51:47.369208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:06.651235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.367205+0000","last_change":"2024-09-21T05:51:03.932268+0000","last_active":"2024-09-21T05:51:47.367205+0000","last_peered":"2024-09-21T05:51:47.367205+0000","last_clean":"2024-09-21T05:51:47.367205+0000","last_became_active":"2024-09-21T05:51:03.931849+0000","last_became_peered":"2024-09-21T05:51:03.931849+0000","last_unstale":"2024-09-21T05:51:47.367205+0000","last_undegraded":"2024-09-21T05:51:47.367205+0000","last_fullsized":"2024-09-21T05:51:47.367205+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:53.622621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371214+0000","last_change":"2024-09-21T05:50:53.897205+0000","last_active":"2024-09-21T05:51:47.371214+0000","last_peered":"2024-09-21T05:51:47.371214+0000","last_clean":"2024-09-21T05:51:47.371214+0000","last_became_active":"2024-09-21T05:50:53.896811+0000","last_became_peered":"2024-09-21T05:50:53.896811+0000","last_unstale":"2024-09-21T05:51:47.371214+0000","last_undegraded":"2024-09-21T05:51:47.371214+0000","last_fullsized":"2024-09-21T05:51:47.371214+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:13.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.376687+0000","last_change":"2024-09-21T05:51:47.376606+0000","last_active":"2024-09-21T05:51:47.376687+0000","last_peered":"2024-09-21T05:51:47.376687+0000","last_clean":"2024-09-21T05:51:47.376687+0000","last_became_active":"2024-09-21T05:51:47.376203+0000","last_became_peered":"2024-09-21T05:51:47.376203+0000","last_unstale":"2024-09-21T05:51:47.376687+0000","last_undegraded":"2024-09-21T05:51:47.376687+0000","last_fullsized":"2024-09-21T05:51:47.376687+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:34.698021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366716+0000","last_change":"2024-09-21T05:50:53.910991+0000","last_active":"2024-09-21T05:51:47.366716+0000","last_peered":"2024-09-21T05:51:47.366716+0000","last_clean":"2024-09-21T05:51:47.366716+0000","last_became_active":"2024-09-21T05:50:53.910720+0000","last_became_peered":"2024-09-21T05:50:53.910720+0000","last_unstale":"2024-09-21T05:51:47.366716+0000","last_undegraded":"2024-09-21T05:51:47.366716+0000","last_fullsized":"2024-09-21T05:51:47.366716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.653746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375259+0000","last_change":"2024-09-21T05:50:53.894065+0000","last_active":"2024-09-21T05:51:47.375259+0000","last_peered":"2024-09-21T05:51:47.375259+0000","last_clean":"2024-09-21T05:51:47.375259+0000","last_became_active":"2024-09-21T05:50:53.892630+0000","last_became_peered":"2024-09-21T05:50:53.892630+0000","last_unstale":"2024-09-21T05:51:47.375259+0000","last_undegraded":"2024-09-21T05:51:47.375259+0000","last_fullsized":"2024-09-21T05:51:47.375259+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:09.025667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372687+0000","last_change":"2024-09-21T05:50:53.899586+0000","last_active":"2024-09-21T05:51:47.372687+0000","last_peered":"2024-09-21T05:51:47.372687+0000","last_clean":"2024-09-21T05:51:47.372687+0000","last_became_active":"2024-09-21T05:50:53.899066+0000","last_became_peered":"2024-09-21T05:50:53.899066+0000","last_unstale":"2024-09-21T05:51:47.372687+0000","last_undegraded":"2024-09-21T05:51:47.372687+0000","last_fullsized":"2024-09-21T05:51:47.372687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:07.678164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375170+0000","last_change":"2024-09-21T05:51:47.375063+0000","last_active":"2024-09-21T05:51:47.375170+0000","last_peered":"2024-09-21T05:51:47.375170+0000","last_clean":"2024-09-21T05:51:47.375170+0000","last_became_active":"2024-09-21T05:51:47.374645+0000","last_became_peered":"2024-09-21T05:51:47.374645+0000","last_unstale":"2024-09-21T05:51:47.375170+0000","last_undegraded":"2024-09-21T05:51:47.375170+0000","last_fullsized":"2024-09-21T05:51:47.375170+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:29.572438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366992+0000","last_change":"2024-09-21T05:50:53.901688+0000","last_active":"2024-09-21T05:51:47.366992+0000","last_peered":"2024-09-21T05:51:47.366992+0000","last_clean":"2024-09-21T05:51:47.366992+0000","last_became_active":"2024-09-21T05:50:53.901245+0000","last_became_peered":"2024-09-21T05:50:53.901245+0000","last_unstale":"2024-09-21T05:51:47.366992+0000","last_undegraded":"2024-09-21T05:51:47.366992+0000","last_fullsized":"2024-09-21T05:51:47.366992+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:41.401357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366378+0000","last_change":"2024-09-21T05:50:53.908954+0000","last_active":"2024-09-21T05:51:47.366378+0000","last_peered":"2024-09-21T05:51:47.366378+0000","last_clean":"2024-09-21T05:51:47.366378+0000","last_became_active":"2024-09-21T05:50:53.897605+0000","last_became_peered":"2024-09-21T05:50:53.897605+0000","last_unstale":"2024-09-21T05:51:47.366378+0000","last_undegraded":"2024-09-21T05:51:47.366378+0000","last_fullsized":"2024-09-21T05:51:47.366378+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:15.634597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374142+0000","last_change":"2024-09-21T05:50:53.900106+0000","last_active":"2024-09-21T05:51:47.374142+0000","last_peered":"2024-09-21T05:51:47.374142+0000","last_clean":"2024-09-21T05:51:47.374142+0000","last_became_active":"2024-09-21T05:50:53.899697+0000","last_became_peered":"2024-09-21T05:50:53.899697+0000","last_unstale":"2024-09-21T05:51:47.374142+0000","last_undegraded":"2024-09-21T05:51:47.374142+0000","last_fullsized":"2024-09-21T05:51:47.374142+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.599501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.365666+0000","last_change":"2024-09-21T05:50:53.899644+0000","last_active":"2024-09-21T05:51:47.365666+0000","last_peered":"2024-09-21T05:51:47.365666+0000","last_clean":"2024-09-21T05:51:47.365666+0000","last_became_active":"2024-09-21T05:50:53.899246+0000","last_became_peered":"2024-09-21T05:50:53.899246+0000","last_unstale":"2024-09-21T05:51:47.365666+0000","last_undegraded":"2024-09-21T05:51:47.365666+0000","last_fullsized":"2024-09-21T05:51:47.365666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:34.551489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373510+0000","last_change":"2024-09-21T05:50:53.904328+0000","last_active":"2024-09-21T05:51:47.373510+0000","last_peered":"2024-09-21T05:51:47.373510+0000","last_clean":"2024-09-21T05:51:47.373510+0000","last_became_active":"2024-09-21T05:50:53.903887+0000","last_became_peered":"2024-09-21T05:50:53.903887+0000","last_unstale":"2024-09-21T05:51:47.373510+0000","last_undegraded":"2024-09-21T05:51:47.373510+0000","last_fullsized":"2024-09-21T05:51:47.373510+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:27.659631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372271+0000","last_change":"2024-09-21T05:50:53.905278+0000","last_active":"2024-09-21T05:51:47.372271+0000","last_peered":"2024-09-21T05:51:47.372271+0000","last_clean":"2024-09-21T05:51:47.372271+0000","last_became_active":"2024-09-21T05:50:53.904633+0000","last_became_peered":"2024-09-21T05:50:53.904633+0000","last_unstale":"2024-09-21T05:51:47.372271+0000","last_undegraded":"2024-09-21T05:51:47.372271+0000","last_fullsized":"2024-09-21T05:51:47.372271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:26.802336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.371630+0000","last_change":"2024-09-21T05:50:53.891621+0000","last_active":"2024-09-21T05:51:47.371630+0000","last_peered":"2024-09-21T05:51:47.371630+0000","last_clean":"2024-09-21T05:51:47.371630+0000","last_became_active":"2024-09-21T05:50:53.891246+0000","last_became_peered":"2024-09-21T05:50:53.891246+0000","last_unstale":"2024-09-21T05:51:47.371630+0000","last_undegraded":"2024-09-21T05:51:47.371630+0000","last_fullsized":"2024-09-21T05:51:47.371630+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:21.419789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.367243+0000","last_change":"2024-09-21T05:50:53.902964+0000","last_active":"2024-09-21T05:51:47.367243+0000","last_peered":"2024-09-21T05:51:47.367243+0000","last_clean":"2024-09-21T05:51:47.367243+0000","last_became_active":"2024-09-21T05:50:53.902574+0000","last_became_peered":"2024-09-21T05:50:53.902574+0000","last_unstale":"2024-09-21T05:51:47.367243+0000","last_undegraded":"2024-09-21T05:51:47.367243+0000","last_fullsized":"2024-09-21T05:51:47.367243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:35.552787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369657+0000","last_change":"2024-09-21T05:50:53.904717+0000","last_active":"2024-09-21T05:51:47.369657+0000","last_peered":"2024-09-21T05:51:47.369657+0000","last_clean":"2024-09-21T05:51:47.369657+0000","last_became_active":"2024-09-21T05:50:53.903152+0000","last_became_peered":"2024-09-21T05:50:53.903152+0000","last_unstale":"2024-09-21T05:51:47.369657+0000","last_undegraded":"2024-09-21T05:51:47.369657+0000","last_fullsized":"2024-09-21T05:51:47.369657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:56.808689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372634+0000","last_change":"2024-09-21T05:50:53.906336+0000","last_active":"2024-09-21T05:51:47.372634+0000","last_peered":"2024-09-21T05:51:47.372634+0000","last_clean":"2024-09-21T05:51:47.372634+0000","last_became_active":"2024-09-21T05:50:53.905942+0000","last_became_peered":"2024-09-21T05:50:53.905942+0000","last_unstale":"2024-09-21T05:51:47.372634+0000","last_undegraded":"2024-09-21T05:51:47.372634+0000","last_fullsized":"2024-09-21T05:51:47.372634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:26.824967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373752+0000","last_change":"2024-09-21T05:50:53.910772+0000","last_active":"2024-09-21T05:51:47.373752+0000","last_peered":"2024-09-21T05:51:47.373752+0000","last_clean":"2024-09-21T05:51:47.373752+0000","last_became_active":"2024-09-21T05:50:53.910394+0000","last_became_peered":"2024-09-21T05:50:53.910394+0000","last_unstale":"2024-09-21T05:51:47.373752+0000","last_undegraded":"2024-09-21T05:51:47.373752+0000","last_fullsized":"2024-09-21T05:51:47.373752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:00.338916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374606+0000","last_change":"2024-09-21T05:50:53.906454+0000","last_active":"2024-09-21T05:51:47.374606+0000","last_peered":"2024-09-21T05:51:47.374606+0000","last_clean":"2024-09-21T05:51:47.374606+0000","last_became_active":"2024-09-21T05:50:53.905947+0000","last_became_peered":"2024-09-21T05:50:53.905947+0000","last_unstale":"2024-09-21T05:51:47.374606+0000","last_undegraded":"2024-09-21T05:51:47.374606+0000","last_fullsized":"2024-09-21T05:51:47.374606+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:57.358615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374819+0000","last_change":"2024-09-21T05:50:53.903690+0000","last_active":"2024-09-21T05:51:47.374819+0000","last_peered":"2024-09-21T05:51:47.374819+0000","last_clean":"2024-09-21T05:51:47.374819+0000","last_became_active":"2024-09-21T05:50:53.900672+0000","last_became_peered":"2024-09-21T05:50:53.900672+0000","last_unstale":"2024-09-21T05:51:47.374819+0000","last_undegraded":"2024-09-21T05:51:47.374819+0000","last_fullsized":"2024-09-21T05:51:47.374819+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:42.005312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372264+0000","last_change":"2024-09-21T05:50:53.888711+0000","last_active":"2024-09-21T05:51:47.372264+0000","last_peered":"2024-09-21T05:51:47.372264+0000","last_clean":"2024-09-21T05:51:47.372264+0000","last_became_active":"2024-09-21T05:50:53.888302+0000","last_became_peered":"2024-09-21T05:50:53.888302+0000","last_unstale":"2024-09-21T05:51:47.372264+0000","last_undegraded":"2024-09-21T05:51:47.372264+0000","last_fullsized":"2024-09-21T05:51:47.372264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:25.766696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588817+0000","last_change":"2024-09-21T05:50:53.898848+0000","last_active":"2024-09-21T05:51:47.588817+0000","last_peered":"2024-09-21T05:51:47.588817+0000","last_clean":"2024-09-21T05:51:47.588817+0000","last_became_active":"2024-09-21T05:50:53.897785+0000","last_became_peered":"2024-09-21T05:50:53.897785+0000","last_unstale":"2024-09-21T05:51:47.588817+0000","last_undegraded":"2024-09-21T05:51:47.588817+0000","last_fullsized":"2024-09-21T05:51:47.588817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:25.099224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586885+0000","last_change":"2024-09-21T05:50:53.899051+0000","last_active":"2024-09-21T05:51:47.586885+0000","last_peered":"2024-09-21T05:51:47.586885+0000","last_clean":"2024-09-21T05:51:47.586885+0000","last_became_active":"2024-09-21T05:50:53.898381+0000","last_became_peered":"2024-09-21T05:50:53.898381+0000","last_unstale":"2024-09-21T05:51:47.586885+0000","last_undegraded":"2024-09-21T05:51:47.586885+0000","last_fullsized":"2024-09-21T05:51:47.586885+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:05.958547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.367168+0000","last_change":"2024-09-21T05:50:53.896079+0000","last_active":"2024-09-21T05:51:47.367168+0000","last_peered":"2024-09-21T05:51:47.367168+0000","last_clean":"2024-09-21T05:51:47.367168+0000","last_became_active":"2024-09-21T05:50:53.895659+0000","last_became_peered":"2024-09-21T05:50:53.895659+0000","last_unstale":"2024-09-21T05:51:47.367168+0000","last_undegraded":"2024-09-21T05:51:47.367168+0000","last_fullsized":"2024-09-21T05:51:47.367168+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:50.151899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.373801+0000","last_change":"2024-09-21T05:50:53.894899+0000","last_active":"2024-09-21T05:51:47.373801+0000","last_peered":"2024-09-21T05:51:47.373801+0000","last_clean":"2024-09-21T05:51:47.373801+0000","last_became_active":"2024-09-21T05:50:53.894530+0000","last_became_peered":"2024-09-21T05:50:53.894530+0000","last_unstale":"2024-09-21T05:51:47.373801+0000","last_undegraded":"2024-09-21T05:51:47.373801+0000","last_fullsized":"2024-09-21T05:51:47.373801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:15.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.378837+0000","last_change":"2024-09-21T05:51:47.376927+0000","last_active":"2024-09-21T05:51:47.378837+0000","last_peered":"2024-09-21T05:51:47.378837+0000","last_clean":"2024-09-21T05:51:47.378837+0000","last_became_active":"2024-09-21T05:51:47.376534+0000","last_became_peered":"2024-09-21T05:51:47.376534+0000","last_unstale":"2024-09-21T05:51:47.378837+0000","last_undegraded":"2024-09-21T05:51:47.378837+0000","last_fullsized":"2024-09-21T05:51:47.378837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:26.353085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.586552+0000","last_change":"2024-09-21T05:50:53.903196+0000","last_active":"2024-09-21T05:51:47.586552+0000","last_peered":"2024-09-21T05:51:47.586552+0000","last_clean":"2024-09-21T05:51:47.586552+0000","last_became_active":"2024-09-21T05:50:53.902825+0000","last_became_peered":"2024-09-21T05:50:53.902825+0000","last_unstale":"2024-09-21T05:51:47.586552+0000","last_undegraded":"2024-09-21T05:51:47.586552+0000","last_fullsized":"2024-09-21T05:51:47.586552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:13.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.366681+0000","last_change":"2024-09-21T05:50:53.902249+0000","last_active":"2024-09-21T05:51:47.366681+0000","last_peered":"2024-09-21T05:51:47.366681+0000","last_clean":"2024-09-21T05:51:47.366681+0000","last_became_active":"2024-09-21T05:50:53.901828+0000","last_became_peered":"2024-09-21T05:50:53.901828+0000","last_unstale":"2024-09-21T05:51:47.366681+0000","last_undegraded":"2024-09-21T05:51:47.366681+0000","last_fullsized":"2024-09-21T05:51:47.366681+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:51.200179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.369725+0000","last_change":"2024-09-21T05:50:53.897170+0000","last_active":"2024-09-21T05:51:47.369725+0000","last_peered":"2024-09-21T05:51:47.369725+0000","last_clean":"2024-09-21T05:51:47.369725+0000","last_became_active":"2024-09-21T05:50:53.895337+0000","last_became_peered":"2024-09-21T05:50:53.895337+0000","last_unstale":"2024-09-21T05:51:47.369725+0000","last_undegraded":"2024-09-21T05:51:47.369725+0000","last_fullsized":"2024-09-21T05:51:47.369725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:19.869698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.588686+0000","last_change":"2024-09-21T05:50:53.899575+0000","last_active":"2024-09-21T05:51:47.588686+0000","last_peered":"2024-09-21T05:51:47.588686+0000","last_clean":"2024-09-21T05:51:47.588686+0000","last_became_active":"2024-09-21T05:50:53.898274+0000","last_became_peered":"2024-09-21T05:50:53.898274+0000","last_unstale":"2024-09-21T05:51:47.588686+0000","last_undegraded":"2024-09-21T05:51:47.588686+0000","last_fullsized":"2024-09-21T05:51:47.588686+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:28.188691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.374942+0000","last_change":"2024-09-21T05:50:53.908381+0000","last_active":"2024-09-21T05:51:47.374942+0000","last_peered":"2024-09-21T05:51:47.374942+0000","last_clean":"2024-09-21T05:51:47.374942+0000","last_became_active":"2024-09-21T05:50:53.906731+0000","last_became_peered":"2024-09-21T05:50:53.906731+0000","last_unstale":"2024-09-21T05:51:47.374942+0000","last_undegraded":"2024-09-21T05:51:47.374942+0000","last_fullsized":"2024-09-21T05:51:47.374942+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:59.254561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.375564+0000","last_change":"2024-09-21T05:50:53.904619+0000","last_active":"2024-09-21T05:51:47.375564+0000","last_peered":"2024-09-21T05:51:47.375564+0000","last_clean":"2024-09-21T05:51:47.375564+0000","last_became_active":"2024-09-21T05:50:53.903901+0000","last_became_peered":"2024-09-21T05:50:53.903901+0000","last_unstale":"2024-09-21T05:51:47.375564+0000","last_undegraded":"2024-09-21T05:51:47.375564+0000","last_fullsized":"2024-09-21T05:51:47.375564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:25.531973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T05:51:47.372499+0000","last_change":"2024-09-21T05:50:53.903557+0000","last_active":"2024-09-21T05:51:47.372499+0000","last_peered":"2024-09-21T05:51:47.372499+0000","last_clean":"2024-09-21T05:51:47.372499+0000","last_became_active":"2024-09-21T05:50:53.903195+0000","last_became_peered":"2024-09-21T05:50:53.903195+0000","last_unstale":"2024-09-21T05:51:47.372499+0000","last_undegraded":"2024-09-21T05:51:47.372499+0000","last_fullsized":"2024-09-21T05:51:47.372499+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:32.268063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64662,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":51,"num_read_kb":86,"num_write":84,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":193986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678044,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":502730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874273,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28660,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716492,"statfs":{"total":95995035648,"available":95965687808,"internally_reserved":0,"allocated":1675264,"data_stored":1148795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037800,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":507408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234029,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":503334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430257,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32752,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712400,"statfs":{"total":95995035648,"available":95961497600,"internally_reserved":0,"allocated":1605632,"data_stored":1097776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626487,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":999424,"data_stored":498634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36916,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708236,"statfs":{"total":95995035648,"available":95957233664,"internally_reserved":0,"allocated":1609728,"data_stored":1093280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018946,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":502752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215175,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":498738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1077248,"data_stored":562532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1073152,"data_stored":562498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1003520,"data_stored":498724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:52:09.961 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T05:52:09.962 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T05:52:09.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T05:52:09.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:09 smithi067 ceph-mon[34443]: pgmap v359: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-21T05:52:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:10.840 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:10 smithi037 ceph-mon[30631]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:10.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:10 smithi144 ceph-mon[34351]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:10.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:10 smithi067 ceph-mon[34443]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.028+0000 7f81a6a00640 1 -- 172.21.15.37:0/1906094691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a0106a10 msgr2=0x7f81a0106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.028+0000 7f81a6a00640 1 --2- 172.21.15.37:0/1906094691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a0106a10 0x7f81a0106e20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8188009900 tx=0x7f818802a480 comp rx=0 tx=0).stop 2024-09-21T05:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.028+0000 7f81a6a00640 1 -- 172.21.15.37:0/1906094691 shutdown_connections 2024-09-21T05:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.028+0000 7f81a6a00640 1 --2- 172.21.15.37:0/1906094691 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81a01073b0 0x7f81a010dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.028+0000 7f81a6a00640 1 --2- 172.21.15.37:0/1906094691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a0106a10 0x7f81a0106e20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.028+0000 7f81a6a00640 1 --2- 172.21.15.37:0/1906094691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81a0105980 0x7f81a0105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.028+0000 7f81a6a00640 1 -- 172.21.15.37:0/1906094691 >> 172.21.15.37:0/1906094691 conn(0x7f81a01012f0 msgr2=0x7f81a01037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:11.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.028+0000 7f81a6a00640 1 -- 172.21.15.37:0/1906094691 shutdown_connections 2024-09-21T05:52:11.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.028+0000 7f81a6a00640 1 -- 172.21.15.37:0/1906094691 wait complete. 2024-09-21T05:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.029+0000 7f81a6a00640 1 Processor -- start 2024-09-21T05:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.029+0000 7f81a6a00640 1 -- start start 2024-09-21T05:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.030+0000 7f81a6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a0105980 0x7f81a019c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.030+0000 7f81a6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81a0106a10 0x7f81a019c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.030+0000 7f81a6a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81a01073b0 0x7f81a019d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.030+0000 7f81a6a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81a01115d0 con 0x7f81a0105980 2024-09-21T05:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.030+0000 7f81a6a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f81a0111450 con 0x7f81a01073b0 2024-09-21T05:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.030+0000 7f81a6a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f81a0111750 con 0x7f81a0106a10 2024-09-21T05:52:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.030+0000 7f819fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a0105980 0x7f81a019c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.030+0000 7f819fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a0105980 0x7f81a019c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48628/0 (socket says 172.21.15.37:48628) 2024-09-21T05:52:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.030+0000 7f819fe00640 1 -- 172.21.15.37:0/3819436616 learned_addr learned my addr 172.21.15.37:0/3819436616 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.030+0000 7f81a4a00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81a01073b0 0x7f81a019d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.030+0000 7f8197e00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81a0106a10 0x7f81a019c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.030+0000 7f819fe00640 1 -- 172.21.15.37:0/3819436616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81a0106a10 msgr2=0x7f81a019c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.030+0000 7f819fe00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81a0106a10 0x7f81a019c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.031+0000 7f819fe00640 1 -- 172.21.15.37:0/3819436616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81a01073b0 msgr2=0x7f81a019d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.031+0000 7f819fe00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81a01073b0 0x7f81a019d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.031+0000 7f819fe00640 1 -- 172.21.15.37:0/3819436616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a019dc00 con 0x7f81a0105980 2024-09-21T05:52:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.031+0000 7f81a4a00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81a01073b0 0x7f81a019d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.031+0000 7f819fe00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a0105980 0x7f81a019c1d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f819000e9f0 tx=0x7f819000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.031+0000 7f819d600640 1 -- 172.21.15.37:0/3819436616 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819000cd80 con 0x7f81a0105980 2024-09-21T05:52:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.031+0000 7f819d600640 1 -- 172.21.15.37:0/3819436616 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81900054d0 con 0x7f81a0105980 2024-09-21T05:52:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.031+0000 7f81a6a00640 1 -- 172.21.15.37:0/3819436616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a019def0 con 0x7f81a0105980 2024-09-21T05:52:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.031+0000 7f819d600640 1 -- 172.21.15.37:0/3819436616 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8190010690 con 0x7f81a0105980 2024-09-21T05:52:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.031+0000 7f81a6a00640 1 -- 172.21.15.37:0/3819436616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a01a45f0 con 0x7f81a0105980 2024-09-21T05:52:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.032+0000 7f81a6a00640 1 -- 172.21.15.37:0/3819436616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a010cb60 con 0x7f81a0105980 2024-09-21T05:52:11.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.035+0000 7f819d600640 1 -- 172.21.15.37:0/3819436616 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f8190004e90 con 0x7f81a0105980 2024-09-21T05:52:11.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.037+0000 7f819d600640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f81840b6620 0x7f81840b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:11.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.037+0000 7f819d600640 1 -- 172.21.15.37:0/3819436616 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f81900e7bd0 con 0x7f81a0105980 2024-09-21T05:52:11.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.038+0000 7f8197e00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f81840b6620 0x7f81840b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:11.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.038+0000 7f8197e00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f81840b6620 0x7f81840b8b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8188000c00 tx=0x7f8188031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:11.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.042+0000 7f819d600640 1 -- 172.21.15.37:0/3819436616 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81900adf40 con 0x7f81a0105980 2024-09-21T05:52:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.318+0000 7f81a6a00640 1 -- 172.21.15.37:0/3819436616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f81a002e640 con 0x7f81a0105980 2024-09-21T05:52:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.322+0000 7f819d600640 1 -- 172.21.15.37:0/3819436616 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f81900b2320 con 0x7f81a0105980 2024-09-21T05:52:11.325 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-09-21T05:52:11.325 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQALX+5mlj4cExAA4L9RXPJwZfyapZrbBH+sEg== 2024-09-21T05:52:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.325+0000 7f81a6a00640 1 -- 172.21.15.37:0/3819436616 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f81840b6620 msgr2=0x7f81840b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.325+0000 7f81a6a00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f81840b6620 0x7f81840b8b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8188000c00 tx=0x7f8188031400 comp rx=0 tx=0).stop 2024-09-21T05:52:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.325+0000 7f81a6a00640 1 -- 172.21.15.37:0/3819436616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a0105980 msgr2=0x7f81a019c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.325+0000 7f81a6a00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a0105980 0x7f81a019c1d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f819000e9f0 tx=0x7f819000edf0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.325+0000 7f81a6a00640 1 -- 172.21.15.37:0/3819436616 shutdown_connections 2024-09-21T05:52:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.325+0000 7f81a6a00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f81840b6620 0x7f81840b8b30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.325+0000 7f81a6a00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81a01073b0 0x7f81a019d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.325+0000 7f81a6a00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81a0106a10 0x7f81a019c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.325+0000 7f81a6a00640 1 --2- 172.21.15.37:0/3819436616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a0105980 0x7f81a019c1d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.325+0000 7f81a6a00640 1 -- 172.21.15.37:0/3819436616 >> 172.21.15.37:0/3819436616 conn(0x7f81a01012f0 msgr2=0x7f81a0109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.325+0000 7f81a6a00640 1 -- 172.21.15.37:0/3819436616 shutdown_connections 2024-09-21T05:52:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:11.325+0000 7f81a6a00640 1 -- 172.21.15.37:0/3819436616 wait complete. 2024-09-21T05:52:11.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:11 smithi144 ceph-mon[34351]: pgmap v360: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-21T05:52:11.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:11 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3819436616' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T05:52:11.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:11 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3819436616' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:52:11.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:11 smithi037 ceph-mon[30631]: pgmap v360: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-21T05:52:11.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:11 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3819436616' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T05:52:11.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:11 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3819436616' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:52:11.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:11 smithi067 ceph-mon[34443]: pgmap v360: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.3 KiB/s wr, 3 op/s 2024-09-21T05:52:11.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:11 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3819436616' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T05:52:11.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:11 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3819436616' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:52:12.200 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:52:12.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T05:52:12.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T05:52:12.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T05:52:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:13.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.339+0000 7f7c1fe00640 1 -- 172.21.15.37:0/771133255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c20077380 msgr2=0x7f7c200757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:13.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.339+0000 7f7c1fe00640 1 --2- 172.21.15.37:0/771133255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c20077380 0x7f7c200757b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009900 tx=0x7f7c1002a3f0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.339+0000 7f7c1fe00640 1 -- 172.21.15.37:0/771133255 shutdown_connections 2024-09-21T05:52:13.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.339+0000 7f7c1fe00640 1 --2- 172.21.15.37:0/771133255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c20114280 0x7f7c20116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.339+0000 7f7c1fe00640 1 --2- 172.21.15.37:0/771133255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c20075dd0 0x7f7c200761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.339+0000 7f7c1fe00640 1 --2- 172.21.15.37:0/771133255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c20077380 0x7f7c200757b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.339+0000 7f7c1fe00640 1 -- 172.21.15.37:0/771133255 >> 172.21.15.37:0/771133255 conn(0x7f7c200ff440 msgr2=0x7f7c20101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:13.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.339+0000 7f7c1fe00640 1 -- 172.21.15.37:0/771133255 shutdown_connections 2024-09-21T05:52:13.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.340+0000 7f7c1fe00640 1 -- 172.21.15.37:0/771133255 wait complete. 2024-09-21T05:52:13.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.341+0000 7f7c1fe00640 1 Processor -- start 2024-09-21T05:52:13.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.341+0000 7f7c1fe00640 1 -- start start 2024-09-21T05:52:13.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.342+0000 7f7c1fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c20075dd0 0x7f7c201a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:13.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.342+0000 7f7c1fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c20077380 0x7f7c201a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:13.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.342+0000 7f7c1fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c20114280 0x7f7c201a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:13.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.342+0000 7f7c1fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c20119ec0 con 0x7f7c20114280 2024-09-21T05:52:13.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.342+0000 7f7c1fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7c20119d40 con 0x7f7c20075dd0 2024-09-21T05:52:13.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.342+0000 7f7c1fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2011a040 con 0x7f7c20077380 2024-09-21T05:52:13.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.342+0000 7f7c1ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c20075dd0 0x7f7c201a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:13.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.342+0000 7f7c1f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c20114280 0x7f7c201a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:13.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.342+0000 7f7c17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c20077380 0x7f7c201a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:13.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.342+0000 7f7c1ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c20075dd0 0x7f7c201a08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:53732/0 (socket says 172.21.15.37:53732) 2024-09-21T05:52:13.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.342+0000 7f7c1ea00640 1 -- 172.21.15.37:0/3815456809 learned_addr learned my addr 172.21.15.37:0/3815456809 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:13.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.343+0000 7f7c17e00640 1 -- 172.21.15.37:0/3815456809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c20075dd0 msgr2=0x7f7c201a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:13.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.343+0000 7f7c17e00640 1 --2- 172.21.15.37:0/3815456809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c20075dd0 0x7f7c201a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.343+0000 7f7c17e00640 1 -- 172.21.15.37:0/3815456809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c20114280 msgr2=0x7f7c201a60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:13.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.343+0000 7f7c17e00640 1 --2- 172.21.15.37:0/3815456809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c20114280 0x7f7c201a60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.343+0000 7f7c17e00640 1 -- 172.21.15.37:0/3815456809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c201a6820 con 0x7f7c20077380 2024-09-21T05:52:13.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.343+0000 7f7c1f400640 1 --2- 172.21.15.37:0/3815456809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c20114280 0x7f7c201a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:13.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.343+0000 7f7c17e00640 1 --2- 172.21.15.37:0/3815456809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c20077380 0x7f7c201a0e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800e9c0 tx=0x7f7c0800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:13.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.343+0000 7f7c17400640 1 -- 172.21.15.37:0/3815456809 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800ccc0 con 0x7f7c20077380 2024-09-21T05:52:13.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.343+0000 7f7c1fe00640 1 -- 172.21.15.37:0/3815456809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c201a6b10 con 0x7f7c20077380 2024-09-21T05:52:13.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.343+0000 7f7c17400640 1 -- 172.21.15.37:0/3815456809 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c080108e0 con 0x7f7c20077380 2024-09-21T05:52:13.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.343+0000 7f7c17400640 1 -- 172.21.15.37:0/3815456809 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c080187a0 con 0x7f7c20077380 2024-09-21T05:52:13.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.343+0000 7f7c1fe00640 1 -- 172.21.15.37:0/3815456809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c201ad270 con 0x7f7c20077380 2024-09-21T05:52:13.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.344+0000 7f7c1fe00640 1 -- 172.21.15.37:0/3815456809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c200761e0 con 0x7f7c20077380 2024-09-21T05:52:13.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.347+0000 7f7c17400640 1 -- 172.21.15.37:0/3815456809 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f7c08010430 con 0x7f7c20077380 2024-09-21T05:52:13.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.348+0000 7f7c17400640 1 --2- 172.21.15.37:0/3815456809 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7c040b65a0 0x7f7c040b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:13.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.348+0000 7f7c17400640 1 -- 172.21.15.37:0/3815456809 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f7c080e7ff0 con 0x7f7c20077380 2024-09-21T05:52:13.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.348+0000 7f7c1ea00640 1 --2- 172.21.15.37:0/3815456809 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7c040b65a0 0x7f7c040b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:13.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.349+0000 7f7c1ea00640 1 --2- 172.21.15.37:0/3815456809 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7c040b65a0 0x7f7c040b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7c10031440 tx=0x7f7c100058d0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:13.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.350+0000 7f7c17400640 1 -- 172.21.15.37:0/3815456809 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c080b2740 con 0x7f7c20077380 2024-09-21T05:52:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.548+0000 7f7c1fe00640 1 -- 172.21.15.37:0/3815456809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f7c20113010 con 0x7f7c20077380 2024-09-21T05:52:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.549+0000 7f7c17400640 1 -- 172.21.15.37:0/3815456809 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v54) ==== 86+0+133 (secure 0 0 0) 0x7f7c080b7680 con 0x7f7c20077380 2024-09-21T05:52:13.551 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:52:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.551+0000 7f7c1fe00640 1 -- 172.21.15.37:0/3815456809 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7c040b65a0 msgr2=0x7f7c040b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.551+0000 7f7c1fe00640 1 --2- 172.21.15.37:0/3815456809 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7c040b65a0 0x7f7c040b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7c10031440 tx=0x7f7c100058d0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.551+0000 7f7c1fe00640 1 -- 172.21.15.37:0/3815456809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c20077380 msgr2=0x7f7c201a0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.551+0000 7f7c1fe00640 1 --2- 172.21.15.37:0/3815456809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c20077380 0x7f7c201a0e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800e9c0 tx=0x7f7c0800ee80 comp rx=0 tx=0).stop 2024-09-21T05:52:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.551+0000 7f7c1fe00640 1 -- 172.21.15.37:0/3815456809 shutdown_connections 2024-09-21T05:52:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.551+0000 7f7c1fe00640 1 --2- 172.21.15.37:0/3815456809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c20114280 0x7f7c201a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.551+0000 7f7c1fe00640 1 --2- 172.21.15.37:0/3815456809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c20077380 0x7f7c201a0e50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.551+0000 7f7c1fe00640 1 --2- 172.21.15.37:0/3815456809 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7c040b65a0 0x7f7c040b8ab0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.551+0000 7f7c1fe00640 1 --2- 172.21.15.37:0/3815456809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c20075dd0 0x7f7c201a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.551+0000 7f7c1fe00640 1 -- 172.21.15.37:0/3815456809 >> 172.21.15.37:0/3815456809 conn(0x7f7c200ff440 msgr2=0x7f7c20110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.551+0000 7f7c1fe00640 1 -- 172.21.15.37:0/3815456809 shutdown_connections 2024-09-21T05:52:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:13.551+0000 7f7c1fe00640 1 -- 172.21.15.37:0/3815456809 wait complete. 2024-09-21T05:52:13.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:13 smithi144 ceph-mon[34351]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-21T05:52:13.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:13 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3815456809' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T05:52:13.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:13 smithi037 ceph-mon[30631]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-21T05:52:13.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:13 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3815456809' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T05:52:13.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:13 smithi067 ceph-mon[34443]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-21T05:52:13.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:13 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3815456809' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T05:52:14.323 INFO:teuthology.orchestra.run.smithi037.stdout:[{"version":54,"timestamp":"2024-09-21T05:50:40.806153+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T05:52:14.324 INFO:tasks.ceph_manager:config epoch is 54 2024-09-21T05:52:14.324 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T05:52:14.324 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T05:52:14.324 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T05:52:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.363+0000 7fe548c00640 1 -- 172.21.15.37:0/1319120270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe544105d80 msgr2=0x7fe544106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.363+0000 7fe548c00640 1 --2- 172.21.15.37:0/1319120270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe544105d80 0x7fe544106190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe534009900 tx=0x7fe53402a3f0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.363+0000 7fe548c00640 1 -- 172.21.15.37:0/1319120270 shutdown_connections 2024-09-21T05:52:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.363+0000 7fe548c00640 1 --2- 172.21.15.37:0/1319120270 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe54410c010 0x7fe544112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.363+0000 7fe548c00640 1 --2- 172.21.15.37:0/1319120270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe54410b6c0 0x7fe54410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.363+0000 7fe548c00640 1 --2- 172.21.15.37:0/1319120270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe544105d80 0x7fe544106190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.363+0000 7fe548c00640 1 -- 172.21.15.37:0/1319120270 >> 172.21.15.37:0/1319120270 conn(0x7fe544101810 msgr2=0x7fe544103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:15.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.363+0000 7fe548c00640 1 -- 172.21.15.37:0/1319120270 shutdown_connections 2024-09-21T05:52:15.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.363+0000 7fe548c00640 1 -- 172.21.15.37:0/1319120270 wait complete. 2024-09-21T05:52:15.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.365+0000 7fe548c00640 1 Processor -- start 2024-09-21T05:52:15.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.365+0000 7fe548c00640 1 -- start start 2024-09-21T05:52:15.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.365+0000 7fe548c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe544105d80 0x7fe54419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:15.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.365+0000 7fe548c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe54410b6c0 0x7fe54419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:15.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.365+0000 7fe548c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe54410c010 0x7fe5441a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:15.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.365+0000 7fe548c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe544115d20 con 0x7fe54410b6c0 2024-09-21T05:52:15.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.365+0000 7fe548c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe544115ba0 con 0x7fe54410c010 2024-09-21T05:52:15.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.365+0000 7fe548c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe544115ea0 con 0x7fe544105d80 2024-09-21T05:52:15.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.366+0000 7fe541e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe544105d80 0x7fe54419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:15.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.366+0000 7fe541e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe544105d80 0x7fe54419c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:52688/0 (socket says 172.21.15.37:52688) 2024-09-21T05:52:15.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.366+0000 7fe541e00640 1 -- 172.21.15.37:0/1859058008 learned_addr learned my addr 172.21.15.37:0/1859058008 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:15.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.366+0000 7fe53be00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe54410b6c0 0x7fe54419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:15.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.366+0000 7fe542800640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe54410c010 0x7fe5441a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:15.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.366+0000 7fe53be00640 1 -- 172.21.15.37:0/1859058008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe544105d80 msgr2=0x7fe54419c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:15.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.366+0000 7fe53be00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe544105d80 0x7fe54419c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.366+0000 7fe53be00640 1 -- 172.21.15.37:0/1859058008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe54410c010 msgr2=0x7fe5441a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:15.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.366+0000 7fe53be00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe54410c010 0x7fe5441a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.366+0000 7fe53be00640 1 -- 172.21.15.37:0/1859058008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5441a2620 con 0x7fe54410b6c0 2024-09-21T05:52:15.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.366+0000 7fe541e00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe544105d80 0x7fe54419c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:15.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.367+0000 7fe53be00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe54410b6c0 0x7fe54419cc50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe52c005fd0 tx=0x7fe52c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:15.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.367+0000 7fe53aa00640 1 -- 172.21.15.37:0/1859058008 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c009c00 con 0x7fe54410b6c0 2024-09-21T05:52:15.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.367+0000 7fe53aa00640 1 -- 172.21.15.37:0/1859058008 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe52c009da0 con 0x7fe54410b6c0 2024-09-21T05:52:15.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.367+0000 7fe548c00640 1 -- 172.21.15.37:0/1859058008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5441a2910 con 0x7fe54410b6c0 2024-09-21T05:52:15.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.367+0000 7fe53aa00640 1 -- 172.21.15.37:0/1859058008 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c003e10 con 0x7fe54410b6c0 2024-09-21T05:52:15.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.367+0000 7fe548c00640 1 -- 172.21.15.37:0/1859058008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5441a9070 con 0x7fe54410b6c0 2024-09-21T05:52:15.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.368+0000 7fe548c00640 1 -- 172.21.15.37:0/1859058008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe544106190 con 0x7fe54410b6c0 2024-09-21T05:52:15.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.371+0000 7fe53aa00640 1 -- 172.21.15.37:0/1859058008 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fe52c003fb0 con 0x7fe54410b6c0 2024-09-21T05:52:15.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.372+0000 7fe53aa00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe5280b65a0 0x7fe5280b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:15.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.372+0000 7fe53aa00640 1 -- 172.21.15.37:0/1859058008 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fe52c0e7380 con 0x7fe54410b6c0 2024-09-21T05:52:15.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.373+0000 7fe541e00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe5280b65a0 0x7fe5280b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:15.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.373+0000 7fe541e00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe5280b65a0 0x7fe5280b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe5340096c0 tx=0x7fe534005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:15.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.377+0000 7fe53aa00640 1 -- 172.21.15.37:0/1859058008 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe52c017020 con 0x7fe54410b6c0 2024-09-21T05:52:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.628+0000 7fe548c00640 1 -- 172.21.15.37:0/1859058008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe54410d850 con 0x7fe54410b6c0 2024-09-21T05:52:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.634+0000 7fe53aa00640 1 -- 172.21.15.37:0/1859058008 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) ==== 74+0+296436 (secure 0 0 0) 0x7fe52c0b1ad0 con 0x7fe54410b6c0 2024-09-21T05:52:15.638 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:52:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.639+0000 7fe548c00640 1 -- 172.21.15.37:0/1859058008 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe5280b65a0 msgr2=0x7fe5280b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.639+0000 7fe548c00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe5280b65a0 0x7fe5280b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe5340096c0 tx=0x7fe534005a20 comp rx=0 tx=0).stop 2024-09-21T05:52:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.639+0000 7fe548c00640 1 -- 172.21.15.37:0/1859058008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe54410b6c0 msgr2=0x7fe54419cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.639+0000 7fe548c00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe54410b6c0 0x7fe54419cc50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe52c005fd0 tx=0x7fe52c00dde0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.639+0000 7fe548c00640 1 -- 172.21.15.37:0/1859058008 shutdown_connections 2024-09-21T05:52:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.639+0000 7fe548c00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe5280b65a0 0x7fe5280b8ab0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.639+0000 7fe548c00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe54410c010 0x7fe5441a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.639+0000 7fe548c00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe54410b6c0 0x7fe54419cc50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.639+0000 7fe548c00640 1 --2- 172.21.15.37:0/1859058008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe544105d80 0x7fe54419c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.639+0000 7fe548c00640 1 -- 172.21.15.37:0/1859058008 >> 172.21.15.37:0/1859058008 conn(0x7fe544101810 msgr2=0x7fe544103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.639+0000 7fe548c00640 1 -- 172.21.15.37:0/1859058008 shutdown_connections 2024-09-21T05:52:15.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:15.639+0000 7fe548c00640 1 -- 172.21.15.37:0/1859058008 wait complete. 2024-09-21T05:52:15.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:15 smithi144 ceph-mon[34351]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T05:52:15.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:15 smithi037 ceph-mon[30631]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T05:52:15.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:15 smithi067 ceph-mon[34443]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T05:52:16.371 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"flags":0,"active_gid":14154,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3016662141},{"type":"v1","addr":"172.21.15.37:6801","nonce":3016662141}]},"active_addr":"172.21.15.37:6801/3016662141","active_change":"2024-09-21T05:42:46.114555+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24118,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24146,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.37:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":2776606190}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":883826775}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":2833364856}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1745596359}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":947282248}]}]} 2024-09-21T05:52:16.377 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T05:52:16.377 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T05:52:16.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:52:16.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:16 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1859058008' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T05:52:16.755 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:16.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:16 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1859058008' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T05:52:16.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:16 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1859058008' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T05:52:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.388+0000 7fd9a0000640 1 -- 172.21.15.37:0/1285328180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd998077380 msgr2=0x7fd9980757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.388+0000 7fd9a0000640 1 --2- 172.21.15.37:0/1285328180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd998077380 0x7fd9980757b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009860 tx=0x7fd98c02a340 comp rx=0 tx=0).stop 2024-09-21T05:52:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.388+0000 7fd9a0000640 1 -- 172.21.15.37:0/1285328180 shutdown_connections 2024-09-21T05:52:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.388+0000 7fd9a0000640 1 --2- 172.21.15.37:0/1285328180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd998114430 0x7fd998116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.388+0000 7fd9a0000640 1 --2- 172.21.15.37:0/1285328180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd998075dd0 0x7fd9980761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.388+0000 7fd9a0000640 1 --2- 172.21.15.37:0/1285328180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd998077380 0x7fd9980757b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.388+0000 7fd9a0000640 1 -- 172.21.15.37:0/1285328180 >> 172.21.15.37:0/1285328180 conn(0x7fd99807b850 msgr2=0x7fd99807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.388+0000 7fd9a0000640 1 -- 172.21.15.37:0/1285328180 shutdown_connections 2024-09-21T05:52:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.388+0000 7fd9a0000640 1 -- 172.21.15.37:0/1285328180 wait complete. 2024-09-21T05:52:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.389+0000 7fd9a0000640 1 Processor -- start 2024-09-21T05:52:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.389+0000 7fd9a0000640 1 -- start start 2024-09-21T05:52:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd9a0000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd998075dd0 0x7fd9981a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd9a0000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd998077380 0x7fd9981a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd9a0000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd998114430 0x7fd9981a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd9a0000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd99811a080 con 0x7fd998114430 2024-09-21T05:52:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd9a0000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd998119f00 con 0x7fd998075dd0 2024-09-21T05:52:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd9a0000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd99811a200 con 0x7fd998077380 2024-09-21T05:52:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd99d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd998075dd0 0x7fd9981a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd99e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd998114430 0x7fd9981a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd99cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd998077380 0x7fd9981a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd99cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd998077380 0x7fd9981a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:52708/0 (socket says 172.21.15.37:52708) 2024-09-21T05:52:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd99d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd998075dd0 0x7fd9981a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:53778/0 (socket says 172.21.15.37:53778) 2024-09-21T05:52:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd99cc00640 1 -- 172.21.15.37:0/201528751 learned_addr learned my addr 172.21.15.37:0/201528751 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd99e000640 1 -- 172.21.15.37:0/201528751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd998077380 msgr2=0x7fd9981a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd99e000640 1 --2- 172.21.15.37:0/201528751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd998077380 0x7fd9981a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd99e000640 1 -- 172.21.15.37:0/201528751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd998075dd0 msgr2=0x7fd9981a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd99e000640 1 --2- 172.21.15.37:0/201528751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd998075dd0 0x7fd9981a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.390+0000 7fd99e000640 1 -- 172.21.15.37:0/201528751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9981a69c0 con 0x7fd998114430 2024-09-21T05:52:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.391+0000 7fd99e000640 1 --2- 172.21.15.37:0/201528751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd998114430 0x7fd9981a6290 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd99000ef00 tx=0x7fd99000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.391+0000 7fd996000640 1 -- 172.21.15.37:0/201528751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990004b20 con 0x7fd998114430 2024-09-21T05:52:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.391+0000 7fd996000640 1 -- 172.21.15.37:0/201528751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd990003e20 con 0x7fd998114430 2024-09-21T05:52:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.391+0000 7fd996000640 1 -- 172.21.15.37:0/201528751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99000b570 con 0x7fd998114430 2024-09-21T05:52:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.391+0000 7fd9a0000640 1 -- 172.21.15.37:0/201528751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9981a6cb0 con 0x7fd998114430 2024-09-21T05:52:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.391+0000 7fd9a0000640 1 -- 172.21.15.37:0/201528751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9981ad410 con 0x7fd998114430 2024-09-21T05:52:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.392+0000 7fd9a0000640 1 -- 172.21.15.37:0/201528751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd998076cc0 con 0x7fd998114430 2024-09-21T05:52:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.395+0000 7fd996000640 1 -- 172.21.15.37:0/201528751 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fd99001d020 con 0x7fd998114430 2024-09-21T05:52:17.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.396+0000 7fd996000640 1 --2- 172.21.15.37:0/201528751 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd9800b6620 0x7fd9800b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:17.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.397+0000 7fd996000640 1 -- 172.21.15.37:0/201528751 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fd9900e8090 con 0x7fd998114430 2024-09-21T05:52:17.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.397+0000 7fd99d600640 1 --2- 172.21.15.37:0/201528751 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd9800b6620 0x7fd9800b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:17.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.397+0000 7fd99d600640 1 --2- 172.21.15.37:0/201528751 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd9800b6620 0x7fd9800b8b30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009830 tx=0x7fd98c030340 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:17.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.398+0000 7fd996000640 1 -- 172.21.15.37:0/201528751 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd990024030 con 0x7fd998114430 2024-09-21T05:52:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.601+0000 7fd9a0000640 1 -- 172.21.15.37:0/201528751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9981ad640 con 0x7fd998114430 2024-09-21T05:52:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.602+0000 7fd996000640 1 -- 172.21.15.37:0/201528751 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24648 (secure 0 0 0) 0x7fd990004cc0 con 0x7fd998114430 2024-09-21T05:52:17.605 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:52:17.605 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":88,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:51:47.353816+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:50:49.791290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:50:51.877662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:51:01.928796+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:52:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.605+0000 7fd9a0000640 1 -- 172.21.15.37:0/201528751 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd9800b6620 msgr2=0x7fd9800b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.605+0000 7fd9a0000640 1 --2- 172.21.15.37:0/201528751 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd9800b6620 0x7fd9800b8b30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009830 tx=0x7fd98c030340 comp rx=0 tx=0).stop 2024-09-21T05:52:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.605+0000 7fd9a0000640 1 -- 172.21.15.37:0/201528751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd998114430 msgr2=0x7fd9981a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.605+0000 7fd9a0000640 1 --2- 172.21.15.37:0/201528751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd998114430 0x7fd9981a6290 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd99000ef00 tx=0x7fd99000c740 comp rx=0 tx=0).stop 2024-09-21T05:52:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.605+0000 7fd9a0000640 1 -- 172.21.15.37:0/201528751 shutdown_connections 2024-09-21T05:52:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.605+0000 7fd9a0000640 1 --2- 172.21.15.37:0/201528751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd998114430 0x7fd9981a6290 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.605+0000 7fd9a0000640 1 --2- 172.21.15.37:0/201528751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd998077380 0x7fd9981a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.605+0000 7fd9a0000640 1 --2- 172.21.15.37:0/201528751 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd9800b6620 0x7fd9800b8b30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.605+0000 7fd9a0000640 1 --2- 172.21.15.37:0/201528751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd998075dd0 0x7fd9981a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.605+0000 7fd9a0000640 1 -- 172.21.15.37:0/201528751 >> 172.21.15.37:0/201528751 conn(0x7fd99807b850 msgr2=0x7fd998113090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.605+0000 7fd9a0000640 1 -- 172.21.15.37:0/201528751 shutdown_connections 2024-09-21T05:52:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:17.605+0000 7fd9a0000640 1 -- 172.21.15.37:0/201528751 wait complete. 2024-09-21T05:52:17.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:17 smithi144 ceph-mon[34351]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T05:52:17.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:17 smithi037 ceph-mon[30631]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T05:52:17.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:17 smithi067 ceph-mon[34443]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T05:52:18.357 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T05:52:18.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:52:18.739 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:18.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:18 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/201528751' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:18.879 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:18 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/201528751' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:18.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:18 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/201528751' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.381+0000 7fcb28400640 1 -- 172.21.15.37:0/2690974841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb2010de30 msgr2=0x7fcb20110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.381+0000 7fcb28400640 1 --2- 172.21.15.37:0/2690974841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb2010de30 0x7fcb20110320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009ca0 tx=0x7fcb1802a8b0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.381+0000 7fcb28400640 1 -- 172.21.15.37:0/2690974841 shutdown_connections 2024-09-21T05:52:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.381+0000 7fcb28400640 1 --2- 172.21.15.37:0/2690974841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb2010de30 0x7fcb20110320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.381+0000 7fcb28400640 1 --2- 172.21.15.37:0/2690974841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb20105320 0x7fcb2010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.381+0000 7fcb28400640 1 --2- 172.21.15.37:0/2690974841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb201049d0 0x7fcb20104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.381+0000 7fcb28400640 1 -- 172.21.15.37:0/2690974841 >> 172.21.15.37:0/2690974841 conn(0x7fcb20079740 msgr2=0x7fcb20079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.381+0000 7fcb28400640 1 -- 172.21.15.37:0/2690974841 shutdown_connections 2024-09-21T05:52:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.382+0000 7fcb28400640 1 -- 172.21.15.37:0/2690974841 wait complete. 2024-09-21T05:52:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.383+0000 7fcb28400640 1 Processor -- start 2024-09-21T05:52:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.383+0000 7fcb28400640 1 -- start start 2024-09-21T05:52:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb28400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb201049d0 0x7fcb2019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb28400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb20105320 0x7fcb2019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb28400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb2010de30 0x7fcb2019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb28400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb20113a90 con 0x7fcb2010de30 2024-09-21T05:52:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb28400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcb20113910 con 0x7fcb20105320 2024-09-21T05:52:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb28400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcb20113c10 con 0x7fcb201049d0 2024-09-21T05:52:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb25a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb201049d0 0x7fcb2019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb26400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb2010de30 0x7fcb2019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb25a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb201049d0 0x7fcb2019a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:52738/0 (socket says 172.21.15.37:52738) 2024-09-21T05:52:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb25a00640 1 -- 172.21.15.37:0/3190553706 learned_addr learned my addr 172.21.15.37:0/3190553706 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb25000640 1 --2- 172.21.15.37:0/3190553706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb20105320 0x7fcb2019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb25a00640 1 -- 172.21.15.37:0/3190553706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb20105320 msgr2=0x7fcb2019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb25a00640 1 --2- 172.21.15.37:0/3190553706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb20105320 0x7fcb2019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb25a00640 1 -- 172.21.15.37:0/3190553706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb2010de30 msgr2=0x7fcb2019fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb25a00640 1 --2- 172.21.15.37:0/3190553706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb2010de30 0x7fcb2019fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.384+0000 7fcb25a00640 1 -- 172.21.15.37:0/3190553706 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb201a03d0 con 0x7fcb201049d0 2024-09-21T05:52:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.385+0000 7fcb25a00640 1 --2- 172.21.15.37:0/3190553706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb201049d0 0x7fcb2019a460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400e9c0 tx=0x7fcb1400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.385+0000 7fcb1e000640 1 -- 172.21.15.37:0/3190553706 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1400cde0 con 0x7fcb201049d0 2024-09-21T05:52:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.385+0000 7fcb1e000640 1 -- 172.21.15.37:0/3190553706 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb140108e0 con 0x7fcb201049d0 2024-09-21T05:52:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.385+0000 7fcb1e000640 1 -- 172.21.15.37:0/3190553706 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14018960 con 0x7fcb201049d0 2024-09-21T05:52:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.385+0000 7fcb28400640 1 -- 172.21.15.37:0/3190553706 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb201a06c0 con 0x7fcb201049d0 2024-09-21T05:52:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.385+0000 7fcb28400640 1 -- 172.21.15.37:0/3190553706 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb201025f0 con 0x7fcb201049d0 2024-09-21T05:52:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.386+0000 7fcb28400640 1 -- 172.21.15.37:0/3190553706 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2006c240 con 0x7fcb201049d0 2024-09-21T05:52:19.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.389+0000 7fcb1e000640 1 -- 172.21.15.37:0/3190553706 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fcb1401f020 con 0x7fcb201049d0 2024-09-21T05:52:19.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.390+0000 7fcb1e000640 1 --2- 172.21.15.37:0/3190553706 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcb080b6620 0x7fcb080b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.390+0000 7fcb1e000640 1 -- 172.21.15.37:0/3190553706 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fcb140e81c0 con 0x7fcb201049d0 2024-09-21T05:52:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.390+0000 7fcb25000640 1 --2- 172.21.15.37:0/3190553706 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcb080b6620 0x7fcb080b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.391+0000 7fcb25000640 1 --2- 172.21.15.37:0/3190553706 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcb080b6620 0x7fcb080b8b30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcb2010fb40 tx=0x7fcb0c005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:19.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.392+0000 7fcb1e000640 1 -- 172.21.15.37:0/3190553706 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb14026070 con 0x7fcb201049d0 2024-09-21T05:52:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.593+0000 7fcb28400640 1 -- 172.21.15.37:0/3190553706 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb20104de0 con 0x7fcb201049d0 2024-09-21T05:52:19.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.595+0000 7fcb1e000640 1 -- 172.21.15.37:0/3190553706 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24648 (secure 0 0 0) 0x7fcb140ae530 con 0x7fcb201049d0 2024-09-21T05:52:19.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:52:19.598 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":88,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:51:47.353816+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:50:49.791290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:50:51.877662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:51:01.928796+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:52:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.598+0000 7fcb28400640 1 -- 172.21.15.37:0/3190553706 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcb080b6620 msgr2=0x7fcb080b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.598+0000 7fcb28400640 1 --2- 172.21.15.37:0/3190553706 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcb080b6620 0x7fcb080b8b30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcb2010fb40 tx=0x7fcb0c005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.598+0000 7fcb28400640 1 -- 172.21.15.37:0/3190553706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb201049d0 msgr2=0x7fcb2019a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.598+0000 7fcb28400640 1 --2- 172.21.15.37:0/3190553706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb201049d0 0x7fcb2019a460 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400e9c0 tx=0x7fcb1400ee80 comp rx=0 tx=0).stop 2024-09-21T05:52:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.598+0000 7fcb28400640 1 -- 172.21.15.37:0/3190553706 shutdown_connections 2024-09-21T05:52:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.598+0000 7fcb28400640 1 --2- 172.21.15.37:0/3190553706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb2010de30 0x7fcb2019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.598+0000 7fcb28400640 1 --2- 172.21.15.37:0/3190553706 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcb080b6620 0x7fcb080b8b30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.598+0000 7fcb28400640 1 --2- 172.21.15.37:0/3190553706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb20105320 0x7fcb2019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.598+0000 7fcb28400640 1 --2- 172.21.15.37:0/3190553706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb201049d0 0x7fcb2019a460 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.598+0000 7fcb28400640 1 -- 172.21.15.37:0/3190553706 >> 172.21.15.37:0/3190553706 conn(0x7fcb20079740 msgr2=0x7fcb200ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.598+0000 7fcb28400640 1 -- 172.21.15.37:0/3190553706 shutdown_connections 2024-09-21T05:52:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:19.598+0000 7fcb28400640 1 -- 172.21.15.37:0/3190553706 wait complete. 2024-09-21T05:52:19.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:19 smithi144 ceph-mon[34351]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:52:19.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:19 smithi037 ceph-mon[30631]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:52:19.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:19 smithi067 ceph-mon[34443]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:52:20.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T05:52:20.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T05:52:20.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T05:52:20.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T05:52:20.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T05:52:20.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T05:52:20.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T05:52:20.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T05:52:20.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T05:52:20.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T05:52:20.461 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T05:52:20.461 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T05:52:20.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:20 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3190553706' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:20.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:20 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3190553706' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:20.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:20 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3190553706' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:52:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:21.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:21 smithi037 ceph-mon[30631]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:52:21.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:21 smithi144 ceph-mon[34351]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:52:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:21 smithi067 ceph-mon[34443]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:52:22.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.227+0000 7fddd6c00640 1 -- 172.21.15.37:0/1394113718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0109e10 msgr2=0x7fddd0110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:22.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.227+0000 7fddd6c00640 1 --2- 172.21.15.37:0/1394113718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0109e10 0x7fddd0110640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009be0 tx=0x7fddc802a6c0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.228+0000 7fddd6c00640 1 -- 172.21.15.37:0/1394113718 shutdown_connections 2024-09-21T05:52:22.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.228+0000 7fddd6c00640 1 --2- 172.21.15.37:0/1394113718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0109e10 0x7fddd0110640 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.228+0000 7fddd6c00640 1 --2- 172.21.15.37:0/1394113718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd01094c0 0x7fddd01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.228+0000 7fddd6c00640 1 --2- 172.21.15.37:0/1394113718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddd0103b80 0x7fddd0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.228+0000 7fddd6c00640 1 -- 172.21.15.37:0/1394113718 >> 172.21.15.37:0/1394113718 conn(0x7fddd00ff5d0 msgr2=0x7fddd0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.228+0000 7fddd6c00640 1 -- 172.21.15.37:0/1394113718 shutdown_connections 2024-09-21T05:52:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.228+0000 7fddd6c00640 1 -- 172.21.15.37:0/1394113718 wait complete. 2024-09-21T05:52:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.229+0000 7fddd6c00640 1 Processor -- start 2024-09-21T05:52:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.229+0000 7fddd6c00640 1 -- start start 2024-09-21T05:52:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.229+0000 7fddd6c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0103b80 0x7fddd019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.229+0000 7fddd6c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddd01094c0 0x7fddd019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.229+0000 7fddd6c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0109e10 0x7fddd019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.229+0000 7fddd6c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0113ad0 con 0x7fddd0103b80 2024-09-21T05:52:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.229+0000 7fddd6c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0113950 con 0x7fddd01094c0 2024-09-21T05:52:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.229+0000 7fddd6c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0113c50 con 0x7fddd0109e10 2024-09-21T05:52:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.229+0000 7fddcfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0103b80 0x7fddd019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.229+0000 7fddcfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0103b80 0x7fddd019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34036/0 (socket says 172.21.15.37:34036) 2024-09-21T05:52:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.230+0000 7fddcfe00640 1 -- 172.21.15.37:0/3690507793 learned_addr learned my addr 172.21.15.37:0/3690507793 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:22.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.230+0000 7fddcf400640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddd01094c0 0x7fddd019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:22.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.230+0000 7fddd4c00640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0109e10 0x7fddd019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:22.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.230+0000 7fddcf400640 1 -- 172.21.15.37:0/3690507793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0109e10 msgr2=0x7fddd019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:22.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.230+0000 7fddcf400640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0109e10 0x7fddd019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.230+0000 7fddcf400640 1 -- 172.21.15.37:0/3690507793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0103b80 msgr2=0x7fddd019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:22.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.230+0000 7fddcf400640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0103b80 0x7fddd019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.230+0000 7fddcf400640 1 -- 172.21.15.37:0/3690507793 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd01a0410 con 0x7fddd01094c0 2024-09-21T05:52:22.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.230+0000 7fddcfe00640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0103b80 0x7fddd019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:22.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.230+0000 7fddcf400640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddd01094c0 0x7fddd019aa40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fddd006c780 tx=0x7fddbc00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:22.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.231+0000 7fddccc00640 1 -- 172.21.15.37:0/3690507793 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00ccd0 con 0x7fddd01094c0 2024-09-21T05:52:22.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.231+0000 7fddccc00640 1 -- 172.21.15.37:0/3690507793 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddbc0035f0 con 0x7fddd01094c0 2024-09-21T05:52:22.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.231+0000 7fddd6c00640 1 -- 172.21.15.37:0/3690507793 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd01a0700 con 0x7fddd01094c0 2024-09-21T05:52:22.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.231+0000 7fddccc00640 1 -- 172.21.15.37:0/3690507793 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc010690 con 0x7fddd01094c0 2024-09-21T05:52:22.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.231+0000 7fddd6c00640 1 -- 172.21.15.37:0/3690507793 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd01a6e60 con 0x7fddd01094c0 2024-09-21T05:52:22.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.232+0000 7fddd6c00640 1 -- 172.21.15.37:0/3690507793 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fddd0063b50 con 0x7fddd01094c0 2024-09-21T05:52:22.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.235+0000 7fddccc00640 1 -- 172.21.15.37:0/3690507793 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fddbc003a80 con 0x7fddd01094c0 2024-09-21T05:52:22.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.236+0000 7fddccc00640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fddb40b65a0 0x7fddb40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:22.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.236+0000 7fddccc00640 1 -- 172.21.15.37:0/3690507793 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fddbc0e7c00 con 0x7fddd01094c0 2024-09-21T05:52:22.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.236+0000 7fddcfe00640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fddb40b65a0 0x7fddb40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:22.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.236+0000 7fddccc00640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060] conn(0x7fddb40c16b0 0x7fddb40c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:22.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.236+0000 7fddccc00640 1 -- 172.21.15.37:0/3690507793 --> [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fddbc016ec0 con 0x7fddb40c16b0 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.236+0000 7fddccc00640 1 -- 172.21.15.37:0/3690507793 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fddbc0e7fb0 con 0x7fddd01094c0 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.237+0000 7fddd4c00640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060] conn(0x7fddb40c16b0 0x7fddb40c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.237+0000 7fddcfe00640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fddb40b65a0 0x7fddb40b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fddc0011500 tx=0x7fddc0005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.237+0000 7fddd4c00640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060] conn(0x7fddb40c16b0 0x7fddb40c3ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.238+0000 7fddccc00640 1 -- 172.21.15.37:0/3690507793 <== osd.2 v2:172.21.15.144:6800/289727060 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fddbc016ec0 con 0x7fddb40c16b0 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.255+0000 7fddd6c00640 1 -- 172.21.15.37:0/3690507793 --> [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fddd0063fd0 con 0x7fddb40c16b0 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.256+0000 7fddccc00640 1 -- 172.21.15.37:0/3690507793 <== osd.2 v2:172.21.15.144:6800/289727060 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fddd0063fd0 con 0x7fddb40c16b0 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.256+0000 7fddd6c00640 1 -- 172.21.15.37:0/3690507793 >> [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060] conn(0x7fddb40c16b0 msgr2=0x7fddb40c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.256+0000 7fddd6c00640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060] conn(0x7fddb40c16b0 0x7fddb40c3ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.256+0000 7fddd6c00640 1 -- 172.21.15.37:0/3690507793 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fddb40b65a0 msgr2=0x7fddb40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.256+0000 7fddd6c00640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fddb40b65a0 0x7fddb40b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fddc0011500 tx=0x7fddc0005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.256+0000 7fddd6c00640 1 -- 172.21.15.37:0/3690507793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddd01094c0 msgr2=0x7fddd019aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.256+0000 7fddd6c00640 1 --2- 172.21.15.37:0/3690507793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddd01094c0 0x7fddd019aa40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fddd006c780 tx=0x7fddbc00ee50 comp rx=0 tx=0).stop 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.256+0000 7fddd4c00640 1 -- 172.21.15.37:0/3690507793 reap_dead start 2024-09-21T05:52:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.257+0000 7fddd6c00640 1 -- 172.21.15.37:0/3690507793 shutdown_connections 2024-09-21T05:52:22.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.257+0000 7fddd6c00640 1 -- 172.21.15.37:0/3690507793 >> 172.21.15.37:0/3690507793 conn(0x7fddd00ff5d0 msgr2=0x7fddd01019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:22.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.257+0000 7fddd6c00640 1 -- 172.21.15.37:0/3690507793 shutdown_connections 2024-09-21T05:52:22.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:22.257+0000 7fddd6c00640 1 -- 172.21.15.37:0/3690507793 wait complete. 2024-09-21T05:52:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.218+0000 7ff5aac00640 1 -- 172.21.15.37:0/3199464913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5a4103990 msgr2=0x7ff5a4103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.218+0000 7ff5aac00640 1 --2- 172.21.15.37:0/3199464913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5a4103990 0x7ff5a4103da0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff598009900 tx=0x7ff59802a410 comp rx=0 tx=0).stop 2024-09-21T05:52:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.219+0000 7ff5aac00640 1 -- 172.21.15.37:0/3199464913 shutdown_connections 2024-09-21T05:52:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.219+0000 7ff5aac00640 1 --2- 172.21.15.37:0/3199464913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5a4109c20 0x7ff5a4110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.219+0000 7ff5aac00640 1 --2- 172.21.15.37:0/3199464913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a41092d0 0x7ff5a41096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.219+0000 7ff5aac00640 1 --2- 172.21.15.37:0/3199464913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5a4103990 0x7ff5a4103da0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.219+0000 7ff5aac00640 1 -- 172.21.15.37:0/3199464913 >> 172.21.15.37:0/3199464913 conn(0x7ff5a40ff440 msgr2=0x7ff5a4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.219+0000 7ff5aac00640 1 -- 172.21.15.37:0/3199464913 shutdown_connections 2024-09-21T05:52:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.219+0000 7ff5aac00640 1 -- 172.21.15.37:0/3199464913 wait complete. 2024-09-21T05:52:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.220+0000 7ff5aac00640 1 Processor -- start 2024-09-21T05:52:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.220+0000 7ff5aac00640 1 -- start start 2024-09-21T05:52:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5a4103990 0x7ff5a4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5a41092d0 0x7ff5a4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a4109c20 0x7ff5a4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a4113930 con 0x7ff5a41092d0 2024-09-21T05:52:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a41137b0 con 0x7ff5a4103990 2024-09-21T05:52:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a4113ab0 con 0x7ff5a4109c20 2024-09-21T05:52:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5a8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5a41092d0 0x7ff5a4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aa200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a4109c20 0x7ff5a4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5a9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5a4103990 0x7ff5a4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aa200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a4109c20 0x7ff5a4076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:46268/0 (socket says 172.21.15.37:46268) 2024-09-21T05:52:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aa200640 1 -- 172.21.15.37:0/321761122 learned_addr learned my addr 172.21.15.37:0/321761122 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aa200640 1 -- 172.21.15.37:0/321761122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5a4103990 msgr2=0x7ff5a4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aa200640 1 --2- 172.21.15.37:0/321761122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5a4103990 0x7ff5a4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aa200640 1 -- 172.21.15.37:0/321761122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5a41092d0 msgr2=0x7ff5a4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aa200640 1 --2- 172.21.15.37:0/321761122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5a41092d0 0x7ff5a4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.221+0000 7ff5aa200640 1 -- 172.21.15.37:0/321761122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a41a8660 con 0x7ff5a4109c20 2024-09-21T05:52:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.222+0000 7ff5aa200640 1 --2- 172.21.15.37:0/321761122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a4109c20 0x7ff5a4076190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00eb10 tx=0x7ff59c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.222+0000 7ff5a2000640 1 -- 172.21.15.37:0/321761122 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c004b20 con 0x7ff5a4109c20 2024-09-21T05:52:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.222+0000 7ff5aac00640 1 -- 172.21.15.37:0/321761122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a41a8950 con 0x7ff5a4109c20 2024-09-21T05:52:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.222+0000 7ff5a2000640 1 -- 172.21.15.37:0/321761122 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff59c004cc0 con 0x7ff5a4109c20 2024-09-21T05:52:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.222+0000 7ff5a2000640 1 -- 172.21.15.37:0/321761122 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c010670 con 0x7ff5a4109c20 2024-09-21T05:52:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.222+0000 7ff5aac00640 1 -- 172.21.15.37:0/321761122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a41a8e60 con 0x7ff5a4109c20 2024-09-21T05:52:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.223+0000 7ff5aac00640 1 -- 172.21.15.37:0/321761122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5a4063ad0 con 0x7ff5a4109c20 2024-09-21T05:52:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.226+0000 7ff5a2000640 1 -- 172.21.15.37:0/321761122 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7ff59c005000 con 0x7ff5a4109c20 2024-09-21T05:52:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.227+0000 7ff5a2000640 1 --2- 172.21.15.37:0/321761122 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff58c0b65a0 0x7ff58c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.227+0000 7ff5a2000640 1 -- 172.21.15.37:0/321761122 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7ff59c0e8170 con 0x7ff5a4109c20 2024-09-21T05:52:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.228+0000 7ff5a9800640 1 --2- 172.21.15.37:0/321761122 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff58c0b65a0 0x7ff58c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.228+0000 7ff5a2000640 1 --2- 172.21.15.37:0/321761122 >> [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743] conn(0x7ff58c0c16b0 0x7ff58c0c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.228+0000 7ff5a2000640 1 -- 172.21.15.37:0/321761122 --> [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff59c015e80 con 0x7ff58c0c16b0 2024-09-21T05:52:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.228+0000 7ff5a2000640 1 -- 172.21.15.37:0/321761122 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7ff59c0e8520 con 0x7ff5a4109c20 2024-09-21T05:52:23.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.228+0000 7ff5a8e00640 1 --2- 172.21.15.37:0/321761122 >> [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743] conn(0x7ff58c0c16b0 0x7ff58c0c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:23.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.228+0000 7ff5a9800640 1 --2- 172.21.15.37:0/321761122 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff58c0b65a0 0x7ff58c0b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff598005ab0 tx=0x7ff598005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:23.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.229+0000 7ff5a8e00640 1 --2- 172.21.15.37:0/321761122 >> [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743] conn(0x7ff58c0c16b0 0x7ff58c0c3ba0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.230+0000 7ff5a2000640 1 -- 172.21.15.37:0/321761122 <== osd.4 v2:172.21.15.67:6808/2545409743 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff59c015e80 con 0x7ff58c0c16b0 2024-09-21T05:52:23.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.245+0000 7ff5aac00640 1 -- 172.21.15.37:0/321761122 --> [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff5a4063f50 con 0x7ff58c0c16b0 2024-09-21T05:52:23.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.246+0000 7ff5a2000640 1 -- 172.21.15.37:0/321761122 <== osd.4 v2:172.21.15.67:6808/2545409743 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff5a4063f50 con 0x7ff58c0c16b0 2024-09-21T05:52:23.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.246+0000 7ff5aac00640 1 -- 172.21.15.37:0/321761122 >> [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743] conn(0x7ff58c0c16b0 msgr2=0x7ff58c0c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.246+0000 7ff5aac00640 1 --2- 172.21.15.37:0/321761122 >> [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743] conn(0x7ff58c0c16b0 0x7ff58c0c3ba0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.246+0000 7ff5aac00640 1 -- 172.21.15.37:0/321761122 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff58c0b65a0 msgr2=0x7ff58c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.246+0000 7ff5aac00640 1 --2- 172.21.15.37:0/321761122 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff58c0b65a0 0x7ff58c0b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff598005ab0 tx=0x7ff598005a20 comp rx=0 tx=0).stop 2024-09-21T05:52:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.246+0000 7ff5aac00640 1 -- 172.21.15.37:0/321761122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a4109c20 msgr2=0x7ff5a4076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.246+0000 7ff5aac00640 1 --2- 172.21.15.37:0/321761122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a4109c20 0x7ff5a4076190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00eb10 tx=0x7ff59c00c2d0 comp rx=0 tx=0).stop 2024-09-21T05:52:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.246+0000 7ff5aa200640 1 -- 172.21.15.37:0/321761122 reap_dead start 2024-09-21T05:52:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.246+0000 7ff5aac00640 1 -- 172.21.15.37:0/321761122 shutdown_connections 2024-09-21T05:52:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.246+0000 7ff5aac00640 1 -- 172.21.15.37:0/321761122 >> 172.21.15.37:0/321761122 conn(0x7ff5a40ff440 msgr2=0x7ff5a4108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.246+0000 7ff5aac00640 1 -- 172.21.15.37:0/321761122 shutdown_connections 2024-09-21T05:52:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:23.246+0000 7ff5aac00640 1 -- 172.21.15.37:0/321761122 wait complete. 2024-09-21T05:52:23.706 INFO:teuthology.orchestra.run.smithi037.stdout:73014444113 2024-09-21T05:52:23.706 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T05:52:23.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:23 smithi144 ceph-mon[34351]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-21T05:52:23.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:23 smithi037 ceph-mon[30631]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-21T05:52:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:23.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:23 smithi067 ceph-mon[34443]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-21T05:52:24.643 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.430+0000 7f3dd6a00640 1 -- 172.21.15.37:0/3608349017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd0103b80 msgr2=0x7f3dd0103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.430+0000 7f3dd6a00640 1 --2- 172.21.15.37:0/3608349017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd0103b80 0x7f3dd0103f90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009900 tx=0x7f3dc002a410 comp rx=0 tx=0).stop 2024-09-21T05:52:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.430+0000 7f3dd6a00640 1 -- 172.21.15.37:0/3608349017 shutdown_connections 2024-09-21T05:52:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.430+0000 7f3dd6a00640 1 --2- 172.21.15.37:0/3608349017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd0109e10 0x7f3dd0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.430+0000 7f3dd6a00640 1 --2- 172.21.15.37:0/3608349017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd01094c0 0x7f3dd01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.430+0000 7f3dd6a00640 1 --2- 172.21.15.37:0/3608349017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd0103b80 0x7f3dd0103f90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.430+0000 7f3dd6a00640 1 -- 172.21.15.37:0/3608349017 >> 172.21.15.37:0/3608349017 conn(0x7f3dd00ff590 msgr2=0x7f3dd01019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.430+0000 7f3dd6a00640 1 -- 172.21.15.37:0/3608349017 shutdown_connections 2024-09-21T05:52:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.430+0000 7f3dd6a00640 1 -- 172.21.15.37:0/3608349017 wait complete. 2024-09-21T05:52:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.431+0000 7f3dd6a00640 1 Processor -- start 2024-09-21T05:52:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.432+0000 7f3dd6a00640 1 -- start start 2024-09-21T05:52:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.432+0000 7f3dd6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd0103b80 0x7f3dd019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.432+0000 7f3dd6a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd01094c0 0x7f3dd019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.432+0000 7f3dd6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd0109e10 0x7f3dd01a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.432+0000 7f3dd6a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0113ad0 con 0x7f3dd0103b80 2024-09-21T05:52:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.432+0000 7f3dd6a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0113950 con 0x7f3dd01094c0 2024-09-21T05:52:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.432+0000 7f3dd6a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd0113c50 con 0x7f3dd0109e10 2024-09-21T05:52:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.432+0000 7f3dcfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd0103b80 0x7f3dd019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.432+0000 7f3dcfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd0103b80 0x7f3dd019c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34130/0 (socket says 172.21.15.37:34130) 2024-09-21T05:52:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.432+0000 7f3dcfe00640 1 -- 172.21.15.37:0/1058132360 learned_addr learned my addr 172.21.15.37:0/1058132360 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.433+0000 7f3dcf400640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd01094c0 0x7f3dd019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.433+0000 7f3dd4a00640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd0109e10 0x7f3dd01a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.433+0000 7f3dcfe00640 1 -- 172.21.15.37:0/1058132360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd0109e10 msgr2=0x7f3dd01a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.433+0000 7f3dcfe00640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd0109e10 0x7f3dd01a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.433+0000 7f3dcfe00640 1 -- 172.21.15.37:0/1058132360 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd01094c0 msgr2=0x7f3dd019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.433+0000 7f3dcfe00640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd01094c0 0x7f3dd019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.433+0000 7f3dcfe00640 1 -- 172.21.15.37:0/1058132360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd01a2610 con 0x7f3dd0103b80 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.433+0000 7f3dcfe00640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd0103b80 0x7f3dd019c6a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0005940 tx=0x7f3dc0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.434+0000 7f3dccc00640 1 -- 172.21.15.37:0/1058132360 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc003f030 con 0x7f3dd0103b80 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.434+0000 7f3dd6a00640 1 -- 172.21.15.37:0/1058132360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd01a28a0 con 0x7f3dd0103b80 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.434+0000 7f3dccc00640 1 -- 172.21.15.37:0/1058132360 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dc0003aa0 con 0x7f3dd0103b80 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.434+0000 7f3dccc00640 1 -- 172.21.15.37:0/1058132360 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0035070 con 0x7f3dd0103b80 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.434+0000 7f3dd6a00640 1 -- 172.21.15.37:0/1058132360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd01a9060 con 0x7f3dd0103b80 2024-09-21T05:52:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.435+0000 7f3dd6a00640 1 -- 172.21.15.37:0/1058132360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3dd0063b50 con 0x7f3dd0103b80 2024-09-21T05:52:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.437+0000 7f3dccc00640 1 -- 172.21.15.37:0/1058132360 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f3dc0042030 con 0x7f3dd0103b80 2024-09-21T05:52:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.439+0000 7f3dccc00640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3db40b65a0 0x7f3db40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.439+0000 7f3dccc00640 1 -- 172.21.15.37:0/1058132360 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f3dc01080e0 con 0x7f3dd0103b80 2024-09-21T05:52:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.439+0000 7f3dcf400640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3db40b65a0 0x7f3db40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.439+0000 7f3dccc00640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946] conn(0x7f3db40c16b0 0x7f3db40c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.439+0000 7f3dccc00640 1 -- 172.21.15.37:0/1058132360 --> [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3dc0045e50 con 0x7f3db40c16b0 2024-09-21T05:52:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.439+0000 7f3dccc00640 1 -- 172.21.15.37:0/1058132360 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f3dc0108490 con 0x7f3dd0103b80 2024-09-21T05:52:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.440+0000 7f3dd4a00640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946] conn(0x7f3db40c16b0 0x7f3db40c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.440+0000 7f3dcf400640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3db40b65a0 0x7f3db40b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0108ce0 tx=0x7f3dbc00b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.440+0000 7f3dd4a00640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946] conn(0x7f3db40c16b0 0x7f3db40c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.441+0000 7f3dccc00640 1 -- 172.21.15.37:0/1058132360 <== osd.0 v2:172.21.15.37:6802/2521687946 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3dc0045e50 con 0x7f3db40c16b0 2024-09-21T05:52:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.456+0000 7f3dd6a00640 1 -- 172.21.15.37:0/1058132360 --> [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3dd0063f50 con 0x7f3db40c16b0 2024-09-21T05:52:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.456+0000 7f3dccc00640 1 -- 172.21.15.37:0/1058132360 <== osd.0 v2:172.21.15.37:6802/2521687946 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3dd0063f50 con 0x7f3db40c16b0 2024-09-21T05:52:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.457+0000 7f3dd6a00640 1 -- 172.21.15.37:0/1058132360 >> [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946] conn(0x7f3db40c16b0 msgr2=0x7f3db40c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.457+0000 7f3dd6a00640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946] conn(0x7f3db40c16b0 0x7f3db40c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.457+0000 7f3dd6a00640 1 -- 172.21.15.37:0/1058132360 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3db40b65a0 msgr2=0x7f3db40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.457+0000 7f3dd6a00640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3db40b65a0 0x7f3db40b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0108ce0 tx=0x7f3dbc00b410 comp rx=0 tx=0).stop 2024-09-21T05:52:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.457+0000 7f3dd6a00640 1 -- 172.21.15.37:0/1058132360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd0103b80 msgr2=0x7f3dd019c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.457+0000 7f3dd6a00640 1 --2- 172.21.15.37:0/1058132360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd0103b80 0x7f3dd019c6a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0005940 tx=0x7f3dc0004270 comp rx=0 tx=0).stop 2024-09-21T05:52:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.457+0000 7f3dd4a00640 1 -- 172.21.15.37:0/1058132360 reap_dead start 2024-09-21T05:52:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.457+0000 7f3dd6a00640 1 -- 172.21.15.37:0/1058132360 shutdown_connections 2024-09-21T05:52:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.457+0000 7f3dd6a00640 1 -- 172.21.15.37:0/1058132360 >> 172.21.15.37:0/1058132360 conn(0x7f3dd00ff590 msgr2=0x7f3dd0102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.457+0000 7f3dd6a00640 1 -- 172.21.15.37:0/1058132360 shutdown_connections 2024-09-21T05:52:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.457+0000 7f3dd6a00640 1 -- 172.21.15.37:0/1058132360 wait complete. 2024-09-21T05:52:25.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.542+0000 7f47fa600640 1 -- 172.21.15.37:0/1323655354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f4109df0 msgr2=0x7f47f4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.542+0000 7f47fa600640 1 --2- 172.21.15.37:0/1323655354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f4109df0 0x7f47f4110620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009be0 tx=0x7f47ec02a6c0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.542+0000 7f47fa600640 1 -- 172.21.15.37:0/1323655354 shutdown_connections 2024-09-21T05:52:25.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.542+0000 7f47fa600640 1 --2- 172.21.15.37:0/1323655354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f4109df0 0x7f47f4110620 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.542+0000 7f47fa600640 1 --2- 172.21.15.37:0/1323655354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47f41094a0 0x7f47f41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.542+0000 7f47fa600640 1 --2- 172.21.15.37:0/1323655354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f4103b60 0x7f47f4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.542+0000 7f47fa600640 1 -- 172.21.15.37:0/1323655354 >> 172.21.15.37:0/1323655354 conn(0x7f47f407b850 msgr2=0x7f47f407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:25.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.542+0000 7f47fa600640 1 -- 172.21.15.37:0/1323655354 shutdown_connections 2024-09-21T05:52:25.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.543+0000 7f47fa600640 1 -- 172.21.15.37:0/1323655354 wait complete. 2024-09-21T05:52:25.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.543+0000 7f47fa600640 1 Processor -- start 2024-09-21T05:52:25.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.544+0000 7f47fa600640 1 -- start start 2024-09-21T05:52:25.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.544+0000 7f47fa600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f4103b60 0x7f47f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.544+0000 7f47fa600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47f41094a0 0x7f47f4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.544+0000 7f47fa600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f4109df0 0x7f47f4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.544+0000 7f47fa600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4113ab0 con 0x7f47f4103b60 2024-09-21T05:52:25.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.544+0000 7f47fa600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4113930 con 0x7f47f41094a0 2024-09-21T05:52:25.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.544+0000 7f47fa600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4113c30 con 0x7f47f4109df0 2024-09-21T05:52:25.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.544+0000 7f47f3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f4103b60 0x7f47f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.545+0000 7f47f3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f4103b60 0x7f47f4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34144/0 (socket says 172.21.15.37:34144) 2024-09-21T05:52:25.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.545+0000 7f47f3400640 1 -- 172.21.15.37:0/1670024109 learned_addr learned my addr 172.21.15.37:0/1670024109 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:25.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.545+0000 7f47ebe00640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47f41094a0 0x7f47f4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.545+0000 7f47f3e00640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f4109df0 0x7f47f4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.545+0000 7f47ebe00640 1 -- 172.21.15.37:0/1670024109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f4109df0 msgr2=0x7f47f4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.545+0000 7f47ebe00640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47f4109df0 0x7f47f4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.545+0000 7f47ebe00640 1 -- 172.21.15.37:0/1670024109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f4103b60 msgr2=0x7f47f4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.545+0000 7f47ebe00640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f4103b60 0x7f47f4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.545+0000 7f47ebe00640 1 -- 172.21.15.37:0/1670024109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f41a86c0 con 0x7f47f41094a0 2024-09-21T05:52:25.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.545+0000 7f47ebe00640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47f41094a0 0x7f47f4075c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47f406c9f0 tx=0x7f47dc00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:25.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.546+0000 7f47f0c00640 1 -- 172.21.15.37:0/1670024109 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00cc40 con 0x7f47f41094a0 2024-09-21T05:52:25.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.546+0000 7f47fa600640 1 -- 172.21.15.37:0/1670024109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f41a89b0 con 0x7f47f41094a0 2024-09-21T05:52:25.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.546+0000 7f47fa600640 1 -- 172.21.15.37:0/1670024109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f41a8f40 con 0x7f47f41094a0 2024-09-21T05:52:25.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.546+0000 7f47f0c00640 1 -- 172.21.15.37:0/1670024109 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47dc00cde0 con 0x7f47f41094a0 2024-09-21T05:52:25.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.546+0000 7f47f0c00640 1 -- 172.21.15.37:0/1670024109 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc018640 con 0x7f47f41094a0 2024-09-21T05:52:25.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.547+0000 7f47fa600640 1 -- 172.21.15.37:0/1670024109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f47f4063b50 con 0x7f47f41094a0 2024-09-21T05:52:25.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.550+0000 7f47f0c00640 1 -- 172.21.15.37:0/1670024109 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f47dc010970 con 0x7f47f41094a0 2024-09-21T05:52:25.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.551+0000 7f47f0c00640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f47d80b6620 0x7f47d80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.551+0000 7f47f0c00640 1 -- 172.21.15.37:0/1670024109 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f47dc0e7f90 con 0x7f47f41094a0 2024-09-21T05:52:25.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.552+0000 7f47f3400640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f47d80b6620 0x7f47d80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.552+0000 7f47f0c00640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551] conn(0x7f47d80c1730 0x7f47d80c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.552+0000 7f47f0c00640 1 -- 172.21.15.37:0/1670024109 --> [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47d80c42f0 con 0x7f47d80c1730 2024-09-21T05:52:25.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.552+0000 7f47f0c00640 1 -- 172.21.15.37:0/1670024109 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f47dc0e8340 con 0x7f47f41094a0 2024-09-21T05:52:25.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.552+0000 7f47f3e00640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551] conn(0x7f47d80c1730 0x7f47d80c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.552+0000 7f47f3400640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f47d80b6620 0x7f47d80b8b30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f47f4077160 tx=0x7f47e4009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:25.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.553+0000 7f47f3e00640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551] conn(0x7f47d80c1730 0x7f47d80c3c20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:25.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.554+0000 7f47f0c00640 1 -- 172.21.15.37:0/1670024109 <== osd.8 v2:172.21.15.144:6816/335694551 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f47d80c42f0 con 0x7f47d80c1730 2024-09-21T05:52:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.568+0000 7f47fa600640 1 -- 172.21.15.37:0/1670024109 --> [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f47f4063fd0 con 0x7f47d80c1730 2024-09-21T05:52:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.569+0000 7f47f0c00640 1 -- 172.21.15.37:0/1670024109 <== osd.8 v2:172.21.15.144:6816/335694551 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f47f4063fd0 con 0x7f47d80c1730 2024-09-21T05:52:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.569+0000 7f47fa600640 1 -- 172.21.15.37:0/1670024109 >> [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551] conn(0x7f47d80c1730 msgr2=0x7f47d80c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.569+0000 7f47fa600640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551] conn(0x7f47d80c1730 0x7f47d80c3c20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.569+0000 7f47fa600640 1 -- 172.21.15.37:0/1670024109 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f47d80b6620 msgr2=0x7f47d80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.569+0000 7f47fa600640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f47d80b6620 0x7f47d80b8b30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f47f4077160 tx=0x7f47e4009260 comp rx=0 tx=0).stop 2024-09-21T05:52:25.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.569+0000 7f47fa600640 1 -- 172.21.15.37:0/1670024109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47f41094a0 msgr2=0x7f47f4075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.569+0000 7f47fa600640 1 --2- 172.21.15.37:0/1670024109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47f41094a0 0x7f47f4075c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47f406c9f0 tx=0x7f47dc00ee50 comp rx=0 tx=0).stop 2024-09-21T05:52:25.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.569+0000 7f47f3e00640 1 -- 172.21.15.37:0/1670024109 reap_dead start 2024-09-21T05:52:25.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.570+0000 7f47fa600640 1 -- 172.21.15.37:0/1670024109 shutdown_connections 2024-09-21T05:52:25.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.570+0000 7f47fa600640 1 -- 172.21.15.37:0/1670024109 >> 172.21.15.37:0/1670024109 conn(0x7f47f407b850 msgr2=0x7f47f41074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:25.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.570+0000 7f47fa600640 1 -- 172.21.15.37:0/1670024109 shutdown_connections 2024-09-21T05:52:25.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:25.570+0000 7f47fa600640 1 -- 172.21.15.37:0/1670024109 wait complete. 2024-09-21T05:52:25.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:25 smithi037 ceph-mon[30631]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:52:25.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.728+0000 7f562e600640 1 -- 172.21.15.37:0/117213016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5628109df0 msgr2=0x7f5628110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.728+0000 7f562e600640 1 --2- 172.21.15.37:0/117213016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5628109df0 0x7f5628110620 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5620009ca0 tx=0x7f562002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.728+0000 7f562e600640 1 -- 172.21.15.37:0/117213016 shutdown_connections 2024-09-21T05:52:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.728+0000 7f562e600640 1 --2- 172.21.15.37:0/117213016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5628109df0 0x7f5628110620 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.729+0000 7f562e600640 1 --2- 172.21.15.37:0/117213016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56281094a0 0x7f56281098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.729+0000 7f562e600640 1 --2- 172.21.15.37:0/117213016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5628103b60 0x7f5628103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.729+0000 7f562e600640 1 -- 172.21.15.37:0/117213016 >> 172.21.15.37:0/117213016 conn(0x7f562807b850 msgr2=0x7f562807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.729+0000 7f562e600640 1 -- 172.21.15.37:0/117213016 shutdown_connections 2024-09-21T05:52:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.729+0000 7f562e600640 1 -- 172.21.15.37:0/117213016 wait complete. 2024-09-21T05:52:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.730+0000 7f562e600640 1 Processor -- start 2024-09-21T05:52:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.730+0000 7f562e600640 1 -- start start 2024-09-21T05:52:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.730+0000 7f562e600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5628103b60 0x7f5628077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.730+0000 7f562e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56281094a0 0x7f5628075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.730+0000 7f562e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5628109df0 0x7f5628075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.730+0000 7f562e600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5628113b00 con 0x7f56281094a0 2024-09-21T05:52:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.730+0000 7f562e600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5628113980 con 0x7f5628103b60 2024-09-21T05:52:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.730+0000 7f562e600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5628113c80 con 0x7f5628109df0 2024-09-21T05:52:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.731+0000 7f5627400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5628103b60 0x7f5628077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.731+0000 7f561ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56281094a0 0x7f5628075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.731+0000 7f5627400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5628103b60 0x7f5628077120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:33004/0 (socket says 172.21.15.37:33004) 2024-09-21T05:52:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.731+0000 7f5627400640 1 -- 172.21.15.37:0/3024672833 learned_addr learned my addr 172.21.15.37:0/3024672833 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.731+0000 7f5627e00640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5628109df0 0x7f5628075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.731+0000 7f561ea00640 1 -- 172.21.15.37:0/3024672833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5628109df0 msgr2=0x7f5628075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.731+0000 7f561ea00640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5628109df0 0x7f5628075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.731+0000 7f561ea00640 1 -- 172.21.15.37:0/3024672833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5628103b60 msgr2=0x7f5628077120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.731+0000 7f561ea00640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5628103b60 0x7f5628077120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.731+0000 7f561ea00640 1 -- 172.21.15.37:0/3024672833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5628076470 con 0x7f56281094a0 2024-09-21T05:52:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.731+0000 7f5627400640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5628103b60 0x7f5628077120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.732+0000 7f561ea00640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56281094a0 0x7f5628075710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f562806c9f0 tx=0x7f561000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.732+0000 7f5624c00640 1 -- 172.21.15.37:0/3024672833 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561000cd00 con 0x7f56281094a0 2024-09-21T05:52:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.732+0000 7f5624c00640 1 -- 172.21.15.37:0/3024672833 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56100035f0 con 0x7f56281094a0 2024-09-21T05:52:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.732+0000 7f562e600640 1 -- 172.21.15.37:0/3024672833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56281acdf0 con 0x7f56281094a0 2024-09-21T05:52:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.732+0000 7f5624c00640 1 -- 172.21.15.37:0/3024672833 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5610010690 con 0x7f56281094a0 2024-09-21T05:52:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.732+0000 7f562e600640 1 -- 172.21.15.37:0/3024672833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56281ad240 con 0x7f56281094a0 2024-09-21T05:52:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.734+0000 7f562e600640 1 -- 172.21.15.37:0/3024672833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5628063b50 con 0x7f56281094a0 2024-09-21T05:52:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.736+0000 7f5624c00640 1 -- 172.21.15.37:0/3024672833 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f56100037a0 con 0x7f56281094a0 2024-09-21T05:52:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.738+0000 7f5624c00640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f560c0b65a0 0x7f560c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.738+0000 7f5624c00640 1 -- 172.21.15.37:0/3024672833 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f56100e7ec0 con 0x7f56281094a0 2024-09-21T05:52:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.739+0000 7f5627400640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f560c0b65a0 0x7f560c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.739+0000 7f5624c00640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854] conn(0x7f560c0c16b0 0x7f560c0c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.739+0000 7f5624c00640 1 -- 172.21.15.37:0/3024672833 --> [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5610016ec0 con 0x7f560c0c16b0 2024-09-21T05:52:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.739+0000 7f5624c00640 1 -- 172.21.15.37:0/3024672833 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f56100e8270 con 0x7f56281094a0 2024-09-21T05:52:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.739+0000 7f5627e00640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854] conn(0x7f560c0c16b0 0x7f560c0c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.739+0000 7f5627400640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f560c0b65a0 0x7f560c0b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f562819e300 tx=0x7f5618005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.740+0000 7f5627e00640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854] conn(0x7f560c0c16b0 0x7f560c0c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.741+0000 7f5624c00640 1 -- 172.21.15.37:0/3024672833 <== osd.10 v2:172.21.15.67:6824/3613225854 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5610016ec0 con 0x7f560c0c16b0 2024-09-21T05:52:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.756+0000 7f562e600640 1 -- 172.21.15.37:0/3024672833 --> [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5628063fd0 con 0x7f560c0c16b0 2024-09-21T05:52:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.757+0000 7f5624c00640 1 -- 172.21.15.37:0/3024672833 <== osd.10 v2:172.21.15.67:6824/3613225854 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5628063fd0 con 0x7f560c0c16b0 2024-09-21T05:52:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.757+0000 7f562e600640 1 -- 172.21.15.37:0/3024672833 >> [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854] conn(0x7f560c0c16b0 msgr2=0x7f560c0c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.757+0000 7f562e600640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854] conn(0x7f560c0c16b0 0x7f560c0c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.757+0000 7f562e600640 1 -- 172.21.15.37:0/3024672833 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f560c0b65a0 msgr2=0x7f560c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.757+0000 7f562e600640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f560c0b65a0 0x7f560c0b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f562819e300 tx=0x7f5618005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.757+0000 7f562e600640 1 -- 172.21.15.37:0/3024672833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56281094a0 msgr2=0x7f5628075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.757+0000 7f562e600640 1 --2- 172.21.15.37:0/3024672833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56281094a0 0x7f5628075710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f562806c9f0 tx=0x7f561000ee50 comp rx=0 tx=0).stop 2024-09-21T05:52:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.757+0000 7f5627e00640 1 -- 172.21.15.37:0/3024672833 reap_dead start 2024-09-21T05:52:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.758+0000 7f562e600640 1 -- 172.21.15.37:0/3024672833 shutdown_connections 2024-09-21T05:52:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.758+0000 7f562e600640 1 -- 172.21.15.37:0/3024672833 >> 172.21.15.37:0/3024672833 conn(0x7f562807b850 msgr2=0x7f5628105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.758+0000 7f562e600640 1 -- 172.21.15.37:0/3024672833 shutdown_connections 2024-09-21T05:52:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.758+0000 7f562e600640 1 -- 172.21.15.37:0/3024672833 wait complete. 2024-09-21T05:52:25.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:25 smithi144 ceph-mon[34351]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:52:25.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:25 smithi067 ceph-mon[34443]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:52:26.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.604+0000 7f812a000640 1 -- 172.21.15.37:0/3070639370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8124075730 msgr2=0x7f8124075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:26.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.604+0000 7f812a000640 1 --2- 172.21.15.37:0/3070639370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8124075730 0x7f8124075b40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8118009900 tx=0x7f811802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:52:26.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.604+0000 7f812a000640 1 -- 172.21.15.37:0/3070639370 shutdown_connections 2024-09-21T05:52:26.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.604+0000 7f812a000640 1 --2- 172.21.15.37:0/3070639370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f812410ff90 0x7f81241123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:26.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.604+0000 7f812a000640 1 --2- 172.21.15.37:0/3070639370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8124076080 0x7f812410fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:26.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.604+0000 7f812a000640 1 --2- 172.21.15.37:0/3070639370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8124075730 0x7f8124075b40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:26.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.604+0000 7f812a000640 1 -- 172.21.15.37:0/3070639370 >> 172.21.15.37:0/3070639370 conn(0x7f81240ff400 msgr2=0x7f8124101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:26.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.605+0000 7f812a000640 1 -- 172.21.15.37:0/3070639370 shutdown_connections 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.605+0000 7f812a000640 1 -- 172.21.15.37:0/3070639370 wait complete. 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.606+0000 7f812a000640 1 Processor -- start 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.606+0000 7f812a000640 1 -- start start 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.606+0000 7f812a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8124075730 0x7f812419c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.606+0000 7f812a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8124076080 0x7f812419cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.606+0000 7f812a000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f812410ff90 0x7f81241a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.606+0000 7f812a000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8124115ad0 con 0x7f8124075730 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.606+0000 7f812a000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8124115950 con 0x7f812410ff90 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.606+0000 7f812a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8124115c50 con 0x7f8124076080 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.606+0000 7f8128c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8124075730 0x7f812419c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.606+0000 7f8129600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f812410ff90 0x7f81241a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.607+0000 7f8123e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8124076080 0x7f812419cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.607+0000 7f8129600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f812410ff90 0x7f81241a1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:32982/0 (socket says 172.21.15.37:32982) 2024-09-21T05:52:26.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.607+0000 7f8128c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8124075730 0x7f812419c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34078/0 (socket says 172.21.15.37:34078) 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.607+0000 7f8129600640 1 -- 172.21.15.37:0/910358467 learned_addr learned my addr 172.21.15.37:0/910358467 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.607+0000 7f8123e00640 1 -- 172.21.15.37:0/910358467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f812410ff90 msgr2=0x7f81241a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.607+0000 7f8123e00640 1 --2- 172.21.15.37:0/910358467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f812410ff90 0x7f81241a1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.607+0000 7f8123e00640 1 -- 172.21.15.37:0/910358467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8124075730 msgr2=0x7f812419c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.607+0000 7f8123e00640 1 --2- 172.21.15.37:0/910358467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8124075730 0x7f812419c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.607+0000 7f8123e00640 1 -- 172.21.15.37:0/910358467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81241a2490 con 0x7f8124076080 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.607+0000 7f8129600640 1 --2- 172.21.15.37:0/910358467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f812410ff90 0x7f81241a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.607+0000 7f8123e00640 1 --2- 172.21.15.37:0/910358467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8124076080 0x7f812419cac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f812406b930 tx=0x7f811000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.608+0000 7f8121600640 1 -- 172.21.15.37:0/910358467 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811000cc40 con 0x7f8124076080 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.608+0000 7f8121600640 1 -- 172.21.15.37:0/910358467 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f811000cde0 con 0x7f8124076080 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.608+0000 7f812a000640 1 -- 172.21.15.37:0/910358467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81241a2780 con 0x7f8124076080 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.608+0000 7f8121600640 1 -- 172.21.15.37:0/910358467 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8110018780 con 0x7f8124076080 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.608+0000 7f812a000640 1 -- 172.21.15.37:0/910358467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81241a8ee0 con 0x7f8124076080 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.609+0000 7f812a000640 1 -- 172.21.15.37:0/910358467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f812410a550 con 0x7f8124076080 2024-09-21T05:52:26.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.611+0000 7f8121600640 1 -- 172.21.15.37:0/910358467 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f8110010a90 con 0x7f8124076080 2024-09-21T05:52:26.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.613+0000 7f8121600640 1 --2- 172.21.15.37:0/910358467 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f810c0b6620 0x7f810c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:26.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.613+0000 7f8121600640 1 -- 172.21.15.37:0/910358467 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f81100e7df0 con 0x7f8124076080 2024-09-21T05:52:26.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.613+0000 7f8128c00640 1 --2- 172.21.15.37:0/910358467 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f810c0b6620 0x7f810c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:26.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.613+0000 7f8121600640 1 --2- 172.21.15.37:0/910358467 >> [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791] conn(0x7f810c0c1730 0x7f810c0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:26.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.613+0000 7f8121600640 1 -- 172.21.15.37:0/910358467 --> [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8110011e50 con 0x7f810c0c1730 2024-09-21T05:52:26.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.613+0000 7f8121600640 1 -- 172.21.15.37:0/910358467 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f81100e81a0 con 0x7f8124076080 2024-09-21T05:52:26.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.614+0000 7f8129600640 1 --2- 172.21.15.37:0/910358467 >> [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791] conn(0x7f810c0c1730 0x7f810c0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:26.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.614+0000 7f8128c00640 1 --2- 172.21.15.37:0/910358467 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f810c0b6620 0x7f810c0b8b30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8118031440 tx=0x7f8118009560 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:26.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.615+0000 7f8129600640 1 --2- 172.21.15.37:0/910358467 >> [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791] conn(0x7f810c0c1730 0x7f810c0c3c20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:26.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.615+0000 7f8121600640 1 -- 172.21.15.37:0/910358467 <== osd.5 v2:172.21.15.144:6808/2813200791 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8110011e50 con 0x7f810c0c1730 2024-09-21T05:52:26.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.634+0000 7f812a000640 1 -- 172.21.15.37:0/910358467 --> [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8124076c40 con 0x7f810c0c1730 2024-09-21T05:52:26.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.634+0000 7f8121600640 1 -- 172.21.15.37:0/910358467 <== osd.5 v2:172.21.15.144:6808/2813200791 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8124076c40 con 0x7f810c0c1730 2024-09-21T05:52:26.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.635+0000 7f812a000640 1 -- 172.21.15.37:0/910358467 >> [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791] conn(0x7f810c0c1730 msgr2=0x7f810c0c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:26.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.635+0000 7f812a000640 1 --2- 172.21.15.37:0/910358467 >> [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791] conn(0x7f810c0c1730 0x7f810c0c3c20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:26.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.635+0000 7f812a000640 1 -- 172.21.15.37:0/910358467 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f810c0b6620 msgr2=0x7f810c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:26.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.635+0000 7f812a000640 1 --2- 172.21.15.37:0/910358467 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f810c0b6620 0x7f810c0b8b30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8118031440 tx=0x7f8118009560 comp rx=0 tx=0).stop 2024-09-21T05:52:26.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.635+0000 7f812a000640 1 -- 172.21.15.37:0/910358467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8124076080 msgr2=0x7f812419cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:26.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.635+0000 7f812a000640 1 --2- 172.21.15.37:0/910358467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8124076080 0x7f812419cac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f812406b930 tx=0x7f811000ee50 comp rx=0 tx=0).stop 2024-09-21T05:52:26.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.635+0000 7f8129600640 1 -- 172.21.15.37:0/910358467 reap_dead start 2024-09-21T05:52:26.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.635+0000 7f812a000640 1 -- 172.21.15.37:0/910358467 shutdown_connections 2024-09-21T05:52:26.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.635+0000 7f812a000640 1 -- 172.21.15.37:0/910358467 >> 172.21.15.37:0/910358467 conn(0x7f81240ff400 msgr2=0x7f8124109b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:26.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.635+0000 7f812a000640 1 -- 172.21.15.37:0/910358467 shutdown_connections 2024-09-21T05:52:26.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:24.635+0000 7f812a000640 1 -- 172.21.15.37:0/910358467 wait complete. 2024-09-21T05:52:26.248 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:26.250 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:26.251 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:26.251 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:27.388 INFO:teuthology.orchestra.run.smithi037.stdout:279172874277 2024-09-21T05:52:27.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T05:52:27.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:27 smithi144 ceph-mon[34351]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-21T05:52:27.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:27 smithi037 ceph-mon[30631]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-21T05:52:27.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:27 smithi067 ceph-mon[34443]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-21T05:52:28.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.320+0000 7f552f200640 1 -- 172.21.15.37:0/1534549314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5530075dd0 msgr2=0x7f55300761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.320+0000 7f552f200640 1 --2- 172.21.15.37:0/1534549314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5530075dd0 0x7f55300761e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f551c009860 tx=0x7f551c02a340 comp rx=0 tx=0).stop 2024-09-21T05:52:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.320+0000 7f552f200640 1 -- 172.21.15.37:0/1534549314 shutdown_connections 2024-09-21T05:52:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.320+0000 7f552f200640 1 --2- 172.21.15.37:0/1534549314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5530114280 0x7f5530116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.320+0000 7f552f200640 1 --2- 172.21.15.37:0/1534549314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5530075dd0 0x7f55300761e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.320+0000 7f552f200640 1 --2- 172.21.15.37:0/1534549314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5530077380 0x7f55300757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.320+0000 7f552f200640 1 -- 172.21.15.37:0/1534549314 >> 172.21.15.37:0/1534549314 conn(0x7f55300ff440 msgr2=0x7f5530101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.320+0000 7f552f200640 1 -- 172.21.15.37:0/1534549314 shutdown_connections 2024-09-21T05:52:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.321+0000 7f552f200640 1 -- 172.21.15.37:0/1534549314 wait complete. 2024-09-21T05:52:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.322+0000 7f552f200640 1 Processor -- start 2024-09-21T05:52:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.322+0000 7f552f200640 1 -- start start 2024-09-21T05:52:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.322+0000 7f552f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5530075dd0 0x7f55301a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.322+0000 7f552f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5530077380 0x7f55301a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.322+0000 7f552f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5530114280 0x7f55301a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.322+0000 7f552f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5530119e80 con 0x7f5530077380 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.322+0000 7f552f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5530119d00 con 0x7f5530114280 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.322+0000 7f552f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f553011a000 con 0x7f5530075dd0 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.323+0000 7f552d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5530077380 0x7f55301a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.323+0000 7f552de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5530075dd0 0x7f55301a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.323+0000 7f552d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5530077380 0x7f55301a0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34162/0 (socket says 172.21.15.37:34162) 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.323+0000 7f552d400640 1 -- 172.21.15.37:0/2782076405 learned_addr learned my addr 172.21.15.37:0/2782076405 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.323+0000 7f552e800640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5530114280 0x7f55301a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.323+0000 7f552d400640 1 -- 172.21.15.37:0/2782076405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5530075dd0 msgr2=0x7f55301a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.323+0000 7f552d400640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5530075dd0 0x7f55301a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.323+0000 7f552d400640 1 -- 172.21.15.37:0/2782076405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5530114280 msgr2=0x7f55301a60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.323+0000 7f552d400640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5530114280 0x7f55301a60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.323+0000 7f552d400640 1 -- 172.21.15.37:0/2782076405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55301a6820 con 0x7f5530077380 2024-09-21T05:52:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.323+0000 7f552de00640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5530075dd0 0x7f55301a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.324+0000 7f552d400640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5530077380 0x7f55301a0e50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f551c000c00 tx=0x7f551c032d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.324+0000 7f5526a00640 1 -- 172.21.15.37:0/2782076405 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551c040020 con 0x7f5530077380 2024-09-21T05:52:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.324+0000 7f5526a00640 1 -- 172.21.15.37:0/2782076405 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f551c030e10 con 0x7f5530077380 2024-09-21T05:52:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.324+0000 7f552f200640 1 -- 172.21.15.37:0/2782076405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55301a6ab0 con 0x7f5530077380 2024-09-21T05:52:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.324+0000 7f5526a00640 1 -- 172.21.15.37:0/2782076405 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551c037040 con 0x7f5530077380 2024-09-21T05:52:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.324+0000 7f552f200640 1 -- 172.21.15.37:0/2782076405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55301ad270 con 0x7f5530077380 2024-09-21T05:52:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.325+0000 7f552f200640 1 -- 172.21.15.37:0/2782076405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5530063b50 con 0x7f5530077380 2024-09-21T05:52:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.328+0000 7f5526a00640 1 -- 172.21.15.37:0/2782076405 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f551c043020 con 0x7f5530077380 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.329+0000 7f5526a00640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f55140b65a0 0x7f55140b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.329+0000 7f5526a00640 1 -- 172.21.15.37:0/2782076405 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f551c107700 con 0x7f5530077380 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.329+0000 7f552de00640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f55140b65a0 0x7f55140b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.329+0000 7f5526a00640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769] conn(0x7f55140c16b0 0x7f55140c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.330+0000 7f5526a00640 1 -- 172.21.15.37:0/2782076405 --> [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f551c048eb0 con 0x7f55140c16b0 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.330+0000 7f5526a00640 1 -- 172.21.15.37:0/2782076405 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f551c107b50 con 0x7f5530077380 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.330+0000 7f552e800640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769] conn(0x7f55140c16b0 0x7f55140c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.330+0000 7f552de00640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f55140b65a0 0x7f55140b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5520009fc0 tx=0x7f5520005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.331+0000 7f552e800640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769] conn(0x7f55140c16b0 0x7f55140c3ba0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.332+0000 7f5526a00640 1 -- 172.21.15.37:0/2782076405 <== osd.3 v2:172.21.15.37:6810/2990917769 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f551c048eb0 con 0x7f55140c16b0 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.347+0000 7f552f200640 1 -- 172.21.15.37:0/2782076405 --> [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5530063fd0 con 0x7f55140c16b0 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.348+0000 7f5526a00640 1 -- 172.21.15.37:0/2782076405 <== osd.3 v2:172.21.15.37:6810/2990917769 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5530063fd0 con 0x7f55140c16b0 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.348+0000 7f552f200640 1 -- 172.21.15.37:0/2782076405 >> [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769] conn(0x7f55140c16b0 msgr2=0x7f55140c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.348+0000 7f552f200640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769] conn(0x7f55140c16b0 0x7f55140c3ba0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.348+0000 7f552f200640 1 -- 172.21.15.37:0/2782076405 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f55140b65a0 msgr2=0x7f55140b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.348+0000 7f552f200640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f55140b65a0 0x7f55140b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5520009fc0 tx=0x7f5520005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.348+0000 7f552f200640 1 -- 172.21.15.37:0/2782076405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5530077380 msgr2=0x7f55301a0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.348+0000 7f552f200640 1 --2- 172.21.15.37:0/2782076405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5530077380 0x7f55301a0e50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f551c000c00 tx=0x7f551c032d40 comp rx=0 tx=0).stop 2024-09-21T05:52:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.349+0000 7f552e800640 1 -- 172.21.15.37:0/2782076405 reap_dead start 2024-09-21T05:52:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.349+0000 7f552f200640 1 -- 172.21.15.37:0/2782076405 shutdown_connections 2024-09-21T05:52:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.349+0000 7f552f200640 1 -- 172.21.15.37:0/2782076405 >> 172.21.15.37:0/2782076405 conn(0x7f55300ff440 msgr2=0x7f5530110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.349+0000 7f552f200640 1 -- 172.21.15.37:0/2782076405 shutdown_connections 2024-09-21T05:52:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.349+0000 7f552f200640 1 -- 172.21.15.37:0/2782076405 wait complete. 2024-09-21T05:52:29.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.200+0000 7ffad2e00640 1 -- 172.21.15.37:0/3997514429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc10b6d0 msgr2=0x7ffacc10bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:29.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.200+0000 7ffad2e00640 1 --2- 172.21.15.37:0/3997514429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc10b6d0 0x7ffacc10bae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009860 tx=0x7ffab402a340 comp rx=0 tx=0).stop 2024-09-21T05:52:29.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.200+0000 7ffad2e00640 1 -- 172.21.15.37:0/3997514429 shutdown_connections 2024-09-21T05:52:29.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.200+0000 7ffad2e00640 1 --2- 172.21.15.37:0/3997514429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffacc10c020 0x7ffacc112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:29.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.200+0000 7ffad2e00640 1 --2- 172.21.15.37:0/3997514429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc10b6d0 0x7ffacc10bae0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:29.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.200+0000 7ffad2e00640 1 --2- 172.21.15.37:0/3997514429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffacc105d90 0x7ffacc1061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:29.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.200+0000 7ffad2e00640 1 -- 172.21.15.37:0/3997514429 >> 172.21.15.37:0/3997514429 conn(0x7ffacc101860 msgr2=0x7ffacc103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:29.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.200+0000 7ffad2e00640 1 -- 172.21.15.37:0/3997514429 shutdown_connections 2024-09-21T05:52:29.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.200+0000 7ffad2e00640 1 -- 172.21.15.37:0/3997514429 wait complete. 2024-09-21T05:52:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.201+0000 7ffad2e00640 1 Processor -- start 2024-09-21T05:52:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.202+0000 7ffad2e00640 1 -- start start 2024-09-21T05:52:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.202+0000 7ffad2e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffacc105d90 0x7ffacc19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.202+0000 7ffad2e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc10b6d0 0x7ffacc19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.202+0000 7ffad2e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffacc10c020 0x7ffacc1a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.202+0000 7ffad2e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc115ce0 con 0x7ffacc10b6d0 2024-09-21T05:52:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.202+0000 7ffad2e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc115b60 con 0x7ffacc105d90 2024-09-21T05:52:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.202+0000 7ffad2e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc115e60 con 0x7ffacc10c020 2024-09-21T05:52:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.202+0000 7ffac3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc10b6d0 0x7ffacc19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.202+0000 7ffac3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc10b6d0 0x7ffacc19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34198/0 (socket says 172.21.15.37:34198) 2024-09-21T05:52:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.202+0000 7ffac3e00640 1 -- 172.21.15.37:0/1749344536 learned_addr learned my addr 172.21.15.37:0/1749344536 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.202+0000 7ffad0e00640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffacc10c020 0x7ffacc1a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.202+0000 7ffacbe00640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffacc105d90 0x7ffacc19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.203+0000 7ffac3e00640 1 -- 172.21.15.37:0/1749344536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffacc10c020 msgr2=0x7ffacc1a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.203+0000 7ffac3e00640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffacc10c020 0x7ffacc1a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.203+0000 7ffac3e00640 1 -- 172.21.15.37:0/1749344536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffacc105d90 msgr2=0x7ffacc19c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.203+0000 7ffac3e00640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffacc105d90 0x7ffacc19c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.203+0000 7ffac3e00640 1 -- 172.21.15.37:0/1749344536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc1a2640 con 0x7ffacc10b6d0 2024-09-21T05:52:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.203+0000 7ffac3e00640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc10b6d0 0x7ffacc19cc70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffab4035040 tx=0x7ffab4032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.203+0000 7ffac9600640 1 -- 172.21.15.37:0/1749344536 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4040020 con 0x7ffacc10b6d0 2024-09-21T05:52:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.203+0000 7ffac9600640 1 -- 172.21.15.37:0/1749344536 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffab4030e10 con 0x7ffacc10b6d0 2024-09-21T05:52:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.204+0000 7ffad2e00640 1 -- 172.21.15.37:0/1749344536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffacc1a28d0 con 0x7ffacc10b6d0 2024-09-21T05:52:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.204+0000 7ffac9600640 1 -- 172.21.15.37:0/1749344536 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4037040 con 0x7ffacc10b6d0 2024-09-21T05:52:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.204+0000 7ffad2e00640 1 -- 172.21.15.37:0/1749344536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffacc1a9090 con 0x7ffacc10b6d0 2024-09-21T05:52:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.204+0000 7ffad2e00640 1 -- 172.21.15.37:0/1749344536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffacc063b50 con 0x7ffacc10b6d0 2024-09-21T05:52:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.207+0000 7ffac9600640 1 -- 172.21.15.37:0/1749344536 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7ffab4043020 con 0x7ffacc10b6d0 2024-09-21T05:52:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.208+0000 7ffac9600640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ffab00b65a0 0x7ffab00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.209+0000 7ffac9600640 1 -- 172.21.15.37:0/1749344536 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7ffab4107730 con 0x7ffacc10b6d0 2024-09-21T05:52:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.209+0000 7ffacbe00640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ffab00b65a0 0x7ffab00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.209+0000 7ffac9600640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723] conn(0x7ffab00c16b0 0x7ffab00c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.209+0000 7ffac9600640 1 -- 172.21.15.37:0/1749344536 --> [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffab4001d30 con 0x7ffab00c16b0 2024-09-21T05:52:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.209+0000 7ffac9600640 1 -- 172.21.15.37:0/1749344536 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7ffab4107b80 con 0x7ffacc10b6d0 2024-09-21T05:52:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.209+0000 7ffad0e00640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723] conn(0x7ffab00c16b0 0x7ffab00c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.210+0000 7ffacbe00640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ffab00b65a0 0x7ffab00b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009bd0 tx=0x7ffabc005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.210+0000 7ffad0e00640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723] conn(0x7ffab00c16b0 0x7ffab00c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.211+0000 7ffac9600640 1 -- 172.21.15.37:0/1749344536 <== osd.7 v2:172.21.15.67:6816/286051723 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffab4001d30 con 0x7ffab00c16b0 2024-09-21T05:52:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.226+0000 7ffad2e00640 1 -- 172.21.15.37:0/1749344536 --> [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffacc063fd0 con 0x7ffab00c16b0 2024-09-21T05:52:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.226+0000 7ffac9600640 1 -- 172.21.15.37:0/1749344536 <== osd.7 v2:172.21.15.67:6816/286051723 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ffacc063fd0 con 0x7ffab00c16b0 2024-09-21T05:52:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.227+0000 7ffad2e00640 1 -- 172.21.15.37:0/1749344536 >> [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723] conn(0x7ffab00c16b0 msgr2=0x7ffab00c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.227+0000 7ffad2e00640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723] conn(0x7ffab00c16b0 0x7ffab00c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.227+0000 7ffad2e00640 1 -- 172.21.15.37:0/1749344536 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ffab00b65a0 msgr2=0x7ffab00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.227+0000 7ffad2e00640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ffab00b65a0 0x7ffab00b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009bd0 tx=0x7ffabc005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.227+0000 7ffad2e00640 1 -- 172.21.15.37:0/1749344536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc10b6d0 msgr2=0x7ffacc19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.227+0000 7ffad2e00640 1 --2- 172.21.15.37:0/1749344536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc10b6d0 0x7ffacc19cc70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffab4035040 tx=0x7ffab4032d50 comp rx=0 tx=0).stop 2024-09-21T05:52:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.227+0000 7ffad0e00640 1 -- 172.21.15.37:0/1749344536 reap_dead start 2024-09-21T05:52:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.227+0000 7ffad2e00640 1 -- 172.21.15.37:0/1749344536 shutdown_connections 2024-09-21T05:52:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.227+0000 7ffad2e00640 1 -- 172.21.15.37:0/1749344536 >> 172.21.15.37:0/1749344536 conn(0x7ffacc101860 msgr2=0x7ffacc103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:29.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.227+0000 7ffad2e00640 1 -- 172.21.15.37:0/1749344536 shutdown_connections 2024-09-21T05:52:29.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:29.227+0000 7ffad2e00640 1 -- 172.21.15.37:0/1749344536 wait complete. 2024-09-21T05:52:29.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:29 smithi037 ceph-mon[30631]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:52:29.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:29 smithi144 ceph-mon[34351]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:52:29.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:29 smithi067 ceph-mon[34443]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:52:30.796 INFO:teuthology.orchestra.run.smithi037.stdout:154618822722 2024-09-21T05:52:30.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T05:52:31.139 INFO:teuthology.orchestra.run.smithi037.stdout:34359738462 2024-09-21T05:52:31.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T05:52:31.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.382+0000 7f05bb600640 1 -- 172.21.15.37:0/2829481494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05b41049d0 msgr2=0x7f05b4104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.382+0000 7f05bb600640 1 --2- 172.21.15.37:0/2829481494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05b41049d0 0x7f05b4104de0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f05a8009860 tx=0x7f05a802a340 comp rx=0 tx=0).stop 2024-09-21T05:52:31.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.382+0000 7f05bb600640 1 -- 172.21.15.37:0/2829481494 shutdown_connections 2024-09-21T05:52:31.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.382+0000 7f05bb600640 1 --2- 172.21.15.37:0/2829481494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b410de30 0x7f05b4110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.382+0000 7f05bb600640 1 --2- 172.21.15.37:0/2829481494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05b4105320 0x7f05b410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.382+0000 7f05bb600640 1 --2- 172.21.15.37:0/2829481494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05b41049d0 0x7f05b4104de0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.382+0000 7f05bb600640 1 -- 172.21.15.37:0/2829481494 >> 172.21.15.37:0/2829481494 conn(0x7f05b4079740 msgr2=0x7f05b4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:31.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.383+0000 7f05bb600640 1 -- 172.21.15.37:0/2829481494 shutdown_connections 2024-09-21T05:52:31.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.383+0000 7f05bb600640 1 -- 172.21.15.37:0/2829481494 wait complete. 2024-09-21T05:52:31.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.384+0000 7f05bb600640 1 Processor -- start 2024-09-21T05:52:31.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.384+0000 7f05bb600640 1 -- start start 2024-09-21T05:52:31.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.385+0000 7f05bb600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b41049d0 0x7f05b419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.385+0000 7f05bb600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05b4105320 0x7f05b419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.385+0000 7f05bb600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05b410de30 0x7f05b41a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.385+0000 7f05bb600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f05b4113ab0 con 0x7f05b41049d0 2024-09-21T05:52:31.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.385+0000 7f05bb600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f05b4113930 con 0x7f05b410de30 2024-09-21T05:52:31.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.385+0000 7f05bb600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05b4113c30 con 0x7f05b4105320 2024-09-21T05:52:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.385+0000 7f05b9600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05b410de30 0x7f05b41a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.385+0000 7f05b8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b41049d0 0x7f05b419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.385+0000 7f05b9600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05b410de30 0x7f05b41a1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:60022/0 (socket says 172.21.15.37:60022) 2024-09-21T05:52:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.385+0000 7f05b3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05b4105320 0x7f05b419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.385+0000 7f05b9600640 1 -- 172.21.15.37:0/2974526945 learned_addr learned my addr 172.21.15.37:0/2974526945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.386+0000 7f05b9600640 1 -- 172.21.15.37:0/2974526945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05b4105320 msgr2=0x7f05b419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.386+0000 7f05b9600640 1 --2- 172.21.15.37:0/2974526945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05b4105320 0x7f05b419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.386+0000 7f05b9600640 1 -- 172.21.15.37:0/2974526945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b41049d0 msgr2=0x7f05b419c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.386+0000 7f05b9600640 1 --2- 172.21.15.37:0/2974526945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b41049d0 0x7f05b419c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.386+0000 7f05b9600640 1 -- 172.21.15.37:0/2974526945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b41a2670 con 0x7f05b410de30 2024-09-21T05:52:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.386+0000 7f05b9600640 1 --2- 172.21.15.37:0/2974526945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05b410de30 0x7f05b41a1f40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00efc0 tx=0x7f05ac00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.386+0000 7f05b1600640 1 -- 172.21.15.37:0/2974526945 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac003970 con 0x7f05b410de30 2024-09-21T05:52:31.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.386+0000 7f05bb600640 1 -- 172.21.15.37:0/2974526945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b41a2960 con 0x7f05b410de30 2024-09-21T05:52:31.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.386+0000 7f05b1600640 1 -- 172.21.15.37:0/2974526945 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05ac004020 con 0x7f05b410de30 2024-09-21T05:52:31.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.386+0000 7f05b1600640 1 -- 172.21.15.37:0/2974526945 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00b940 con 0x7f05b410de30 2024-09-21T05:52:31.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.386+0000 7f05bb600640 1 -- 172.21.15.37:0/2974526945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b41a90c0 con 0x7f05b410de30 2024-09-21T05:52:31.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.388+0000 7f05bb600640 1 -- 172.21.15.37:0/2974526945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f05b410d6d0 con 0x7f05b410de30 2024-09-21T05:52:31.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.390+0000 7f05b1600640 1 -- 172.21.15.37:0/2974526945 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f05ac01d020 con 0x7f05b410de30 2024-09-21T05:52:31.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.391+0000 7f05b1600640 1 --2- 172.21.15.37:0/2974526945 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f059c0b65a0 0x7f059c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.392+0000 7f05b1600640 1 -- 172.21.15.37:0/2974526945 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f05ac0e7fb0 con 0x7f05b410de30 2024-09-21T05:52:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.392+0000 7f05b8c00640 1 --2- 172.21.15.37:0/2974526945 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f059c0b65a0 0x7f059c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.392+0000 7f05b1600640 1 --2- 172.21.15.37:0/2974526945 >> [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890] conn(0x7f059c0c16b0 0x7f059c0c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.392+0000 7f05b1600640 1 -- 172.21.15.37:0/2974526945 --> [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f059c0c4270 con 0x7f059c0c16b0 2024-09-21T05:52:31.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.392+0000 7f05b1600640 1 -- 172.21.15.37:0/2974526945 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f05ac0e8360 con 0x7f05b410de30 2024-09-21T05:52:31.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.392+0000 7f05b3e00640 1 --2- 172.21.15.37:0/2974526945 >> [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890] conn(0x7f059c0c16b0 0x7f059c0c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.393+0000 7f05b8c00640 1 --2- 172.21.15.37:0/2974526945 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f059c0b65a0 0x7f059c0b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f05a8009830 tx=0x7f05a80058d0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:31.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.393+0000 7f05b3e00640 1 --2- 172.21.15.37:0/2974526945 >> [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890] conn(0x7f059c0c16b0 0x7f059c0c3ba0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:31.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.394+0000 7f05b1600640 1 -- 172.21.15.37:0/2974526945 <== osd.11 v2:172.21.15.144:6824/2555236890 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f059c0c4270 con 0x7f059c0c16b0 2024-09-21T05:52:31.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.415+0000 7f05bb600640 1 -- 172.21.15.37:0/2974526945 --> [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f05b406b390 con 0x7f059c0c16b0 2024-09-21T05:52:31.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.416+0000 7f05b1600640 1 -- 172.21.15.37:0/2974526945 <== osd.11 v2:172.21.15.144:6824/2555236890 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f05b406b390 con 0x7f059c0c16b0 2024-09-21T05:52:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.417+0000 7f05bb600640 1 -- 172.21.15.37:0/2974526945 >> [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890] conn(0x7f059c0c16b0 msgr2=0x7f059c0c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.417+0000 7f05bb600640 1 --2- 172.21.15.37:0/2974526945 >> [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890] conn(0x7f059c0c16b0 0x7f059c0c3ba0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.417+0000 7f05bb600640 1 -- 172.21.15.37:0/2974526945 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f059c0b65a0 msgr2=0x7f059c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.417+0000 7f05bb600640 1 --2- 172.21.15.37:0/2974526945 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f059c0b65a0 0x7f059c0b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f05a8009830 tx=0x7f05a80058d0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.417+0000 7f05bb600640 1 -- 172.21.15.37:0/2974526945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05b410de30 msgr2=0x7f05b41a1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.417+0000 7f05bb600640 1 --2- 172.21.15.37:0/2974526945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05b410de30 0x7f05b41a1f40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00efc0 tx=0x7f05ac00c800 comp rx=0 tx=0).stop 2024-09-21T05:52:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.417+0000 7f05b9600640 1 -- 172.21.15.37:0/2974526945 reap_dead start 2024-09-21T05:52:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.417+0000 7f05bb600640 1 -- 172.21.15.37:0/2974526945 shutdown_connections 2024-09-21T05:52:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.417+0000 7f05bb600640 1 -- 172.21.15.37:0/2974526945 >> 172.21.15.37:0/2974526945 conn(0x7f05b4079740 msgr2=0x7f05b410cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.417+0000 7f05bb600640 1 -- 172.21.15.37:0/2974526945 shutdown_connections 2024-09-21T05:52:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.417+0000 7f05bb600640 1 -- 172.21.15.37:0/2974526945 wait complete. 2024-09-21T05:52:31.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.174+0000 7eff22c00640 1 -- 172.21.15.37:0/1788099289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff1c1049d0 msgr2=0x7eff1c104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.174+0000 7eff22c00640 1 --2- 172.21.15.37:0/1788099289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff1c1049d0 0x7eff1c104de0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009900 tx=0x7eff0c02a3f0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.174+0000 7eff22c00640 1 -- 172.21.15.37:0/1788099289 shutdown_connections 2024-09-21T05:52:31.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.174+0000 7eff22c00640 1 --2- 172.21.15.37:0/1788099289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c10de30 0x7eff1c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.174+0000 7eff22c00640 1 --2- 172.21.15.37:0/1788099289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c105320 0x7eff1c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.174+0000 7eff22c00640 1 --2- 172.21.15.37:0/1788099289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff1c1049d0 0x7eff1c104de0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.174+0000 7eff22c00640 1 -- 172.21.15.37:0/1788099289 >> 172.21.15.37:0/1788099289 conn(0x7eff1c079740 msgr2=0x7eff1c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:31.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.174+0000 7eff22c00640 1 -- 172.21.15.37:0/1788099289 shutdown_connections 2024-09-21T05:52:31.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.174+0000 7eff22c00640 1 -- 172.21.15.37:0/1788099289 wait complete. 2024-09-21T05:52:31.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.175+0000 7eff22c00640 1 Processor -- start 2024-09-21T05:52:31.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.176+0000 7eff22c00640 1 -- start start 2024-09-21T05:52:31.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.176+0000 7eff22c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c1049d0 0x7eff1c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.176+0000 7eff22c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff1c105320 0x7eff1c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.176+0000 7eff22c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c10de30 0x7eff1c19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.176+0000 7eff22c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c113a90 con 0x7eff1c105320 2024-09-21T05:52:31.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.176+0000 7eff22c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c113910 con 0x7eff1c1049d0 2024-09-21T05:52:31.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.176+0000 7eff22c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c113c10 con 0x7eff1c10de30 2024-09-21T05:52:31.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.176+0000 7eff13e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff1c105320 0x7eff1c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.176+0000 7eff1be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c1049d0 0x7eff1c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.176+0000 7eff13e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff1c105320 0x7eff1c19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44062/0 (socket says 172.21.15.37:44062) 2024-09-21T05:52:31.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.176+0000 7eff13e00640 1 -- 172.21.15.37:0/1762852731 learned_addr learned my addr 172.21.15.37:0/1762852731 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:31.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.177+0000 7eff20c00640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c10de30 0x7eff1c19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.177+0000 7eff1be00640 1 -- 172.21.15.37:0/1762852731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c10de30 msgr2=0x7eff1c19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.177+0000 7eff1be00640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c10de30 0x7eff1c19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.177+0000 7eff1be00640 1 -- 172.21.15.37:0/1762852731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff1c105320 msgr2=0x7eff1c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.177+0000 7eff1be00640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff1c105320 0x7eff1c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.177+0000 7eff1be00640 1 -- 172.21.15.37:0/1762852731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c1a0510 con 0x7eff1c1049d0 2024-09-21T05:52:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.177+0000 7eff13e00640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff1c105320 0x7eff1c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.177+0000 7eff1be00640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c1049d0 0x7eff1c19a5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff0c02a910 tx=0x7eff0c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.178+0000 7eff19600640 1 -- 172.21.15.37:0/1762852731 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c03f070 con 0x7eff1c1049d0 2024-09-21T05:52:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.178+0000 7eff22c00640 1 -- 172.21.15.37:0/1762852731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c1a07a0 con 0x7eff1c1049d0 2024-09-21T05:52:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.178+0000 7eff19600640 1 -- 172.21.15.37:0/1762852731 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff0c003ca0 con 0x7eff1c1049d0 2024-09-21T05:52:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.178+0000 7eff19600640 1 -- 172.21.15.37:0/1762852731 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c035070 con 0x7eff1c1049d0 2024-09-21T05:52:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.178+0000 7eff22c00640 1 -- 172.21.15.37:0/1762852731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c1a6f60 con 0x7eff1c1049d0 2024-09-21T05:52:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.179+0000 7eff22c00640 1 -- 172.21.15.37:0/1762852731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff1c063b50 con 0x7eff1c1049d0 2024-09-21T05:52:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.184+0000 7eff19600640 1 -- 172.21.15.37:0/1762852731 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7eff0c03b4f0 con 0x7eff1c1049d0 2024-09-21T05:52:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.185+0000 7eff19600640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7eff000b6620 0x7eff000b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.185+0000 7eff19600640 1 -- 172.21.15.37:0/1762852731 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7eff0c108160 con 0x7eff1c1049d0 2024-09-21T05:52:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.185+0000 7eff13e00640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7eff000b6620 0x7eff000b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.185+0000 7eff19600640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458] conn(0x7eff000c1730 0x7eff000c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.185+0000 7eff19600640 1 -- 172.21.15.37:0/1762852731 --> [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff0c040ec0 con 0x7eff000c1730 2024-09-21T05:52:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.185+0000 7eff19600640 1 -- 172.21.15.37:0/1762852731 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7eff0c108510 con 0x7eff1c1049d0 2024-09-21T05:52:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.186+0000 7eff20c00640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458] conn(0x7eff000c1730 0x7eff000c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.186+0000 7eff13e00640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7eff000b6620 0x7eff000b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7eff1c079ff0 tx=0x7eff0400b440 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.186+0000 7eff20c00640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458] conn(0x7eff000c1730 0x7eff000c3c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.187+0000 7eff19600640 1 -- 172.21.15.37:0/1762852731 <== osd.1 v2:172.21.15.67:6800/2228599458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff0c040ec0 con 0x7eff000c1730 2024-09-21T05:52:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.202+0000 7eff22c00640 1 -- 172.21.15.37:0/1762852731 --> [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff1c063f80 con 0x7eff000c1730 2024-09-21T05:52:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.203+0000 7eff19600640 1 -- 172.21.15.37:0/1762852731 <== osd.1 v2:172.21.15.67:6800/2228599458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7eff1c063f80 con 0x7eff000c1730 2024-09-21T05:52:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.203+0000 7eff22c00640 1 -- 172.21.15.37:0/1762852731 >> [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458] conn(0x7eff000c1730 msgr2=0x7eff000c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.203+0000 7eff22c00640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458] conn(0x7eff000c1730 0x7eff000c3c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.204+0000 7eff22c00640 1 -- 172.21.15.37:0/1762852731 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7eff000b6620 msgr2=0x7eff000b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.204+0000 7eff22c00640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7eff000b6620 0x7eff000b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7eff1c079ff0 tx=0x7eff0400b440 comp rx=0 tx=0).stop 2024-09-21T05:52:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.204+0000 7eff22c00640 1 -- 172.21.15.37:0/1762852731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c1049d0 msgr2=0x7eff1c19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.204+0000 7eff22c00640 1 --2- 172.21.15.37:0/1762852731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1c1049d0 0x7eff1c19a5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff0c02a910 tx=0x7eff0c004270 comp rx=0 tx=0).stop 2024-09-21T05:52:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.204+0000 7eff20c00640 1 -- 172.21.15.37:0/1762852731 reap_dead start 2024-09-21T05:52:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.204+0000 7eff22c00640 1 -- 172.21.15.37:0/1762852731 shutdown_connections 2024-09-21T05:52:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.204+0000 7eff22c00640 1 -- 172.21.15.37:0/1762852731 >> 172.21.15.37:0/1762852731 conn(0x7eff1c079740 msgr2=0x7eff1c100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.204+0000 7eff22c00640 1 -- 172.21.15.37:0/1762852731 shutdown_connections 2024-09-21T05:52:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:31.204+0000 7eff22c00640 1 -- 172.21.15.37:0/1762852731 wait complete. 2024-09-21T05:52:31.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:31 smithi144 ceph-mon[34351]: pgmap v370: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:52:31.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:31 smithi037 ceph-mon[30631]: pgmap v370: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:52:31.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:31 smithi067 ceph-mon[34443]: pgmap v370: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:52:32.109 INFO:teuthology.orchestra.run.smithi037.stdout:231928234033 2024-09-21T05:52:32.109 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T05:52:32.289 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:32.538 INFO:teuthology.orchestra.run.smithi037.stdout:206158430262 2024-09-21T05:52:32.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T05:52:33.243 INFO:teuthology.orchestra.run.smithi037.stdout:55834574936 2024-09-21T05:52:33.243 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T05:52:33.831 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:33 smithi037 ceph-mon[30631]: pgmap v371: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:33.833 INFO:teuthology.orchestra.run.smithi037.stdout:103079215180 2024-09-21T05:52:33.834 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T05:52:33.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:33 smithi144 ceph-mon[34351]: pgmap v371: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:33.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:33 smithi067 ceph-mon[34443]: pgmap v371: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:34.253 INFO:teuthology.orchestra.run.smithi037.stdout:128849018950 2024-09-21T05:52:34.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T05:52:34.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.539+0000 7ff176a00640 1 -- 172.21.15.37:0/2507538054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff170105bc0 msgr2=0x7ff170105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.539+0000 7ff176a00640 1 --2- 172.21.15.37:0/2507538054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff170105bc0 0x7ff170105fd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff164009900 tx=0x7ff16402a3f0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.539+0000 7ff176a00640 1 -- 172.21.15.37:0/2507538054 shutdown_connections 2024-09-21T05:52:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.539+0000 7ff176a00640 1 --2- 172.21.15.37:0/2507538054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff17010be50 0x7ff170112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.539+0000 7ff176a00640 1 --2- 172.21.15.37:0/2507538054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17010b500 0x7ff17010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.539+0000 7ff176a00640 1 --2- 172.21.15.37:0/2507538054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff170105bc0 0x7ff170105fd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.539+0000 7ff176a00640 1 -- 172.21.15.37:0/2507538054 >> 172.21.15.37:0/2507538054 conn(0x7ff170101630 msgr2=0x7ff170103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.539+0000 7ff176a00640 1 -- 172.21.15.37:0/2507538054 shutdown_connections 2024-09-21T05:52:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.539+0000 7ff176a00640 1 -- 172.21.15.37:0/2507538054 wait complete. 2024-09-21T05:52:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.540+0000 7ff176a00640 1 Processor -- start 2024-09-21T05:52:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.540+0000 7ff176a00640 1 -- start start 2024-09-21T05:52:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.540+0000 7ff176a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170105bc0 0x7ff17019c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.541+0000 7ff176a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff17010b500 0x7ff17019cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.541+0000 7ff176a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17010be50 0x7ff1701a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.541+0000 7ff176a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff170115b10 con 0x7ff170105bc0 2024-09-21T05:52:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.541+0000 7ff176a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff170115990 con 0x7ff17010b500 2024-09-21T05:52:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.541+0000 7ff176a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff170115c90 con 0x7ff17010be50 2024-09-21T05:52:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.541+0000 7ff175600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170105bc0 0x7ff17019c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.541+0000 7ff174c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff17010b500 0x7ff17019cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.541+0000 7ff174c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff17010b500 0x7ff17019cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:60054/0 (socket says 172.21.15.37:60054) 2024-09-21T05:52:34.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.541+0000 7ff174c00640 1 -- 172.21.15.37:0/256176486 learned_addr learned my addr 172.21.15.37:0/256176486 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:34.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.541+0000 7ff176000640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17010be50 0x7ff1701a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.542+0000 7ff175600640 1 -- 172.21.15.37:0/256176486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17010be50 msgr2=0x7ff1701a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.542+0000 7ff175600640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17010be50 0x7ff1701a1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.542+0000 7ff175600640 1 -- 172.21.15.37:0/256176486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff17010b500 msgr2=0x7ff17019cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.542+0000 7ff175600640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff17010b500 0x7ff17019cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.542+0000 7ff175600640 1 -- 172.21.15.37:0/256176486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1701a2490 con 0x7ff170105bc0 2024-09-21T05:52:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.542+0000 7ff176000640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17010be50 0x7ff1701a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.542+0000 7ff175600640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170105bc0 0x7ff17019c520 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff16402a910 tx=0x7ff164031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.542+0000 7ff16e000640 1 -- 172.21.15.37:0/256176486 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16403f030 con 0x7ff170105bc0 2024-09-21T05:52:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.542+0000 7ff176a00640 1 -- 172.21.15.37:0/256176486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1701a2720 con 0x7ff170105bc0 2024-09-21T05:52:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.543+0000 7ff16e000640 1 -- 172.21.15.37:0/256176486 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1640043d0 con 0x7ff170105bc0 2024-09-21T05:52:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.543+0000 7ff16e000640 1 -- 172.21.15.37:0/256176486 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff164035070 con 0x7ff170105bc0 2024-09-21T05:52:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.543+0000 7ff176a00640 1 -- 172.21.15.37:0/256176486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1701a8ee0 con 0x7ff170105bc0 2024-09-21T05:52:34.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.543+0000 7ff176a00640 1 -- 172.21.15.37:0/256176486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff170063b50 con 0x7ff170105bc0 2024-09-21T05:52:34.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.546+0000 7ff16e000640 1 -- 172.21.15.37:0/256176486 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7ff164042030 con 0x7ff170105bc0 2024-09-21T05:52:34.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.548+0000 7ff16e000640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff1580b6620 0x7ff1580b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.548+0000 7ff16e000640 1 -- 172.21.15.37:0/256176486 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7ff1641080d0 con 0x7ff170105bc0 2024-09-21T05:52:34.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.548+0000 7ff174c00640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff1580b6620 0x7ff1580b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.548+0000 7ff16e000640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355] conn(0x7ff1580c1730 0x7ff1580c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.548+0000 7ff16e000640 1 -- 172.21.15.37:0/256176486 --> [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff164032970 con 0x7ff1580c1730 2024-09-21T05:52:34.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.548+0000 7ff16e000640 1 -- 172.21.15.37:0/256176486 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7ff164108480 con 0x7ff170105bc0 2024-09-21T05:52:34.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.549+0000 7ff176000640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355] conn(0x7ff1580c1730 0x7ff1580c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.549+0000 7ff174c00640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff1580b6620 0x7ff1580b8b30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff17010b170 tx=0x7ff15c005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:34.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.549+0000 7ff176000640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355] conn(0x7ff1580c1730 0x7ff1580c3c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:34.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.550+0000 7ff16e000640 1 -- 172.21.15.37:0/256176486 <== osd.9 v2:172.21.15.37:6826/2945950355 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff164032970 con 0x7ff1580c1730 2024-09-21T05:52:34.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.565+0000 7ff176a00640 1 -- 172.21.15.37:0/256176486 --> [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff170063f80 con 0x7ff1580c1730 2024-09-21T05:52:34.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.565+0000 7ff16e000640 1 -- 172.21.15.37:0/256176486 <== osd.9 v2:172.21.15.37:6826/2945950355 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff170063f80 con 0x7ff1580c1730 2024-09-21T05:52:34.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.566+0000 7ff176a00640 1 -- 172.21.15.37:0/256176486 >> [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355] conn(0x7ff1580c1730 msgr2=0x7ff1580c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.566+0000 7ff176a00640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355] conn(0x7ff1580c1730 0x7ff1580c3c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.566+0000 7ff176a00640 1 -- 172.21.15.37:0/256176486 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff1580b6620 msgr2=0x7ff1580b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.566+0000 7ff176a00640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff1580b6620 0x7ff1580b8b30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff17010b170 tx=0x7ff15c005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:34.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.566+0000 7ff176a00640 1 -- 172.21.15.37:0/256176486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170105bc0 msgr2=0x7ff17019c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.566+0000 7ff176a00640 1 --2- 172.21.15.37:0/256176486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff170105bc0 0x7ff17019c520 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff16402a910 tx=0x7ff164031a20 comp rx=0 tx=0).stop 2024-09-21T05:52:34.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.566+0000 7ff176000640 1 -- 172.21.15.37:0/256176486 reap_dead start 2024-09-21T05:52:34.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.566+0000 7ff176a00640 1 -- 172.21.15.37:0/256176486 shutdown_connections 2024-09-21T05:52:34.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.566+0000 7ff176a00640 1 -- 172.21.15.37:0/256176486 >> 172.21.15.37:0/256176486 conn(0x7ff170101630 msgr2=0x7ff170103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:34.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.566+0000 7ff176a00640 1 -- 172.21.15.37:0/256176486 shutdown_connections 2024-09-21T05:52:34.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:34.566+0000 7ff176a00640 1 -- 172.21.15.37:0/256176486 wait complete. 2024-09-21T05:52:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.434+0000 7fe55e800640 1 -- 172.21.15.37:0/759823551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe558075730 msgr2=0x7fe558075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.434+0000 7fe55e800640 1 --2- 172.21.15.37:0/759823551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe558075730 0x7fe558075b40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe548009860 tx=0x7fe54802a340 comp rx=0 tx=0).stop 2024-09-21T05:52:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.434+0000 7fe55e800640 1 -- 172.21.15.37:0/759823551 shutdown_connections 2024-09-21T05:52:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.434+0000 7fe55e800640 1 --2- 172.21.15.37:0/759823551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe558110160 0x7fe558112580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.434+0000 7fe55e800640 1 --2- 172.21.15.37:0/759823551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe558076080 0x7fe55810fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.434+0000 7fe55e800640 1 --2- 172.21.15.37:0/759823551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe558075730 0x7fe558075b40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.434+0000 7fe55e800640 1 -- 172.21.15.37:0/759823551 >> 172.21.15.37:0/759823551 conn(0x7fe5580ff5d0 msgr2=0x7fe558101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.434+0000 7fe55e800640 1 -- 172.21.15.37:0/759823551 shutdown_connections 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.434+0000 7fe55e800640 1 -- 172.21.15.37:0/759823551 wait complete. 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.435+0000 7fe55e800640 1 Processor -- start 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.436+0000 7fe55e800640 1 -- start start 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.436+0000 7fe55e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe558075730 0x7fe55819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.436+0000 7fe55e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe558076080 0x7fe55819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.436+0000 7fe55e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe558110160 0x7fe5581a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.436+0000 7fe55e800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe558115ca0 con 0x7fe558075730 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.436+0000 7fe55e800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe558115b20 con 0x7fe558076080 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.436+0000 7fe55e800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe558115e20 con 0x7fe558110160 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.436+0000 7fe557400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe558075730 0x7fe55819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.436+0000 7fe54fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe558076080 0x7fe55819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.436+0000 7fe557400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe558075730 0x7fe55819c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34172/0 (socket says 172.21.15.37:34172) 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.436+0000 7fe557400640 1 -- 172.21.15.37:0/1264165118 learned_addr learned my addr 172.21.15.37:0/1264165118 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.436+0000 7fe557e00640 1 --2- 172.21.15.37:0/1264165118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe558110160 0x7fe5581a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.437+0000 7fe54fe00640 1 -- 172.21.15.37:0/1264165118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe558110160 msgr2=0x7fe5581a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.437+0000 7fe54fe00640 1 --2- 172.21.15.37:0/1264165118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe558110160 0x7fe5581a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.437+0000 7fe54fe00640 1 -- 172.21.15.37:0/1264165118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe558075730 msgr2=0x7fe55819c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.437+0000 7fe54fe00640 1 --2- 172.21.15.37:0/1264165118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe558075730 0x7fe55819c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.437+0000 7fe54fe00640 1 -- 172.21.15.37:0/1264165118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5581a2640 con 0x7fe558076080 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.437+0000 7fe54fe00640 1 --2- 172.21.15.37:0/1264165118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe558076080 0x7fe55819cc70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe55806c780 tx=0x7fe54000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.437+0000 7fe554c00640 1 -- 172.21.15.37:0/1264165118 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54000ccd0 con 0x7fe558076080 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.437+0000 7fe55e800640 1 -- 172.21.15.37:0/1264165118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5581a2930 con 0x7fe558076080 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.437+0000 7fe554c00640 1 -- 172.21.15.37:0/1264165118 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5400035f0 con 0x7fe558076080 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.437+0000 7fe554c00640 1 -- 172.21.15.37:0/1264165118 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540010690 con 0x7fe558076080 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.438+0000 7fe55e800640 1 -- 172.21.15.37:0/1264165118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5581a9090 con 0x7fe558076080 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.438+0000 7fe55e800640 1 -- 172.21.15.37:0/1264165118 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe55810a720 con 0x7fe558076080 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.441+0000 7fe554c00640 1 -- 172.21.15.37:0/1264165118 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fe540003a80 con 0x7fe558076080 2024-09-21T05:52:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.442+0000 7fe554c00640 1 --2- 172.21.15.37:0/1264165118 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe53c0b65a0 0x7fe53c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.443+0000 7fe554c00640 1 -- 172.21.15.37:0/1264165118 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fe5400e7c90 con 0x7fe558076080 2024-09-21T05:52:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.443+0000 7fe557400640 1 --2- 172.21.15.37:0/1264165118 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe53c0b65a0 0x7fe53c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.443+0000 7fe554c00640 1 --2- 172.21.15.37:0/1264165118 >> [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668] conn(0x7fe53c0c16b0 0x7fe53c0c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.443+0000 7fe554c00640 1 -- 172.21.15.37:0/1264165118 --> [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe540016ec0 con 0x7fe53c0c16b0 2024-09-21T05:52:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.443+0000 7fe554c00640 1 -- 172.21.15.37:0/1264165118 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fe5400e8040 con 0x7fe558076080 2024-09-21T05:52:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.443+0000 7fe557e00640 1 --2- 172.21.15.37:0/1264165118 >> [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668] conn(0x7fe53c0c16b0 0x7fe53c0c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.444+0000 7fe557400640 1 --2- 172.21.15.37:0/1264165118 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe53c0b65a0 0x7fe53c0b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe5480095f0 tx=0x7fe548030340 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.444+0000 7fe557e00640 1 --2- 172.21.15.37:0/1264165118 >> [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668] conn(0x7fe53c0c16b0 0x7fe53c0c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.445+0000 7fe554c00640 1 -- 172.21.15.37:0/1264165118 <== osd.6 v2:172.21.15.37:6818/3607526668 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe540016ec0 con 0x7fe53c0c16b0 2024-09-21T05:52:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.459+0000 7fe55e800640 1 -- 172.21.15.37:0/1264165118 --> [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe558076c40 con 0x7fe53c0c16b0 2024-09-21T05:52:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.460+0000 7fe554c00640 1 -- 172.21.15.37:0/1264165118 <== osd.6 v2:172.21.15.37:6818/3607526668 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe558076c40 con 0x7fe53c0c16b0 2024-09-21T05:52:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.460+0000 7fe55e800640 1 -- 172.21.15.37:0/1264165118 >> [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668] conn(0x7fe53c0c16b0 msgr2=0x7fe53c0c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.460+0000 7fe55e800640 1 --2- 172.21.15.37:0/1264165118 >> [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668] conn(0x7fe53c0c16b0 0x7fe53c0c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.460+0000 7fe55e800640 1 -- 172.21.15.37:0/1264165118 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe53c0b65a0 msgr2=0x7fe53c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.460+0000 7fe55e800640 1 --2- 172.21.15.37:0/1264165118 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe53c0b65a0 0x7fe53c0b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe5480095f0 tx=0x7fe548030340 comp rx=0 tx=0).stop 2024-09-21T05:52:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.460+0000 7fe55e800640 1 -- 172.21.15.37:0/1264165118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe558076080 msgr2=0x7fe55819cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.460+0000 7fe55e800640 1 --2- 172.21.15.37:0/1264165118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe558076080 0x7fe55819cc70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe55806c780 tx=0x7fe54000ee50 comp rx=0 tx=0).stop 2024-09-21T05:52:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.460+0000 7fe557e00640 1 -- 172.21.15.37:0/1264165118 reap_dead start 2024-09-21T05:52:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.460+0000 7fe55e800640 1 -- 172.21.15.37:0/1264165118 shutdown_connections 2024-09-21T05:52:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.460+0000 7fe55e800640 1 -- 172.21.15.37:0/1264165118 >> 172.21.15.37:0/1264165118 conn(0x7fe5580ff5d0 msgr2=0x7fe558109d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.460+0000 7fe55e800640 1 -- 172.21.15.37:0/1264165118 shutdown_connections 2024-09-21T05:52:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:28.461+0000 7fe55e800640 1 -- 172.21.15.37:0/1264165118 wait complete. 2024-09-21T05:52:35.544 INFO:teuthology.orchestra.run.smithi037.stdout:180388626492 2024-09-21T05:52:35.544 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T05:52:35.792 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:35 smithi037 ceph-mon[30631]: pgmap v372: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:52:35.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:35 smithi144 ceph-mon[34351]: pgmap v372: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:52:35.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:35 smithi067 ceph-mon[34443]: pgmap v372: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:52:36.460 INFO:teuthology.orchestra.run.smithi037.stdout:304942678049 2024-09-21T05:52:36.461 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T05:52:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.900+0000 7f3718a00640 1 -- 172.21.15.37:0/3087008973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f370c0954f0 msgr2=0x7f370c0a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.900+0000 7f3718a00640 1 --2- 172.21.15.37:0/3087008973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f370c0954f0 0x7f370c0a2210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3700009900 tx=0x7f370002a480 comp rx=0 tx=0).stop 2024-09-21T05:52:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.901+0000 7f3718a00640 1 -- 172.21.15.37:0/3087008973 shutdown_connections 2024-09-21T05:52:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.901+0000 7f3718a00640 1 --2- 172.21.15.37:0/3087008973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370c0a2750 0x7f370c0a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.901+0000 7f3718a00640 1 --2- 172.21.15.37:0/3087008973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f370c0954f0 0x7f370c0a2210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.901+0000 7f3718a00640 1 --2- 172.21.15.37:0/3087008973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c094ba0 0x7f370c094fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.901+0000 7f3718a00640 1 -- 172.21.15.37:0/3087008973 >> 172.21.15.37:0/3087008973 conn(0x7f370c00cd80 msgr2=0x7f370c00d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.901+0000 7f3718a00640 1 -- 172.21.15.37:0/3087008973 shutdown_connections 2024-09-21T05:52:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.901+0000 7f3718a00640 1 -- 172.21.15.37:0/3087008973 wait complete. 2024-09-21T05:52:36.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.903+0000 7f3718a00640 1 Processor -- start 2024-09-21T05:52:36.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.904+0000 7f3718a00640 1 -- start start 2024-09-21T05:52:36.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.905+0000 7f3718a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c094ba0 0x7f370c12ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:36.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.905+0000 7f3718a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370c0954f0 0x7f370c12f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:36.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.906+0000 7f3718a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f370c0a2750 0x7f370c1345c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.906+0000 7f3718a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f370c0a8330 con 0x7f370c094ba0 2024-09-21T05:52:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.906+0000 7f3718a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f370c0a81b0 con 0x7f370c0954f0 2024-09-21T05:52:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.906+0000 7f3718a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f370c0a84b0 con 0x7f370c0a2750 2024-09-21T05:52:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.906+0000 7f3713400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c094ba0 0x7f370c12ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.906+0000 7f3712a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370c0954f0 0x7f370c12f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.906+0000 7f3712a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370c0954f0 0x7f370c12f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:60072/0 (socket says 172.21.15.37:60072) 2024-09-21T05:52:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.906+0000 7f3713400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c094ba0 0x7f370c12ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44104/0 (socket says 172.21.15.37:44104) 2024-09-21T05:52:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.906+0000 7f3712a00640 1 -- 172.21.15.37:0/2901175440 learned_addr learned my addr 172.21.15.37:0/2901175440 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.906+0000 7f3713e00640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f370c0a2750 0x7f370c1345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.907+0000 7f3712a00640 1 -- 172.21.15.37:0/2901175440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f370c0a2750 msgr2=0x7f370c1345c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.907+0000 7f3712a00640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f370c0a2750 0x7f370c1345c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.907+0000 7f3712a00640 1 -- 172.21.15.37:0/2901175440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c094ba0 msgr2=0x7f370c12ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.907+0000 7f3712a00640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c094ba0 0x7f370c12ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:36.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.907+0000 7f3712a00640 1 -- 172.21.15.37:0/2901175440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370c134cf0 con 0x7f370c0954f0 2024-09-21T05:52:36.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.907+0000 7f3713400640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c094ba0 0x7f370c12ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:36.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.907+0000 7f3712a00640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370c0954f0 0x7f370c12f320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3700005ab0 tx=0x7f3700003d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.908+0000 7f3707e00640 1 -- 172.21.15.37:0/2901175440 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370003f070 con 0x7f370c0954f0 2024-09-21T05:52:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.908+0000 7f3718a00640 1 -- 172.21.15.37:0/2901175440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370c134f80 con 0x7f370c0954f0 2024-09-21T05:52:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.908+0000 7f3718a00640 1 -- 172.21.15.37:0/2901175440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f370c13b740 con 0x7f370c0954f0 2024-09-21T05:52:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.908+0000 7f3707e00640 1 -- 172.21.15.37:0/2901175440 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3700031d60 con 0x7f370c0954f0 2024-09-21T05:52:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.908+0000 7f3707e00640 1 -- 172.21.15.37:0/2901175440 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3700035030 con 0x7f370c0954f0 2024-09-21T05:52:36.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.909+0000 7f3718a00640 1 -- 172.21.15.37:0/2901175440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f40052c0 con 0x7f370c0954f0 2024-09-21T05:52:36.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.912+0000 7f3707e00640 1 -- 172.21.15.37:0/2901175440 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f3700042070 con 0x7f370c0954f0 2024-09-21T05:52:36.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.913+0000 7f3707e00640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f36fc0b6620 0x7f36fc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:36.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.913+0000 7f3707e00640 1 -- 172.21.15.37:0/2901175440 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f3700108240 con 0x7f370c0954f0 2024-09-21T05:52:36.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.913+0000 7f3713400640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f36fc0b6620 0x7f36fc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:36.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.914+0000 7f3713400640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f36fc0b6620 0x7f36fc0b8b30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3708009d60 tx=0x7f3708009110 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:36.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:36.915+0000 7f3707e00640 1 -- 172.21.15.37:0/2901175440 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f37000ce5b0 con 0x7f370c0954f0 2024-09-21T05:52:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.127+0000 7f3718a00640 1 -- 172.21.15.37:0/2901175440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f36f4005880 con 0x7f370c0954f0 2024-09-21T05:52:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.128+0000 7f3707e00640 1 -- 172.21.15.37:0/2901175440 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f37000d2990 con 0x7f370c0954f0 2024-09-21T05:52:37.130 INFO:teuthology.orchestra.run.smithi037.stdout:73014444116 2024-09-21T05:52:37.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.130+0000 7f3718a00640 1 -- 172.21.15.37:0/2901175440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f36fc0b6620 msgr2=0x7f36fc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:37.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.130+0000 7f3718a00640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f36fc0b6620 0x7f36fc0b8b30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3708009d60 tx=0x7f3708009110 comp rx=0 tx=0).stop 2024-09-21T05:52:37.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.130+0000 7f3718a00640 1 -- 172.21.15.37:0/2901175440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370c0954f0 msgr2=0x7f370c12f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:37.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.130+0000 7f3718a00640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370c0954f0 0x7f370c12f320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3700005ab0 tx=0x7f3700003d50 comp rx=0 tx=0).stop 2024-09-21T05:52:37.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.130+0000 7f3718a00640 1 -- 172.21.15.37:0/2901175440 shutdown_connections 2024-09-21T05:52:37.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.130+0000 7f3718a00640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f370c0a2750 0x7f370c1345c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:37.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.130+0000 7f3718a00640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f36fc0b6620 0x7f36fc0b8b30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:37.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.130+0000 7f3718a00640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f370c0954f0 0x7f370c12f320 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:37.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.130+0000 7f3718a00640 1 --2- 172.21.15.37:0/2901175440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c094ba0 0x7f370c12ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:37.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.130+0000 7f3718a00640 1 -- 172.21.15.37:0/2901175440 >> 172.21.15.37:0/2901175440 conn(0x7f370c00cd80 msgr2=0x7f370c0a3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:37.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.130+0000 7f3718a00640 1 -- 172.21.15.37:0/2901175440 shutdown_connections 2024-09-21T05:52:37.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:37.130+0000 7f3718a00640 1 -- 172.21.15.37:0/2901175440 wait complete. 2024-09-21T05:52:37.481 INFO:teuthology.orchestra.run.smithi037.stdout:257698037806 2024-09-21T05:52:37.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T05:52:37.740 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:37 smithi037 ceph-mon[30631]: pgmap v373: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:37.740 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:37 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2901175440' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T05:52:37.747 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:37.749 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:37.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:37 smithi144 ceph-mon[34351]: pgmap v373: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:37.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:37 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2901175440' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T05:52:37.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:37 smithi067 ceph-mon[34443]: pgmap v373: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:37.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:37 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2901175440' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T05:52:38.235 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:38.239 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:38.241 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:38.245 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:38.262 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:38.287 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:38.301 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444113 got 73014444116 for osd.2 2024-09-21T05:52:38.301 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.034+0000 7f5e6c200640 1 -- 172.21.15.37:0/3844796126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e64105d80 msgr2=0x7f5e64106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.034+0000 7f5e6c200640 1 --2- 172.21.15.37:0/3844796126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e64105d80 0x7f5e64106190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009900 tx=0x7f5e5802a410 comp rx=0 tx=0).stop 2024-09-21T05:52:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.034+0000 7f5e6c200640 1 -- 172.21.15.37:0/3844796126 shutdown_connections 2024-09-21T05:52:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.034+0000 7f5e6c200640 1 --2- 172.21.15.37:0/3844796126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e6410c010 0x7f5e64112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.034+0000 7f5e6c200640 1 --2- 172.21.15.37:0/3844796126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e6410b6c0 0x7f5e6410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.034+0000 7f5e6c200640 1 --2- 172.21.15.37:0/3844796126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e64105d80 0x7f5e64106190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.034+0000 7f5e6c200640 1 -- 172.21.15.37:0/3844796126 >> 172.21.15.37:0/3844796126 conn(0x7f5e64101810 msgr2=0x7f5e64103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.034+0000 7f5e6c200640 1 -- 172.21.15.37:0/3844796126 shutdown_connections 2024-09-21T05:52:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.034+0000 7f5e6c200640 1 -- 172.21.15.37:0/3844796126 wait complete. 2024-09-21T05:52:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.035+0000 7f5e6c200640 1 Processor -- start 2024-09-21T05:52:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.035+0000 7f5e6c200640 1 -- start start 2024-09-21T05:52:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.036+0000 7f5e6c200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e64105d80 0x7f5e6419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.036+0000 7f5e6c200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e6410b6c0 0x7f5e6419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.036+0000 7f5e6c200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e6410c010 0x7f5e641a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.036+0000 7f5e6c200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e64115cd0 con 0x7f5e64105d80 2024-09-21T05:52:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.036+0000 7f5e6c200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5e64115b50 con 0x7f5e6410b6c0 2024-09-21T05:52:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.036+0000 7f5e6c200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5e64115e50 con 0x7f5e6410c010 2024-09-21T05:52:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.036+0000 7f5e69800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e64105d80 0x7f5e6419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.036+0000 7f5e69800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e64105d80 0x7f5e6419c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44120/0 (socket says 172.21.15.37:44120) 2024-09-21T05:52:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.036+0000 7f5e69800640 1 -- 172.21.15.37:0/57581857 learned_addr learned my addr 172.21.15.37:0/57581857 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.036+0000 7f5e68e00640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e6410b6c0 0x7f5e6419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.036+0000 7f5e6a200640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e6410c010 0x7f5e641a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.037+0000 7f5e69800640 1 -- 172.21.15.37:0/57581857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e6410c010 msgr2=0x7f5e641a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.037+0000 7f5e69800640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e6410c010 0x7f5e641a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.037+0000 7f5e69800640 1 -- 172.21.15.37:0/57581857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e6410b6c0 msgr2=0x7f5e6419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.037+0000 7f5e69800640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e6410b6c0 0x7f5e6419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.037+0000 7f5e69800640 1 -- 172.21.15.37:0/57581857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e641a2630 con 0x7f5e64105d80 2024-09-21T05:52:39.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.037+0000 7f5e68e00640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e6410b6c0 0x7f5e6419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:39.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.037+0000 7f5e69800640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e64105d80 0x7f5e6419c6c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5e58005940 tx=0x7f5e580040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:39.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.037+0000 7f5e62000640 1 -- 172.21.15.37:0/57581857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5803f030 con 0x7f5e64105d80 2024-09-21T05:52:39.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.038+0000 7f5e62000640 1 -- 172.21.15.37:0/57581857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e580044c0 con 0x7f5e64105d80 2024-09-21T05:52:39.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.038+0000 7f5e62000640 1 -- 172.21.15.37:0/57581857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e58035070 con 0x7f5e64105d80 2024-09-21T05:52:39.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.038+0000 7f5e6c200640 1 -- 172.21.15.37:0/57581857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e641a28c0 con 0x7f5e64105d80 2024-09-21T05:52:39.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.038+0000 7f5e6c200640 1 -- 172.21.15.37:0/57581857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e641a9080 con 0x7f5e64105d80 2024-09-21T05:52:39.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.039+0000 7f5e6c200640 1 -- 172.21.15.37:0/57581857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e64107000 con 0x7f5e64105d80 2024-09-21T05:52:39.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.041+0000 7f5e62000640 1 -- 172.21.15.37:0/57581857 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f5e58042030 con 0x7f5e64105d80 2024-09-21T05:52:39.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.044+0000 7f5e62000640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5e4c0b6620 0x7f5e4c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:39.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.044+0000 7f5e62000640 1 -- 172.21.15.37:0/57581857 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f5e58107da0 con 0x7f5e64105d80 2024-09-21T05:52:39.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.044+0000 7f5e68e00640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5e4c0b6620 0x7f5e4c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:39.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.045+0000 7f5e68e00640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5e4c0b6620 0x7f5e4c0b8b30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5e500095f0 tx=0x7f5e50005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:39.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.046+0000 7f5e62000640 1 -- 172.21.15.37:0/57581857 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e580d24f0 con 0x7f5e64105d80 2024-09-21T05:52:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.249+0000 7f5e6c200640 1 -- 172.21.15.37:0/57581857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5e6410dde0 con 0x7f5e64105d80 2024-09-21T05:52:39.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.250+0000 7f5e62000640 1 -- 172.21.15.37:0/57581857 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5e580d7430 con 0x7f5e64105d80 2024-09-21T05:52:39.252 INFO:teuthology.orchestra.run.smithi037.stdout:206158430264 2024-09-21T05:52:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.252+0000 7f5e6c200640 1 -- 172.21.15.37:0/57581857 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5e4c0b6620 msgr2=0x7f5e4c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.252+0000 7f5e6c200640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5e4c0b6620 0x7f5e4c0b8b30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5e500095f0 tx=0x7f5e50005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.252+0000 7f5e6c200640 1 -- 172.21.15.37:0/57581857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e64105d80 msgr2=0x7f5e6419c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.252+0000 7f5e6c200640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e64105d80 0x7f5e6419c6c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5e58005940 tx=0x7f5e580040c0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.252+0000 7f5e6c200640 1 -- 172.21.15.37:0/57581857 shutdown_connections 2024-09-21T05:52:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.252+0000 7f5e6c200640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e6410c010 0x7f5e641a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.252+0000 7f5e6c200640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5e4c0b6620 0x7f5e4c0b8b30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.252+0000 7f5e6c200640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e6410b6c0 0x7f5e6419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.252+0000 7f5e6c200640 1 --2- 172.21.15.37:0/57581857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e64105d80 0x7f5e6419c6c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.252+0000 7f5e6c200640 1 -- 172.21.15.37:0/57581857 >> 172.21.15.37:0/57581857 conn(0x7f5e64101810 msgr2=0x7f5e64103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.252+0000 7f5e6c200640 1 -- 172.21.15.37:0/57581857 shutdown_connections 2024-09-21T05:52:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.253+0000 7f5e6c200640 1 -- 172.21.15.37:0/57581857 wait complete. 2024-09-21T05:52:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.336+0000 7f9f33800640 1 -- 172.21.15.37:0/3477140376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f2c1094a0 msgr2=0x7f9f2c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.336+0000 7f9f33800640 1 --2- 172.21.15.37:0/3477140376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f2c1094a0 0x7f9f2c1098b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009900 tx=0x7f9f1802a410 comp rx=0 tx=0).stop 2024-09-21T05:52:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.336+0000 7f9f33800640 1 -- 172.21.15.37:0/3477140376 shutdown_connections 2024-09-21T05:52:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.336+0000 7f9f33800640 1 --2- 172.21.15.37:0/3477140376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f2c109df0 0x7f9f2c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.336+0000 7f9f33800640 1 --2- 172.21.15.37:0/3477140376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f2c1094a0 0x7f9f2c1098b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.336+0000 7f9f33800640 1 --2- 172.21.15.37:0/3477140376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f2c103b60 0x7f9f2c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.336+0000 7f9f33800640 1 -- 172.21.15.37:0/3477140376 >> 172.21.15.37:0/3477140376 conn(0x7f9f2c07b850 msgr2=0x7f9f2c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.336+0000 7f9f33800640 1 -- 172.21.15.37:0/3477140376 shutdown_connections 2024-09-21T05:52:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.336+0000 7f9f33800640 1 -- 172.21.15.37:0/3477140376 wait complete. 2024-09-21T05:52:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.338+0000 7f9f33800640 1 Processor -- start 2024-09-21T05:52:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.338+0000 7f9f33800640 1 -- start start 2024-09-21T05:52:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.338+0000 7f9f33800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f2c103b60 0x7f9f2c19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.338+0000 7f9f33800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f2c1094a0 0x7f9f2c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.338+0000 7f9f33800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f2c109df0 0x7f9f2c19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.338+0000 7f9f33800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c113b00 con 0x7f9f2c1094a0 2024-09-21T05:52:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.338+0000 7f9f33800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c113980 con 0x7f9f2c103b60 2024-09-21T05:52:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.338+0000 7f9f33800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c113c80 con 0x7f9f2c109df0 2024-09-21T05:52:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.338+0000 7f9f2be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f2c1094a0 0x7f9f2c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.338+0000 7f9f30e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f2c103b60 0x7f9f2c19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.338+0000 7f9f2be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f2c1094a0 0x7f9f2c19ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44138/0 (socket says 172.21.15.37:44138) 2024-09-21T05:52:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.338+0000 7f9f2be00640 1 -- 172.21.15.37:0/3880813788 learned_addr learned my addr 172.21.15.37:0/3880813788 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.338+0000 7f9f31800640 1 --2- 172.21.15.37:0/3880813788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f2c109df0 0x7f9f2c19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.339+0000 7f9f31800640 1 -- 172.21.15.37:0/3880813788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f2c103b60 msgr2=0x7f9f2c19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.339+0000 7f9f31800640 1 --2- 172.21.15.37:0/3880813788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f2c103b60 0x7f9f2c19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.339+0000 7f9f31800640 1 -- 172.21.15.37:0/3880813788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f2c1094a0 msgr2=0x7f9f2c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.339+0000 7f9f31800640 1 --2- 172.21.15.37:0/3880813788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f2c1094a0 0x7f9f2c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.339+0000 7f9f31800640 1 -- 172.21.15.37:0/3880813788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c1a0520 con 0x7f9f2c109df0 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.339+0000 7f9f31800640 1 --2- 172.21.15.37:0/3880813788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f2c109df0 0x7f9f2c19fdf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009fd0 tx=0x7f9f2400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.340+0000 7f9f29600640 1 -- 172.21.15.37:0/3880813788 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2400ce20 con 0x7f9f2c109df0 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.340+0000 7f9f29600640 1 -- 172.21.15.37:0/3880813788 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f24005020 con 0x7f9f2c109df0 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.340+0000 7f9f33800640 1 -- 172.21.15.37:0/3880813788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2c1a0810 con 0x7f9f2c109df0 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.340+0000 7f9f29600640 1 -- 172.21.15.37:0/3880813788 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f24010690 con 0x7f9f2c109df0 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.340+0000 7f9f33800640 1 -- 172.21.15.37:0/3880813788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2c1a6f70 con 0x7f9f2c109df0 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.341+0000 7f9f33800640 1 -- 172.21.15.37:0/3880813788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f2c103f70 con 0x7f9f2c109df0 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.343+0000 7f9f29600640 1 -- 172.21.15.37:0/3880813788 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f9f240054d0 con 0x7f9f2c109df0 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.345+0000 7f9f29600640 1 --2- 172.21.15.37:0/3880813788 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9f140b65a0 0x7f9f140b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.345+0000 7f9f29600640 1 -- 172.21.15.37:0/3880813788 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f9f240e7e50 con 0x7f9f2c109df0 2024-09-21T05:52:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.345+0000 7f9f30e00640 1 --2- 172.21.15.37:0/3880813788 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9f140b65a0 0x7f9f140b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.346+0000 7f9f30e00640 1 --2- 172.21.15.37:0/3880813788 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9f140b65a0 0x7f9f140b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009bd0 tx=0x7f9f20005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.347+0000 7f9f29600640 1 -- 172.21.15.37:0/3880813788 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f240ae1c0 con 0x7f9f2c109df0 2024-09-21T05:52:39.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.553+0000 7f9f33800640 1 -- 172.21.15.37:0/3880813788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9f2c19b6e0 con 0x7f9f2c109df0 2024-09-21T05:52:39.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.554+0000 7f9f29600640 1 -- 172.21.15.37:0/3880813788 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9f2c19b6e0 con 0x7f9f2c109df0 2024-09-21T05:52:39.556 INFO:teuthology.orchestra.run.smithi037.stdout:34359738464 2024-09-21T05:52:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.557+0000 7f9f33800640 1 -- 172.21.15.37:0/3880813788 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9f140b65a0 msgr2=0x7f9f140b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.557+0000 7f9f33800640 1 --2- 172.21.15.37:0/3880813788 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9f140b65a0 0x7f9f140b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009bd0 tx=0x7f9f20005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.557+0000 7f9f33800640 1 -- 172.21.15.37:0/3880813788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f2c109df0 msgr2=0x7f9f2c19fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.557+0000 7f9f33800640 1 --2- 172.21.15.37:0/3880813788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f2c109df0 0x7f9f2c19fdf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009fd0 tx=0x7f9f2400ef10 comp rx=0 tx=0).stop 2024-09-21T05:52:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.557+0000 7f9f33800640 1 -- 172.21.15.37:0/3880813788 shutdown_connections 2024-09-21T05:52:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.557+0000 7f9f33800640 1 --2- 172.21.15.37:0/3880813788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f2c109df0 0x7f9f2c19fdf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.557+0000 7f9f33800640 1 --2- 172.21.15.37:0/3880813788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f2c1094a0 0x7f9f2c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.557+0000 7f9f33800640 1 --2- 172.21.15.37:0/3880813788 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9f140b65a0 0x7f9f140b8ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.557+0000 7f9f33800640 1 --2- 172.21.15.37:0/3880813788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f2c103b60 0x7f9f2c19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.557+0000 7f9f33800640 1 -- 172.21.15.37:0/3880813788 >> 172.21.15.37:0/3880813788 conn(0x7f9f2c07b850 msgr2=0x7f9f2c107690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.557+0000 7f9f33800640 1 -- 172.21.15.37:0/3880813788 shutdown_connections 2024-09-21T05:52:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.557+0000 7f9f33800640 1 -- 172.21.15.37:0/3880813788 wait complete. 2024-09-21T05:52:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.826+0000 7f6401e00640 1 -- 172.21.15.37:0/510951146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc105d90 msgr2=0x7f63fc1061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.826+0000 7f6401e00640 1 --2- 172.21.15.37:0/510951146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc105d90 0x7f63fc1061a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009860 tx=0x7f63ec02a340 comp rx=0 tx=0).stop 2024-09-21T05:52:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.826+0000 7f6401e00640 1 -- 172.21.15.37:0/510951146 shutdown_connections 2024-09-21T05:52:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.826+0000 7f6401e00640 1 --2- 172.21.15.37:0/510951146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc10c020 0x7f63fc112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.826+0000 7f6401e00640 1 --2- 172.21.15.37:0/510951146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc10b6d0 0x7f63fc10bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.826+0000 7f6401e00640 1 --2- 172.21.15.37:0/510951146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc105d90 0x7f63fc1061a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.826+0000 7f6401e00640 1 -- 172.21.15.37:0/510951146 >> 172.21.15.37:0/510951146 conn(0x7f63fc101860 msgr2=0x7f63fc103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:39.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.827+0000 7f6401e00640 1 -- 172.21.15.37:0/510951146 shutdown_connections 2024-09-21T05:52:39.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.827+0000 7f6401e00640 1 -- 172.21.15.37:0/510951146 wait complete. 2024-09-21T05:52:39.830 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:39 smithi037 ceph-mon[30631]: pgmap v374: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T05:52:39.830 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:39 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/57581857' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T05:52:39.830 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:39 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3880813788' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T05:52:39.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.828+0000 7f6401e00640 1 Processor -- start 2024-09-21T05:52:39.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.828+0000 7f6401e00640 1 -- start start 2024-09-21T05:52:39.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f6401e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc105d90 0x7f63fc19c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:39.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f6401e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc10b6d0 0x7f63fc19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f6401e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc10c020 0x7f63fc1a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f6401e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc115ce0 con 0x7f63fc10c020 2024-09-21T05:52:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f6401e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc115b60 con 0x7f63fc10b6d0 2024-09-21T05:52:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f6401e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc115e60 con 0x7f63fc105d90 2024-09-21T05:52:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f63f3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc10b6d0 0x7f63fc19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f63f3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc10b6d0 0x7f63fc19cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:60142/0 (socket says 172.21.15.37:60142) 2024-09-21T05:52:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f63f3e00640 1 -- 172.21.15.37:0/1596006071 learned_addr learned my addr 172.21.15.37:0/1596006071 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f63faa00640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc105d90 0x7f63fc19c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f63fb400640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc10c020 0x7f63fc1a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f63f3e00640 1 -- 172.21.15.37:0/1596006071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc105d90 msgr2=0x7f63fc19c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f63f3e00640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc105d90 0x7f63fc19c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f63f3e00640 1 -- 172.21.15.37:0/1596006071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc10c020 msgr2=0x7f63fc1a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f63f3e00640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc10c020 0x7f63fc1a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.829+0000 7f63f3e00640 1 -- 172.21.15.37:0/1596006071 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc1a2620 con 0x7f63fc10b6d0 2024-09-21T05:52:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.830+0000 7f63f3e00640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc10b6d0 0x7f63fc19cc50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f63e400d740 tx=0x7f63e400dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.830+0000 7f6400a00640 1 -- 172.21.15.37:0/1596006071 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4017070 con 0x7f63fc10b6d0 2024-09-21T05:52:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.830+0000 7f6401e00640 1 -- 172.21.15.37:0/1596006071 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc1a2910 con 0x7f63fc10b6d0 2024-09-21T05:52:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.830+0000 7f6400a00640 1 -- 172.21.15.37:0/1596006071 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63e400de50 con 0x7f63fc10b6d0 2024-09-21T05:52:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.830+0000 7f6400a00640 1 -- 172.21.15.37:0/1596006071 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e400f620 con 0x7f63fc10b6d0 2024-09-21T05:52:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.830+0000 7f6401e00640 1 -- 172.21.15.37:0/1596006071 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63fc1a9070 con 0x7f63fc10b6d0 2024-09-21T05:52:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.831+0000 7f6401e00640 1 -- 172.21.15.37:0/1596006071 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63fc1061a0 con 0x7f63fc10b6d0 2024-09-21T05:52:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.834+0000 7f6400a00640 1 -- 172.21.15.37:0/1596006071 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f63e401a070 con 0x7f63fc10b6d0 2024-09-21T05:52:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.835+0000 7f6400a00640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f63e00b65a0 0x7f63e00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.835+0000 7f6400a00640 1 -- 172.21.15.37:0/1596006071 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f63e40e7220 con 0x7f63fc10b6d0 2024-09-21T05:52:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.836+0000 7f63faa00640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f63e00b65a0 0x7f63e00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.836+0000 7f63faa00640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f63e00b65a0 0x7f63e00b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009830 tx=0x7f63ec030340 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:39.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:39.839+0000 7f6400a00640 1 -- 172.21.15.37:0/1596006071 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f63e40b1970 con 0x7f63fc10b6d0 2024-09-21T05:52:39.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:39 smithi144 ceph-mon[34351]: pgmap v374: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T05:52:39.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:39 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/57581857' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T05:52:39.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:39 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3880813788' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T05:52:39.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:39 smithi067 ceph-mon[34443]: pgmap v374: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T05:52:39.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:39 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/57581857' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T05:52:39.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:39 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3880813788' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T05:52:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.044+0000 7f6401e00640 1 -- 172.21.15.37:0/1596006071 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f63fc10d860 con 0x7f63fc10b6d0 2024-09-21T05:52:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.045+0000 7f6400a00640 1 -- 172.21.15.37:0/1596006071 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f63e40b68b0 con 0x7f63fc10b6d0 2024-09-21T05:52:40.047 INFO:teuthology.orchestra.run.smithi037.stdout:103079215182 2024-09-21T05:52:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.047+0000 7f6401e00640 1 -- 172.21.15.37:0/1596006071 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f63e00b65a0 msgr2=0x7f63e00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.047+0000 7f6401e00640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f63e00b65a0 0x7f63e00b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009830 tx=0x7f63ec030340 comp rx=0 tx=0).stop 2024-09-21T05:52:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.047+0000 7f6401e00640 1 -- 172.21.15.37:0/1596006071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc10b6d0 msgr2=0x7f63fc19cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.047+0000 7f6401e00640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc10b6d0 0x7f63fc19cc50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f63e400d740 tx=0x7f63e400dc00 comp rx=0 tx=0).stop 2024-09-21T05:52:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.047+0000 7f6401e00640 1 -- 172.21.15.37:0/1596006071 shutdown_connections 2024-09-21T05:52:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.047+0000 7f6401e00640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc10c020 0x7f63fc1a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.047+0000 7f6401e00640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f63e00b65a0 0x7f63e00b8ab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.047+0000 7f6401e00640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63fc10b6d0 0x7f63fc19cc50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.047+0000 7f6401e00640 1 --2- 172.21.15.37:0/1596006071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc105d90 0x7f63fc19c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.047+0000 7f6401e00640 1 -- 172.21.15.37:0/1596006071 >> 172.21.15.37:0/1596006071 conn(0x7f63fc101860 msgr2=0x7f63fc103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.047+0000 7f6401e00640 1 -- 172.21.15.37:0/1596006071 shutdown_connections 2024-09-21T05:52:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:40.047+0000 7f6401e00640 1 -- 172.21.15.37:0/1596006071 wait complete. 2024-09-21T05:52:40.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:40 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1596006071' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T05:52:40.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:40 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1596006071' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T05:52:41.065 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738462 got 34359738464 for osd.0 2024-09-21T05:52:41.066 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:41.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:40 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1596006071' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T05:52:41.731 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.775+0000 7f38e8200640 1 -- 172.21.15.37:0/4104215630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e00757b0 msgr2=0x7f38e0075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.775+0000 7f38e8200640 1 --2- 172.21.15.37:0/4104215630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e00757b0 0x7f38e0075bc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009900 tx=0x7f38d402a410 comp rx=0 tx=0).stop 2024-09-21T05:52:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.775+0000 7f38e8200640 1 -- 172.21.15.37:0/4104215630 shutdown_connections 2024-09-21T05:52:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.775+0000 7f38e8200640 1 --2- 172.21.15.37:0/4104215630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38e01100e0 0x7f38e0112520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.775+0000 7f38e8200640 1 --2- 172.21.15.37:0/4104215630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e0076100 0x7f38e010fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.775+0000 7f38e8200640 1 --2- 172.21.15.37:0/4104215630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e00757b0 0x7f38e0075bc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.775+0000 7f38e8200640 1 -- 172.21.15.37:0/4104215630 >> 172.21.15.37:0/4104215630 conn(0x7f38e00ff610 msgr2=0x7f38e0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.775+0000 7f38e8200640 1 -- 172.21.15.37:0/4104215630 shutdown_connections 2024-09-21T05:52:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.775+0000 7f38e8200640 1 -- 172.21.15.37:0/4104215630 wait complete. 2024-09-21T05:52:41.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.776+0000 7f38e8200640 1 Processor -- start 2024-09-21T05:52:41.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.777+0000 7f38e8200640 1 -- start start 2024-09-21T05:52:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.777+0000 7f38e8200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38e00757b0 0x7f38e019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.777+0000 7f38e8200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e0076100 0x7f38e019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.777+0000 7f38e8200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e01100e0 0x7f38e01a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.777+0000 7f38e8200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0115ce0 con 0x7f38e0076100 2024-09-21T05:52:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.777+0000 7f38e8200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0115b60 con 0x7f38e00757b0 2024-09-21T05:52:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.777+0000 7f38e8200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0115e60 con 0x7f38e01100e0 2024-09-21T05:52:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.777+0000 7f38e5800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38e00757b0 0x7f38e019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.778+0000 7f38e5800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38e00757b0 0x7f38e019c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:39308/0 (socket says 172.21.15.37:39308) 2024-09-21T05:52:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.778+0000 7f38e5800640 1 -- 172.21.15.37:0/2951407304 learned_addr learned my addr 172.21.15.37:0/2951407304 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.778+0000 7f38e4e00640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e0076100 0x7f38e019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.778+0000 7f38e6200640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e01100e0 0x7f38e01a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:41.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.778+0000 7f38e6200640 1 -- 172.21.15.37:0/2951407304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38e00757b0 msgr2=0x7f38e019c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:41.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.778+0000 7f38e6200640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38e00757b0 0x7f38e019c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.778+0000 7f38e6200640 1 -- 172.21.15.37:0/2951407304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e0076100 msgr2=0x7f38e019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:41.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.778+0000 7f38e6200640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e0076100 0x7f38e019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.778+0000 7f38e6200640 1 -- 172.21.15.37:0/2951407304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e01a2640 con 0x7f38e01100e0 2024-09-21T05:52:41.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.778+0000 7f38e5800640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38e00757b0 0x7f38e019c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:41.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.778+0000 7f38e6200640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e01100e0 0x7f38e01a1f10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009fd0 tx=0x7f38d800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.779+0000 7f38de000640 1 -- 172.21.15.37:0/2951407304 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d800ce20 con 0x7f38e01100e0 2024-09-21T05:52:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.779+0000 7f38de000640 1 -- 172.21.15.37:0/2951407304 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38d8005020 con 0x7f38e01100e0 2024-09-21T05:52:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.779+0000 7f38de000640 1 -- 172.21.15.37:0/2951407304 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8010690 con 0x7f38e01100e0 2024-09-21T05:52:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.779+0000 7f38e8200640 1 -- 172.21.15.37:0/2951407304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e01a2930 con 0x7f38e01100e0 2024-09-21T05:52:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.779+0000 7f38e8200640 1 -- 172.21.15.37:0/2951407304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e01a9090 con 0x7f38e01100e0 2024-09-21T05:52:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.780+0000 7f38e8200640 1 -- 172.21.15.37:0/2951407304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e0076cc0 con 0x7f38e01100e0 2024-09-21T05:52:41.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.783+0000 7f38de000640 1 -- 172.21.15.37:0/2951407304 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f38d80054d0 con 0x7f38e01100e0 2024-09-21T05:52:41.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.784+0000 7f38de000640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f38c80b6620 0x7f38c80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:41.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.784+0000 7f38de000640 1 -- 172.21.15.37:0/2951407304 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f38d80e7de0 con 0x7f38e01100e0 2024-09-21T05:52:41.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.784+0000 7f38e5800640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f38c80b6620 0x7f38c80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:41.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.785+0000 7f38e5800640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f38c80b6620 0x7f38c80b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f38d40096c0 tx=0x7f38d4005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.786+0000 7f38de000640 1 -- 172.21.15.37:0/2951407304 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38d80ae1e0 con 0x7f38e01100e0 2024-09-21T05:52:41.849 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:41 smithi037 ceph-mon[30631]: pgmap v375: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T05:52:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.988+0000 7f38e8200640 1 -- 172.21.15.37:0/2951407304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f38e0075bc0 con 0x7f38e01100e0 2024-09-21T05:52:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.989+0000 7f38de000640 1 -- 172.21.15.37:0/2951407304 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38d80b25c0 con 0x7f38e01100e0 2024-09-21T05:52:41.992 INFO:teuthology.orchestra.run.smithi037.stdout:55834574938 2024-09-21T05:52:41.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.992+0000 7f38e8200640 1 -- 172.21.15.37:0/2951407304 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f38c80b6620 msgr2=0x7f38c80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:41.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.992+0000 7f38e8200640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f38c80b6620 0x7f38c80b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f38d40096c0 tx=0x7f38d4005a20 comp rx=0 tx=0).stop 2024-09-21T05:52:41.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.992+0000 7f38e8200640 1 -- 172.21.15.37:0/2951407304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e01100e0 msgr2=0x7f38e01a1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:41.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.992+0000 7f38e8200640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e01100e0 0x7f38e01a1f10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009fd0 tx=0x7f38d800ef10 comp rx=0 tx=0).stop 2024-09-21T05:52:41.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.992+0000 7f38e8200640 1 -- 172.21.15.37:0/2951407304 shutdown_connections 2024-09-21T05:52:41.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.992+0000 7f38e8200640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e01100e0 0x7f38e01a1f10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.992+0000 7f38e8200640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e0076100 0x7f38e019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.992+0000 7f38e8200640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f38c80b6620 0x7f38c80b8b30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.992+0000 7f38e8200640 1 --2- 172.21.15.37:0/2951407304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38e00757b0 0x7f38e019c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:41.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.992+0000 7f38e8200640 1 -- 172.21.15.37:0/2951407304 >> 172.21.15.37:0/2951407304 conn(0x7f38e00ff610 msgr2=0x7f38e0107b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:41.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.992+0000 7f38e8200640 1 -- 172.21.15.37:0/2951407304 shutdown_connections 2024-09-21T05:52:41.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:41.992+0000 7f38e8200640 1 -- 172.21.15.37:0/2951407304 wait complete. 2024-09-21T05:52:41.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:41 smithi067 ceph-mon[34443]: pgmap v375: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T05:52:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:41 smithi144 ceph-mon[34351]: pgmap v375: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T05:52:42.717 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:42 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2951407304' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T05:52:42.717 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:42 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2897302131' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T05:52:42.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:42 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2951407304' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T05:52:42.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:42 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2897302131' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T05:52:43.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:42 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2951407304' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T05:52:43.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:42 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2897302131' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T05:52:43.267 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430262 got 206158430264 for osd.7 2024-09-21T05:52:43.267 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:43.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.535+0000 7f2188a00640 1 -- 172.21.15.37:0/2194211729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2184103b60 msgr2=0x7f2184103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.535+0000 7f2188a00640 1 --2- 172.21.15.37:0/2194211729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2184103b60 0x7f2184103f70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2174009900 tx=0x7f217402a400 comp rx=0 tx=0).stop 2024-09-21T05:52:43.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.535+0000 7f2188a00640 1 -- 172.21.15.37:0/2194211729 shutdown_connections 2024-09-21T05:52:43.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.535+0000 7f2188a00640 1 --2- 172.21.15.37:0/2194211729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2184109df0 0x7f2184110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.535+0000 7f2188a00640 1 --2- 172.21.15.37:0/2194211729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21841094a0 0x7f21841098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.535+0000 7f2188a00640 1 --2- 172.21.15.37:0/2194211729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2184103b60 0x7f2184103f70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.535+0000 7f2188a00640 1 -- 172.21.15.37:0/2194211729 >> 172.21.15.37:0/2194211729 conn(0x7f218407b850 msgr2=0x7f218407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:43.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.535+0000 7f2188a00640 1 -- 172.21.15.37:0/2194211729 shutdown_connections 2024-09-21T05:52:43.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.536+0000 7f2188a00640 1 -- 172.21.15.37:0/2194211729 wait complete. 2024-09-21T05:52:43.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.537+0000 7f2188a00640 1 Processor -- start 2024-09-21T05:52:43.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.537+0000 7f2188a00640 1 -- start start 2024-09-21T05:52:43.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.538+0000 7f2188a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2184103b60 0x7f218419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.538+0000 7f2188a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21841094a0 0x7f218419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.538+0000 7f2188a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2184109df0 0x7f218419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.538+0000 7f2188a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2184113b00 con 0x7f2184109df0 2024-09-21T05:52:43.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.538+0000 7f2188a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2184113980 con 0x7f2184103b60 2024-09-21T05:52:43.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.538+0000 7f2188a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2184113c80 con 0x7f21841094a0 2024-09-21T05:52:43.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.538+0000 7f217be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21841094a0 0x7f218419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.538+0000 7f2182800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2184109df0 0x7f218419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.538+0000 7f217be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21841094a0 0x7f218419aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:39004/0 (socket says 172.21.15.37:39004) 2024-09-21T05:52:43.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.538+0000 7f217be00640 1 -- 172.21.15.37:0/1978979200 learned_addr learned my addr 172.21.15.37:0/1978979200 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:43.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.538+0000 7f2181e00640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2184103b60 0x7f218419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.539+0000 7f217be00640 1 -- 172.21.15.37:0/1978979200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2184103b60 msgr2=0x7f218419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.539+0000 7f217be00640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2184103b60 0x7f218419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.539+0000 7f217be00640 1 -- 172.21.15.37:0/1978979200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2184109df0 msgr2=0x7f218419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.539+0000 7f217be00640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2184109df0 0x7f218419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.539+0000 7f217be00640 1 -- 172.21.15.37:0/1978979200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21841a0440 con 0x7f21841094a0 2024-09-21T05:52:43.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.539+0000 7f2182800640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2184109df0 0x7f218419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:43.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.539+0000 7f217be00640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21841094a0 0x7f218419aa70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f216c00e9c0 tx=0x7f216c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:43.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.539+0000 7f217aa00640 1 -- 172.21.15.37:0/1978979200 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c00ccc0 con 0x7f21841094a0 2024-09-21T05:52:43.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.540+0000 7f2188a00640 1 -- 172.21.15.37:0/1978979200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21841a0730 con 0x7f21841094a0 2024-09-21T05:52:43.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.540+0000 7f217aa00640 1 -- 172.21.15.37:0/1978979200 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216c0054d0 con 0x7f21841094a0 2024-09-21T05:52:43.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.540+0000 7f217aa00640 1 -- 172.21.15.37:0/1978979200 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c010430 con 0x7f21841094a0 2024-09-21T05:52:43.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.540+0000 7f2188a00640 1 -- 172.21.15.37:0/1978979200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21840755f0 con 0x7f21841094a0 2024-09-21T05:52:43.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.541+0000 7f2188a00640 1 -- 172.21.15.37:0/1978979200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2184103f70 con 0x7f21841094a0 2024-09-21T05:52:43.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.544+0000 7f217aa00640 1 -- 172.21.15.37:0/1978979200 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f216c005000 con 0x7f21841094a0 2024-09-21T05:52:43.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.546+0000 7f217aa00640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f21680b65a0 0x7f21680b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.546+0000 7f217aa00640 1 -- 172.21.15.37:0/1978979200 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f216c0e7d60 con 0x7f21841094a0 2024-09-21T05:52:43.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.546+0000 7f2181e00640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f21680b65a0 0x7f21680b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.547+0000 7f217aa00640 1 -- 172.21.15.37:0/1978979200 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f216c056710 con 0x7f21841094a0 2024-09-21T05:52:43.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.547+0000 7f2181e00640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f21680b65a0 0x7f21680b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2174005ab0 tx=0x7f2174005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:43.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.750+0000 7f2188a00640 1 -- 172.21.15.37:0/1978979200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f218410bbc0 con 0x7f21841094a0 2024-09-21T05:52:43.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.751+0000 7f217aa00640 1 -- 172.21.15.37:0/1978979200 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f216c0052f0 con 0x7f21841094a0 2024-09-21T05:52:43.753 INFO:teuthology.orchestra.run.smithi037.stdout:279172874281 2024-09-21T05:52:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.754+0000 7f2188a00640 1 -- 172.21.15.37:0/1978979200 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f21680b65a0 msgr2=0x7f21680b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.754+0000 7f2188a00640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f21680b65a0 0x7f21680b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2174005ab0 tx=0x7f2174005a20 comp rx=0 tx=0).stop 2024-09-21T05:52:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.754+0000 7f2188a00640 1 -- 172.21.15.37:0/1978979200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21841094a0 msgr2=0x7f218419aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.754+0000 7f2188a00640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21841094a0 0x7f218419aa70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f216c00e9c0 tx=0x7f216c00ee80 comp rx=0 tx=0).stop 2024-09-21T05:52:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.754+0000 7f2188a00640 1 -- 172.21.15.37:0/1978979200 shutdown_connections 2024-09-21T05:52:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.754+0000 7f2188a00640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2184109df0 0x7f218419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.754+0000 7f2188a00640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21841094a0 0x7f218419aa70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.754+0000 7f2188a00640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f21680b65a0 0x7f21680b8ab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.754+0000 7f2188a00640 1 --2- 172.21.15.37:0/1978979200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2184103b60 0x7f218419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.754+0000 7f2188a00640 1 -- 172.21.15.37:0/1978979200 >> 172.21.15.37:0/1978979200 conn(0x7f218407b850 msgr2=0x7f2184107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.754+0000 7f2188a00640 1 -- 172.21.15.37:0/1978979200 shutdown_connections 2024-09-21T05:52:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.754+0000 7f2188a00640 1 -- 172.21.15.37:0/1978979200 wait complete. 2024-09-21T05:52:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.031+0000 7f2a0bc00640 1 -- 172.21.15.37:0/1988869011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a041100d0 msgr2=0x7f2a04112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.031+0000 7f2a0bc00640 1 --2- 172.21.15.37:0/1988869011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a041100d0 0x7f2a04112510 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009be0 tx=0x7f29fc02a6c0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.031+0000 7f2a0bc00640 1 -- 172.21.15.37:0/1988869011 shutdown_connections 2024-09-21T05:52:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.031+0000 7f2a0bc00640 1 --2- 172.21.15.37:0/1988869011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a041100d0 0x7f2a04112510 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.031+0000 7f2a0bc00640 1 --2- 172.21.15.37:0/1988869011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a04076100 0x7f2a0410fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.031+0000 7f2a0bc00640 1 --2- 172.21.15.37:0/1988869011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a040757b0 0x7f2a04075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.031+0000 7f2a0bc00640 1 -- 172.21.15.37:0/1988869011 >> 172.21.15.37:0/1988869011 conn(0x7f2a040ff5e0 msgr2=0x7f2a04101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.031+0000 7f2a0bc00640 1 -- 172.21.15.37:0/1988869011 shutdown_connections 2024-09-21T05:52:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.031+0000 7f2a0bc00640 1 -- 172.21.15.37:0/1988869011 wait complete. 2024-09-21T05:52:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.033+0000 7f2a0bc00640 1 Processor -- start 2024-09-21T05:52:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.033+0000 7f2a0bc00640 1 -- start start 2024-09-21T05:52:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.033+0000 7f2a0bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a040757b0 0x7f2a041a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.033+0000 7f2a0bc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a04076100 0x7f2a041a3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.033+0000 7f2a0bc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a041100d0 0x7f2a0410f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.033+0000 7f2a0bc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04115c80 con 0x7f2a04076100 2024-09-21T05:52:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.033+0000 7f2a0bc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04115b00 con 0x7f2a041100d0 2024-09-21T05:52:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.033+0000 7f2a0bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04115e00 con 0x7f2a040757b0 2024-09-21T05:52:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.034+0000 7f2a03e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a04076100 0x7f2a041a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.034+0000 7f2a03e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a04076100 0x7f2a041a3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33016/0 (socket says 172.21.15.37:33016) 2024-09-21T05:52:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.034+0000 7f2a03e00640 1 -- 172.21.15.37:0/2897302131 learned_addr learned my addr 172.21.15.37:0/2897302131 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.034+0000 7f2a09c00640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a041100d0 0x7f2a0410f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.034+0000 7f2a09200640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a040757b0 0x7f2a041a2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.034+0000 7f2a03e00640 1 -- 172.21.15.37:0/2897302131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a040757b0 msgr2=0x7f2a041a2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.034+0000 7f2a03e00640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a040757b0 0x7f2a041a2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.034+0000 7f2a03e00640 1 -- 172.21.15.37:0/2897302131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a041100d0 msgr2=0x7f2a0410f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.034+0000 7f2a03e00640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a041100d0 0x7f2a0410f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.034+0000 7f2a03e00640 1 -- 172.21.15.37:0/2897302131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0410fa30 con 0x7f2a04076100 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.034+0000 7f2a09c00640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a041100d0 0x7f2a0410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.035+0000 7f2a03e00640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a04076100 0x7f2a041a3020 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29f000e9f0 tx=0x7f29f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.035+0000 7f2a01600640 1 -- 172.21.15.37:0/2897302131 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f000ccc0 con 0x7f2a04076100 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.035+0000 7f2a0bc00640 1 -- 172.21.15.37:0/2897302131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0410fcc0 con 0x7f2a04076100 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.035+0000 7f2a0bc00640 1 -- 172.21.15.37:0/2897302131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0410a340 con 0x7f2a04076100 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.035+0000 7f2a01600640 1 -- 172.21.15.37:0/2897302131 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29f00035f0 con 0x7f2a04076100 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.035+0000 7f2a01600640 1 -- 172.21.15.37:0/2897302131 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f000ce60 con 0x7f2a04076100 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.037+0000 7f2a0bc00640 1 -- 172.21.15.37:0/2897302131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e40052c0 con 0x7f2a04076100 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.041+0000 7f2a01600640 1 -- 172.21.15.37:0/2897302131 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f29f0010690 con 0x7f2a04076100 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.043+0000 7f2a01600640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f29ec0b6620 0x7f29ec0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.043+0000 7f2a01600640 1 -- 172.21.15.37:0/2897302131 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7f29f00e7990 con 0x7f2a04076100 2024-09-21T05:52:43.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.043+0000 7f2a01600640 1 -- 172.21.15.37:0/2897302131 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f29f00add60 con 0x7f2a04076100 2024-09-21T05:52:43.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.043+0000 7f2a09200640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f29ec0b6620 0x7f29ec0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.044+0000 7f2a09200640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f29ec0b6620 0x7f29ec0b8b30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2a0410b200 tx=0x7f29f8005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:43.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.256+0000 7f2a0bc00640 1 -- 172.21.15.37:0/2897302131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f29e4005880 con 0x7f2a04076100 2024-09-21T05:52:43.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.256+0000 7f2a01600640 1 -- 172.21.15.37:0/2897302131 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f29f00b2140 con 0x7f2a04076100 2024-09-21T05:52:43.779 INFO:teuthology.orchestra.run.smithi037.stdout:128849018954 2024-09-21T05:52:43.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.259+0000 7f2a0bc00640 1 -- 172.21.15.37:0/2897302131 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f29ec0b6620 msgr2=0x7f29ec0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.259+0000 7f2a0bc00640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f29ec0b6620 0x7f29ec0b8b30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2a0410b200 tx=0x7f29f8005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.259+0000 7f2a0bc00640 1 -- 172.21.15.37:0/2897302131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a04076100 msgr2=0x7f2a041a3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.259+0000 7f2a0bc00640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a04076100 0x7f2a041a3020 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29f000e9f0 tx=0x7f29f000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.259+0000 7f2a0bc00640 1 -- 172.21.15.37:0/2897302131 shutdown_connections 2024-09-21T05:52:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.259+0000 7f2a0bc00640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f29ec0b6620 0x7f29ec0b8b30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.259+0000 7f2a0bc00640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a041100d0 0x7f2a0410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.259+0000 7f2a0bc00640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a04076100 0x7f2a041a3020 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.259+0000 7f2a0bc00640 1 --2- 172.21.15.37:0/2897302131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a040757b0 0x7f2a041a2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.259+0000 7f2a0bc00640 1 -- 172.21.15.37:0/2897302131 >> 172.21.15.37:0/2897302131 conn(0x7f2a040ff5e0 msgr2=0x7f2a04103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.259+0000 7f2a0bc00640 1 -- 172.21.15.37:0/2897302131 shutdown_connections 2024-09-21T05:52:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:42.259+0000 7f2a0bc00640 1 -- 172.21.15.37:0/2897302131 wait complete. 2024-09-21T05:52:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.783+0000 7fa46a400640 1 -- 172.21.15.37:0/3353582757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4641092f0 msgr2=0x7fa464109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.783+0000 7fa46a400640 1 --2- 172.21.15.37:0/3353582757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4641092f0 0x7fa464109700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa450009900 tx=0x7fa45002a410 comp rx=0 tx=0).stop 2024-09-21T05:52:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.783+0000 7fa46a400640 1 -- 172.21.15.37:0/3353582757 shutdown_connections 2024-09-21T05:52:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.783+0000 7fa46a400640 1 --2- 172.21.15.37:0/3353582757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa464109c40 0x7fa464110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.783+0000 7fa46a400640 1 --2- 172.21.15.37:0/3353582757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4641092f0 0x7fa464109700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.783+0000 7fa46a400640 1 --2- 172.21.15.37:0/3353582757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4641039b0 0x7fa464103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.783+0000 7fa46a400640 1 -- 172.21.15.37:0/3353582757 >> 172.21.15.37:0/3353582757 conn(0x7fa4640ff440 msgr2=0x7fa464101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.783+0000 7fa46a400640 1 -- 172.21.15.37:0/3353582757 shutdown_connections 2024-09-21T05:52:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.783+0000 7fa46a400640 1 -- 172.21.15.37:0/3353582757 wait complete. 2024-09-21T05:52:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.784+0000 7fa46a400640 1 Processor -- start 2024-09-21T05:52:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.784+0000 7fa46a400640 1 -- start start 2024-09-21T05:52:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.785+0000 7fa46a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4641039b0 0x7fa46419a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.785+0000 7fa46a400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4641092f0 0x7fa46419a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.785+0000 7fa46a400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109c40 0x7fa46419fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.785+0000 7fa46a400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa464113950 con 0x7fa464109c40 2024-09-21T05:52:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.785+0000 7fa46a400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa4641137d0 con 0x7fa4641092f0 2024-09-21T05:52:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.785+0000 7fa46a400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa464113ad0 con 0x7fa4641039b0 2024-09-21T05:52:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.785+0000 7fa469a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109c40 0x7fa46419fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.785+0000 7fa469a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109c40 0x7fa46419fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33056/0 (socket says 172.21.15.37:33056) 2024-09-21T05:52:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.785+0000 7fa469a00640 1 -- 172.21.15.37:0/2741505532 learned_addr learned my addr 172.21.15.37:0/2741505532 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.785+0000 7fa469000640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4641039b0 0x7fa46419a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.785+0000 7fa463e00640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4641092f0 0x7fa46419a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.786+0000 7fa469000640 1 -- 172.21.15.37:0/2741505532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4641092f0 msgr2=0x7fa46419a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.786+0000 7fa469000640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4641092f0 0x7fa46419a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.786+0000 7fa469000640 1 -- 172.21.15.37:0/2741505532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109c40 msgr2=0x7fa46419fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.786+0000 7fa469000640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109c40 0x7fa46419fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.786+0000 7fa469000640 1 -- 172.21.15.37:0/2741505532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4641a0230 con 0x7fa4641039b0 2024-09-21T05:52:43.789 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:43 smithi037 ceph-mon[30631]: pgmap v376: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.786+0000 7fa469a00640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109c40 0x7fa46419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.786+0000 7fa469000640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4641039b0 0x7fa46419a2c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa45800e9f0 tx=0x7fa45800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.786+0000 7fa461600640 1 -- 172.21.15.37:0/2741505532 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45800cd80 con 0x7fa4641039b0 2024-09-21T05:52:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.786+0000 7fa461600640 1 -- 172.21.15.37:0/2741505532 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4580035f0 con 0x7fa4641039b0 2024-09-21T05:52:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.786+0000 7fa461600640 1 -- 172.21.15.37:0/2741505532 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458010670 con 0x7fa4641039b0 2024-09-21T05:52:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.787+0000 7fa46a400640 1 -- 172.21.15.37:0/2741505532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4641a0520 con 0x7fa4641039b0 2024-09-21T05:52:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.787+0000 7fa46a400640 1 -- 172.21.15.37:0/2741505532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4640755f0 con 0x7fa4641039b0 2024-09-21T05:52:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.788+0000 7fa46a400640 1 -- 172.21.15.37:0/2741505532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa464104c30 con 0x7fa4641039b0 2024-09-21T05:52:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.790+0000 7fa461600640 1 -- 172.21.15.37:0/2741505532 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fa4580037a0 con 0x7fa4641039b0 2024-09-21T05:52:43.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.792+0000 7fa461600640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa44c0b6620 0x7fa44c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:43.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.792+0000 7fa461600640 1 -- 172.21.15.37:0/2741505532 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fa4580e7a50 con 0x7fa4641039b0 2024-09-21T05:52:43.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.792+0000 7fa463e00640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa44c0b6620 0x7fa44c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.793+0000 7fa463e00640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa44c0b6620 0x7fa44c0b8b30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa45002aa00 tx=0x7fa45003c040 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:43.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:43.796+0000 7fa461600640 1 -- 172.21.15.37:0/2741505532 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4580addc0 con 0x7fa4641039b0 2024-09-21T05:52:43.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:43 smithi067 ceph-mon[34443]: pgmap v376: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:44.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.002+0000 7fa46a400640 1 -- 172.21.15.37:0/2741505532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fa464103dc0 con 0x7fa4641039b0 2024-09-21T05:52:44.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.003+0000 7fa461600640 1 -- 172.21.15.37:0/2741505532 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa4580b21a0 con 0x7fa4641039b0 2024-09-21T05:52:44.005 INFO:teuthology.orchestra.run.smithi037.stdout:231928234037 2024-09-21T05:52:44.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.005+0000 7fa46a400640 1 -- 172.21.15.37:0/2741505532 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa44c0b6620 msgr2=0x7fa44c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.005+0000 7fa46a400640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa44c0b6620 0x7fa44c0b8b30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa45002aa00 tx=0x7fa45003c040 comp rx=0 tx=0).stop 2024-09-21T05:52:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.005+0000 7fa46a400640 1 -- 172.21.15.37:0/2741505532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4641039b0 msgr2=0x7fa46419a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.005+0000 7fa46a400640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4641039b0 0x7fa46419a2c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa45800e9f0 tx=0x7fa45800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:52:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.005+0000 7fa46a400640 1 -- 172.21.15.37:0/2741505532 shutdown_connections 2024-09-21T05:52:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.005+0000 7fa46a400640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109c40 0x7fa46419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.005+0000 7fa46a400640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa44c0b6620 0x7fa44c0b8b30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.005+0000 7fa46a400640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4641092f0 0x7fa46419a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.005+0000 7fa46a400640 1 --2- 172.21.15.37:0/2741505532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4641039b0 0x7fa46419a2c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.005+0000 7fa46a400640 1 -- 172.21.15.37:0/2741505532 >> 172.21.15.37:0/2741505532 conn(0x7fa4640ff440 msgr2=0x7fa464101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.005+0000 7fa46a400640 1 -- 172.21.15.37:0/2741505532 shutdown_connections 2024-09-21T05:52:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.005+0000 7fa46a400640 1 -- 172.21.15.37:0/2741505532 wait complete. 2024-09-21T05:52:44.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:43 smithi144 ceph-mon[34351]: pgmap v376: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:44.888 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:44 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1978979200' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T05:52:44.888 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:44 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2741505532' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T05:52:44.931 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215180 got 103079215182 for osd.3 2024-09-21T05:52:44.932 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:44.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:44 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1978979200' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T05:52:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:44 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2741505532' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T05:52:45.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:44 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1978979200' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T05:52:45.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:44 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2741505532' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T05:52:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.718+0000 7fdebf200640 1 -- 172.21.15.37:0/2218773708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdec0109c40 msgr2=0x7fdec0110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.718+0000 7fdebf200640 1 --2- 172.21.15.37:0/2218773708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdec0109c40 0x7fdec0110470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009ca0 tx=0x7fdeb802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.718+0000 7fdebf200640 1 -- 172.21.15.37:0/2218773708 shutdown_connections 2024-09-21T05:52:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.718+0000 7fdebf200640 1 --2- 172.21.15.37:0/2218773708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdec0109c40 0x7fdec0110470 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.718+0000 7fdebf200640 1 --2- 172.21.15.37:0/2218773708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec01092f0 0x7fdec0109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.718+0000 7fdebf200640 1 --2- 172.21.15.37:0/2218773708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdec01039b0 0x7fdec0103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.718+0000 7fdebf200640 1 -- 172.21.15.37:0/2218773708 >> 172.21.15.37:0/2218773708 conn(0x7fdec00ff440 msgr2=0x7fdec0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.718+0000 7fdebf200640 1 -- 172.21.15.37:0/2218773708 shutdown_connections 2024-09-21T05:52:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.718+0000 7fdebf200640 1 -- 172.21.15.37:0/2218773708 wait complete. 2024-09-21T05:52:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.719+0000 7fdebf200640 1 Processor -- start 2024-09-21T05:52:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.719+0000 7fdebf200640 1 -- start start 2024-09-21T05:52:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.720+0000 7fdebf200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdec01039b0 0x7fdec019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.720+0000 7fdebf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec01092f0 0x7fdec019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.720+0000 7fdebf200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdec0109c40 0x7fdec019fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.720+0000 7fdebf200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdec0113900 con 0x7fdec0109c40 2024-09-21T05:52:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.720+0000 7fdebf200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdec0113780 con 0x7fdec01039b0 2024-09-21T05:52:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.720+0000 7fdebf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdec0113a80 con 0x7fdec01092f0 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.720+0000 7fdebde00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdec01039b0 0x7fdec019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.720+0000 7fdebe800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdec0109c40 0x7fdec019fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.720+0000 7fdebde00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdec01039b0 0x7fdec019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:39388/0 (socket says 172.21.15.37:39388) 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.720+0000 7fdebde00640 1 -- 172.21.15.37:0/2099329854 learned_addr learned my addr 172.21.15.37:0/2099329854 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.720+0000 7fdeb5400640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec01092f0 0x7fdec019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.721+0000 7fdebde00640 1 -- 172.21.15.37:0/2099329854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec01092f0 msgr2=0x7fdec019a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.721+0000 7fdebde00640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec01092f0 0x7fdec019a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.721+0000 7fdebde00640 1 -- 172.21.15.37:0/2099329854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdec0109c40 msgr2=0x7fdec019fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.721+0000 7fdebde00640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdec0109c40 0x7fdec019fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.721+0000 7fdebde00640 1 -- 172.21.15.37:0/2099329854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec01a01c0 con 0x7fdec01039b0 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.721+0000 7fdebe800640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdec0109c40 0x7fdec019fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.721+0000 7fdebde00640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdec01039b0 0x7fdec019a250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000e9f0 tx=0x7fdeb000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.721+0000 7fdeb7400640 1 -- 172.21.15.37:0/2099329854 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb000cd80 con 0x7fdec01039b0 2024-09-21T05:52:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.721+0000 7fdebf200640 1 -- 172.21.15.37:0/2099329854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec01a04b0 con 0x7fdec01039b0 2024-09-21T05:52:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.721+0000 7fdeb7400640 1 -- 172.21.15.37:0/2099329854 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeb00108e0 con 0x7fdec01039b0 2024-09-21T05:52:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.721+0000 7fdeb7400640 1 -- 172.21.15.37:0/2099329854 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0018980 con 0x7fdec01039b0 2024-09-21T05:52:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.721+0000 7fdebf200640 1 -- 172.21.15.37:0/2099329854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec01a6c10 con 0x7fdec01039b0 2024-09-21T05:52:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.722+0000 7fdebf200640 1 -- 172.21.15.37:0/2099329854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec0103dc0 con 0x7fdec01039b0 2024-09-21T05:52:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.725+0000 7fdeb7400640 1 -- 172.21.15.37:0/2099329854 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fdeb0010430 con 0x7fdec01039b0 2024-09-21T05:52:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.726+0000 7fdeb7400640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdea40b65a0 0x7fdea40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.726+0000 7fdeb7400640 1 -- 172.21.15.37:0/2099329854 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fdeb00e7fe0 con 0x7fdec01039b0 2024-09-21T05:52:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.726+0000 7fdeb5400640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdea40b65a0 0x7fdea40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.727+0000 7fdeb5400640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdea40b65a0 0x7fdea40b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdec0108de0 tx=0x7fdea800b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:45.574 INFO:teuthology.orchestra.run.smithi037.stdout:180388626495 2024-09-21T05:52:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.728+0000 7fdeb7400640 1 -- 172.21.15.37:0/2099329854 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdeb00b2790 con 0x7fdec01039b0 2024-09-21T05:52:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.936+0000 7fdebf200640 1 -- 172.21.15.37:0/2099329854 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fdec010ba90 con 0x7fdec01039b0 2024-09-21T05:52:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.937+0000 7fdeb7400640 1 -- 172.21.15.37:0/2099329854 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdeb00b76d0 con 0x7fdec01039b0 2024-09-21T05:52:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.939+0000 7fdebf200640 1 -- 172.21.15.37:0/2099329854 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdea40b65a0 msgr2=0x7fdea40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.939+0000 7fdebf200640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdea40b65a0 0x7fdea40b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdec0108de0 tx=0x7fdea800b410 comp rx=0 tx=0).stop 2024-09-21T05:52:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.939+0000 7fdebf200640 1 -- 172.21.15.37:0/2099329854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdec01039b0 msgr2=0x7fdec019a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.939+0000 7fdebf200640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdec01039b0 0x7fdec019a250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000e9f0 tx=0x7fdeb000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.939+0000 7fdebf200640 1 -- 172.21.15.37:0/2099329854 shutdown_connections 2024-09-21T05:52:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.939+0000 7fdebf200640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdec0109c40 0x7fdec019fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.940+0000 7fdebf200640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec01092f0 0x7fdec019a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.940+0000 7fdebf200640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdea40b65a0 0x7fdea40b8ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.940+0000 7fdebf200640 1 --2- 172.21.15.37:0/2099329854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdec01039b0 0x7fdec019a250 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:45.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.940+0000 7fdebf200640 1 -- 172.21.15.37:0/2099329854 >> 172.21.15.37:0/2099329854 conn(0x7fdec00ff440 msgr2=0x7fdec0101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:45.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.940+0000 7fdebf200640 1 -- 172.21.15.37:0/2099329854 shutdown_connections 2024-09-21T05:52:45.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:44.940+0000 7fdebf200640 1 -- 172.21.15.37:0/2099329854 wait complete. 2024-09-21T05:52:45.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:45 smithi037 ceph-mon[30631]: pgmap v377: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T05:52:45.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:45 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2099329854' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T05:52:45.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:45 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/88232521' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T05:52:45.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:45 smithi067 ceph-mon[34443]: pgmap v377: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T05:52:45.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:45 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2099329854' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T05:52:45.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:45 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/88232521' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T05:52:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:45 smithi144 ceph-mon[34351]: pgmap v377: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T05:52:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:45 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2099329854' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T05:52:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:45 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/88232521' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T05:52:46.471 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574936 got 55834574938 for osd.1 2024-09-21T05:52:46.471 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:46.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.187+0000 7fe2dee00640 1 -- 172.21.15.37:0/1923318862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d8103b60 msgr2=0x7fe2d8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.187+0000 7fe2dee00640 1 --2- 172.21.15.37:0/1923318862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d8103b60 0x7fe2d8103f70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009900 tx=0x7fe2c802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.187+0000 7fe2dee00640 1 -- 172.21.15.37:0/1923318862 shutdown_connections 2024-09-21T05:52:46.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.187+0000 7fe2dee00640 1 --2- 172.21.15.37:0/1923318862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d8109df0 0x7fe2d8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.187+0000 7fe2dee00640 1 --2- 172.21.15.37:0/1923318862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d81094a0 0x7fe2d81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.187+0000 7fe2dee00640 1 --2- 172.21.15.37:0/1923318862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d8103b60 0x7fe2d8103f70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.187+0000 7fe2dee00640 1 -- 172.21.15.37:0/1923318862 >> 172.21.15.37:0/1923318862 conn(0x7fe2d807b850 msgr2=0x7fe2d807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.187+0000 7fe2dee00640 1 -- 172.21.15.37:0/1923318862 shutdown_connections 2024-09-21T05:52:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.187+0000 7fe2dee00640 1 -- 172.21.15.37:0/1923318862 wait complete. 2024-09-21T05:52:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.189+0000 7fe2dee00640 1 Processor -- start 2024-09-21T05:52:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.189+0000 7fe2dee00640 1 -- start start 2024-09-21T05:52:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.189+0000 7fe2dee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d8103b60 0x7fe2d819c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.189+0000 7fe2dee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d81094a0 0x7fe2d819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.189+0000 7fe2dee00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d8109df0 0x7fe2d81a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.189+0000 7fe2dee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d8113b00 con 0x7fe2d8103b60 2024-09-21T05:52:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.189+0000 7fe2dee00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d8113980 con 0x7fe2d8109df0 2024-09-21T05:52:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.189+0000 7fe2dee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d8113c80 con 0x7fe2d81094a0 2024-09-21T05:52:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.190+0000 7fe2d7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d8103b60 0x7fe2d819c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.190+0000 7fe2d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d81094a0 0x7fe2d819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.190+0000 7fe2d7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d8103b60 0x7fe2d819c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33078/0 (socket says 172.21.15.37:33078) 2024-09-21T05:52:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.190+0000 7fe2d7e00640 1 -- 172.21.15.37:0/88232521 learned_addr learned my addr 172.21.15.37:0/88232521 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.190+0000 7fe2dce00640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d8109df0 0x7fe2d81a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.190+0000 7fe2d7e00640 1 -- 172.21.15.37:0/88232521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d81094a0 msgr2=0x7fe2d819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.190+0000 7fe2d7e00640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d81094a0 0x7fe2d819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.190+0000 7fe2d7e00640 1 -- 172.21.15.37:0/88232521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d8109df0 msgr2=0x7fe2d81a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.190+0000 7fe2d7e00640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d8109df0 0x7fe2d81a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.190+0000 7fe2d7e00640 1 -- 172.21.15.37:0/88232521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d81a2680 con 0x7fe2d8103b60 2024-09-21T05:52:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.190+0000 7fe2d7400640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d81094a0 0x7fe2d819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.191+0000 7fe2d7e00640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d8103b60 0x7fe2d819c710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8005ab0 tx=0x7fe2c8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.191+0000 7fe2d4c00640 1 -- 172.21.15.37:0/88232521 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c803f070 con 0x7fe2d8103b60 2024-09-21T05:52:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.191+0000 7fe2d4c00640 1 -- 172.21.15.37:0/88232521 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2c8031b60 con 0x7fe2d8103b60 2024-09-21T05:52:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.191+0000 7fe2dee00640 1 -- 172.21.15.37:0/88232521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d81a2910 con 0x7fe2d8103b60 2024-09-21T05:52:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.191+0000 7fe2d4c00640 1 -- 172.21.15.37:0/88232521 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8035030 con 0x7fe2d8103b60 2024-09-21T05:52:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.191+0000 7fe2dee00640 1 -- 172.21.15.37:0/88232521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d81a90d0 con 0x7fe2d8103b60 2024-09-21T05:52:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.192+0000 7fe2dee00640 1 -- 172.21.15.37:0/88232521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d8103f70 con 0x7fe2d8103b60 2024-09-21T05:52:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.196+0000 7fe2d4c00640 1 -- 172.21.15.37:0/88232521 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fe2c8042070 con 0x7fe2d8103b60 2024-09-21T05:52:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.198+0000 7fe2d4c00640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe2bc0b6620 0x7fe2bc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.198+0000 7fe2d4c00640 1 -- 172.21.15.37:0/88232521 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fe2c8108180 con 0x7fe2d8103b60 2024-09-21T05:52:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.198+0000 7fe2d7400640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe2bc0b6620 0x7fe2bc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.199+0000 7fe2d7400640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe2bc0b6620 0x7fe2bc0b8b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8108ef0 tx=0x7fe2c4005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.200+0000 7fe2d4c00640 1 -- 172.21.15.37:0/88232521 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2c80d28d0 con 0x7fe2d8103b60 2024-09-21T05:52:46.539 INFO:teuthology.orchestra.run.smithi037.stdout:154618822726 2024-09-21T05:52:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.400+0000 7fe2dee00640 1 -- 172.21.15.37:0/88232521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe2d81a9370 con 0x7fe2d8103b60 2024-09-21T05:52:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.400+0000 7fe2d4c00640 1 -- 172.21.15.37:0/88232521 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe2c80d7810 con 0x7fe2d8103b60 2024-09-21T05:52:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.403+0000 7fe2dee00640 1 -- 172.21.15.37:0/88232521 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe2bc0b6620 msgr2=0x7fe2bc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.403+0000 7fe2dee00640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe2bc0b6620 0x7fe2bc0b8b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8108ef0 tx=0x7fe2c4005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.403+0000 7fe2dee00640 1 -- 172.21.15.37:0/88232521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d8103b60 msgr2=0x7fe2d819c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.403+0000 7fe2dee00640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d8103b60 0x7fe2d819c710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8005ab0 tx=0x7fe2c8003c10 comp rx=0 tx=0).stop 2024-09-21T05:52:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.403+0000 7fe2dee00640 1 -- 172.21.15.37:0/88232521 shutdown_connections 2024-09-21T05:52:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.403+0000 7fe2dee00640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe2bc0b6620 0x7fe2bc0b8b30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.403+0000 7fe2dee00640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d8109df0 0x7fe2d81a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.403+0000 7fe2dee00640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d81094a0 0x7fe2d819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.403+0000 7fe2dee00640 1 --2- 172.21.15.37:0/88232521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d8103b60 0x7fe2d819c710 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.403+0000 7fe2dee00640 1 -- 172.21.15.37:0/88232521 >> 172.21.15.37:0/88232521 conn(0x7fe2d807b850 msgr2=0x7fe2d8107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.403+0000 7fe2dee00640 1 -- 172.21.15.37:0/88232521 shutdown_connections 2024-09-21T05:52:46.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:45.403+0000 7fe2dee00640 1 -- 172.21.15.37:0/88232521 wait complete. 2024-09-21T05:52:46.866 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-09-21T05:52:46.867 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T05:52:46.867 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]} : dispatch 2024-09-21T05:52:46.867 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:46 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 10]} : dispatch 2024-09-21T05:52:46.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-09-21T05:52:46.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T05:52:46.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]} : dispatch 2024-09-21T05:52:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:46 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 10]} : dispatch 2024-09-21T05:52:47.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-09-21T05:52:47.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T05:52:47.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]} : dispatch 2024-09-21T05:52:47.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:46 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 10]} : dispatch 2024-09-21T05:52:47.238 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626492 got 180388626495 for osd.6 2024-09-21T05:52:47.238 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:47.731 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:47 smithi037 ceph-mon[30631]: pgmap v378: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:47.731 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-21T05:52:47.731 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T05:52:47.732 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-09-21T05:52:47.732 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:47 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 10]}]': finished 2024-09-21T05:52:47.732 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:47 smithi037 ceph-mon[30631]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T05:52:47.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:47 smithi067 ceph-mon[34443]: pgmap v378: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:47.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-21T05:52:47.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T05:52:47.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-09-21T05:52:47.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:47 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 10]}]': finished 2024-09-21T05:52:47.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:47 smithi067 ceph-mon[34443]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T05:52:48.035 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822722 got 154618822726 for osd.5 2024-09-21T05:52:48.035 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:47 smithi144 ceph-mon[34351]: pgmap v378: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-21T05:52:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T05:52:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-09-21T05:52:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:47 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 10]}]': finished 2024-09-21T05:52:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:47 smithi144 ceph-mon[34351]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T05:52:48.523 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:48.555 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234033 got 231928234037 for osd.8 2024-09-21T05:52:48.555 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:48.866 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:48 smithi037 ceph-mon[30631]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T05:52:48.905 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874277 got 279172874281 for osd.10 2024-09-21T05:52:48.905 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:48.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:48 smithi067 ceph-mon[34443]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T05:52:49.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:48 smithi144 ceph-mon[34351]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T05:52:49.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.649+0000 7f5979e00640 1 -- 172.21.15.37:0/90313593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5974103b80 msgr2=0x7f5974103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:49.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.649+0000 7f5979e00640 1 --2- 172.21.15.37:0/90313593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5974103b80 0x7f5974103f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5964009860 tx=0x7f596402a340 comp rx=0 tx=0).stop 2024-09-21T05:52:49.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.649+0000 7f5979e00640 1 -- 172.21.15.37:0/90313593 shutdown_connections 2024-09-21T05:52:49.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.649+0000 7f5979e00640 1 --2- 172.21.15.37:0/90313593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974109e10 0x7f5974110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.649+0000 7f5979e00640 1 --2- 172.21.15.37:0/90313593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59741094c0 0x7f59741098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.649+0000 7f5979e00640 1 --2- 172.21.15.37:0/90313593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5974103b80 0x7f5974103f90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.649+0000 7f5979e00640 1 -- 172.21.15.37:0/90313593 >> 172.21.15.37:0/90313593 conn(0x7f59740ff590 msgr2=0x7f59741019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:49.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.649+0000 7f5979e00640 1 -- 172.21.15.37:0/90313593 shutdown_connections 2024-09-21T05:52:49.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.650+0000 7f5979e00640 1 -- 172.21.15.37:0/90313593 wait complete. 2024-09-21T05:52:49.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.651+0000 7f5979e00640 1 Processor -- start 2024-09-21T05:52:49.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.651+0000 7f5979e00640 1 -- start start 2024-09-21T05:52:49.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.651+0000 7f5979e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5974103b80 0x7f5974075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:49.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.651+0000 7f5979e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59741094c0 0x7f5974075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.651+0000 7f5979e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974109e10 0x7f5974076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.651+0000 7f5979e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5974113ad0 con 0x7f5974109e10 2024-09-21T05:52:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.651+0000 7f5979e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5974113950 con 0x7f59741094c0 2024-09-21T05:52:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.651+0000 7f5979e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5974113c50 con 0x7f5974103b80 2024-09-21T05:52:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.652+0000 7f5972a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5974103b80 0x7f5974075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.652+0000 7f5973400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974109e10 0x7f5974076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.652+0000 7f5972000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59741094c0 0x7f5974075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.652+0000 7f5972a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5974103b80 0x7f5974075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:39112/0 (socket says 172.21.15.37:39112) 2024-09-21T05:52:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.652+0000 7f5972a00640 1 -- 172.21.15.37:0/3778131317 learned_addr learned my addr 172.21.15.37:0/3778131317 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.652+0000 7f5972a00640 1 -- 172.21.15.37:0/3778131317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59741094c0 msgr2=0x7f5974075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.652+0000 7f5972a00640 1 --2- 172.21.15.37:0/3778131317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59741094c0 0x7f5974075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.652+0000 7f5972a00640 1 -- 172.21.15.37:0/3778131317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974109e10 msgr2=0x7f5974076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.652+0000 7f5972a00640 1 --2- 172.21.15.37:0/3778131317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974109e10 0x7f5974076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.652+0000 7f5972a00640 1 -- 172.21.15.37:0/3778131317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59741a87c0 con 0x7f5974103b80 2024-09-21T05:52:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.652+0000 7f5973400640 1 --2- 172.21.15.37:0/3778131317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974109e10 0x7f5974076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.653+0000 7f5972a00640 1 --2- 172.21.15.37:0/3778131317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5974103b80 0x7f5974075710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f59640303f0 tx=0x7f5964032da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.653+0000 7f5978a00640 1 -- 172.21.15.37:0/3778131317 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964040020 con 0x7f5974103b80 2024-09-21T05:52:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.653+0000 7f5978a00640 1 -- 172.21.15.37:0/3778131317 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5964030dd0 con 0x7f5974103b80 2024-09-21T05:52:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.653+0000 7f5978a00640 1 -- 172.21.15.37:0/3778131317 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964037040 con 0x7f5974103b80 2024-09-21T05:52:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.653+0000 7f5979e00640 1 -- 172.21.15.37:0/3778131317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59741a8a50 con 0x7f5974103b80 2024-09-21T05:52:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.653+0000 7f5979e00640 1 -- 172.21.15.37:0/3778131317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59741a8ee0 con 0x7f5974103b80 2024-09-21T05:52:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.655+0000 7f5979e00640 1 -- 172.21.15.37:0/3778131317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5974103f90 con 0x7f5974103b80 2024-09-21T05:52:49.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.659+0000 7f5978a00640 1 -- 172.21.15.37:0/3778131317 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f5964043020 con 0x7f5974103b80 2024-09-21T05:52:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.660+0000 7f5978a00640 1 --2- 172.21.15.37:0/3778131317 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f59580b65a0 0x7f59580b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.661+0000 7f5978a00640 1 -- 172.21.15.37:0/3778131317 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f5964107bb0 con 0x7f5974103b80 2024-09-21T05:52:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.661+0000 7f5972000640 1 --2- 172.21.15.37:0/3778131317 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f59580b65a0 0x7f59580b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.661+0000 7f5978a00640 1 -- 172.21.15.37:0/3778131317 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f596404a020 con 0x7f5974103b80 2024-09-21T05:52:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.661+0000 7f5972000640 1 --2- 172.21.15.37:0/3778131317 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f59580b65a0 0x7f59580b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5974101d90 tx=0x7f5960005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:49.770 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:49 smithi037 ceph-mon[30631]: pgmap v381: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:49.770 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:49 smithi037 ceph-mon[30631]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T05:52:49.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.885+0000 7f5979e00640 1 -- 172.21.15.37:0/3778131317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f597402e640 con 0x7f5974103b80 2024-09-21T05:52:49.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.886+0000 7f5978a00640 1 -- 172.21.15.37:0/3778131317 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f59640cdf30 con 0x7f5974103b80 2024-09-21T05:52:49.888 INFO:teuthology.orchestra.run.smithi037.stdout:257698037809 2024-09-21T05:52:49.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.889+0000 7f5979e00640 1 -- 172.21.15.37:0/3778131317 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f59580b65a0 msgr2=0x7f59580b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:49.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.889+0000 7f5979e00640 1 --2- 172.21.15.37:0/3778131317 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f59580b65a0 0x7f59580b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5974101d90 tx=0x7f5960005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:49.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.889+0000 7f5979e00640 1 -- 172.21.15.37:0/3778131317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5974103b80 msgr2=0x7f5974075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:49.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.889+0000 7f5979e00640 1 --2- 172.21.15.37:0/3778131317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5974103b80 0x7f5974075710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f59640303f0 tx=0x7f5964032da0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.889+0000 7f5979e00640 1 -- 172.21.15.37:0/3778131317 shutdown_connections 2024-09-21T05:52:49.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.889+0000 7f5979e00640 1 --2- 172.21.15.37:0/3778131317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974109e10 0x7f5974076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.889+0000 7f5979e00640 1 --2- 172.21.15.37:0/3778131317 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f59580b65a0 0x7f59580b8ab0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.889+0000 7f5979e00640 1 --2- 172.21.15.37:0/3778131317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59741094c0 0x7f5974075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.889+0000 7f5979e00640 1 --2- 172.21.15.37:0/3778131317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5974103b80 0x7f5974075710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:49.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.889+0000 7f5979e00640 1 -- 172.21.15.37:0/3778131317 >> 172.21.15.37:0/3778131317 conn(0x7f59740ff590 msgr2=0x7f59741029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:49.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.889+0000 7f5979e00640 1 -- 172.21.15.37:0/3778131317 shutdown_connections 2024-09-21T05:52:49.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.889+0000 7f5979e00640 1 -- 172.21.15.37:0/3778131317 wait complete. 2024-09-21T05:52:49.993 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018950 got 128849018954 for osd.4 2024-09-21T05:52:49.994 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:49 smithi067 ceph-mon[34443]: pgmap v381: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:49 smithi067 ceph-mon[34443]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T05:52:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:49 smithi144 ceph-mon[34351]: pgmap v381: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:49 smithi144 ceph-mon[34351]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T05:52:50.655 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037806 got 257698037809 for osd.9 2024-09-21T05:52:50.656 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.541+0000 7f6551400640 1 -- 172.21.15.37:0/4259436557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c1094c0 msgr2=0x7f654c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.541+0000 7f6551400640 1 --2- 172.21.15.37:0/4259436557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c1094c0 0x7f654c1098d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6538009900 tx=0x7f653802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:52:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.541+0000 7f6551400640 1 -- 172.21.15.37:0/4259436557 shutdown_connections 2024-09-21T05:52:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.541+0000 7f6551400640 1 --2- 172.21.15.37:0/4259436557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c109e10 0x7f654c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.541+0000 7f6551400640 1 --2- 172.21.15.37:0/4259436557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c1094c0 0x7f654c1098d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.541+0000 7f6551400640 1 --2- 172.21.15.37:0/4259436557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f654c103b80 0x7f654c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.541+0000 7f6551400640 1 -- 172.21.15.37:0/4259436557 >> 172.21.15.37:0/4259436557 conn(0x7f654c0ff590 msgr2=0x7f654c1019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.541+0000 7f6551400640 1 -- 172.21.15.37:0/4259436557 shutdown_connections 2024-09-21T05:52:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.541+0000 7f6551400640 1 -- 172.21.15.37:0/4259436557 wait complete. 2024-09-21T05:52:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.542+0000 7f6551400640 1 Processor -- start 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.543+0000 7f6551400640 1 -- start start 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.543+0000 7f6551400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c103b80 0x7f654c19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.543+0000 7f6551400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c1094c0 0x7f654c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.543+0000 7f6551400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f654c109e10 0x7f654c1a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.543+0000 7f6551400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f654c113ad0 con 0x7f654c1094c0 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.543+0000 7f6551400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f654c113950 con 0x7f654c103b80 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.543+0000 7f6551400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f654c113c50 con 0x7f654c109e10 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.543+0000 7f6549e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c1094c0 0x7f654c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.543+0000 7f6549e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c1094c0 0x7f654c19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33094/0 (socket says 172.21.15.37:33094) 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.543+0000 7f6549e00640 1 -- 172.21.15.37:0/888592440 learned_addr learned my addr 172.21.15.37:0/888592440 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.543+0000 7f654a800640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c103b80 0x7f654c19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.544+0000 7f654b200640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f654c109e10 0x7f654c1a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.544+0000 7f6549e00640 1 -- 172.21.15.37:0/888592440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f654c109e10 msgr2=0x7f654c1a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.544+0000 7f6549e00640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f654c109e10 0x7f654c1a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.544+0000 7f6549e00640 1 -- 172.21.15.37:0/888592440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c103b80 msgr2=0x7f654c19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.544+0000 7f6549e00640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c103b80 0x7f654c19c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.544+0000 7f6549e00640 1 -- 172.21.15.37:0/888592440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654c1a2610 con 0x7f654c1094c0 2024-09-21T05:52:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.544+0000 7f6549e00640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c1094c0 0x7f654c19cc40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f653802a910 tx=0x7f6538031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.545+0000 7f6543400640 1 -- 172.21.15.37:0/888592440 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653803f030 con 0x7f654c1094c0 2024-09-21T05:52:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.545+0000 7f6551400640 1 -- 172.21.15.37:0/888592440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f654c1a28a0 con 0x7f654c1094c0 2024-09-21T05:52:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.545+0000 7f6543400640 1 -- 172.21.15.37:0/888592440 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6538004490 con 0x7f654c1094c0 2024-09-21T05:52:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.545+0000 7f6551400640 1 -- 172.21.15.37:0/888592440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f654c1a9060 con 0x7f654c1094c0 2024-09-21T05:52:50.822 INFO:teuthology.orchestra.run.smithi037.stdout:304942678053 2024-09-21T05:52:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.545+0000 7f6543400640 1 -- 172.21.15.37:0/888592440 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538049060 con 0x7f654c1094c0 2024-09-21T05:52:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.547+0000 7f6551400640 1 -- 172.21.15.37:0/888592440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f654c103f90 con 0x7f654c1094c0 2024-09-21T05:52:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.548+0000 7f6543400640 1 -- 172.21.15.37:0/888592440 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f6538042030 con 0x7f654c1094c0 2024-09-21T05:52:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.550+0000 7f6543400640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f65300b65a0 0x7f65300b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.550+0000 7f6543400640 1 -- 172.21.15.37:0/888592440 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f6538107f40 con 0x7f654c1094c0 2024-09-21T05:52:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.550+0000 7f654a800640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f65300b65a0 0x7f65300b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.551+0000 7f654a800640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f65300b65a0 0x7f65300b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f653c009bd0 tx=0x7f653c005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.559+0000 7f6543400640 1 -- 172.21.15.37:0/888592440 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f65380d2620 con 0x7f654c1094c0 2024-09-21T05:52:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.768+0000 7f6551400640 1 -- 172.21.15.37:0/888592440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f654c110010 con 0x7f654c1094c0 2024-09-21T05:52:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.769+0000 7f6543400640 1 -- 172.21.15.37:0/888592440 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f65380d7560 con 0x7f654c1094c0 2024-09-21T05:52:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.771+0000 7f6551400640 1 -- 172.21.15.37:0/888592440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f65300b65a0 msgr2=0x7f65300b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.771+0000 7f6551400640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f65300b65a0 0x7f65300b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f653c009bd0 tx=0x7f653c005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.771+0000 7f6551400640 1 -- 172.21.15.37:0/888592440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c1094c0 msgr2=0x7f654c19cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.771+0000 7f6551400640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c1094c0 0x7f654c19cc40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f653802a910 tx=0x7f6538031a20 comp rx=0 tx=0).stop 2024-09-21T05:52:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.771+0000 7f6551400640 1 -- 172.21.15.37:0/888592440 shutdown_connections 2024-09-21T05:52:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.771+0000 7f6551400640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f654c109e10 0x7f654c1a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.771+0000 7f6551400640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654c1094c0 0x7f654c19cc40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.771+0000 7f6551400640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f65300b65a0 0x7f65300b8ab0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.771+0000 7f6551400640 1 --2- 172.21.15.37:0/888592440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c103b80 0x7f654c19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.771+0000 7f6551400640 1 -- 172.21.15.37:0/888592440 >> 172.21.15.37:0/888592440 conn(0x7f654c0ff590 msgr2=0x7f654c102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.772+0000 7f6551400640 1 -- 172.21.15.37:0/888592440 shutdown_connections 2024-09-21T05:52:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:49.772+0000 7f6551400640 1 -- 172.21.15.37:0/888592440 wait complete. 2024-09-21T05:52:50.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:50 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/888592440' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T05:52:50.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:50 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3778131317' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T05:52:50.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:50 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/888592440' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T05:52:50.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:50 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3778131317' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T05:52:51.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:50 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/888592440' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T05:52:51.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:50 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3778131317' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T05:52:51.561 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678049 got 304942678053 for osd.11 2024-09-21T05:52:51.561 DEBUG:teuthology.parallel:result is None 2024-09-21T05:52:51.561 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T05:52:51.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:52:51.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:51 smithi037 ceph-mon[30631]: pgmap v382: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-21T05:52:51.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:52:51.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:51.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:51 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:51.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:51 smithi067 ceph-mon[34443]: pgmap v382: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-21T05:52:51.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:52:51.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:51.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:51 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:52.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:51 smithi144 ceph-mon[34351]: pgmap v382: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-21T05:52:52.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:52:52.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:52.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:51 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:52.590 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:53.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.252+0000 7f0295400640 1 -- 172.21.15.37:0/2378555402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02901049d0 msgr2=0x7f0290104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:53.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.252+0000 7f0295400640 1 --2- 172.21.15.37:0/2378555402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02901049d0 0x7f0290104de0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0280009900 tx=0x7f028002a410 comp rx=0 tx=0).stop 2024-09-21T05:52:53.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.252+0000 7f0295400640 1 -- 172.21.15.37:0/2378555402 shutdown_connections 2024-09-21T05:52:53.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.252+0000 7f0295400640 1 --2- 172.21.15.37:0/2378555402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f029010de30 0x7f0290110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:53.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.252+0000 7f0295400640 1 --2- 172.21.15.37:0/2378555402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0290105320 0x7f029010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.252+0000 7f0295400640 1 --2- 172.21.15.37:0/2378555402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02901049d0 0x7f0290104de0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.252+0000 7f0295400640 1 -- 172.21.15.37:0/2378555402 >> 172.21.15.37:0/2378555402 conn(0x7f0290079740 msgr2=0x7f0290079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.252+0000 7f0295400640 1 -- 172.21.15.37:0/2378555402 shutdown_connections 2024-09-21T05:52:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.252+0000 7f0295400640 1 -- 172.21.15.37:0/2378555402 wait complete. 2024-09-21T05:52:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.254+0000 7f0295400640 1 Processor -- start 2024-09-21T05:52:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.254+0000 7f0295400640 1 -- start start 2024-09-21T05:52:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.254+0000 7f0295400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02901049d0 0x7f029019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.254+0000 7f0295400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0290105320 0x7f029019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.254+0000 7f0295400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f029010de30 0x7f029019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.254+0000 7f0295400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0290113ae0 con 0x7f02901049d0 2024-09-21T05:52:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.254+0000 7f0295400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0290113960 con 0x7f029010de30 2024-09-21T05:52:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.254+0000 7f0295400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0290113c60 con 0x7f0290105320 2024-09-21T05:52:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.255+0000 7f028e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02901049d0 0x7f029019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.255+0000 7f028f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f029010de30 0x7f029019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.255+0000 7f028e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02901049d0 0x7f029019a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50534/0 (socket says 172.21.15.37:50534) 2024-09-21T05:52:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.255+0000 7f028e800640 1 -- 172.21.15.37:0/1610000851 learned_addr learned my addr 172.21.15.37:0/1610000851 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.255+0000 7f0287e00640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0290105320 0x7f029019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.255+0000 7f0287e00640 1 -- 172.21.15.37:0/1610000851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f029010de30 msgr2=0x7f029019fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.255+0000 7f0287e00640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f029010de30 0x7f029019fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.255+0000 7f0287e00640 1 -- 172.21.15.37:0/1610000851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02901049d0 msgr2=0x7f029019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.255+0000 7f0287e00640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02901049d0 0x7f029019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.255+0000 7f0287e00640 1 -- 172.21.15.37:0/1610000851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02901a04a0 con 0x7f0290105320 2024-09-21T05:52:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.255+0000 7f028f200640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f029010de30 0x7f029019fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.256+0000 7f0287e00640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0290105320 0x7f029019aad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f029006b950 tx=0x7f027800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.256+0000 7f0287400640 1 -- 172.21.15.37:0/1610000851 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027800cc40 con 0x7f0290105320 2024-09-21T05:52:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.256+0000 7f0287400640 1 -- 172.21.15.37:0/1610000851 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f027800cde0 con 0x7f0290105320 2024-09-21T05:52:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.256+0000 7f0295400640 1 -- 172.21.15.37:0/1610000851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02901a0790 con 0x7f0290105320 2024-09-21T05:52:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.256+0000 7f0287400640 1 -- 172.21.15.37:0/1610000851 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0278018780 con 0x7f0290105320 2024-09-21T05:52:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.256+0000 7f0295400640 1 -- 172.21.15.37:0/1610000851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02901a6ef0 con 0x7f0290105320 2024-09-21T05:52:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.257+0000 7f0295400640 1 -- 172.21.15.37:0/1610000851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f029006c240 con 0x7f0290105320 2024-09-21T05:52:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.260+0000 7f0287400640 1 -- 172.21.15.37:0/1610000851 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f0278010a90 con 0x7f0290105320 2024-09-21T05:52:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.262+0000 7f0287400640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02740b65a0 0x7f02740b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.262+0000 7f0287400640 1 -- 172.21.15.37:0/1610000851 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f02780e7b70 con 0x7f0290105320 2024-09-21T05:52:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.262+0000 7f028e800640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02740b65a0 0x7f02740b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.263+0000 7f028e800640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02740b65a0 0x7f02740b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0280000c00 tx=0x7f0280005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:53.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.266+0000 7f0287400640 1 -- 172.21.15.37:0/1610000851 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02780b2250 con 0x7f0290105320 2024-09-21T05:52:53.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:53.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:53.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:53 smithi037 ceph-mon[30631]: pgmap v383: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:53.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:53.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:53 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:53.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:53.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:53.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:53 smithi067 ceph-mon[34443]: pgmap v383: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:53.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:53.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:53 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:53.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.510+0000 7f0295400640 1 -- 172.21.15.37:0/1610000851 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0290100c90 con 0x7f02740b65a0 2024-09-21T05:52:53.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.517+0000 7f0287400640 1 -- 172.21.15.37:0/1610000851 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340244 (secure 0 0 0) 0x7f0290100c90 con 0x7f02740b65a0 2024-09-21T05:52:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:52:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T05:52:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.522+0000 7f0295400640 1 -- 172.21.15.37:0/1610000851 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02740b65a0 msgr2=0x7f02740b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.522+0000 7f0295400640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02740b65a0 0x7f02740b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0280000c00 tx=0x7f0280005a20 comp rx=0 tx=0).stop 2024-09-21T05:52:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.522+0000 7f0295400640 1 -- 172.21.15.37:0/1610000851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0290105320 msgr2=0x7f029019aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.522+0000 7f0295400640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0290105320 0x7f029019aad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f029006b950 tx=0x7f027800ee50 comp rx=0 tx=0).stop 2024-09-21T05:52:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.523+0000 7f0295400640 1 -- 172.21.15.37:0/1610000851 shutdown_connections 2024-09-21T05:52:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.523+0000 7f0295400640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f02740b65a0 0x7f02740b8ab0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.523+0000 7f0295400640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f029010de30 0x7f029019fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.523+0000 7f0295400640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0290105320 0x7f029019aad0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.523+0000 7f0295400640 1 --2- 172.21.15.37:0/1610000851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02901049d0 0x7f029019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.523+0000 7f0295400640 1 -- 172.21.15.37:0/1610000851 >> 172.21.15.37:0/1610000851 conn(0x7f0290079740 msgr2=0x7f02900ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.523+0000 7f0295400640 1 -- 172.21.15.37:0/1610000851 shutdown_connections 2024-09-21T05:52:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:53.523+0000 7f0295400640 1 -- 172.21.15.37:0/1610000851 wait complete. 2024-09-21T05:52:53.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:53.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:53.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:53 smithi144 ceph-mon[34351]: pgmap v383: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:52:53.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:53.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:53 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:54.262 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2024-09-21T05:52:52.258496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660667,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":219,"num_read_kb":206,"num_write":214,"num_write_kb":2252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384224,"kb_used_data":14108,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557600,"statfs":{"total":1151940427776,"available":1151546982400,"internally_reserved":0,"allocated":14446592,"data_stored":8196851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002225"},"pg_stats":[{"pgid":"2.1f","version":"79'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012688+0000","last_change":"2024-09-21T05:50:50.846365+0000","last_active":"2024-09-21T05:52:48.012688+0000","last_peered":"2024-09-21T05:52:48.012688+0000","last_clean":"2024-09-21T05:52:48.012688+0000","last_became_active":"2024-09-21T05:50:50.845924+0000","last_became_peered":"2024-09-21T05:50:50.845924+0000","last_unstale":"2024-09-21T05:52:48.012688+0000","last_undegraded":"2024-09-21T05:52:48.012688+0000","last_fullsized":"2024-09-21T05:52:48.012688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:39.056271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012242+0000","last_change":"2024-09-21T05:51:47.377003+0000","last_active":"2024-09-21T05:52:48.012242+0000","last_peered":"2024-09-21T05:52:48.012242+0000","last_clean":"2024-09-21T05:52:48.012242+0000","last_became_active":"2024-09-21T05:51:47.376624+0000","last_became_peered":"2024-09-21T05:51:47.376624+0000","last_unstale":"2024-09-21T05:52:48.012242+0000","last_undegraded":"2024-09-21T05:52:48.012242+0000","last_fullsized":"2024-09-21T05:52:48.012242+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:20.569002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.679683+0000","last_change":"2024-09-21T05:51:03.940107+0000","last_active":"2024-09-21T05:52:46.679683+0000","last_peered":"2024-09-21T05:52:46.679683+0000","last_clean":"2024-09-21T05:52:46.679683+0000","last_became_active":"2024-09-21T05:51:03.939723+0000","last_became_peered":"2024-09-21T05:51:03.939723+0000","last_unstale":"2024-09-21T05:52:46.679683+0000","last_undegraded":"2024-09-21T05:52:46.679683+0000","last_fullsized":"2024-09-21T05:52:46.679683+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:15.116461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321731+0000","last_change":"2024-09-21T05:50:51.162120+0000","last_active":"2024-09-21T05:52:48.321731+0000","last_peered":"2024-09-21T05:52:48.321731+0000","last_clean":"2024-09-21T05:52:48.321731+0000","last_became_active":"2024-09-21T05:50:51.161679+0000","last_became_peered":"2024-09-21T05:50:51.161679+0000","last_unstale":"2024-09-21T05:52:48.321731+0000","last_undegraded":"2024-09-21T05:52:48.321731+0000","last_fullsized":"2024-09-21T05:52:48.321731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:10.028536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674932+0000","last_change":"2024-09-21T05:50:53.907800+0000","last_active":"2024-09-21T05:52:47.674932+0000","last_peered":"2024-09-21T05:52:47.674932+0000","last_clean":"2024-09-21T05:52:47.674932+0000","last_became_active":"2024-09-21T05:50:53.906695+0000","last_became_peered":"2024-09-21T05:50:53.906695+0000","last_unstale":"2024-09-21T05:52:47.674932+0000","last_undegraded":"2024-09-21T05:52:47.674932+0000","last_fullsized":"2024-09-21T05:52:47.674932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:45.999010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698901+0000","last_change":"2024-09-21T05:51:03.947020+0000","last_active":"2024-09-21T05:52:47.698901+0000","last_peered":"2024-09-21T05:52:47.698901+0000","last_clean":"2024-09-21T05:52:47.698901+0000","last_became_active":"2024-09-21T05:51:03.946387+0000","last_became_peered":"2024-09-21T05:51:03.946387+0000","last_unstale":"2024-09-21T05:52:47.698901+0000","last_undegraded":"2024-09-21T05:52:47.698901+0000","last_fullsized":"2024-09-21T05:52:47.698901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:02.073199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677293+0000","last_change":"2024-09-21T05:50:50.850606+0000","last_active":"2024-09-21T05:52:47.677293+0000","last_peered":"2024-09-21T05:52:47.677293+0000","last_clean":"2024-09-21T05:52:47.677293+0000","last_became_active":"2024-09-21T05:50:50.850244+0000","last_became_peered":"2024-09-21T05:50:50.850244+0000","last_unstale":"2024-09-21T05:52:47.677293+0000","last_undegraded":"2024-09-21T05:52:47.677293+0000","last_fullsized":"2024-09-21T05:52:47.677293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:39.437099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675482+0000","last_change":"2024-09-21T05:50:53.897805+0000","last_active":"2024-09-21T05:52:47.675482+0000","last_peered":"2024-09-21T05:52:47.675482+0000","last_clean":"2024-09-21T05:52:47.675482+0000","last_became_active":"2024-09-21T05:50:53.896977+0000","last_became_peered":"2024-09-21T05:50:53.896977+0000","last_unstale":"2024-09-21T05:52:47.675482+0000","last_undegraded":"2024-09-21T05:52:47.675482+0000","last_fullsized":"2024-09-21T05:52:47.675482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:35.538322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698736+0000","last_change":"2024-09-21T05:51:03.939519+0000","last_active":"2024-09-21T05:52:47.698736+0000","last_peered":"2024-09-21T05:52:47.698736+0000","last_clean":"2024-09-21T05:52:47.698736+0000","last_became_active":"2024-09-21T05:51:03.938429+0000","last_became_peered":"2024-09-21T05:51:03.938429+0000","last_unstale":"2024-09-21T05:52:47.698736+0000","last_undegraded":"2024-09-21T05:52:47.698736+0000","last_fullsized":"2024-09-21T05:52:47.698736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:09.236561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677031+0000","last_change":"2024-09-21T05:50:50.847640+0000","last_active":"2024-09-21T05:52:47.677031+0000","last_peered":"2024-09-21T05:52:47.677031+0000","last_clean":"2024-09-21T05:52:47.677031+0000","last_became_active":"2024-09-21T05:50:50.847101+0000","last_became_peered":"2024-09-21T05:50:50.847101+0000","last_unstale":"2024-09-21T05:52:47.677031+0000","last_undegraded":"2024-09-21T05:52:47.677031+0000","last_fullsized":"2024-09-21T05:52:47.677031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:09.087655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010733+0000","last_change":"2024-09-21T05:50:53.889855+0000","last_active":"2024-09-21T05:52:48.010733+0000","last_peered":"2024-09-21T05:52:48.010733+0000","last_clean":"2024-09-21T05:52:48.010733+0000","last_became_active":"2024-09-21T05:50:53.889444+0000","last_became_peered":"2024-09-21T05:50:53.889444+0000","last_unstale":"2024-09-21T05:52:48.010733+0000","last_undegraded":"2024-09-21T05:52:48.010733+0000","last_fullsized":"2024-09-21T05:52:48.010733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:47.480986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698591+0000","last_change":"2024-09-21T05:51:03.946866+0000","last_active":"2024-09-21T05:52:47.698591+0000","last_peered":"2024-09-21T05:52:47.698591+0000","last_clean":"2024-09-21T05:52:47.698591+0000","last_became_active":"2024-09-21T05:51:03.946332+0000","last_became_peered":"2024-09-21T05:51:03.946332+0000","last_unstale":"2024-09-21T05:52:47.698591+0000","last_undegraded":"2024-09-21T05:52:47.698591+0000","last_fullsized":"2024-09-21T05:52:47.698591+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:43.527937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.680956+0000","last_change":"2024-09-21T05:50:53.900395+0000","last_active":"2024-09-21T05:52:47.680956+0000","last_peered":"2024-09-21T05:52:47.680956+0000","last_clean":"2024-09-21T05:52:47.680956+0000","last_became_active":"2024-09-21T05:50:53.894925+0000","last_became_peered":"2024-09-21T05:50:53.894925+0000","last_unstale":"2024-09-21T05:52:47.680956+0000","last_undegraded":"2024-09-21T05:52:47.680956+0000","last_fullsized":"2024-09-21T05:52:47.680956+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.939120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.676418+0000","last_change":"2024-09-21T05:50:50.851145+0000","last_active":"2024-09-21T05:52:47.676418+0000","last_peered":"2024-09-21T05:52:47.676418+0000","last_clean":"2024-09-21T05:52:47.676418+0000","last_became_active":"2024-09-21T05:50:50.850641+0000","last_became_peered":"2024-09-21T05:50:50.850641+0000","last_unstale":"2024-09-21T05:52:47.676418+0000","last_undegraded":"2024-09-21T05:52:47.676418+0000","last_fullsized":"2024-09-21T05:52:47.676418+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:34.560798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699143+0000","last_change":"2024-09-21T05:51:03.991798+0000","last_active":"2024-09-21T05:52:47.699143+0000","last_peered":"2024-09-21T05:52:47.699143+0000","last_clean":"2024-09-21T05:52:47.699143+0000","last_became_active":"2024-09-21T05:51:03.991173+0000","last_became_peered":"2024-09-21T05:51:03.991173+0000","last_unstale":"2024-09-21T05:52:47.699143+0000","last_undegraded":"2024-09-21T05:52:47.699143+0000","last_fullsized":"2024-09-21T05:52:47.699143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:46.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321213+0000","last_change":"2024-09-21T05:50:53.892293+0000","last_active":"2024-09-21T05:52:48.321213+0000","last_peered":"2024-09-21T05:52:48.321213+0000","last_clean":"2024-09-21T05:52:48.321213+0000","last_became_active":"2024-09-21T05:50:53.891814+0000","last_became_peered":"2024-09-21T05:50:53.891814+0000","last_unstale":"2024-09-21T05:52:48.321213+0000","last_undegraded":"2024-09-21T05:52:48.321213+0000","last_fullsized":"2024-09-21T05:52:48.321213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:14.810409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.679827+0000","last_change":"2024-09-21T05:50:50.846360+0000","last_active":"2024-09-21T05:52:46.679827+0000","last_peered":"2024-09-21T05:52:46.679827+0000","last_clean":"2024-09-21T05:52:46.679827+0000","last_became_active":"2024-09-21T05:50:50.845972+0000","last_became_peered":"2024-09-21T05:50:50.845972+0000","last_unstale":"2024-09-21T05:52:46.679827+0000","last_undegraded":"2024-09-21T05:52:46.679827+0000","last_fullsized":"2024-09-21T05:52:46.679827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.023239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698905+0000","last_change":"2024-09-21T05:51:03.938903+0000","last_active":"2024-09-21T05:52:47.698905+0000","last_peered":"2024-09-21T05:52:47.698905+0000","last_clean":"2024-09-21T05:52:47.698905+0000","last_became_active":"2024-09-21T05:51:03.938312+0000","last_became_peered":"2024-09-21T05:51:03.938312+0000","last_unstale":"2024-09-21T05:52:47.698905+0000","last_undegraded":"2024-09-21T05:52:47.698905+0000","last_fullsized":"2024-09-21T05:52:47.698905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:01.851758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682483+0000","last_change":"2024-09-21T05:50:53.907529+0000","last_active":"2024-09-21T05:52:47.682483+0000","last_peered":"2024-09-21T05:52:47.682483+0000","last_clean":"2024-09-21T05:52:47.682483+0000","last_became_active":"2024-09-21T05:50:53.907154+0000","last_became_peered":"2024-09-21T05:50:53.907154+0000","last_unstale":"2024-09-21T05:52:47.682483+0000","last_undegraded":"2024-09-21T05:52:47.682483+0000","last_fullsized":"2024-09-21T05:52:47.682483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:22.586642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321377+0000","last_change":"2024-09-21T05:50:50.838939+0000","last_active":"2024-09-21T05:52:48.321377+0000","last_peered":"2024-09-21T05:52:48.321377+0000","last_clean":"2024-09-21T05:52:48.321377+0000","last_became_active":"2024-09-21T05:50:50.838457+0000","last_became_peered":"2024-09-21T05:50:50.838457+0000","last_unstale":"2024-09-21T05:52:48.321377+0000","last_undegraded":"2024-09-21T05:52:48.321377+0000","last_fullsized":"2024-09-21T05:52:48.321377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:54.259046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011048+0000","last_change":"2024-09-21T05:51:03.944824+0000","last_active":"2024-09-21T05:52:48.011048+0000","last_peered":"2024-09-21T05:52:48.011048+0000","last_clean":"2024-09-21T05:52:48.011048+0000","last_became_active":"2024-09-21T05:51:03.938856+0000","last_became_peered":"2024-09-21T05:51:03.938856+0000","last_unstale":"2024-09-21T05:52:48.011048+0000","last_undegraded":"2024-09-21T05:52:48.011048+0000","last_fullsized":"2024-09-21T05:52:48.011048+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:12.111775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.676219+0000","last_change":"2024-09-21T05:50:53.891676+0000","last_active":"2024-09-21T05:52:47.676219+0000","last_peered":"2024-09-21T05:52:47.676219+0000","last_clean":"2024-09-21T05:52:47.676219+0000","last_became_active":"2024-09-21T05:50:53.891339+0000","last_became_peered":"2024-09-21T05:50:53.891339+0000","last_unstale":"2024-09-21T05:52:47.676219+0000","last_undegraded":"2024-09-21T05:52:47.676219+0000","last_fullsized":"2024-09-21T05:52:47.676219+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:41.707680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675376+0000","last_change":"2024-09-21T05:50:51.162492+0000","last_active":"2024-09-21T05:52:47.675376+0000","last_peered":"2024-09-21T05:52:47.675376+0000","last_clean":"2024-09-21T05:52:47.675376+0000","last_became_active":"2024-09-21T05:50:51.162108+0000","last_became_peered":"2024-09-21T05:50:51.162108+0000","last_unstale":"2024-09-21T05:52:47.675376+0000","last_undegraded":"2024-09-21T05:52:47.675376+0000","last_fullsized":"2024-09-21T05:52:47.675376+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.387568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698973+0000","last_change":"2024-09-21T05:51:03.992550+0000","last_active":"2024-09-21T05:52:47.698973+0000","last_peered":"2024-09-21T05:52:47.698973+0000","last_clean":"2024-09-21T05:52:47.698973+0000","last_became_active":"2024-09-21T05:51:03.991865+0000","last_became_peered":"2024-09-21T05:51:03.991865+0000","last_unstale":"2024-09-21T05:52:47.698973+0000","last_undegraded":"2024-09-21T05:52:47.698973+0000","last_fullsized":"2024-09-21T05:52:47.698973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:50.204058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674781+0000","last_change":"2024-09-21T05:50:53.884376+0000","last_active":"2024-09-21T05:52:47.674781+0000","last_peered":"2024-09-21T05:52:47.674781+0000","last_clean":"2024-09-21T05:52:47.674781+0000","last_became_active":"2024-09-21T05:50:53.884033+0000","last_became_peered":"2024-09-21T05:50:53.884033+0000","last_unstale":"2024-09-21T05:52:47.674781+0000","last_undegraded":"2024-09-21T05:52:47.674781+0000","last_fullsized":"2024-09-21T05:52:47.674781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.359191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699346+0000","last_change":"2024-09-21T05:50:50.869502+0000","last_active":"2024-09-21T05:52:47.699346+0000","last_peered":"2024-09-21T05:52:47.699346+0000","last_clean":"2024-09-21T05:52:47.699346+0000","last_became_active":"2024-09-21T05:50:50.869071+0000","last_became_peered":"2024-09-21T05:50:50.869071+0000","last_unstale":"2024-09-21T05:52:47.699346+0000","last_undegraded":"2024-09-21T05:52:47.699346+0000","last_fullsized":"2024-09-21T05:52:47.699346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:48.364902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.679843+0000","last_change":"2024-09-21T05:51:03.931945+0000","last_active":"2024-09-21T05:52:46.679843+0000","last_peered":"2024-09-21T05:52:46.679843+0000","last_clean":"2024-09-21T05:52:46.679843+0000","last_became_active":"2024-09-21T05:51:03.931411+0000","last_became_peered":"2024-09-21T05:51:03.931411+0000","last_unstale":"2024-09-21T05:52:46.679843+0000","last_undegraded":"2024-09-21T05:52:46.679843+0000","last_fullsized":"2024-09-21T05:52:46.679843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.910547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321735+0000","last_change":"2024-09-21T05:50:53.897995+0000","last_active":"2024-09-21T05:52:48.321735+0000","last_peered":"2024-09-21T05:52:48.321735+0000","last_clean":"2024-09-21T05:52:48.321735+0000","last_became_active":"2024-09-21T05:50:53.895797+0000","last_became_peered":"2024-09-21T05:50:53.895797+0000","last_unstale":"2024-09-21T05:52:48.321735+0000","last_undegraded":"2024-09-21T05:52:48.321735+0000","last_fullsized":"2024-09-21T05:52:48.321735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.484867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'9","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012571+0000","last_change":"2024-09-21T05:50:50.845853+0000","last_active":"2024-09-21T05:52:48.012571+0000","last_peered":"2024-09-21T05:52:48.012571+0000","last_clean":"2024-09-21T05:52:48.012571+0000","last_became_active":"2024-09-21T05:50:50.845495+0000","last_became_peered":"2024-09-21T05:50:50.845495+0000","last_unstale":"2024-09-21T05:52:48.012571+0000","last_undegraded":"2024-09-21T05:52:48.012571+0000","last_fullsized":"2024-09-21T05:52:48.012571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:47.960498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.320605+0000","last_change":"2024-09-21T05:51:03.991380+0000","last_active":"2024-09-21T05:52:48.320605+0000","last_peered":"2024-09-21T05:52:48.320605+0000","last_clean":"2024-09-21T05:52:48.320605+0000","last_became_active":"2024-09-21T05:51:03.990911+0000","last_became_peered":"2024-09-21T05:51:03.990911+0000","last_unstale":"2024-09-21T05:52:48.320605+0000","last_undegraded":"2024-09-21T05:52:48.320605+0000","last_fullsized":"2024-09-21T05:52:48.320605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:01.779692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.682654+0000","last_change":"2024-09-21T05:50:53.910190+0000","last_active":"2024-09-21T05:52:46.682654+0000","last_peered":"2024-09-21T05:52:46.682654+0000","last_clean":"2024-09-21T05:52:46.682654+0000","last_became_active":"2024-09-21T05:50:53.909649+0000","last_became_peered":"2024-09-21T05:50:53.909649+0000","last_unstale":"2024-09-21T05:52:46.682654+0000","last_undegraded":"2024-09-21T05:52:46.682654+0000","last_fullsized":"2024-09-21T05:52:46.682654+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:14.582217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677426+0000","last_change":"2024-09-21T05:50:51.163512+0000","last_active":"2024-09-21T05:52:47.677426+0000","last_peered":"2024-09-21T05:52:47.677426+0000","last_clean":"2024-09-21T05:52:47.677426+0000","last_became_active":"2024-09-21T05:50:51.161959+0000","last_became_peered":"2024-09-21T05:50:51.161959+0000","last_unstale":"2024-09-21T05:52:47.677426+0000","last_undegraded":"2024-09-21T05:52:47.677426+0000","last_fullsized":"2024-09-21T05:52:47.677426+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:51.701990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682096+0000","last_change":"2024-09-21T05:51:03.936815+0000","last_active":"2024-09-21T05:52:47.682096+0000","last_peered":"2024-09-21T05:52:47.682096+0000","last_clean":"2024-09-21T05:52:47.682096+0000","last_became_active":"2024-09-21T05:51:03.936365+0000","last_became_peered":"2024-09-21T05:51:03.936365+0000","last_unstale":"2024-09-21T05:52:47.682096+0000","last_undegraded":"2024-09-21T05:52:47.682096+0000","last_fullsized":"2024-09-21T05:52:47.682096+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:59.820159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011086+0000","last_change":"2024-09-21T05:50:53.892772+0000","last_active":"2024-09-21T05:52:48.011086+0000","last_peered":"2024-09-21T05:52:48.011086+0000","last_clean":"2024-09-21T05:52:48.011086+0000","last_became_active":"2024-09-21T05:50:53.892378+0000","last_became_peered":"2024-09-21T05:50:53.892378+0000","last_unstale":"2024-09-21T05:52:48.011086+0000","last_undegraded":"2024-09-21T05:52:48.011086+0000","last_fullsized":"2024-09-21T05:52:48.011086+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:34.438067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011938+0000","last_change":"2024-09-21T05:51:47.378160+0000","last_active":"2024-09-21T05:52:48.011938+0000","last_peered":"2024-09-21T05:52:48.011938+0000","last_clean":"2024-09-21T05:52:48.011938+0000","last_became_active":"2024-09-21T05:51:47.377779+0000","last_became_peered":"2024-09-21T05:51:47.377779+0000","last_unstale":"2024-09-21T05:52:48.011938+0000","last_undegraded":"2024-09-21T05:52:48.011938+0000","last_fullsized":"2024-09-21T05:52:48.011938+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:27.780273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011920+0000","last_change":"2024-09-21T05:52:48.011820+0000","last_active":"2024-09-21T05:52:48.011920+0000","last_peered":"2024-09-21T05:52:48.011920+0000","last_clean":"2024-09-21T05:52:48.011920+0000","last_became_active":"2024-09-21T05:52:48.011191+0000","last_became_peered":"2024-09-21T05:52:48.011191+0000","last_unstale":"2024-09-21T05:52:48.011920+0000","last_undegraded":"2024-09-21T05:52:48.011920+0000","last_fullsized":"2024-09-21T05:52:48.011920+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:45.598281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010809+0000","last_change":"2024-09-21T05:50:53.899306+0000","last_active":"2024-09-21T05:52:48.010809+0000","last_peered":"2024-09-21T05:52:48.010809+0000","last_clean":"2024-09-21T05:52:48.010809+0000","last_became_active":"2024-09-21T05:50:53.898921+0000","last_became_peered":"2024-09-21T05:50:53.898921+0000","last_unstale":"2024-09-21T05:52:48.010809+0000","last_undegraded":"2024-09-21T05:52:48.010809+0000","last_fullsized":"2024-09-21T05:52:48.010809+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:45.698584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681138+0000","last_change":"2024-09-21T05:50:50.844394+0000","last_active":"2024-09-21T05:52:47.681138+0000","last_peered":"2024-09-21T05:52:47.681138+0000","last_clean":"2024-09-21T05:52:47.681138+0000","last_became_active":"2024-09-21T05:50:50.843771+0000","last_became_peered":"2024-09-21T05:50:50.843771+0000","last_unstale":"2024-09-21T05:52:47.681138+0000","last_undegraded":"2024-09-21T05:52:47.681138+0000","last_fullsized":"2024-09-21T05:52:47.681138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:14.372917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.682528+0000","last_change":"2024-09-21T05:51:03.941277+0000","last_active":"2024-09-21T05:52:46.682528+0000","last_peered":"2024-09-21T05:52:46.682528+0000","last_clean":"2024-09-21T05:52:46.682528+0000","last_became_active":"2024-09-21T05:51:03.940659+0000","last_became_peered":"2024-09-21T05:51:03.940659+0000","last_unstale":"2024-09-21T05:52:46.682528+0000","last_undegraded":"2024-09-21T05:52:46.682528+0000","last_fullsized":"2024-09-21T05:52:46.682528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:40.217023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010255+0000","last_change":"2024-09-21T05:50:53.895399+0000","last_active":"2024-09-21T05:52:48.010255+0000","last_peered":"2024-09-21T05:52:48.010255+0000","last_clean":"2024-09-21T05:52:48.010255+0000","last_became_active":"2024-09-21T05:50:53.895022+0000","last_became_peered":"2024-09-21T05:50:53.895022+0000","last_unstale":"2024-09-21T05:52:48.010255+0000","last_undegraded":"2024-09-21T05:52:48.010255+0000","last_fullsized":"2024-09-21T05:52:48.010255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:02.056015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.681192+0000","last_change":"2024-09-21T05:50:51.162215+0000","last_active":"2024-09-21T05:52:46.681192+0000","last_peered":"2024-09-21T05:52:46.681192+0000","last_clean":"2024-09-21T05:52:46.681192+0000","last_became_active":"2024-09-21T05:50:51.161812+0000","last_became_peered":"2024-09-21T05:50:51.161812+0000","last_unstale":"2024-09-21T05:52:46.681192+0000","last_undegraded":"2024-09-21T05:52:46.681192+0000","last_fullsized":"2024-09-21T05:52:46.681192+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:05.237806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.682820+0000","last_change":"2024-09-21T05:51:03.991488+0000","last_active":"2024-09-21T05:52:46.682820+0000","last_peered":"2024-09-21T05:52:46.682820+0000","last_clean":"2024-09-21T05:52:46.682820+0000","last_became_active":"2024-09-21T05:51:03.990866+0000","last_became_peered":"2024-09-21T05:51:03.990866+0000","last_unstale":"2024-09-21T05:52:46.682820+0000","last_undegraded":"2024-09-21T05:52:46.682820+0000","last_fullsized":"2024-09-21T05:52:46.682820+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:41.061421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.680761+0000","last_change":"2024-09-21T05:50:53.895076+0000","last_active":"2024-09-21T05:52:46.680761+0000","last_peered":"2024-09-21T05:52:46.680761+0000","last_clean":"2024-09-21T05:52:46.680761+0000","last_became_active":"2024-09-21T05:50:53.893888+0000","last_became_peered":"2024-09-21T05:50:53.893888+0000","last_unstale":"2024-09-21T05:52:46.680761+0000","last_undegraded":"2024-09-21T05:52:46.680761+0000","last_fullsized":"2024-09-21T05:52:46.680761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:13.397806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681934+0000","last_change":"2024-09-21T05:51:47.376540+0000","last_active":"2024-09-21T05:52:47.681934+0000","last_peered":"2024-09-21T05:52:47.681934+0000","last_clean":"2024-09-21T05:52:47.681934+0000","last_became_active":"2024-09-21T05:51:47.376163+0000","last_became_peered":"2024-09-21T05:51:47.376163+0000","last_unstale":"2024-09-21T05:52:47.681934+0000","last_undegraded":"2024-09-21T05:52:47.681934+0000","last_fullsized":"2024-09-21T05:52:47.681934+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:51.217674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010471+0000","last_change":"2024-09-21T05:51:03.991711+0000","last_active":"2024-09-21T05:52:48.010471+0000","last_peered":"2024-09-21T05:52:48.010471+0000","last_clean":"2024-09-21T05:52:48.010471+0000","last_became_active":"2024-09-21T05:51:03.991200+0000","last_became_peered":"2024-09-21T05:51:03.991200+0000","last_unstale":"2024-09-21T05:52:48.010471+0000","last_undegraded":"2024-09-21T05:52:48.010471+0000","last_fullsized":"2024-09-21T05:52:48.010471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:40.981303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321052+0000","last_change":"2024-09-21T05:50:53.887913+0000","last_active":"2024-09-21T05:52:48.321052+0000","last_peered":"2024-09-21T05:52:48.321052+0000","last_clean":"2024-09-21T05:52:48.321052+0000","last_became_active":"2024-09-21T05:50:53.887583+0000","last_became_peered":"2024-09-21T05:50:53.887583+0000","last_unstale":"2024-09-21T05:52:48.321052+0000","last_undegraded":"2024-09-21T05:52:48.321052+0000","last_fullsized":"2024-09-21T05:52:48.321052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:05.941780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699346+0000","last_change":"2024-09-21T05:50:50.846370+0000","last_active":"2024-09-21T05:52:47.699346+0000","last_peered":"2024-09-21T05:52:47.699346+0000","last_clean":"2024-09-21T05:52:47.699346+0000","last_became_active":"2024-09-21T05:50:50.845890+0000","last_became_peered":"2024-09-21T05:50:50.845890+0000","last_unstale":"2024-09-21T05:52:47.699346+0000","last_undegraded":"2024-09-21T05:52:47.699346+0000","last_fullsized":"2024-09-21T05:52:47.699346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:15.180734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":118,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.680908+0000","last_change":"2024-09-21T05:49:33.762460+0000","last_active":"2024-09-21T05:52:47.680908+0000","last_peered":"2024-09-21T05:52:47.680908+0000","last_clean":"2024-09-21T05:52:47.680908+0000","last_became_active":"2024-09-21T05:49:33.705194+0000","last_became_peered":"2024-09-21T05:49:33.705194+0000","last_unstale":"2024-09-21T05:52:47.680908+0000","last_undegraded":"2024-09-21T05:52:47.680908+0000","last_fullsized":"2024-09-21T05:52:47.680908+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_clean_scrub_stamp":"2024-09-21T05:45:49.237325+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:39.194122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681293+0000","last_change":"2024-09-21T05:51:03.938790+0000","last_active":"2024-09-21T05:52:47.681293+0000","last_peered":"2024-09-21T05:52:47.681293+0000","last_clean":"2024-09-21T05:52:47.681293+0000","last_became_active":"2024-09-21T05:51:03.938214+0000","last_became_peered":"2024-09-21T05:51:03.938214+0000","last_unstale":"2024-09-21T05:52:47.681293+0000","last_undegraded":"2024-09-21T05:52:47.681293+0000","last_fullsized":"2024-09-21T05:52:47.681293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:11.512500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681482+0000","last_change":"2024-09-21T05:50:53.893475+0000","last_active":"2024-09-21T05:52:47.681482+0000","last_peered":"2024-09-21T05:52:47.681482+0000","last_clean":"2024-09-21T05:52:47.681482+0000","last_became_active":"2024-09-21T05:50:53.892946+0000","last_became_peered":"2024-09-21T05:50:53.892946+0000","last_unstale":"2024-09-21T05:52:47.681482+0000","last_undegraded":"2024-09-21T05:52:47.681482+0000","last_fullsized":"2024-09-21T05:52:47.681482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:23.612285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.680985+0000","last_change":"2024-09-21T05:50:51.162170+0000","last_active":"2024-09-21T05:52:46.680985+0000","last_peered":"2024-09-21T05:52:46.680985+0000","last_clean":"2024-09-21T05:52:46.680985+0000","last_became_active":"2024-09-21T05:50:51.161685+0000","last_became_peered":"2024-09-21T05:50:51.161685+0000","last_unstale":"2024-09-21T05:52:46.680985+0000","last_undegraded":"2024-09-21T05:52:46.680985+0000","last_fullsized":"2024-09-21T05:52:46.680985+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:14.922423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675213+0000","last_change":"2024-09-21T05:51:03.937061+0000","last_active":"2024-09-21T05:52:47.675213+0000","last_peered":"2024-09-21T05:52:47.675213+0000","last_clean":"2024-09-21T05:52:47.675213+0000","last_became_active":"2024-09-21T05:51:03.936306+0000","last_became_peered":"2024-09-21T05:51:03.936306+0000","last_unstale":"2024-09-21T05:52:47.675213+0000","last_undegraded":"2024-09-21T05:52:47.675213+0000","last_fullsized":"2024-09-21T05:52:47.675213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:51.057973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681242+0000","last_change":"2024-09-21T05:50:53.893930+0000","last_active":"2024-09-21T05:52:47.681242+0000","last_peered":"2024-09-21T05:52:47.681242+0000","last_clean":"2024-09-21T05:52:47.681242+0000","last_became_active":"2024-09-21T05:50:53.893155+0000","last_became_peered":"2024-09-21T05:50:53.893155+0000","last_unstale":"2024-09-21T05:52:47.681242+0000","last_undegraded":"2024-09-21T05:52:47.681242+0000","last_fullsized":"2024-09-21T05:52:47.681242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:46.097408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011000+0000","last_change":"2024-09-21T05:50:50.847890+0000","last_active":"2024-09-21T05:52:48.011000+0000","last_peered":"2024-09-21T05:52:48.011000+0000","last_clean":"2024-09-21T05:52:48.011000+0000","last_became_active":"2024-09-21T05:50:50.847549+0000","last_became_peered":"2024-09-21T05:50:50.847549+0000","last_unstale":"2024-09-21T05:52:48.011000+0000","last_undegraded":"2024-09-21T05:52:48.011000+0000","last_fullsized":"2024-09-21T05:52:48.011000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:14.998849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674457+0000","last_change":"2024-09-21T05:51:03.940674+0000","last_active":"2024-09-21T05:52:47.674457+0000","last_peered":"2024-09-21T05:52:47.674457+0000","last_clean":"2024-09-21T05:52:47.674457+0000","last_became_active":"2024-09-21T05:51:03.940222+0000","last_became_peered":"2024-09-21T05:51:03.940222+0000","last_unstale":"2024-09-21T05:52:47.674457+0000","last_undegraded":"2024-09-21T05:52:47.674457+0000","last_fullsized":"2024-09-21T05:52:47.674457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:58.497147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681539+0000","last_change":"2024-09-21T05:50:53.895191+0000","last_active":"2024-09-21T05:52:47.681539+0000","last_peered":"2024-09-21T05:52:47.681539+0000","last_clean":"2024-09-21T05:52:47.681539+0000","last_became_active":"2024-09-21T05:50:53.892894+0000","last_became_peered":"2024-09-21T05:50:53.892894+0000","last_unstale":"2024-09-21T05:52:47.681539+0000","last_undegraded":"2024-09-21T05:52:47.681539+0000","last_fullsized":"2024-09-21T05:52:47.681539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:41.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.682680+0000","last_change":"2024-09-21T05:50:50.844301+0000","last_active":"2024-09-21T05:52:46.682680+0000","last_peered":"2024-09-21T05:52:46.682680+0000","last_clean":"2024-09-21T05:52:46.682680+0000","last_became_active":"2024-09-21T05:50:50.843878+0000","last_became_peered":"2024-09-21T05:50:50.843878+0000","last_unstale":"2024-09-21T05:52:46.682680+0000","last_undegraded":"2024-09-21T05:52:46.682680+0000","last_fullsized":"2024-09-21T05:52:46.682680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:53.150300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009424+0000","last_change":"2024-09-21T05:51:03.931684+0000","last_active":"2024-09-21T05:52:48.009424+0000","last_peered":"2024-09-21T05:52:48.009424+0000","last_clean":"2024-09-21T05:52:48.009424+0000","last_became_active":"2024-09-21T05:51:03.931225+0000","last_became_peered":"2024-09-21T05:51:03.931225+0000","last_unstale":"2024-09-21T05:52:48.009424+0000","last_undegraded":"2024-09-21T05:52:48.009424+0000","last_fullsized":"2024-09-21T05:52:48.009424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:51.993481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682329+0000","last_change":"2024-09-21T05:50:53.892740+0000","last_active":"2024-09-21T05:52:47.682329+0000","last_peered":"2024-09-21T05:52:47.682329+0000","last_clean":"2024-09-21T05:52:47.682329+0000","last_became_active":"2024-09-21T05:50:53.892381+0000","last_became_peered":"2024-09-21T05:50:53.892381+0000","last_unstale":"2024-09-21T05:52:47.682329+0000","last_undegraded":"2024-09-21T05:52:47.682329+0000","last_fullsized":"2024-09-21T05:52:47.682329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:20.038644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677739+0000","last_change":"2024-09-21T05:50:50.850077+0000","last_active":"2024-09-21T05:52:47.677739+0000","last_peered":"2024-09-21T05:52:47.677739+0000","last_clean":"2024-09-21T05:52:47.677739+0000","last_became_active":"2024-09-21T05:50:50.849553+0000","last_became_peered":"2024-09-21T05:50:50.849553+0000","last_unstale":"2024-09-21T05:52:47.677739+0000","last_undegraded":"2024-09-21T05:52:47.677739+0000","last_fullsized":"2024-09-21T05:52:47.677739+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:09.764465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009424+0000","last_change":"2024-09-21T05:51:03.930231+0000","last_active":"2024-09-21T05:52:48.009424+0000","last_peered":"2024-09-21T05:52:48.009424+0000","last_clean":"2024-09-21T05:52:48.009424+0000","last_became_active":"2024-09-21T05:51:03.929907+0000","last_became_peered":"2024-09-21T05:51:03.929907+0000","last_unstale":"2024-09-21T05:52:48.009424+0000","last_undegraded":"2024-09-21T05:52:48.009424+0000","last_fullsized":"2024-09-21T05:52:48.009424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:18.829725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010293+0000","last_change":"2024-09-21T05:50:53.888988+0000","last_active":"2024-09-21T05:52:48.010293+0000","last_peered":"2024-09-21T05:52:48.010293+0000","last_clean":"2024-09-21T05:52:48.010293+0000","last_became_active":"2024-09-21T05:50:53.888599+0000","last_became_peered":"2024-09-21T05:50:53.888599+0000","last_unstale":"2024-09-21T05:52:48.010293+0000","last_undegraded":"2024-09-21T05:52:48.010293+0000","last_fullsized":"2024-09-21T05:52:48.010293+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:32.353201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677016+0000","last_change":"2024-09-21T05:51:47.383528+0000","last_active":"2024-09-21T05:52:47.677016+0000","last_peered":"2024-09-21T05:52:47.677016+0000","last_clean":"2024-09-21T05:52:47.677016+0000","last_became_active":"2024-09-21T05:51:47.376325+0000","last_became_peered":"2024-09-21T05:51:47.376325+0000","last_unstale":"2024-09-21T05:52:47.677016+0000","last_undegraded":"2024-09-21T05:52:47.677016+0000","last_fullsized":"2024-09-21T05:52:47.677016+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:47.659961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.682566+0000","last_change":"2024-09-21T05:51:03.946581+0000","last_active":"2024-09-21T05:52:46.682566+0000","last_peered":"2024-09-21T05:52:46.682566+0000","last_clean":"2024-09-21T05:52:46.682566+0000","last_became_active":"2024-09-21T05:51:03.946170+0000","last_became_peered":"2024-09-21T05:51:03.946170+0000","last_unstale":"2024-09-21T05:52:46.682566+0000","last_undegraded":"2024-09-21T05:52:46.682566+0000","last_fullsized":"2024-09-21T05:52:46.682566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:59.302647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.680732+0000","last_change":"2024-09-21T05:50:53.890164+0000","last_active":"2024-09-21T05:52:47.680732+0000","last_peered":"2024-09-21T05:52:47.680732+0000","last_clean":"2024-09-21T05:52:47.680732+0000","last_became_active":"2024-09-21T05:50:53.889309+0000","last_became_peered":"2024-09-21T05:50:53.889309+0000","last_unstale":"2024-09-21T05:52:47.680732+0000","last_undegraded":"2024-09-21T05:52:47.680732+0000","last_fullsized":"2024-09-21T05:52:47.680732+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:18.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699024+0000","last_change":"2024-09-21T05:50:50.844080+0000","last_active":"2024-09-21T05:52:47.699024+0000","last_peered":"2024-09-21T05:52:47.699024+0000","last_clean":"2024-09-21T05:52:47.699024+0000","last_became_active":"2024-09-21T05:50:50.842929+0000","last_became_peered":"2024-09-21T05:50:50.842929+0000","last_unstale":"2024-09-21T05:52:47.699024+0000","last_undegraded":"2024-09-21T05:52:47.699024+0000","last_fullsized":"2024-09-21T05:52:47.699024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:49.623189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010877+0000","last_change":"2024-09-21T05:51:03.939228+0000","last_active":"2024-09-21T05:52:48.010877+0000","last_peered":"2024-09-21T05:52:48.010877+0000","last_clean":"2024-09-21T05:52:48.010877+0000","last_became_active":"2024-09-21T05:51:03.937857+0000","last_became_peered":"2024-09-21T05:51:03.937857+0000","last_unstale":"2024-09-21T05:52:48.010877+0000","last_undegraded":"2024-09-21T05:52:48.010877+0000","last_fullsized":"2024-09-21T05:52:48.010877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:54.147008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681033+0000","last_change":"2024-09-21T05:50:53.890755+0000","last_active":"2024-09-21T05:52:47.681033+0000","last_peered":"2024-09-21T05:52:47.681033+0000","last_clean":"2024-09-21T05:52:47.681033+0000","last_became_active":"2024-09-21T05:50:53.890286+0000","last_became_peered":"2024-09-21T05:50:53.890286+0000","last_unstale":"2024-09-21T05:52:47.681033+0000","last_undegraded":"2024-09-21T05:52:47.681033+0000","last_fullsized":"2024-09-21T05:52:47.681033+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:50.767355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010323+0000","last_change":"2024-09-21T05:50:50.852722+0000","last_active":"2024-09-21T05:52:48.010323+0000","last_peered":"2024-09-21T05:52:48.010323+0000","last_clean":"2024-09-21T05:52:48.010323+0000","last_became_active":"2024-09-21T05:50:50.852211+0000","last_became_peered":"2024-09-21T05:50:50.852211+0000","last_unstale":"2024-09-21T05:52:48.010323+0000","last_undegraded":"2024-09-21T05:52:48.010323+0000","last_fullsized":"2024-09-21T05:52:48.010323+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:44.392153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.013611+0000","last_change":"2024-09-21T05:52:48.013503+0000","last_active":"2024-09-21T05:52:48.013611+0000","last_peered":"2024-09-21T05:52:48.013611+0000","last_clean":"2024-09-21T05:52:48.013611+0000","last_became_active":"2024-09-21T05:52:48.012908+0000","last_became_peered":"2024-09-21T05:52:48.012908+0000","last_unstale":"2024-09-21T05:52:48.013611+0000","last_undegraded":"2024-09-21T05:52:48.013611+0000","last_fullsized":"2024-09-21T05:52:48.013611+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:59.512334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.681687+0000","last_change":"2024-09-21T05:50:53.903935+0000","last_active":"2024-09-21T05:52:46.681687+0000","last_peered":"2024-09-21T05:52:46.681687+0000","last_clean":"2024-09-21T05:52:46.681687+0000","last_became_active":"2024-09-21T05:50:53.903604+0000","last_became_peered":"2024-09-21T05:50:53.903604+0000","last_unstale":"2024-09-21T05:52:46.681687+0000","last_undegraded":"2024-09-21T05:52:46.681687+0000","last_fullsized":"2024-09-21T05:52:46.681687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:49.552901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.680103+0000","last_change":"2024-09-21T05:50:50.848254+0000","last_active":"2024-09-21T05:52:46.680103+0000","last_peered":"2024-09-21T05:52:46.680103+0000","last_clean":"2024-09-21T05:52:46.680103+0000","last_became_active":"2024-09-21T05:50:50.847834+0000","last_became_peered":"2024-09-21T05:50:50.847834+0000","last_unstale":"2024-09-21T05:52:46.680103+0000","last_undegraded":"2024-09-21T05:52:46.680103+0000","last_fullsized":"2024-09-21T05:52:46.680103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:36.579763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009513+0000","last_change":"2024-09-21T05:51:03.941732+0000","last_active":"2024-09-21T05:52:48.009513+0000","last_peered":"2024-09-21T05:52:48.009513+0000","last_clean":"2024-09-21T05:52:48.009513+0000","last_became_active":"2024-09-21T05:51:03.941144+0000","last_became_peered":"2024-09-21T05:51:03.941144+0000","last_unstale":"2024-09-21T05:52:48.009513+0000","last_undegraded":"2024-09-21T05:52:48.009513+0000","last_fullsized":"2024-09-21T05:52:48.009513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:38.117642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677129+0000","last_change":"2024-09-21T05:50:53.904574+0000","last_active":"2024-09-21T05:52:47.677129+0000","last_peered":"2024-09-21T05:52:47.677129+0000","last_clean":"2024-09-21T05:52:47.677129+0000","last_became_active":"2024-09-21T05:50:53.904215+0000","last_became_peered":"2024-09-21T05:50:53.904215+0000","last_unstale":"2024-09-21T05:52:47.677129+0000","last_undegraded":"2024-09-21T05:52:47.677129+0000","last_fullsized":"2024-09-21T05:52:47.677129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:49.662725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'33","reported_seq":215,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:50.498223+0000","last_change":"2024-09-21T05:50:50.850929+0000","last_active":"2024-09-21T05:52:50.498223+0000","last_peered":"2024-09-21T05:52:50.498223+0000","last_clean":"2024-09-21T05:52:50.498223+0000","last_became_active":"2024-09-21T05:50:50.850495+0000","last_became_peered":"2024-09-21T05:50:50.850495+0000","last_unstale":"2024-09-21T05:52:50.498223+0000","last_undegraded":"2024-09-21T05:52:50.498223+0000","last_fullsized":"2024-09-21T05:52:50.498223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:45.224063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69267,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":33,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011469+0000","last_change":"2024-09-21T05:51:03.944010+0000","last_active":"2024-09-21T05:52:48.011469+0000","last_peered":"2024-09-21T05:52:48.011469+0000","last_clean":"2024-09-21T05:52:48.011469+0000","last_became_active":"2024-09-21T05:51:03.942942+0000","last_became_peered":"2024-09-21T05:51:03.942942+0000","last_unstale":"2024-09-21T05:52:48.011469+0000","last_undegraded":"2024-09-21T05:52:48.011469+0000","last_fullsized":"2024-09-21T05:52:48.011469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:38.846493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675534+0000","last_change":"2024-09-21T05:51:47.376326+0000","last_active":"2024-09-21T05:52:47.675534+0000","last_peered":"2024-09-21T05:52:47.675534+0000","last_clean":"2024-09-21T05:52:47.675534+0000","last_became_active":"2024-09-21T05:51:47.375993+0000","last_became_peered":"2024-09-21T05:51:47.375993+0000","last_unstale":"2024-09-21T05:52:47.675534+0000","last_undegraded":"2024-09-21T05:52:47.675534+0000","last_fullsized":"2024-09-21T05:52:47.675534+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:13.193571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010813+0000","last_change":"2024-09-21T05:50:51.162682+0000","last_active":"2024-09-21T05:52:48.010813+0000","last_peered":"2024-09-21T05:52:48.010813+0000","last_clean":"2024-09-21T05:52:48.010813+0000","last_became_active":"2024-09-21T05:50:51.162244+0000","last_became_peered":"2024-09-21T05:50:51.162244+0000","last_unstale":"2024-09-21T05:52:48.010813+0000","last_undegraded":"2024-09-21T05:52:48.010813+0000","last_fullsized":"2024-09-21T05:52:48.010813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.595096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699011+0000","last_change":"2024-09-21T05:51:03.939666+0000","last_active":"2024-09-21T05:52:47.699011+0000","last_peered":"2024-09-21T05:52:47.699011+0000","last_clean":"2024-09-21T05:52:47.699011+0000","last_became_active":"2024-09-21T05:51:03.938311+0000","last_became_peered":"2024-09-21T05:51:03.938311+0000","last_unstale":"2024-09-21T05:52:47.699011+0000","last_undegraded":"2024-09-21T05:52:47.699011+0000","last_fullsized":"2024-09-21T05:52:47.699011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:31.407900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674955+0000","last_change":"2024-09-21T05:51:47.588416+0000","last_active":"2024-09-21T05:52:47.674955+0000","last_peered":"2024-09-21T05:52:47.674955+0000","last_clean":"2024-09-21T05:52:47.674955+0000","last_became_active":"2024-09-21T05:51:47.587905+0000","last_became_peered":"2024-09-21T05:51:47.587905+0000","last_unstale":"2024-09-21T05:52:47.674955+0000","last_undegraded":"2024-09-21T05:52:47.674955+0000","last_fullsized":"2024-09-21T05:52:47.674955+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:05.821048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681402+0000","last_change":"2024-09-21T05:50:50.846164+0000","last_active":"2024-09-21T05:52:47.681402+0000","last_peered":"2024-09-21T05:52:47.681402+0000","last_clean":"2024-09-21T05:52:47.681402+0000","last_became_active":"2024-09-21T05:50:50.845775+0000","last_became_peered":"2024-09-21T05:50:50.845775+0000","last_unstale":"2024-09-21T05:52:47.681402+0000","last_undegraded":"2024-09-21T05:52:47.681402+0000","last_fullsized":"2024-09-21T05:52:47.681402+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:45.356626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.701383+0000","last_change":"2024-09-21T05:52:47.700832+0000","last_active":"2024-09-21T05:52:47.701383+0000","last_peered":"2024-09-21T05:52:47.701383+0000","last_clean":"2024-09-21T05:52:47.701383+0000","last_became_active":"2024-09-21T05:52:47.700372+0000","last_became_peered":"2024-09-21T05:52:47.700372+0000","last_unstale":"2024-09-21T05:52:47.701383+0000","last_undegraded":"2024-09-21T05:52:47.701383+0000","last_fullsized":"2024-09-21T05:52:47.701383+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.887433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675865+0000","last_change":"2024-09-21T05:50:53.903005+0000","last_active":"2024-09-21T05:52:47.675865+0000","last_peered":"2024-09-21T05:52:47.675865+0000","last_clean":"2024-09-21T05:52:47.675865+0000","last_became_active":"2024-09-21T05:50:53.902590+0000","last_became_peered":"2024-09-21T05:50:53.902590+0000","last_unstale":"2024-09-21T05:52:47.675865+0000","last_undegraded":"2024-09-21T05:52:47.675865+0000","last_fullsized":"2024-09-21T05:52:47.675865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:46.602723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011586+0000","last_change":"2024-09-21T05:50:50.846682+0000","last_active":"2024-09-21T05:52:48.011586+0000","last_peered":"2024-09-21T05:52:48.011586+0000","last_clean":"2024-09-21T05:52:48.011586+0000","last_became_active":"2024-09-21T05:50:50.846305+0000","last_became_peered":"2024-09-21T05:50:50.846305+0000","last_unstale":"2024-09-21T05:52:48.011586+0000","last_undegraded":"2024-09-21T05:52:48.011586+0000","last_fullsized":"2024-09-21T05:52:48.011586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:30.946247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.320608+0000","last_change":"2024-09-21T05:51:03.931781+0000","last_active":"2024-09-21T05:52:48.320608+0000","last_peered":"2024-09-21T05:52:48.320608+0000","last_clean":"2024-09-21T05:52:48.320608+0000","last_became_active":"2024-09-21T05:51:03.930921+0000","last_became_peered":"2024-09-21T05:51:03.930921+0000","last_unstale":"2024-09-21T05:52:48.320608+0000","last_undegraded":"2024-09-21T05:52:48.320608+0000","last_fullsized":"2024-09-21T05:52:48.320608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:03.284929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674665+0000","last_change":"2024-09-21T05:51:03.947521+0000","last_active":"2024-09-21T05:52:47.674665+0000","last_peered":"2024-09-21T05:52:47.674665+0000","last_clean":"2024-09-21T05:52:47.674665+0000","last_became_active":"2024-09-21T05:51:03.947074+0000","last_became_peered":"2024-09-21T05:51:03.947074+0000","last_unstale":"2024-09-21T05:52:47.674665+0000","last_undegraded":"2024-09-21T05:52:47.674665+0000","last_fullsized":"2024-09-21T05:52:47.674665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:51.313988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011333+0000","last_change":"2024-09-21T05:50:53.911791+0000","last_active":"2024-09-21T05:52:48.011333+0000","last_peered":"2024-09-21T05:52:48.011333+0000","last_clean":"2024-09-21T05:52:48.011333+0000","last_became_active":"2024-09-21T05:50:53.911392+0000","last_became_peered":"2024-09-21T05:50:53.911392+0000","last_unstale":"2024-09-21T05:52:48.011333+0000","last_undegraded":"2024-09-21T05:52:48.011333+0000","last_fullsized":"2024-09-21T05:52:48.011333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:45.688626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010622+0000","last_change":"2024-09-21T05:50:50.853383+0000","last_active":"2024-09-21T05:52:48.010622+0000","last_peered":"2024-09-21T05:52:48.010622+0000","last_clean":"2024-09-21T05:52:48.010622+0000","last_became_active":"2024-09-21T05:50:50.853006+0000","last_became_peered":"2024-09-21T05:50:50.853006+0000","last_unstale":"2024-09-21T05:52:48.010622+0000","last_undegraded":"2024-09-21T05:52:48.010622+0000","last_fullsized":"2024-09-21T05:52:48.010622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:14.838953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682453+0000","last_change":"2024-09-21T05:51:03.945415+0000","last_active":"2024-09-21T05:52:47.682453+0000","last_peered":"2024-09-21T05:52:47.682453+0000","last_clean":"2024-09-21T05:52:47.682453+0000","last_became_active":"2024-09-21T05:51:03.945019+0000","last_became_peered":"2024-09-21T05:51:03.945019+0000","last_unstale":"2024-09-21T05:52:47.682453+0000","last_undegraded":"2024-09-21T05:52:47.682453+0000","last_fullsized":"2024-09-21T05:52:47.682453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:27.006823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321042+0000","last_change":"2024-09-21T05:50:53.897515+0000","last_active":"2024-09-21T05:52:48.321042+0000","last_peered":"2024-09-21T05:52:48.321042+0000","last_clean":"2024-09-21T05:52:48.321042+0000","last_became_active":"2024-09-21T05:50:53.897070+0000","last_became_peered":"2024-09-21T05:50:53.897070+0000","last_unstale":"2024-09-21T05:52:48.321042+0000","last_undegraded":"2024-09-21T05:52:48.321042+0000","last_fullsized":"2024-09-21T05:52:48.321042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:16.971379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.680885+0000","last_change":"2024-09-21T05:50:50.844937+0000","last_active":"2024-09-21T05:52:46.680885+0000","last_peered":"2024-09-21T05:52:46.680885+0000","last_clean":"2024-09-21T05:52:46.680885+0000","last_became_active":"2024-09-21T05:50:50.844048+0000","last_became_peered":"2024-09-21T05:50:50.844048+0000","last_unstale":"2024-09-21T05:52:46.680885+0000","last_undegraded":"2024-09-21T05:52:46.680885+0000","last_fullsized":"2024-09-21T05:52:46.680885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:28.764620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010572+0000","last_change":"2024-09-21T05:51:47.587919+0000","last_active":"2024-09-21T05:52:48.010572+0000","last_peered":"2024-09-21T05:52:48.010572+0000","last_clean":"2024-09-21T05:52:48.010572+0000","last_became_active":"2024-09-21T05:51:47.587418+0000","last_became_peered":"2024-09-21T05:51:47.587418+0000","last_unstale":"2024-09-21T05:52:48.010572+0000","last_undegraded":"2024-09-21T05:52:48.010572+0000","last_fullsized":"2024-09-21T05:52:48.010572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:29.800848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010290+0000","last_change":"2024-09-21T05:50:53.890761+0000","last_active":"2024-09-21T05:52:48.010290+0000","last_peered":"2024-09-21T05:52:48.010290+0000","last_clean":"2024-09-21T05:52:48.010290+0000","last_became_active":"2024-09-21T05:50:53.890394+0000","last_became_peered":"2024-09-21T05:50:53.890394+0000","last_unstale":"2024-09-21T05:52:48.010290+0000","last_undegraded":"2024-09-21T05:52:48.010290+0000","last_fullsized":"2024-09-21T05:52:48.010290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.176920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"peering","last_fresh":"2024-09-21T05:51:47.366972+0000","last_change":"2024-09-21T05:52:46.680214+0000","last_active":"2024-09-21T05:52:46.680214+0000","last_peered":"2024-09-21T05:51:47.366972+0000","last_clean":"2024-09-21T05:51:47.366972+0000","last_became_active":"2024-09-21T05:51:03.940593+0000","last_became_peered":"2024-09-21T05:51:03.940593+0000","last_unstale":"2024-09-21T05:51:47.366972+0000","last_undegraded":"2024-09-21T05:51:47.366972+0000","last_fullsized":"2024-09-21T05:51:47.366972+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,10],"acting":[2,6,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6,9,10],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010581+0000","last_change":"2024-09-21T05:50:50.852630+0000","last_active":"2024-09-21T05:52:48.010581+0000","last_peered":"2024-09-21T05:52:48.010581+0000","last_clean":"2024-09-21T05:52:48.010581+0000","last_became_active":"2024-09-21T05:50:50.852255+0000","last_became_peered":"2024-09-21T05:50:50.852255+0000","last_unstale":"2024-09-21T05:52:48.010581+0000","last_undegraded":"2024-09-21T05:52:48.010581+0000","last_fullsized":"2024-09-21T05:52:48.010581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:18.094082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.676420+0000","last_change":"2024-09-21T05:50:53.902303+0000","last_active":"2024-09-21T05:52:47.676420+0000","last_peered":"2024-09-21T05:52:47.676420+0000","last_clean":"2024-09-21T05:52:47.676420+0000","last_became_active":"2024-09-21T05:50:53.901910+0000","last_became_peered":"2024-09-21T05:50:53.901910+0000","last_unstale":"2024-09-21T05:52:47.676420+0000","last_undegraded":"2024-09-21T05:52:47.676420+0000","last_fullsized":"2024-09-21T05:52:47.676420+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:06.651235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.680216+0000","last_change":"2024-09-21T05:51:03.932268+0000","last_active":"2024-09-21T05:52:46.680216+0000","last_peered":"2024-09-21T05:52:46.680216+0000","last_clean":"2024-09-21T05:52:46.680216+0000","last_became_active":"2024-09-21T05:51:03.931849+0000","last_became_peered":"2024-09-21T05:51:03.931849+0000","last_unstale":"2024-09-21T05:52:46.680216+0000","last_undegraded":"2024-09-21T05:52:46.680216+0000","last_fullsized":"2024-09-21T05:52:46.680216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:53.622621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682511+0000","last_change":"2024-09-21T05:50:53.897205+0000","last_active":"2024-09-21T05:52:47.682511+0000","last_peered":"2024-09-21T05:52:47.682511+0000","last_clean":"2024-09-21T05:52:47.682511+0000","last_became_active":"2024-09-21T05:50:53.896811+0000","last_became_peered":"2024-09-21T05:50:53.896811+0000","last_unstale":"2024-09-21T05:52:47.682511+0000","last_undegraded":"2024-09-21T05:52:47.682511+0000","last_fullsized":"2024-09-21T05:52:47.682511+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:13.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.679995+0000","last_change":"2024-09-21T05:51:47.376606+0000","last_active":"2024-09-21T05:52:46.679995+0000","last_peered":"2024-09-21T05:52:46.679995+0000","last_clean":"2024-09-21T05:52:46.679995+0000","last_became_active":"2024-09-21T05:51:47.376203+0000","last_became_peered":"2024-09-21T05:51:47.376203+0000","last_unstale":"2024-09-21T05:52:46.679995+0000","last_undegraded":"2024-09-21T05:52:46.679995+0000","last_fullsized":"2024-09-21T05:52:46.679995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:34.698021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.679783+0000","last_change":"2024-09-21T05:50:53.910991+0000","last_active":"2024-09-21T05:52:46.679783+0000","last_peered":"2024-09-21T05:52:46.679783+0000","last_clean":"2024-09-21T05:52:46.679783+0000","last_became_active":"2024-09-21T05:50:53.910720+0000","last_became_peered":"2024-09-21T05:50:53.910720+0000","last_unstale":"2024-09-21T05:52:46.679783+0000","last_undegraded":"2024-09-21T05:52:46.679783+0000","last_fullsized":"2024-09-21T05:52:46.679783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.653746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674557+0000","last_change":"2024-09-21T05:50:53.894065+0000","last_active":"2024-09-21T05:52:47.674557+0000","last_peered":"2024-09-21T05:52:47.674557+0000","last_clean":"2024-09-21T05:52:47.674557+0000","last_became_active":"2024-09-21T05:50:53.892630+0000","last_became_peered":"2024-09-21T05:50:53.892630+0000","last_unstale":"2024-09-21T05:52:47.674557+0000","last_undegraded":"2024-09-21T05:52:47.674557+0000","last_fullsized":"2024-09-21T05:52:47.674557+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:09.025667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.682571+0000","last_change":"2024-09-21T05:50:53.899586+0000","last_active":"2024-09-21T05:52:46.682571+0000","last_peered":"2024-09-21T05:52:46.682571+0000","last_clean":"2024-09-21T05:52:46.682571+0000","last_became_active":"2024-09-21T05:50:53.899066+0000","last_became_peered":"2024-09-21T05:50:53.899066+0000","last_unstale":"2024-09-21T05:52:46.682571+0000","last_undegraded":"2024-09-21T05:52:46.682571+0000","last_fullsized":"2024-09-21T05:52:46.682571+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:07.678164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682523+0000","last_change":"2024-09-21T05:51:47.375063+0000","last_active":"2024-09-21T05:52:47.682523+0000","last_peered":"2024-09-21T05:52:47.682523+0000","last_clean":"2024-09-21T05:52:47.682523+0000","last_became_active":"2024-09-21T05:51:47.374645+0000","last_became_peered":"2024-09-21T05:51:47.374645+0000","last_unstale":"2024-09-21T05:52:47.682523+0000","last_undegraded":"2024-09-21T05:52:47.682523+0000","last_fullsized":"2024-09-21T05:52:47.682523+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:29.572438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.680262+0000","last_change":"2024-09-21T05:50:53.901688+0000","last_active":"2024-09-21T05:52:46.680262+0000","last_peered":"2024-09-21T05:52:46.680262+0000","last_clean":"2024-09-21T05:52:46.680262+0000","last_became_active":"2024-09-21T05:50:53.901245+0000","last_became_peered":"2024-09-21T05:50:53.901245+0000","last_unstale":"2024-09-21T05:52:46.680262+0000","last_undegraded":"2024-09-21T05:52:46.680262+0000","last_fullsized":"2024-09-21T05:52:46.680262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:41.401357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321731+0000","last_change":"2024-09-21T05:50:53.908954+0000","last_active":"2024-09-21T05:52:48.321731+0000","last_peered":"2024-09-21T05:52:48.321731+0000","last_clean":"2024-09-21T05:52:48.321731+0000","last_became_active":"2024-09-21T05:50:53.897605+0000","last_became_peered":"2024-09-21T05:50:53.897605+0000","last_unstale":"2024-09-21T05:52:48.321731+0000","last_undegraded":"2024-09-21T05:52:48.321731+0000","last_fullsized":"2024-09-21T05:52:48.321731+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:15.634597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010197+0000","last_change":"2024-09-21T05:50:53.900106+0000","last_active":"2024-09-21T05:52:48.010197+0000","last_peered":"2024-09-21T05:52:48.010197+0000","last_clean":"2024-09-21T05:52:48.010197+0000","last_became_active":"2024-09-21T05:50:53.899697+0000","last_became_peered":"2024-09-21T05:50:53.899697+0000","last_unstale":"2024-09-21T05:52:48.010197+0000","last_undegraded":"2024-09-21T05:52:48.010197+0000","last_fullsized":"2024-09-21T05:52:48.010197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.599501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321285+0000","last_change":"2024-09-21T05:50:53.899644+0000","last_active":"2024-09-21T05:52:48.321285+0000","last_peered":"2024-09-21T05:52:48.321285+0000","last_clean":"2024-09-21T05:52:48.321285+0000","last_became_active":"2024-09-21T05:50:53.899246+0000","last_became_peered":"2024-09-21T05:50:53.899246+0000","last_unstale":"2024-09-21T05:52:48.321285+0000","last_undegraded":"2024-09-21T05:52:48.321285+0000","last_fullsized":"2024-09-21T05:52:48.321285+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:34.551489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675389+0000","last_change":"2024-09-21T05:50:53.904328+0000","last_active":"2024-09-21T05:52:47.675389+0000","last_peered":"2024-09-21T05:52:47.675389+0000","last_clean":"2024-09-21T05:52:47.675389+0000","last_became_active":"2024-09-21T05:50:53.903887+0000","last_became_peered":"2024-09-21T05:50:53.903887+0000","last_unstale":"2024-09-21T05:52:47.675389+0000","last_undegraded":"2024-09-21T05:52:47.675389+0000","last_fullsized":"2024-09-21T05:52:47.675389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:27.659631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.682142+0000","last_change":"2024-09-21T05:50:53.905278+0000","last_active":"2024-09-21T05:52:46.682142+0000","last_peered":"2024-09-21T05:52:46.682142+0000","last_clean":"2024-09-21T05:52:46.682142+0000","last_became_active":"2024-09-21T05:50:53.904633+0000","last_became_peered":"2024-09-21T05:50:53.904633+0000","last_unstale":"2024-09-21T05:52:46.682142+0000","last_undegraded":"2024-09-21T05:52:46.682142+0000","last_fullsized":"2024-09-21T05:52:46.682142+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:26.802336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682752+0000","last_change":"2024-09-21T05:50:53.891621+0000","last_active":"2024-09-21T05:52:47.682752+0000","last_peered":"2024-09-21T05:52:47.682752+0000","last_clean":"2024-09-21T05:52:47.682752+0000","last_became_active":"2024-09-21T05:50:53.891246+0000","last_became_peered":"2024-09-21T05:50:53.891246+0000","last_unstale":"2024-09-21T05:52:47.682752+0000","last_undegraded":"2024-09-21T05:52:47.682752+0000","last_fullsized":"2024-09-21T05:52:47.682752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:21.419789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.680258+0000","last_change":"2024-09-21T05:50:53.902964+0000","last_active":"2024-09-21T05:52:46.680258+0000","last_peered":"2024-09-21T05:52:46.680258+0000","last_clean":"2024-09-21T05:52:46.680258+0000","last_became_active":"2024-09-21T05:50:53.902574+0000","last_became_peered":"2024-09-21T05:50:53.902574+0000","last_unstale":"2024-09-21T05:52:46.680258+0000","last_undegraded":"2024-09-21T05:52:46.680258+0000","last_fullsized":"2024-09-21T05:52:46.680258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:35.552787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012516+0000","last_change":"2024-09-21T05:50:53.904717+0000","last_active":"2024-09-21T05:52:48.012516+0000","last_peered":"2024-09-21T05:52:48.012516+0000","last_clean":"2024-09-21T05:52:48.012516+0000","last_became_active":"2024-09-21T05:50:53.903152+0000","last_became_peered":"2024-09-21T05:50:53.903152+0000","last_unstale":"2024-09-21T05:52:48.012516+0000","last_undegraded":"2024-09-21T05:52:48.012516+0000","last_fullsized":"2024-09-21T05:52:48.012516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:56.808689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682887+0000","last_change":"2024-09-21T05:50:53.906336+0000","last_active":"2024-09-21T05:52:47.682887+0000","last_peered":"2024-09-21T05:52:47.682887+0000","last_clean":"2024-09-21T05:52:47.682887+0000","last_became_active":"2024-09-21T05:50:53.905942+0000","last_became_peered":"2024-09-21T05:50:53.905942+0000","last_unstale":"2024-09-21T05:52:47.682887+0000","last_undegraded":"2024-09-21T05:52:47.682887+0000","last_fullsized":"2024-09-21T05:52:47.682887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:26.824967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675200+0000","last_change":"2024-09-21T05:50:53.910772+0000","last_active":"2024-09-21T05:52:47.675200+0000","last_peered":"2024-09-21T05:52:47.675200+0000","last_clean":"2024-09-21T05:52:47.675200+0000","last_became_active":"2024-09-21T05:50:53.910394+0000","last_became_peered":"2024-09-21T05:50:53.910394+0000","last_unstale":"2024-09-21T05:52:47.675200+0000","last_undegraded":"2024-09-21T05:52:47.675200+0000","last_fullsized":"2024-09-21T05:52:47.675200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:00.338916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674332+0000","last_change":"2024-09-21T05:50:53.906454+0000","last_active":"2024-09-21T05:52:47.674332+0000","last_peered":"2024-09-21T05:52:47.674332+0000","last_clean":"2024-09-21T05:52:47.674332+0000","last_became_active":"2024-09-21T05:50:53.905947+0000","last_became_peered":"2024-09-21T05:50:53.905947+0000","last_unstale":"2024-09-21T05:52:47.674332+0000","last_undegraded":"2024-09-21T05:52:47.674332+0000","last_fullsized":"2024-09-21T05:52:47.674332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:57.358615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674433+0000","last_change":"2024-09-21T05:50:53.903690+0000","last_active":"2024-09-21T05:52:47.674433+0000","last_peered":"2024-09-21T05:52:47.674433+0000","last_clean":"2024-09-21T05:52:47.674433+0000","last_became_active":"2024-09-21T05:50:53.900672+0000","last_became_peered":"2024-09-21T05:50:53.900672+0000","last_unstale":"2024-09-21T05:52:47.674433+0000","last_undegraded":"2024-09-21T05:52:47.674433+0000","last_fullsized":"2024-09-21T05:52:47.674433+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:42.005312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-21T05:52:46.682018+0000","last_change":"2024-09-21T05:50:53.888711+0000","last_active":"2024-09-21T05:52:46.682018+0000","last_peered":"2024-09-21T05:52:46.682018+0000","last_clean":"2024-09-21T05:52:46.682018+0000","last_became_active":"2024-09-21T05:50:53.888302+0000","last_became_peered":"2024-09-21T05:50:53.888302+0000","last_unstale":"2024-09-21T05:52:46.682018+0000","last_undegraded":"2024-09-21T05:52:46.682018+0000","last_fullsized":"2024-09-21T05:52:46.682018+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:25.766696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699100+0000","last_change":"2024-09-21T05:50:53.898848+0000","last_active":"2024-09-21T05:52:47.699100+0000","last_peered":"2024-09-21T05:52:47.699100+0000","last_clean":"2024-09-21T05:52:47.699100+0000","last_became_active":"2024-09-21T05:50:53.897785+0000","last_became_peered":"2024-09-21T05:50:53.897785+0000","last_unstale":"2024-09-21T05:52:47.699100+0000","last_undegraded":"2024-09-21T05:52:47.699100+0000","last_fullsized":"2024-09-21T05:52:47.699100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:25.099224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681452+0000","last_change":"2024-09-21T05:50:53.899051+0000","last_active":"2024-09-21T05:52:47.681452+0000","last_peered":"2024-09-21T05:52:47.681452+0000","last_clean":"2024-09-21T05:52:47.681452+0000","last_became_active":"2024-09-21T05:50:53.898381+0000","last_became_peered":"2024-09-21T05:50:53.898381+0000","last_unstale":"2024-09-21T05:52:47.681452+0000","last_undegraded":"2024-09-21T05:52:47.681452+0000","last_fullsized":"2024-09-21T05:52:47.681452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:05.958547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011512+0000","last_change":"2024-09-21T05:50:53.896079+0000","last_active":"2024-09-21T05:52:48.011512+0000","last_peered":"2024-09-21T05:52:48.011512+0000","last_clean":"2024-09-21T05:52:48.011512+0000","last_became_active":"2024-09-21T05:50:53.895659+0000","last_became_peered":"2024-09-21T05:50:53.895659+0000","last_unstale":"2024-09-21T05:52:48.011512+0000","last_undegraded":"2024-09-21T05:52:48.011512+0000","last_fullsized":"2024-09-21T05:52:48.011512+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:50.151899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675981+0000","last_change":"2024-09-21T05:50:53.894899+0000","last_active":"2024-09-21T05:52:47.675981+0000","last_peered":"2024-09-21T05:52:47.675981+0000","last_clean":"2024-09-21T05:52:47.675981+0000","last_became_active":"2024-09-21T05:50:53.894530+0000","last_became_peered":"2024-09-21T05:50:53.894530+0000","last_unstale":"2024-09-21T05:52:47.675981+0000","last_undegraded":"2024-09-21T05:52:47.675981+0000","last_fullsized":"2024-09-21T05:52:47.675981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:15.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010925+0000","last_change":"2024-09-21T05:51:47.376927+0000","last_active":"2024-09-21T05:52:48.010925+0000","last_peered":"2024-09-21T05:52:48.010925+0000","last_clean":"2024-09-21T05:52:48.010925+0000","last_became_active":"2024-09-21T05:51:47.376534+0000","last_became_peered":"2024-09-21T05:51:47.376534+0000","last_unstale":"2024-09-21T05:52:48.010925+0000","last_undegraded":"2024-09-21T05:52:48.010925+0000","last_fullsized":"2024-09-21T05:52:48.010925+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:26.353085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.680854+0000","last_change":"2024-09-21T05:50:53.903196+0000","last_active":"2024-09-21T05:52:47.680854+0000","last_peered":"2024-09-21T05:52:47.680854+0000","last_clean":"2024-09-21T05:52:47.680854+0000","last_became_active":"2024-09-21T05:50:53.902825+0000","last_became_peered":"2024-09-21T05:50:53.902825+0000","last_unstale":"2024-09-21T05:52:47.680854+0000","last_undegraded":"2024-09-21T05:52:47.680854+0000","last_fullsized":"2024-09-21T05:52:47.680854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:13.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010520+0000","last_change":"2024-09-21T05:50:53.902249+0000","last_active":"2024-09-21T05:52:48.010520+0000","last_peered":"2024-09-21T05:52:48.010520+0000","last_clean":"2024-09-21T05:52:48.010520+0000","last_became_active":"2024-09-21T05:50:53.901828+0000","last_became_peered":"2024-09-21T05:50:53.901828+0000","last_unstale":"2024-09-21T05:52:48.010520+0000","last_undegraded":"2024-09-21T05:52:48.010520+0000","last_fullsized":"2024-09-21T05:52:48.010520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:51.200179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.676219+0000","last_change":"2024-09-21T05:50:53.897170+0000","last_active":"2024-09-21T05:52:47.676219+0000","last_peered":"2024-09-21T05:52:47.676219+0000","last_clean":"2024-09-21T05:52:47.676219+0000","last_became_active":"2024-09-21T05:50:53.895337+0000","last_became_peered":"2024-09-21T05:50:53.895337+0000","last_unstale":"2024-09-21T05:52:47.676219+0000","last_undegraded":"2024-09-21T05:52:47.676219+0000","last_fullsized":"2024-09-21T05:52:47.676219+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:19.869698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698957+0000","last_change":"2024-09-21T05:50:53.899575+0000","last_active":"2024-09-21T05:52:47.698957+0000","last_peered":"2024-09-21T05:52:47.698957+0000","last_clean":"2024-09-21T05:52:47.698957+0000","last_became_active":"2024-09-21T05:50:53.898274+0000","last_became_peered":"2024-09-21T05:50:53.898274+0000","last_unstale":"2024-09-21T05:52:47.698957+0000","last_undegraded":"2024-09-21T05:52:47.698957+0000","last_fullsized":"2024-09-21T05:52:47.698957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:28.188691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674665+0000","last_change":"2024-09-21T05:50:53.908381+0000","last_active":"2024-09-21T05:52:47.674665+0000","last_peered":"2024-09-21T05:52:47.674665+0000","last_clean":"2024-09-21T05:52:47.674665+0000","last_became_active":"2024-09-21T05:50:53.906731+0000","last_became_peered":"2024-09-21T05:50:53.906731+0000","last_unstale":"2024-09-21T05:52:47.674665+0000","last_undegraded":"2024-09-21T05:52:47.674665+0000","last_fullsized":"2024-09-21T05:52:47.674665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:59.254561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674671+0000","last_change":"2024-09-21T05:50:53.904619+0000","last_active":"2024-09-21T05:52:47.674671+0000","last_peered":"2024-09-21T05:52:47.674671+0000","last_clean":"2024-09-21T05:52:47.674671+0000","last_became_active":"2024-09-21T05:50:53.903901+0000","last_became_peered":"2024-09-21T05:50:53.903901+0000","last_unstale":"2024-09-21T05:52:47.674671+0000","last_undegraded":"2024-09-21T05:52:47.674671+0000","last_fullsized":"2024-09-21T05:52:47.674671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:25.531973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682851+0000","last_change":"2024-09-21T05:50:53.903557+0000","last_active":"2024-09-21T05:52:47.682851+0000","last_peered":"2024-09-21T05:52:47.682851+0000","last_clean":"2024-09-21T05:52:47.682851+0000","last_became_active":"2024-09-21T05:50:53.903195+0000","last_became_peered":"2024-09-21T05:50:53.903195+0000","last_unstale":"2024-09-21T05:52:47.682851+0000","last_undegraded":"2024-09-21T05:52:47.682851+0000","last_fullsized":"2024-09-21T05:52:47.682851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:32.268063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70065,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":143,"num_read_kb":142,"num_write":89,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":210195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678054,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":521686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874283,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28704,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716448,"statfs":{"total":95995035648,"available":95965642752,"internally_reserved":0,"allocated":1716224,"data_stored":1177419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037810,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1044480,"data_stored":526364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234039,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1044480,"data_stored":522290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32792,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712360,"statfs":{"total":95995035648,"available":95961456640,"internally_reserved":0,"allocated":1638400,"data_stored":1116732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626496,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1015808,"data_stored":508158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822728,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1642496,"data_stored":1112236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018956,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1040384,"data_stored":521708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215185,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1040384,"data_stored":517694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444119,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1097728,"data_stored":577459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36416,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708736,"statfs":{"total":95995035648,"available":95957745664,"internally_reserved":0,"allocated":1093632,"data_stored":577425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1036288,"data_stored":517680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:52:54.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:52:54.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:54 smithi067 ceph-mon[34443]: from='client.25138 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:54.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:54 smithi144 ceph-mon[34351]: from='client.25138 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:54.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:54 smithi037 ceph-mon[30631]: from='client.25138 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:54.707 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:55.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.341+0000 7fbbbde00640 1 -- 172.21.15.37:0/2903667364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb81092f0 msgr2=0x7fbbb8109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:55.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.341+0000 7fbbbde00640 1 --2- 172.21.15.37:0/2903667364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb81092f0 0x7fbbb8109700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009900 tx=0x7fbba402a410 comp rx=0 tx=0).stop 2024-09-21T05:52:55.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.341+0000 7fbbbde00640 1 -- 172.21.15.37:0/2903667364 shutdown_connections 2024-09-21T05:52:55.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.341+0000 7fbbbde00640 1 --2- 172.21.15.37:0/2903667364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbb8109c40 0x7fbbb8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:55.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.341+0000 7fbbbde00640 1 --2- 172.21.15.37:0/2903667364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb81092f0 0x7fbbb8109700 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:55.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.341+0000 7fbbbde00640 1 --2- 172.21.15.37:0/2903667364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbb81039b0 0x7fbbb8103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:55.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.341+0000 7fbbbde00640 1 -- 172.21.15.37:0/2903667364 >> 172.21.15.37:0/2903667364 conn(0x7fbbb80ff440 msgr2=0x7fbbb8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:55.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.341+0000 7fbbbde00640 1 -- 172.21.15.37:0/2903667364 shutdown_connections 2024-09-21T05:52:55.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.341+0000 7fbbbde00640 1 -- 172.21.15.37:0/2903667364 wait complete. 2024-09-21T05:52:55.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.342+0000 7fbbbde00640 1 Processor -- start 2024-09-21T05:52:55.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.342+0000 7fbbbde00640 1 -- start start 2024-09-21T05:52:55.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.343+0000 7fbbbde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb81039b0 0x7fbbb819c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.343+0000 7fbbbde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbb81092f0 0x7fbbb819cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.343+0000 7fbbbde00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbb8109c40 0x7fbbb81a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.343+0000 7fbbbde00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb8113900 con 0x7fbbb81039b0 2024-09-21T05:52:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.343+0000 7fbbbde00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb8113780 con 0x7fbbb8109c40 2024-09-21T05:52:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.343+0000 7fbbbde00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb8113a80 con 0x7fbbb81092f0 2024-09-21T05:52:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.343+0000 7fbbbca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb81039b0 0x7fbbb819c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.343+0000 7fbbbd400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbb8109c40 0x7fbbb81a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.343+0000 7fbbbca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb81039b0 0x7fbbb819c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50538/0 (socket says 172.21.15.37:50538) 2024-09-21T05:52:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.343+0000 7fbbbca00640 1 -- 172.21.15.37:0/3197493068 learned_addr learned my addr 172.21.15.37:0/3197493068 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.344+0000 7fbbb7e00640 1 --2- 172.21.15.37:0/3197493068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbb81092f0 0x7fbbb819cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.344+0000 7fbbbd400640 1 -- 172.21.15.37:0/3197493068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbb81092f0 msgr2=0x7fbbb819cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.344+0000 7fbbbd400640 1 --2- 172.21.15.37:0/3197493068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbb81092f0 0x7fbbb819cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.344+0000 7fbbbd400640 1 -- 172.21.15.37:0/3197493068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb81039b0 msgr2=0x7fbbb819c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.344+0000 7fbbbd400640 1 --2- 172.21.15.37:0/3197493068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb81039b0 0x7fbbb819c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.344+0000 7fbbbd400640 1 -- 172.21.15.37:0/3197493068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb81a24a0 con 0x7fbbb8109c40 2024-09-21T05:52:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.344+0000 7fbbbd400640 1 --2- 172.21.15.37:0/3197493068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbb8109c40 0x7fbbb81a1d70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009fd0 tx=0x7fbbb000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.345+0000 7fbbb5600640 1 -- 172.21.15.37:0/3197493068 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb000ce20 con 0x7fbbb8109c40 2024-09-21T05:52:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.345+0000 7fbbb5600640 1 -- 172.21.15.37:0/3197493068 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbb0005020 con 0x7fbbb8109c40 2024-09-21T05:52:55.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.345+0000 7fbbb5600640 1 -- 172.21.15.37:0/3197493068 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0010690 con 0x7fbbb8109c40 2024-09-21T05:52:55.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.345+0000 7fbbbde00640 1 -- 172.21.15.37:0/3197493068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb81a2790 con 0x7fbbb8109c40 2024-09-21T05:52:55.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.345+0000 7fbbbde00640 1 -- 172.21.15.37:0/3197493068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb81a8ef0 con 0x7fbbb8109c40 2024-09-21T05:52:55.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.346+0000 7fbbbde00640 1 -- 172.21.15.37:0/3197493068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb8103dc0 con 0x7fbbb8109c40 2024-09-21T05:52:55.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.348+0000 7fbbb5600640 1 -- 172.21.15.37:0/3197493068 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fbbb0004b20 con 0x7fbbb8109c40 2024-09-21T05:52:55.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.350+0000 7fbbb5600640 1 --2- 172.21.15.37:0/3197493068 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fbba00b6620 0x7fbba00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:55.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.350+0000 7fbbb5600640 1 -- 172.21.15.37:0/3197493068 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fbbb00e7f90 con 0x7fbbb8109c40 2024-09-21T05:52:55.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.350+0000 7fbbbca00640 1 --2- 172.21.15.37:0/3197493068 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fbba00b6620 0x7fbba00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:55.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.351+0000 7fbbbca00640 1 --2- 172.21.15.37:0/3197493068 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fbba00b6620 0x7fbba00b8b30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009c90 tx=0x7fbbac005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:55.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.354+0000 7fbbb5600640 1 -- 172.21.15.37:0/3197493068 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbbb00ae290 con 0x7fbbb8109c40 2024-09-21T05:52:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.556+0000 7fbbbde00640 1 -- 172.21.15.37:0/3197493068 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbbb810f740 con 0x7fbba00b6620 2024-09-21T05:52:55.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.563+0000 7fbbb5600640 1 -- 172.21.15.37:0/3197493068 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340278 (secure 0 0 0) 0x7fbbb810f740 con 0x7fbba00b6620 2024-09-21T05:52:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:52:55.570 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T05:52:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.568+0000 7fbbbde00640 1 -- 172.21.15.37:0/3197493068 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fbba00b6620 msgr2=0x7fbba00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.568+0000 7fbbbde00640 1 --2- 172.21.15.37:0/3197493068 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fbba00b6620 0x7fbba00b8b30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009c90 tx=0x7fbbac005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.568+0000 7fbbbde00640 1 -- 172.21.15.37:0/3197493068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbb8109c40 msgr2=0x7fbbb81a1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.568+0000 7fbbbde00640 1 --2- 172.21.15.37:0/3197493068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbb8109c40 0x7fbbb81a1d70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009fd0 tx=0x7fbbb000ef10 comp rx=0 tx=0).stop 2024-09-21T05:52:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.568+0000 7fbbbde00640 1 -- 172.21.15.37:0/3197493068 shutdown_connections 2024-09-21T05:52:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.568+0000 7fbbbde00640 1 --2- 172.21.15.37:0/3197493068 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fbba00b6620 0x7fbba00b8b30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.568+0000 7fbbbde00640 1 --2- 172.21.15.37:0/3197493068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbb8109c40 0x7fbbb81a1d70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.568+0000 7fbbbde00640 1 --2- 172.21.15.37:0/3197493068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbb81092f0 0x7fbbb819cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.568+0000 7fbbbde00640 1 --2- 172.21.15.37:0/3197493068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb81039b0 0x7fbbb819c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.568+0000 7fbbbde00640 1 -- 172.21.15.37:0/3197493068 >> 172.21.15.37:0/3197493068 conn(0x7fbbb80ff440 msgr2=0x7fbbb81089f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.568+0000 7fbbbde00640 1 -- 172.21.15.37:0/3197493068 shutdown_connections 2024-09-21T05:52:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:55.568+0000 7fbbbde00640 1 -- 172.21.15.37:0/3197493068 wait complete. 2024-09-21T05:52:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:55 smithi144 ceph-mon[34351]: pgmap v384: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-21T05:52:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:55 smithi144 ceph-mon[34351]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T05:52:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:55 smithi144 ceph-mon[34351]: Cluster is now healthy 2024-09-21T05:52:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:52:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:52:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:55.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:55 smithi037 ceph-mon[30631]: pgmap v384: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-21T05:52:55.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:55.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:55.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:55 smithi037 ceph-mon[30631]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T05:52:55.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:55 smithi037 ceph-mon[30631]: Cluster is now healthy 2024-09-21T05:52:55.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:52:55.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:52:55.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:55 smithi067 ceph-mon[34443]: pgmap v384: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-21T05:52:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:55 smithi067 ceph-mon[34443]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T05:52:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:55 smithi067 ceph-mon[34443]: Cluster is now healthy 2024-09-21T05:52:55.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:52:55.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:52:55.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:52:56.304 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-09-21T05:52:54.259051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660667,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":219,"num_read_kb":206,"num_write":214,"num_write_kb":2252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":422,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384284,"kb_used_data":14156,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557540,"statfs":{"total":1151940427776,"available":1151546920960,"internally_reserved":0,"allocated":14495744,"data_stored":8225147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002238"},"pg_stats":[{"pgid":"2.1f","version":"79'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012688+0000","last_change":"2024-09-21T05:50:50.846365+0000","last_active":"2024-09-21T05:52:48.012688+0000","last_peered":"2024-09-21T05:52:48.012688+0000","last_clean":"2024-09-21T05:52:48.012688+0000","last_became_active":"2024-09-21T05:50:50.845924+0000","last_became_peered":"2024-09-21T05:50:50.845924+0000","last_unstale":"2024-09-21T05:52:48.012688+0000","last_undegraded":"2024-09-21T05:52:48.012688+0000","last_fullsized":"2024-09-21T05:52:48.012688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:39.056271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012242+0000","last_change":"2024-09-21T05:51:47.377003+0000","last_active":"2024-09-21T05:52:48.012242+0000","last_peered":"2024-09-21T05:52:48.012242+0000","last_clean":"2024-09-21T05:52:48.012242+0000","last_became_active":"2024-09-21T05:51:47.376624+0000","last_became_peered":"2024-09-21T05:51:47.376624+0000","last_unstale":"2024-09-21T05:52:48.012242+0000","last_undegraded":"2024-09-21T05:52:48.012242+0000","last_fullsized":"2024-09-21T05:52:48.012242+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:20.569002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677963+0000","last_change":"2024-09-21T05:51:03.940107+0000","last_active":"2024-09-21T05:52:47.677963+0000","last_peered":"2024-09-21T05:52:47.677963+0000","last_clean":"2024-09-21T05:52:47.677963+0000","last_became_active":"2024-09-21T05:51:03.939723+0000","last_became_peered":"2024-09-21T05:51:03.939723+0000","last_unstale":"2024-09-21T05:52:47.677963+0000","last_undegraded":"2024-09-21T05:52:47.677963+0000","last_fullsized":"2024-09-21T05:52:47.677963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:15.116461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321731+0000","last_change":"2024-09-21T05:50:51.162120+0000","last_active":"2024-09-21T05:52:48.321731+0000","last_peered":"2024-09-21T05:52:48.321731+0000","last_clean":"2024-09-21T05:52:48.321731+0000","last_became_active":"2024-09-21T05:50:51.161679+0000","last_became_peered":"2024-09-21T05:50:51.161679+0000","last_unstale":"2024-09-21T05:52:48.321731+0000","last_undegraded":"2024-09-21T05:52:48.321731+0000","last_fullsized":"2024-09-21T05:52:48.321731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:10.028536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674932+0000","last_change":"2024-09-21T05:50:53.907800+0000","last_active":"2024-09-21T05:52:47.674932+0000","last_peered":"2024-09-21T05:52:47.674932+0000","last_clean":"2024-09-21T05:52:47.674932+0000","last_became_active":"2024-09-21T05:50:53.906695+0000","last_became_peered":"2024-09-21T05:50:53.906695+0000","last_unstale":"2024-09-21T05:52:47.674932+0000","last_undegraded":"2024-09-21T05:52:47.674932+0000","last_fullsized":"2024-09-21T05:52:47.674932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:45.999010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698901+0000","last_change":"2024-09-21T05:51:03.947020+0000","last_active":"2024-09-21T05:52:47.698901+0000","last_peered":"2024-09-21T05:52:47.698901+0000","last_clean":"2024-09-21T05:52:47.698901+0000","last_became_active":"2024-09-21T05:51:03.946387+0000","last_became_peered":"2024-09-21T05:51:03.946387+0000","last_unstale":"2024-09-21T05:52:47.698901+0000","last_undegraded":"2024-09-21T05:52:47.698901+0000","last_fullsized":"2024-09-21T05:52:47.698901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:02.073199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677293+0000","last_change":"2024-09-21T05:50:50.850606+0000","last_active":"2024-09-21T05:52:47.677293+0000","last_peered":"2024-09-21T05:52:47.677293+0000","last_clean":"2024-09-21T05:52:47.677293+0000","last_became_active":"2024-09-21T05:50:50.850244+0000","last_became_peered":"2024-09-21T05:50:50.850244+0000","last_unstale":"2024-09-21T05:52:47.677293+0000","last_undegraded":"2024-09-21T05:52:47.677293+0000","last_fullsized":"2024-09-21T05:52:47.677293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:39.437099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675482+0000","last_change":"2024-09-21T05:50:53.897805+0000","last_active":"2024-09-21T05:52:47.675482+0000","last_peered":"2024-09-21T05:52:47.675482+0000","last_clean":"2024-09-21T05:52:47.675482+0000","last_became_active":"2024-09-21T05:50:53.896977+0000","last_became_peered":"2024-09-21T05:50:53.896977+0000","last_unstale":"2024-09-21T05:52:47.675482+0000","last_undegraded":"2024-09-21T05:52:47.675482+0000","last_fullsized":"2024-09-21T05:52:47.675482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:35.538322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698736+0000","last_change":"2024-09-21T05:51:03.939519+0000","last_active":"2024-09-21T05:52:47.698736+0000","last_peered":"2024-09-21T05:52:47.698736+0000","last_clean":"2024-09-21T05:52:47.698736+0000","last_became_active":"2024-09-21T05:51:03.938429+0000","last_became_peered":"2024-09-21T05:51:03.938429+0000","last_unstale":"2024-09-21T05:52:47.698736+0000","last_undegraded":"2024-09-21T05:52:47.698736+0000","last_fullsized":"2024-09-21T05:52:47.698736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:09.236561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677031+0000","last_change":"2024-09-21T05:50:50.847640+0000","last_active":"2024-09-21T05:52:47.677031+0000","last_peered":"2024-09-21T05:52:47.677031+0000","last_clean":"2024-09-21T05:52:47.677031+0000","last_became_active":"2024-09-21T05:50:50.847101+0000","last_became_peered":"2024-09-21T05:50:50.847101+0000","last_unstale":"2024-09-21T05:52:47.677031+0000","last_undegraded":"2024-09-21T05:52:47.677031+0000","last_fullsized":"2024-09-21T05:52:47.677031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:09.087655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010733+0000","last_change":"2024-09-21T05:50:53.889855+0000","last_active":"2024-09-21T05:52:48.010733+0000","last_peered":"2024-09-21T05:52:48.010733+0000","last_clean":"2024-09-21T05:52:48.010733+0000","last_became_active":"2024-09-21T05:50:53.889444+0000","last_became_peered":"2024-09-21T05:50:53.889444+0000","last_unstale":"2024-09-21T05:52:48.010733+0000","last_undegraded":"2024-09-21T05:52:48.010733+0000","last_fullsized":"2024-09-21T05:52:48.010733+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:47.480986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698591+0000","last_change":"2024-09-21T05:51:03.946866+0000","last_active":"2024-09-21T05:52:47.698591+0000","last_peered":"2024-09-21T05:52:47.698591+0000","last_clean":"2024-09-21T05:52:47.698591+0000","last_became_active":"2024-09-21T05:51:03.946332+0000","last_became_peered":"2024-09-21T05:51:03.946332+0000","last_unstale":"2024-09-21T05:52:47.698591+0000","last_undegraded":"2024-09-21T05:52:47.698591+0000","last_fullsized":"2024-09-21T05:52:47.698591+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:43.527937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.680956+0000","last_change":"2024-09-21T05:50:53.900395+0000","last_active":"2024-09-21T05:52:47.680956+0000","last_peered":"2024-09-21T05:52:47.680956+0000","last_clean":"2024-09-21T05:52:47.680956+0000","last_became_active":"2024-09-21T05:50:53.894925+0000","last_became_peered":"2024-09-21T05:50:53.894925+0000","last_unstale":"2024-09-21T05:52:47.680956+0000","last_undegraded":"2024-09-21T05:52:47.680956+0000","last_fullsized":"2024-09-21T05:52:47.680956+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.939120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.676418+0000","last_change":"2024-09-21T05:50:50.851145+0000","last_active":"2024-09-21T05:52:47.676418+0000","last_peered":"2024-09-21T05:52:47.676418+0000","last_clean":"2024-09-21T05:52:47.676418+0000","last_became_active":"2024-09-21T05:50:50.850641+0000","last_became_peered":"2024-09-21T05:50:50.850641+0000","last_unstale":"2024-09-21T05:52:47.676418+0000","last_undegraded":"2024-09-21T05:52:47.676418+0000","last_fullsized":"2024-09-21T05:52:47.676418+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:34.560798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699143+0000","last_change":"2024-09-21T05:51:03.991798+0000","last_active":"2024-09-21T05:52:47.699143+0000","last_peered":"2024-09-21T05:52:47.699143+0000","last_clean":"2024-09-21T05:52:47.699143+0000","last_became_active":"2024-09-21T05:51:03.991173+0000","last_became_peered":"2024-09-21T05:51:03.991173+0000","last_unstale":"2024-09-21T05:52:47.699143+0000","last_undegraded":"2024-09-21T05:52:47.699143+0000","last_fullsized":"2024-09-21T05:52:47.699143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:46.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321213+0000","last_change":"2024-09-21T05:50:53.892293+0000","last_active":"2024-09-21T05:52:48.321213+0000","last_peered":"2024-09-21T05:52:48.321213+0000","last_clean":"2024-09-21T05:52:48.321213+0000","last_became_active":"2024-09-21T05:50:53.891814+0000","last_became_peered":"2024-09-21T05:50:53.891814+0000","last_unstale":"2024-09-21T05:52:48.321213+0000","last_undegraded":"2024-09-21T05:52:48.321213+0000","last_fullsized":"2024-09-21T05:52:48.321213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:14.810409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678456+0000","last_change":"2024-09-21T05:50:50.846360+0000","last_active":"2024-09-21T05:52:47.678456+0000","last_peered":"2024-09-21T05:52:47.678456+0000","last_clean":"2024-09-21T05:52:47.678456+0000","last_became_active":"2024-09-21T05:50:50.845972+0000","last_became_peered":"2024-09-21T05:50:50.845972+0000","last_unstale":"2024-09-21T05:52:47.678456+0000","last_undegraded":"2024-09-21T05:52:47.678456+0000","last_fullsized":"2024-09-21T05:52:47.678456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.023239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698905+0000","last_change":"2024-09-21T05:51:03.938903+0000","last_active":"2024-09-21T05:52:47.698905+0000","last_peered":"2024-09-21T05:52:47.698905+0000","last_clean":"2024-09-21T05:52:47.698905+0000","last_became_active":"2024-09-21T05:51:03.938312+0000","last_became_peered":"2024-09-21T05:51:03.938312+0000","last_unstale":"2024-09-21T05:52:47.698905+0000","last_undegraded":"2024-09-21T05:52:47.698905+0000","last_fullsized":"2024-09-21T05:52:47.698905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:01.851758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682483+0000","last_change":"2024-09-21T05:50:53.907529+0000","last_active":"2024-09-21T05:52:47.682483+0000","last_peered":"2024-09-21T05:52:47.682483+0000","last_clean":"2024-09-21T05:52:47.682483+0000","last_became_active":"2024-09-21T05:50:53.907154+0000","last_became_peered":"2024-09-21T05:50:53.907154+0000","last_unstale":"2024-09-21T05:52:47.682483+0000","last_undegraded":"2024-09-21T05:52:47.682483+0000","last_fullsized":"2024-09-21T05:52:47.682483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:22.586642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321377+0000","last_change":"2024-09-21T05:50:50.838939+0000","last_active":"2024-09-21T05:52:48.321377+0000","last_peered":"2024-09-21T05:52:48.321377+0000","last_clean":"2024-09-21T05:52:48.321377+0000","last_became_active":"2024-09-21T05:50:50.838457+0000","last_became_peered":"2024-09-21T05:50:50.838457+0000","last_unstale":"2024-09-21T05:52:48.321377+0000","last_undegraded":"2024-09-21T05:52:48.321377+0000","last_fullsized":"2024-09-21T05:52:48.321377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:54.259046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011048+0000","last_change":"2024-09-21T05:51:03.944824+0000","last_active":"2024-09-21T05:52:48.011048+0000","last_peered":"2024-09-21T05:52:48.011048+0000","last_clean":"2024-09-21T05:52:48.011048+0000","last_became_active":"2024-09-21T05:51:03.938856+0000","last_became_peered":"2024-09-21T05:51:03.938856+0000","last_unstale":"2024-09-21T05:52:48.011048+0000","last_undegraded":"2024-09-21T05:52:48.011048+0000","last_fullsized":"2024-09-21T05:52:48.011048+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:12.111775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.676219+0000","last_change":"2024-09-21T05:50:53.891676+0000","last_active":"2024-09-21T05:52:47.676219+0000","last_peered":"2024-09-21T05:52:47.676219+0000","last_clean":"2024-09-21T05:52:47.676219+0000","last_became_active":"2024-09-21T05:50:53.891339+0000","last_became_peered":"2024-09-21T05:50:53.891339+0000","last_unstale":"2024-09-21T05:52:47.676219+0000","last_undegraded":"2024-09-21T05:52:47.676219+0000","last_fullsized":"2024-09-21T05:52:47.676219+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:41.707680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675376+0000","last_change":"2024-09-21T05:50:51.162492+0000","last_active":"2024-09-21T05:52:47.675376+0000","last_peered":"2024-09-21T05:52:47.675376+0000","last_clean":"2024-09-21T05:52:47.675376+0000","last_became_active":"2024-09-21T05:50:51.162108+0000","last_became_peered":"2024-09-21T05:50:51.162108+0000","last_unstale":"2024-09-21T05:52:47.675376+0000","last_undegraded":"2024-09-21T05:52:47.675376+0000","last_fullsized":"2024-09-21T05:52:47.675376+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.387568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698973+0000","last_change":"2024-09-21T05:51:03.992550+0000","last_active":"2024-09-21T05:52:47.698973+0000","last_peered":"2024-09-21T05:52:47.698973+0000","last_clean":"2024-09-21T05:52:47.698973+0000","last_became_active":"2024-09-21T05:51:03.991865+0000","last_became_peered":"2024-09-21T05:51:03.991865+0000","last_unstale":"2024-09-21T05:52:47.698973+0000","last_undegraded":"2024-09-21T05:52:47.698973+0000","last_fullsized":"2024-09-21T05:52:47.698973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:50.204058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674781+0000","last_change":"2024-09-21T05:50:53.884376+0000","last_active":"2024-09-21T05:52:47.674781+0000","last_peered":"2024-09-21T05:52:47.674781+0000","last_clean":"2024-09-21T05:52:47.674781+0000","last_became_active":"2024-09-21T05:50:53.884033+0000","last_became_peered":"2024-09-21T05:50:53.884033+0000","last_unstale":"2024-09-21T05:52:47.674781+0000","last_undegraded":"2024-09-21T05:52:47.674781+0000","last_fullsized":"2024-09-21T05:52:47.674781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.359191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699346+0000","last_change":"2024-09-21T05:50:50.869502+0000","last_active":"2024-09-21T05:52:47.699346+0000","last_peered":"2024-09-21T05:52:47.699346+0000","last_clean":"2024-09-21T05:52:47.699346+0000","last_became_active":"2024-09-21T05:50:50.869071+0000","last_became_peered":"2024-09-21T05:50:50.869071+0000","last_unstale":"2024-09-21T05:52:47.699346+0000","last_undegraded":"2024-09-21T05:52:47.699346+0000","last_fullsized":"2024-09-21T05:52:47.699346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:48.364902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678114+0000","last_change":"2024-09-21T05:51:03.931945+0000","last_active":"2024-09-21T05:52:47.678114+0000","last_peered":"2024-09-21T05:52:47.678114+0000","last_clean":"2024-09-21T05:52:47.678114+0000","last_became_active":"2024-09-21T05:51:03.931411+0000","last_became_peered":"2024-09-21T05:51:03.931411+0000","last_unstale":"2024-09-21T05:52:47.678114+0000","last_undegraded":"2024-09-21T05:52:47.678114+0000","last_fullsized":"2024-09-21T05:52:47.678114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.910547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321735+0000","last_change":"2024-09-21T05:50:53.897995+0000","last_active":"2024-09-21T05:52:48.321735+0000","last_peered":"2024-09-21T05:52:48.321735+0000","last_clean":"2024-09-21T05:52:48.321735+0000","last_became_active":"2024-09-21T05:50:53.895797+0000","last_became_peered":"2024-09-21T05:50:53.895797+0000","last_unstale":"2024-09-21T05:52:48.321735+0000","last_undegraded":"2024-09-21T05:52:48.321735+0000","last_fullsized":"2024-09-21T05:52:48.321735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.484867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'9","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012571+0000","last_change":"2024-09-21T05:50:50.845853+0000","last_active":"2024-09-21T05:52:48.012571+0000","last_peered":"2024-09-21T05:52:48.012571+0000","last_clean":"2024-09-21T05:52:48.012571+0000","last_became_active":"2024-09-21T05:50:50.845495+0000","last_became_peered":"2024-09-21T05:50:50.845495+0000","last_unstale":"2024-09-21T05:52:48.012571+0000","last_undegraded":"2024-09-21T05:52:48.012571+0000","last_fullsized":"2024-09-21T05:52:48.012571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:47.960498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.320605+0000","last_change":"2024-09-21T05:51:03.991380+0000","last_active":"2024-09-21T05:52:48.320605+0000","last_peered":"2024-09-21T05:52:48.320605+0000","last_clean":"2024-09-21T05:52:48.320605+0000","last_became_active":"2024-09-21T05:51:03.990911+0000","last_became_peered":"2024-09-21T05:51:03.990911+0000","last_unstale":"2024-09-21T05:52:48.320605+0000","last_undegraded":"2024-09-21T05:52:48.320605+0000","last_fullsized":"2024-09-21T05:52:48.320605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:01.779692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011345+0000","last_change":"2024-09-21T05:50:53.910190+0000","last_active":"2024-09-21T05:52:48.011345+0000","last_peered":"2024-09-21T05:52:48.011345+0000","last_clean":"2024-09-21T05:52:48.011345+0000","last_became_active":"2024-09-21T05:50:53.909649+0000","last_became_peered":"2024-09-21T05:50:53.909649+0000","last_unstale":"2024-09-21T05:52:48.011345+0000","last_undegraded":"2024-09-21T05:52:48.011345+0000","last_fullsized":"2024-09-21T05:52:48.011345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:14.582217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677426+0000","last_change":"2024-09-21T05:50:51.163512+0000","last_active":"2024-09-21T05:52:47.677426+0000","last_peered":"2024-09-21T05:52:47.677426+0000","last_clean":"2024-09-21T05:52:47.677426+0000","last_became_active":"2024-09-21T05:50:51.161959+0000","last_became_peered":"2024-09-21T05:50:51.161959+0000","last_unstale":"2024-09-21T05:52:47.677426+0000","last_undegraded":"2024-09-21T05:52:47.677426+0000","last_fullsized":"2024-09-21T05:52:47.677426+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:51.701990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682096+0000","last_change":"2024-09-21T05:51:03.936815+0000","last_active":"2024-09-21T05:52:47.682096+0000","last_peered":"2024-09-21T05:52:47.682096+0000","last_clean":"2024-09-21T05:52:47.682096+0000","last_became_active":"2024-09-21T05:51:03.936365+0000","last_became_peered":"2024-09-21T05:51:03.936365+0000","last_unstale":"2024-09-21T05:52:47.682096+0000","last_undegraded":"2024-09-21T05:52:47.682096+0000","last_fullsized":"2024-09-21T05:52:47.682096+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:59.820159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011086+0000","last_change":"2024-09-21T05:50:53.892772+0000","last_active":"2024-09-21T05:52:48.011086+0000","last_peered":"2024-09-21T05:52:48.011086+0000","last_clean":"2024-09-21T05:52:48.011086+0000","last_became_active":"2024-09-21T05:50:53.892378+0000","last_became_peered":"2024-09-21T05:50:53.892378+0000","last_unstale":"2024-09-21T05:52:48.011086+0000","last_undegraded":"2024-09-21T05:52:48.011086+0000","last_fullsized":"2024-09-21T05:52:48.011086+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:34.438067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011938+0000","last_change":"2024-09-21T05:51:47.378160+0000","last_active":"2024-09-21T05:52:48.011938+0000","last_peered":"2024-09-21T05:52:48.011938+0000","last_clean":"2024-09-21T05:52:48.011938+0000","last_became_active":"2024-09-21T05:51:47.377779+0000","last_became_peered":"2024-09-21T05:51:47.377779+0000","last_unstale":"2024-09-21T05:52:48.011938+0000","last_undegraded":"2024-09-21T05:52:48.011938+0000","last_fullsized":"2024-09-21T05:52:48.011938+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:27.780273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011920+0000","last_change":"2024-09-21T05:52:48.011820+0000","last_active":"2024-09-21T05:52:48.011920+0000","last_peered":"2024-09-21T05:52:48.011920+0000","last_clean":"2024-09-21T05:52:48.011920+0000","last_became_active":"2024-09-21T05:52:48.011191+0000","last_became_peered":"2024-09-21T05:52:48.011191+0000","last_unstale":"2024-09-21T05:52:48.011920+0000","last_undegraded":"2024-09-21T05:52:48.011920+0000","last_fullsized":"2024-09-21T05:52:48.011920+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:45.598281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010809+0000","last_change":"2024-09-21T05:50:53.899306+0000","last_active":"2024-09-21T05:52:48.010809+0000","last_peered":"2024-09-21T05:52:48.010809+0000","last_clean":"2024-09-21T05:52:48.010809+0000","last_became_active":"2024-09-21T05:50:53.898921+0000","last_became_peered":"2024-09-21T05:50:53.898921+0000","last_unstale":"2024-09-21T05:52:48.010809+0000","last_undegraded":"2024-09-21T05:52:48.010809+0000","last_fullsized":"2024-09-21T05:52:48.010809+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:45.698584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681138+0000","last_change":"2024-09-21T05:50:50.844394+0000","last_active":"2024-09-21T05:52:47.681138+0000","last_peered":"2024-09-21T05:52:47.681138+0000","last_clean":"2024-09-21T05:52:47.681138+0000","last_became_active":"2024-09-21T05:50:50.843771+0000","last_became_peered":"2024-09-21T05:50:50.843771+0000","last_unstale":"2024-09-21T05:52:47.681138+0000","last_undegraded":"2024-09-21T05:52:47.681138+0000","last_fullsized":"2024-09-21T05:52:47.681138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:14.372917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009704+0000","last_change":"2024-09-21T05:51:03.941277+0000","last_active":"2024-09-21T05:52:48.009704+0000","last_peered":"2024-09-21T05:52:48.009704+0000","last_clean":"2024-09-21T05:52:48.009704+0000","last_became_active":"2024-09-21T05:51:03.940659+0000","last_became_peered":"2024-09-21T05:51:03.940659+0000","last_unstale":"2024-09-21T05:52:48.009704+0000","last_undegraded":"2024-09-21T05:52:48.009704+0000","last_fullsized":"2024-09-21T05:52:48.009704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:40.217023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010255+0000","last_change":"2024-09-21T05:50:53.895399+0000","last_active":"2024-09-21T05:52:48.010255+0000","last_peered":"2024-09-21T05:52:48.010255+0000","last_clean":"2024-09-21T05:52:48.010255+0000","last_became_active":"2024-09-21T05:50:53.895022+0000","last_became_peered":"2024-09-21T05:50:53.895022+0000","last_unstale":"2024-09-21T05:52:48.010255+0000","last_undegraded":"2024-09-21T05:52:48.010255+0000","last_fullsized":"2024-09-21T05:52:48.010255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:02.056015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009992+0000","last_change":"2024-09-21T05:50:51.162215+0000","last_active":"2024-09-21T05:52:48.009992+0000","last_peered":"2024-09-21T05:52:48.009992+0000","last_clean":"2024-09-21T05:52:48.009992+0000","last_became_active":"2024-09-21T05:50:51.161812+0000","last_became_peered":"2024-09-21T05:50:51.161812+0000","last_unstale":"2024-09-21T05:52:48.009992+0000","last_undegraded":"2024-09-21T05:52:48.009992+0000","last_fullsized":"2024-09-21T05:52:48.009992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:05.237806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009787+0000","last_change":"2024-09-21T05:51:03.991488+0000","last_active":"2024-09-21T05:52:48.009787+0000","last_peered":"2024-09-21T05:52:48.009787+0000","last_clean":"2024-09-21T05:52:48.009787+0000","last_became_active":"2024-09-21T05:51:03.990866+0000","last_became_peered":"2024-09-21T05:51:03.990866+0000","last_unstale":"2024-09-21T05:52:48.009787+0000","last_undegraded":"2024-09-21T05:52:48.009787+0000","last_fullsized":"2024-09-21T05:52:48.009787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:41.061421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009724+0000","last_change":"2024-09-21T05:50:53.895076+0000","last_active":"2024-09-21T05:52:48.009724+0000","last_peered":"2024-09-21T05:52:48.009724+0000","last_clean":"2024-09-21T05:52:48.009724+0000","last_became_active":"2024-09-21T05:50:53.893888+0000","last_became_peered":"2024-09-21T05:50:53.893888+0000","last_unstale":"2024-09-21T05:52:48.009724+0000","last_undegraded":"2024-09-21T05:52:48.009724+0000","last_fullsized":"2024-09-21T05:52:48.009724+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:13.397806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681934+0000","last_change":"2024-09-21T05:51:47.376540+0000","last_active":"2024-09-21T05:52:47.681934+0000","last_peered":"2024-09-21T05:52:47.681934+0000","last_clean":"2024-09-21T05:52:47.681934+0000","last_became_active":"2024-09-21T05:51:47.376163+0000","last_became_peered":"2024-09-21T05:51:47.376163+0000","last_unstale":"2024-09-21T05:52:47.681934+0000","last_undegraded":"2024-09-21T05:52:47.681934+0000","last_fullsized":"2024-09-21T05:52:47.681934+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:51.217674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010471+0000","last_change":"2024-09-21T05:51:03.991711+0000","last_active":"2024-09-21T05:52:48.010471+0000","last_peered":"2024-09-21T05:52:48.010471+0000","last_clean":"2024-09-21T05:52:48.010471+0000","last_became_active":"2024-09-21T05:51:03.991200+0000","last_became_peered":"2024-09-21T05:51:03.991200+0000","last_unstale":"2024-09-21T05:52:48.010471+0000","last_undegraded":"2024-09-21T05:52:48.010471+0000","last_fullsized":"2024-09-21T05:52:48.010471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:40.981303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321052+0000","last_change":"2024-09-21T05:50:53.887913+0000","last_active":"2024-09-21T05:52:48.321052+0000","last_peered":"2024-09-21T05:52:48.321052+0000","last_clean":"2024-09-21T05:52:48.321052+0000","last_became_active":"2024-09-21T05:50:53.887583+0000","last_became_peered":"2024-09-21T05:50:53.887583+0000","last_unstale":"2024-09-21T05:52:48.321052+0000","last_undegraded":"2024-09-21T05:52:48.321052+0000","last_fullsized":"2024-09-21T05:52:48.321052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:05.941780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699346+0000","last_change":"2024-09-21T05:50:50.846370+0000","last_active":"2024-09-21T05:52:47.699346+0000","last_peered":"2024-09-21T05:52:47.699346+0000","last_clean":"2024-09-21T05:52:47.699346+0000","last_became_active":"2024-09-21T05:50:50.845890+0000","last_became_peered":"2024-09-21T05:50:50.845890+0000","last_unstale":"2024-09-21T05:52:47.699346+0000","last_undegraded":"2024-09-21T05:52:47.699346+0000","last_fullsized":"2024-09-21T05:52:47.699346+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:15.180734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":118,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.680908+0000","last_change":"2024-09-21T05:49:33.762460+0000","last_active":"2024-09-21T05:52:47.680908+0000","last_peered":"2024-09-21T05:52:47.680908+0000","last_clean":"2024-09-21T05:52:47.680908+0000","last_became_active":"2024-09-21T05:49:33.705194+0000","last_became_peered":"2024-09-21T05:49:33.705194+0000","last_unstale":"2024-09-21T05:52:47.680908+0000","last_undegraded":"2024-09-21T05:52:47.680908+0000","last_fullsized":"2024-09-21T05:52:47.680908+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_clean_scrub_stamp":"2024-09-21T05:45:49.237325+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:39.194122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681293+0000","last_change":"2024-09-21T05:51:03.938790+0000","last_active":"2024-09-21T05:52:47.681293+0000","last_peered":"2024-09-21T05:52:47.681293+0000","last_clean":"2024-09-21T05:52:47.681293+0000","last_became_active":"2024-09-21T05:51:03.938214+0000","last_became_peered":"2024-09-21T05:51:03.938214+0000","last_unstale":"2024-09-21T05:52:47.681293+0000","last_undegraded":"2024-09-21T05:52:47.681293+0000","last_fullsized":"2024-09-21T05:52:47.681293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:11.512500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681482+0000","last_change":"2024-09-21T05:50:53.893475+0000","last_active":"2024-09-21T05:52:47.681482+0000","last_peered":"2024-09-21T05:52:47.681482+0000","last_clean":"2024-09-21T05:52:47.681482+0000","last_became_active":"2024-09-21T05:50:53.892946+0000","last_became_peered":"2024-09-21T05:50:53.892946+0000","last_unstale":"2024-09-21T05:52:47.681482+0000","last_undegraded":"2024-09-21T05:52:47.681482+0000","last_fullsized":"2024-09-21T05:52:47.681482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:23.612285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678664+0000","last_change":"2024-09-21T05:50:51.162170+0000","last_active":"2024-09-21T05:52:47.678664+0000","last_peered":"2024-09-21T05:52:47.678664+0000","last_clean":"2024-09-21T05:52:47.678664+0000","last_became_active":"2024-09-21T05:50:51.161685+0000","last_became_peered":"2024-09-21T05:50:51.161685+0000","last_unstale":"2024-09-21T05:52:47.678664+0000","last_undegraded":"2024-09-21T05:52:47.678664+0000","last_fullsized":"2024-09-21T05:52:47.678664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:14.922423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675213+0000","last_change":"2024-09-21T05:51:03.937061+0000","last_active":"2024-09-21T05:52:47.675213+0000","last_peered":"2024-09-21T05:52:47.675213+0000","last_clean":"2024-09-21T05:52:47.675213+0000","last_became_active":"2024-09-21T05:51:03.936306+0000","last_became_peered":"2024-09-21T05:51:03.936306+0000","last_unstale":"2024-09-21T05:52:47.675213+0000","last_undegraded":"2024-09-21T05:52:47.675213+0000","last_fullsized":"2024-09-21T05:52:47.675213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:51.057973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681242+0000","last_change":"2024-09-21T05:50:53.893930+0000","last_active":"2024-09-21T05:52:47.681242+0000","last_peered":"2024-09-21T05:52:47.681242+0000","last_clean":"2024-09-21T05:52:47.681242+0000","last_became_active":"2024-09-21T05:50:53.893155+0000","last_became_peered":"2024-09-21T05:50:53.893155+0000","last_unstale":"2024-09-21T05:52:47.681242+0000","last_undegraded":"2024-09-21T05:52:47.681242+0000","last_fullsized":"2024-09-21T05:52:47.681242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:46.097408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011000+0000","last_change":"2024-09-21T05:50:50.847890+0000","last_active":"2024-09-21T05:52:48.011000+0000","last_peered":"2024-09-21T05:52:48.011000+0000","last_clean":"2024-09-21T05:52:48.011000+0000","last_became_active":"2024-09-21T05:50:50.847549+0000","last_became_peered":"2024-09-21T05:50:50.847549+0000","last_unstale":"2024-09-21T05:52:48.011000+0000","last_undegraded":"2024-09-21T05:52:48.011000+0000","last_fullsized":"2024-09-21T05:52:48.011000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:14.998849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674457+0000","last_change":"2024-09-21T05:51:03.940674+0000","last_active":"2024-09-21T05:52:47.674457+0000","last_peered":"2024-09-21T05:52:47.674457+0000","last_clean":"2024-09-21T05:52:47.674457+0000","last_became_active":"2024-09-21T05:51:03.940222+0000","last_became_peered":"2024-09-21T05:51:03.940222+0000","last_unstale":"2024-09-21T05:52:47.674457+0000","last_undegraded":"2024-09-21T05:52:47.674457+0000","last_fullsized":"2024-09-21T05:52:47.674457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:58.497147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681539+0000","last_change":"2024-09-21T05:50:53.895191+0000","last_active":"2024-09-21T05:52:47.681539+0000","last_peered":"2024-09-21T05:52:47.681539+0000","last_clean":"2024-09-21T05:52:47.681539+0000","last_became_active":"2024-09-21T05:50:53.892894+0000","last_became_peered":"2024-09-21T05:50:53.892894+0000","last_unstale":"2024-09-21T05:52:47.681539+0000","last_undegraded":"2024-09-21T05:52:47.681539+0000","last_fullsized":"2024-09-21T05:52:47.681539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:41.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011692+0000","last_change":"2024-09-21T05:50:50.844301+0000","last_active":"2024-09-21T05:52:48.011692+0000","last_peered":"2024-09-21T05:52:48.011692+0000","last_clean":"2024-09-21T05:52:48.011692+0000","last_became_active":"2024-09-21T05:50:50.843878+0000","last_became_peered":"2024-09-21T05:50:50.843878+0000","last_unstale":"2024-09-21T05:52:48.011692+0000","last_undegraded":"2024-09-21T05:52:48.011692+0000","last_fullsized":"2024-09-21T05:52:48.011692+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:53.150300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009424+0000","last_change":"2024-09-21T05:51:03.931684+0000","last_active":"2024-09-21T05:52:48.009424+0000","last_peered":"2024-09-21T05:52:48.009424+0000","last_clean":"2024-09-21T05:52:48.009424+0000","last_became_active":"2024-09-21T05:51:03.931225+0000","last_became_peered":"2024-09-21T05:51:03.931225+0000","last_unstale":"2024-09-21T05:52:48.009424+0000","last_undegraded":"2024-09-21T05:52:48.009424+0000","last_fullsized":"2024-09-21T05:52:48.009424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:51.993481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682329+0000","last_change":"2024-09-21T05:50:53.892740+0000","last_active":"2024-09-21T05:52:47.682329+0000","last_peered":"2024-09-21T05:52:47.682329+0000","last_clean":"2024-09-21T05:52:47.682329+0000","last_became_active":"2024-09-21T05:50:53.892381+0000","last_became_peered":"2024-09-21T05:50:53.892381+0000","last_unstale":"2024-09-21T05:52:47.682329+0000","last_undegraded":"2024-09-21T05:52:47.682329+0000","last_fullsized":"2024-09-21T05:52:47.682329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:20.038644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677739+0000","last_change":"2024-09-21T05:50:50.850077+0000","last_active":"2024-09-21T05:52:47.677739+0000","last_peered":"2024-09-21T05:52:47.677739+0000","last_clean":"2024-09-21T05:52:47.677739+0000","last_became_active":"2024-09-21T05:50:50.849553+0000","last_became_peered":"2024-09-21T05:50:50.849553+0000","last_unstale":"2024-09-21T05:52:47.677739+0000","last_undegraded":"2024-09-21T05:52:47.677739+0000","last_fullsized":"2024-09-21T05:52:47.677739+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:09.764465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009424+0000","last_change":"2024-09-21T05:51:03.930231+0000","last_active":"2024-09-21T05:52:48.009424+0000","last_peered":"2024-09-21T05:52:48.009424+0000","last_clean":"2024-09-21T05:52:48.009424+0000","last_became_active":"2024-09-21T05:51:03.929907+0000","last_became_peered":"2024-09-21T05:51:03.929907+0000","last_unstale":"2024-09-21T05:52:48.009424+0000","last_undegraded":"2024-09-21T05:52:48.009424+0000","last_fullsized":"2024-09-21T05:52:48.009424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:18.829725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010293+0000","last_change":"2024-09-21T05:50:53.888988+0000","last_active":"2024-09-21T05:52:48.010293+0000","last_peered":"2024-09-21T05:52:48.010293+0000","last_clean":"2024-09-21T05:52:48.010293+0000","last_became_active":"2024-09-21T05:50:53.888599+0000","last_became_peered":"2024-09-21T05:50:53.888599+0000","last_unstale":"2024-09-21T05:52:48.010293+0000","last_undegraded":"2024-09-21T05:52:48.010293+0000","last_fullsized":"2024-09-21T05:52:48.010293+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:32.353201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677016+0000","last_change":"2024-09-21T05:51:47.383528+0000","last_active":"2024-09-21T05:52:47.677016+0000","last_peered":"2024-09-21T05:52:47.677016+0000","last_clean":"2024-09-21T05:52:47.677016+0000","last_became_active":"2024-09-21T05:51:47.376325+0000","last_became_peered":"2024-09-21T05:51:47.376325+0000","last_unstale":"2024-09-21T05:52:47.677016+0000","last_undegraded":"2024-09-21T05:52:47.677016+0000","last_fullsized":"2024-09-21T05:52:47.677016+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:47.659961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009770+0000","last_change":"2024-09-21T05:51:03.946581+0000","last_active":"2024-09-21T05:52:48.009770+0000","last_peered":"2024-09-21T05:52:48.009770+0000","last_clean":"2024-09-21T05:52:48.009770+0000","last_became_active":"2024-09-21T05:51:03.946170+0000","last_became_peered":"2024-09-21T05:51:03.946170+0000","last_unstale":"2024-09-21T05:52:48.009770+0000","last_undegraded":"2024-09-21T05:52:48.009770+0000","last_fullsized":"2024-09-21T05:52:48.009770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:59.302647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.680732+0000","last_change":"2024-09-21T05:50:53.890164+0000","last_active":"2024-09-21T05:52:47.680732+0000","last_peered":"2024-09-21T05:52:47.680732+0000","last_clean":"2024-09-21T05:52:47.680732+0000","last_became_active":"2024-09-21T05:50:53.889309+0000","last_became_peered":"2024-09-21T05:50:53.889309+0000","last_unstale":"2024-09-21T05:52:47.680732+0000","last_undegraded":"2024-09-21T05:52:47.680732+0000","last_fullsized":"2024-09-21T05:52:47.680732+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:18.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699024+0000","last_change":"2024-09-21T05:50:50.844080+0000","last_active":"2024-09-21T05:52:47.699024+0000","last_peered":"2024-09-21T05:52:47.699024+0000","last_clean":"2024-09-21T05:52:47.699024+0000","last_became_active":"2024-09-21T05:50:50.842929+0000","last_became_peered":"2024-09-21T05:50:50.842929+0000","last_unstale":"2024-09-21T05:52:47.699024+0000","last_undegraded":"2024-09-21T05:52:47.699024+0000","last_fullsized":"2024-09-21T05:52:47.699024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:49.623189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010877+0000","last_change":"2024-09-21T05:51:03.939228+0000","last_active":"2024-09-21T05:52:48.010877+0000","last_peered":"2024-09-21T05:52:48.010877+0000","last_clean":"2024-09-21T05:52:48.010877+0000","last_became_active":"2024-09-21T05:51:03.937857+0000","last_became_peered":"2024-09-21T05:51:03.937857+0000","last_unstale":"2024-09-21T05:52:48.010877+0000","last_undegraded":"2024-09-21T05:52:48.010877+0000","last_fullsized":"2024-09-21T05:52:48.010877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:54.147008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681033+0000","last_change":"2024-09-21T05:50:53.890755+0000","last_active":"2024-09-21T05:52:47.681033+0000","last_peered":"2024-09-21T05:52:47.681033+0000","last_clean":"2024-09-21T05:52:47.681033+0000","last_became_active":"2024-09-21T05:50:53.890286+0000","last_became_peered":"2024-09-21T05:50:53.890286+0000","last_unstale":"2024-09-21T05:52:47.681033+0000","last_undegraded":"2024-09-21T05:52:47.681033+0000","last_fullsized":"2024-09-21T05:52:47.681033+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:50.767355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010323+0000","last_change":"2024-09-21T05:50:50.852722+0000","last_active":"2024-09-21T05:52:48.010323+0000","last_peered":"2024-09-21T05:52:48.010323+0000","last_clean":"2024-09-21T05:52:48.010323+0000","last_became_active":"2024-09-21T05:50:50.852211+0000","last_became_peered":"2024-09-21T05:50:50.852211+0000","last_unstale":"2024-09-21T05:52:48.010323+0000","last_undegraded":"2024-09-21T05:52:48.010323+0000","last_fullsized":"2024-09-21T05:52:48.010323+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:44.392153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.013611+0000","last_change":"2024-09-21T05:52:48.013503+0000","last_active":"2024-09-21T05:52:48.013611+0000","last_peered":"2024-09-21T05:52:48.013611+0000","last_clean":"2024-09-21T05:52:48.013611+0000","last_became_active":"2024-09-21T05:52:48.012908+0000","last_became_peered":"2024-09-21T05:52:48.012908+0000","last_unstale":"2024-09-21T05:52:48.013611+0000","last_undegraded":"2024-09-21T05:52:48.013611+0000","last_fullsized":"2024-09-21T05:52:48.013611+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:59.512334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010252+0000","last_change":"2024-09-21T05:50:53.903935+0000","last_active":"2024-09-21T05:52:48.010252+0000","last_peered":"2024-09-21T05:52:48.010252+0000","last_clean":"2024-09-21T05:52:48.010252+0000","last_became_active":"2024-09-21T05:50:53.903604+0000","last_became_peered":"2024-09-21T05:50:53.903604+0000","last_unstale":"2024-09-21T05:52:48.010252+0000","last_undegraded":"2024-09-21T05:52:48.010252+0000","last_fullsized":"2024-09-21T05:52:48.010252+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:49.552901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678622+0000","last_change":"2024-09-21T05:50:50.848254+0000","last_active":"2024-09-21T05:52:47.678622+0000","last_peered":"2024-09-21T05:52:47.678622+0000","last_clean":"2024-09-21T05:52:47.678622+0000","last_became_active":"2024-09-21T05:50:50.847834+0000","last_became_peered":"2024-09-21T05:50:50.847834+0000","last_unstale":"2024-09-21T05:52:47.678622+0000","last_undegraded":"2024-09-21T05:52:47.678622+0000","last_fullsized":"2024-09-21T05:52:47.678622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:36.579763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009513+0000","last_change":"2024-09-21T05:51:03.941732+0000","last_active":"2024-09-21T05:52:48.009513+0000","last_peered":"2024-09-21T05:52:48.009513+0000","last_clean":"2024-09-21T05:52:48.009513+0000","last_became_active":"2024-09-21T05:51:03.941144+0000","last_became_peered":"2024-09-21T05:51:03.941144+0000","last_unstale":"2024-09-21T05:52:48.009513+0000","last_undegraded":"2024-09-21T05:52:48.009513+0000","last_fullsized":"2024-09-21T05:52:48.009513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:38.117642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677129+0000","last_change":"2024-09-21T05:50:53.904574+0000","last_active":"2024-09-21T05:52:47.677129+0000","last_peered":"2024-09-21T05:52:47.677129+0000","last_clean":"2024-09-21T05:52:47.677129+0000","last_became_active":"2024-09-21T05:50:53.904215+0000","last_became_peered":"2024-09-21T05:50:53.904215+0000","last_unstale":"2024-09-21T05:52:47.677129+0000","last_undegraded":"2024-09-21T05:52:47.677129+0000","last_fullsized":"2024-09-21T05:52:47.677129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:49.662725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'33","reported_seq":215,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:50.498223+0000","last_change":"2024-09-21T05:50:50.850929+0000","last_active":"2024-09-21T05:52:50.498223+0000","last_peered":"2024-09-21T05:52:50.498223+0000","last_clean":"2024-09-21T05:52:50.498223+0000","last_became_active":"2024-09-21T05:50:50.850495+0000","last_became_peered":"2024-09-21T05:50:50.850495+0000","last_unstale":"2024-09-21T05:52:50.498223+0000","last_undegraded":"2024-09-21T05:52:50.498223+0000","last_fullsized":"2024-09-21T05:52:50.498223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:45.224063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69267,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":33,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011469+0000","last_change":"2024-09-21T05:51:03.944010+0000","last_active":"2024-09-21T05:52:48.011469+0000","last_peered":"2024-09-21T05:52:48.011469+0000","last_clean":"2024-09-21T05:52:48.011469+0000","last_became_active":"2024-09-21T05:51:03.942942+0000","last_became_peered":"2024-09-21T05:51:03.942942+0000","last_unstale":"2024-09-21T05:52:48.011469+0000","last_undegraded":"2024-09-21T05:52:48.011469+0000","last_fullsized":"2024-09-21T05:52:48.011469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:38.846493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675534+0000","last_change":"2024-09-21T05:51:47.376326+0000","last_active":"2024-09-21T05:52:47.675534+0000","last_peered":"2024-09-21T05:52:47.675534+0000","last_clean":"2024-09-21T05:52:47.675534+0000","last_became_active":"2024-09-21T05:51:47.375993+0000","last_became_peered":"2024-09-21T05:51:47.375993+0000","last_unstale":"2024-09-21T05:52:47.675534+0000","last_undegraded":"2024-09-21T05:52:47.675534+0000","last_fullsized":"2024-09-21T05:52:47.675534+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:13.193571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010813+0000","last_change":"2024-09-21T05:50:51.162682+0000","last_active":"2024-09-21T05:52:48.010813+0000","last_peered":"2024-09-21T05:52:48.010813+0000","last_clean":"2024-09-21T05:52:48.010813+0000","last_became_active":"2024-09-21T05:50:51.162244+0000","last_became_peered":"2024-09-21T05:50:51.162244+0000","last_unstale":"2024-09-21T05:52:48.010813+0000","last_undegraded":"2024-09-21T05:52:48.010813+0000","last_fullsized":"2024-09-21T05:52:48.010813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.595096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699011+0000","last_change":"2024-09-21T05:51:03.939666+0000","last_active":"2024-09-21T05:52:47.699011+0000","last_peered":"2024-09-21T05:52:47.699011+0000","last_clean":"2024-09-21T05:52:47.699011+0000","last_became_active":"2024-09-21T05:51:03.938311+0000","last_became_peered":"2024-09-21T05:51:03.938311+0000","last_unstale":"2024-09-21T05:52:47.699011+0000","last_undegraded":"2024-09-21T05:52:47.699011+0000","last_fullsized":"2024-09-21T05:52:47.699011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:31.407900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674955+0000","last_change":"2024-09-21T05:51:47.588416+0000","last_active":"2024-09-21T05:52:47.674955+0000","last_peered":"2024-09-21T05:52:47.674955+0000","last_clean":"2024-09-21T05:52:47.674955+0000","last_became_active":"2024-09-21T05:51:47.587905+0000","last_became_peered":"2024-09-21T05:51:47.587905+0000","last_unstale":"2024-09-21T05:52:47.674955+0000","last_undegraded":"2024-09-21T05:52:47.674955+0000","last_fullsized":"2024-09-21T05:52:47.674955+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:05.821048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681402+0000","last_change":"2024-09-21T05:50:50.846164+0000","last_active":"2024-09-21T05:52:47.681402+0000","last_peered":"2024-09-21T05:52:47.681402+0000","last_clean":"2024-09-21T05:52:47.681402+0000","last_became_active":"2024-09-21T05:50:50.845775+0000","last_became_peered":"2024-09-21T05:50:50.845775+0000","last_unstale":"2024-09-21T05:52:47.681402+0000","last_undegraded":"2024-09-21T05:52:47.681402+0000","last_fullsized":"2024-09-21T05:52:47.681402+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:45.356626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.701383+0000","last_change":"2024-09-21T05:52:47.700832+0000","last_active":"2024-09-21T05:52:47.701383+0000","last_peered":"2024-09-21T05:52:47.701383+0000","last_clean":"2024-09-21T05:52:47.701383+0000","last_became_active":"2024-09-21T05:52:47.700372+0000","last_became_peered":"2024-09-21T05:52:47.700372+0000","last_unstale":"2024-09-21T05:52:47.701383+0000","last_undegraded":"2024-09-21T05:52:47.701383+0000","last_fullsized":"2024-09-21T05:52:47.701383+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.887433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675865+0000","last_change":"2024-09-21T05:50:53.903005+0000","last_active":"2024-09-21T05:52:47.675865+0000","last_peered":"2024-09-21T05:52:47.675865+0000","last_clean":"2024-09-21T05:52:47.675865+0000","last_became_active":"2024-09-21T05:50:53.902590+0000","last_became_peered":"2024-09-21T05:50:53.902590+0000","last_unstale":"2024-09-21T05:52:47.675865+0000","last_undegraded":"2024-09-21T05:52:47.675865+0000","last_fullsized":"2024-09-21T05:52:47.675865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:46.602723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011586+0000","last_change":"2024-09-21T05:50:50.846682+0000","last_active":"2024-09-21T05:52:48.011586+0000","last_peered":"2024-09-21T05:52:48.011586+0000","last_clean":"2024-09-21T05:52:48.011586+0000","last_became_active":"2024-09-21T05:50:50.846305+0000","last_became_peered":"2024-09-21T05:50:50.846305+0000","last_unstale":"2024-09-21T05:52:48.011586+0000","last_undegraded":"2024-09-21T05:52:48.011586+0000","last_fullsized":"2024-09-21T05:52:48.011586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:30.946247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.320608+0000","last_change":"2024-09-21T05:51:03.931781+0000","last_active":"2024-09-21T05:52:48.320608+0000","last_peered":"2024-09-21T05:52:48.320608+0000","last_clean":"2024-09-21T05:52:48.320608+0000","last_became_active":"2024-09-21T05:51:03.930921+0000","last_became_peered":"2024-09-21T05:51:03.930921+0000","last_unstale":"2024-09-21T05:52:48.320608+0000","last_undegraded":"2024-09-21T05:52:48.320608+0000","last_fullsized":"2024-09-21T05:52:48.320608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:03.284929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674665+0000","last_change":"2024-09-21T05:51:03.947521+0000","last_active":"2024-09-21T05:52:47.674665+0000","last_peered":"2024-09-21T05:52:47.674665+0000","last_clean":"2024-09-21T05:52:47.674665+0000","last_became_active":"2024-09-21T05:51:03.947074+0000","last_became_peered":"2024-09-21T05:51:03.947074+0000","last_unstale":"2024-09-21T05:52:47.674665+0000","last_undegraded":"2024-09-21T05:52:47.674665+0000","last_fullsized":"2024-09-21T05:52:47.674665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:51.313988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011333+0000","last_change":"2024-09-21T05:50:53.911791+0000","last_active":"2024-09-21T05:52:48.011333+0000","last_peered":"2024-09-21T05:52:48.011333+0000","last_clean":"2024-09-21T05:52:48.011333+0000","last_became_active":"2024-09-21T05:50:53.911392+0000","last_became_peered":"2024-09-21T05:50:53.911392+0000","last_unstale":"2024-09-21T05:52:48.011333+0000","last_undegraded":"2024-09-21T05:52:48.011333+0000","last_fullsized":"2024-09-21T05:52:48.011333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:45.688626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010622+0000","last_change":"2024-09-21T05:50:50.853383+0000","last_active":"2024-09-21T05:52:48.010622+0000","last_peered":"2024-09-21T05:52:48.010622+0000","last_clean":"2024-09-21T05:52:48.010622+0000","last_became_active":"2024-09-21T05:50:50.853006+0000","last_became_peered":"2024-09-21T05:50:50.853006+0000","last_unstale":"2024-09-21T05:52:48.010622+0000","last_undegraded":"2024-09-21T05:52:48.010622+0000","last_fullsized":"2024-09-21T05:52:48.010622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:14.838953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682453+0000","last_change":"2024-09-21T05:51:03.945415+0000","last_active":"2024-09-21T05:52:47.682453+0000","last_peered":"2024-09-21T05:52:47.682453+0000","last_clean":"2024-09-21T05:52:47.682453+0000","last_became_active":"2024-09-21T05:51:03.945019+0000","last_became_peered":"2024-09-21T05:51:03.945019+0000","last_unstale":"2024-09-21T05:52:47.682453+0000","last_undegraded":"2024-09-21T05:52:47.682453+0000","last_fullsized":"2024-09-21T05:52:47.682453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:27.006823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321042+0000","last_change":"2024-09-21T05:50:53.897515+0000","last_active":"2024-09-21T05:52:48.321042+0000","last_peered":"2024-09-21T05:52:48.321042+0000","last_clean":"2024-09-21T05:52:48.321042+0000","last_became_active":"2024-09-21T05:50:53.897070+0000","last_became_peered":"2024-09-21T05:50:53.897070+0000","last_unstale":"2024-09-21T05:52:48.321042+0000","last_undegraded":"2024-09-21T05:52:48.321042+0000","last_fullsized":"2024-09-21T05:52:48.321042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:16.971379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009873+0000","last_change":"2024-09-21T05:50:50.844937+0000","last_active":"2024-09-21T05:52:48.009873+0000","last_peered":"2024-09-21T05:52:48.009873+0000","last_clean":"2024-09-21T05:52:48.009873+0000","last_became_active":"2024-09-21T05:50:50.844048+0000","last_became_peered":"2024-09-21T05:50:50.844048+0000","last_unstale":"2024-09-21T05:52:48.009873+0000","last_undegraded":"2024-09-21T05:52:48.009873+0000","last_fullsized":"2024-09-21T05:52:48.009873+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:28.764620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010572+0000","last_change":"2024-09-21T05:51:47.587919+0000","last_active":"2024-09-21T05:52:48.010572+0000","last_peered":"2024-09-21T05:52:48.010572+0000","last_clean":"2024-09-21T05:52:48.010572+0000","last_became_active":"2024-09-21T05:51:47.587418+0000","last_became_peered":"2024-09-21T05:51:47.587418+0000","last_unstale":"2024-09-21T05:52:48.010572+0000","last_undegraded":"2024-09-21T05:52:48.010572+0000","last_fullsized":"2024-09-21T05:52:48.010572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:29.800848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010290+0000","last_change":"2024-09-21T05:50:53.890761+0000","last_active":"2024-09-21T05:52:48.010290+0000","last_peered":"2024-09-21T05:52:48.010290+0000","last_clean":"2024-09-21T05:52:48.010290+0000","last_became_active":"2024-09-21T05:50:53.890394+0000","last_became_peered":"2024-09-21T05:50:53.890394+0000","last_unstale":"2024-09-21T05:52:48.010290+0000","last_undegraded":"2024-09-21T05:52:48.010290+0000","last_fullsized":"2024-09-21T05:52:48.010290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.176920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.014167+0000","last_change":"2024-09-21T05:52:48.014051+0000","last_active":"2024-09-21T05:52:48.014167+0000","last_peered":"2024-09-21T05:52:48.014167+0000","last_clean":"2024-09-21T05:52:48.014167+0000","last_became_active":"2024-09-21T05:52:48.013422+0000","last_became_peered":"2024-09-21T05:52:48.013422+0000","last_unstale":"2024-09-21T05:52:48.014167+0000","last_undegraded":"2024-09-21T05:52:48.014167+0000","last_fullsized":"2024-09-21T05:52:48.014167+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:18.380310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,10],"acting":[2,6,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010581+0000","last_change":"2024-09-21T05:50:50.852630+0000","last_active":"2024-09-21T05:52:48.010581+0000","last_peered":"2024-09-21T05:52:48.010581+0000","last_clean":"2024-09-21T05:52:48.010581+0000","last_became_active":"2024-09-21T05:50:50.852255+0000","last_became_peered":"2024-09-21T05:50:50.852255+0000","last_unstale":"2024-09-21T05:52:48.010581+0000","last_undegraded":"2024-09-21T05:52:48.010581+0000","last_fullsized":"2024-09-21T05:52:48.010581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:18.094082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.676420+0000","last_change":"2024-09-21T05:50:53.902303+0000","last_active":"2024-09-21T05:52:47.676420+0000","last_peered":"2024-09-21T05:52:47.676420+0000","last_clean":"2024-09-21T05:52:47.676420+0000","last_became_active":"2024-09-21T05:50:53.901910+0000","last_became_peered":"2024-09-21T05:50:53.901910+0000","last_unstale":"2024-09-21T05:52:47.676420+0000","last_undegraded":"2024-09-21T05:52:47.676420+0000","last_fullsized":"2024-09-21T05:52:47.676420+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:06.651235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678933+0000","last_change":"2024-09-21T05:51:03.932268+0000","last_active":"2024-09-21T05:52:47.678933+0000","last_peered":"2024-09-21T05:52:47.678933+0000","last_clean":"2024-09-21T05:52:47.678933+0000","last_became_active":"2024-09-21T05:51:03.931849+0000","last_became_peered":"2024-09-21T05:51:03.931849+0000","last_unstale":"2024-09-21T05:52:47.678933+0000","last_undegraded":"2024-09-21T05:52:47.678933+0000","last_fullsized":"2024-09-21T05:52:47.678933+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:53.622621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682511+0000","last_change":"2024-09-21T05:50:53.897205+0000","last_active":"2024-09-21T05:52:47.682511+0000","last_peered":"2024-09-21T05:52:47.682511+0000","last_clean":"2024-09-21T05:52:47.682511+0000","last_became_active":"2024-09-21T05:50:53.896811+0000","last_became_peered":"2024-09-21T05:50:53.896811+0000","last_unstale":"2024-09-21T05:52:47.682511+0000","last_undegraded":"2024-09-21T05:52:47.682511+0000","last_fullsized":"2024-09-21T05:52:47.682511+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:13.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678268+0000","last_change":"2024-09-21T05:51:47.376606+0000","last_active":"2024-09-21T05:52:47.678268+0000","last_peered":"2024-09-21T05:52:47.678268+0000","last_clean":"2024-09-21T05:52:47.678268+0000","last_became_active":"2024-09-21T05:51:47.376203+0000","last_became_peered":"2024-09-21T05:51:47.376203+0000","last_unstale":"2024-09-21T05:52:47.678268+0000","last_undegraded":"2024-09-21T05:52:47.678268+0000","last_fullsized":"2024-09-21T05:52:47.678268+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:34.698021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678067+0000","last_change":"2024-09-21T05:50:53.910991+0000","last_active":"2024-09-21T05:52:47.678067+0000","last_peered":"2024-09-21T05:52:47.678067+0000","last_clean":"2024-09-21T05:52:47.678067+0000","last_became_active":"2024-09-21T05:50:53.910720+0000","last_became_peered":"2024-09-21T05:50:53.910720+0000","last_unstale":"2024-09-21T05:52:47.678067+0000","last_undegraded":"2024-09-21T05:52:47.678067+0000","last_fullsized":"2024-09-21T05:52:47.678067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.653746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674557+0000","last_change":"2024-09-21T05:50:53.894065+0000","last_active":"2024-09-21T05:52:47.674557+0000","last_peered":"2024-09-21T05:52:47.674557+0000","last_clean":"2024-09-21T05:52:47.674557+0000","last_became_active":"2024-09-21T05:50:53.892630+0000","last_became_peered":"2024-09-21T05:50:53.892630+0000","last_unstale":"2024-09-21T05:52:47.674557+0000","last_undegraded":"2024-09-21T05:52:47.674557+0000","last_fullsized":"2024-09-21T05:52:47.674557+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:09.025667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011281+0000","last_change":"2024-09-21T05:50:53.899586+0000","last_active":"2024-09-21T05:52:48.011281+0000","last_peered":"2024-09-21T05:52:48.011281+0000","last_clean":"2024-09-21T05:52:48.011281+0000","last_became_active":"2024-09-21T05:50:53.899066+0000","last_became_peered":"2024-09-21T05:50:53.899066+0000","last_unstale":"2024-09-21T05:52:48.011281+0000","last_undegraded":"2024-09-21T05:52:48.011281+0000","last_fullsized":"2024-09-21T05:52:48.011281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:07.678164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682523+0000","last_change":"2024-09-21T05:51:47.375063+0000","last_active":"2024-09-21T05:52:47.682523+0000","last_peered":"2024-09-21T05:52:47.682523+0000","last_clean":"2024-09-21T05:52:47.682523+0000","last_became_active":"2024-09-21T05:51:47.374645+0000","last_became_peered":"2024-09-21T05:51:47.374645+0000","last_unstale":"2024-09-21T05:52:47.682523+0000","last_undegraded":"2024-09-21T05:52:47.682523+0000","last_fullsized":"2024-09-21T05:52:47.682523+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:29.572438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.679639+0000","last_change":"2024-09-21T05:50:53.901688+0000","last_active":"2024-09-21T05:52:47.679639+0000","last_peered":"2024-09-21T05:52:47.679639+0000","last_clean":"2024-09-21T05:52:47.679639+0000","last_became_active":"2024-09-21T05:50:53.901245+0000","last_became_peered":"2024-09-21T05:50:53.901245+0000","last_unstale":"2024-09-21T05:52:47.679639+0000","last_undegraded":"2024-09-21T05:52:47.679639+0000","last_fullsized":"2024-09-21T05:52:47.679639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:41.401357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321731+0000","last_change":"2024-09-21T05:50:53.908954+0000","last_active":"2024-09-21T05:52:48.321731+0000","last_peered":"2024-09-21T05:52:48.321731+0000","last_clean":"2024-09-21T05:52:48.321731+0000","last_became_active":"2024-09-21T05:50:53.897605+0000","last_became_peered":"2024-09-21T05:50:53.897605+0000","last_unstale":"2024-09-21T05:52:48.321731+0000","last_undegraded":"2024-09-21T05:52:48.321731+0000","last_fullsized":"2024-09-21T05:52:48.321731+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:15.634597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010197+0000","last_change":"2024-09-21T05:50:53.900106+0000","last_active":"2024-09-21T05:52:48.010197+0000","last_peered":"2024-09-21T05:52:48.010197+0000","last_clean":"2024-09-21T05:52:48.010197+0000","last_became_active":"2024-09-21T05:50:53.899697+0000","last_became_peered":"2024-09-21T05:50:53.899697+0000","last_unstale":"2024-09-21T05:52:48.010197+0000","last_undegraded":"2024-09-21T05:52:48.010197+0000","last_fullsized":"2024-09-21T05:52:48.010197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.599501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321285+0000","last_change":"2024-09-21T05:50:53.899644+0000","last_active":"2024-09-21T05:52:48.321285+0000","last_peered":"2024-09-21T05:52:48.321285+0000","last_clean":"2024-09-21T05:52:48.321285+0000","last_became_active":"2024-09-21T05:50:53.899246+0000","last_became_peered":"2024-09-21T05:50:53.899246+0000","last_unstale":"2024-09-21T05:52:48.321285+0000","last_undegraded":"2024-09-21T05:52:48.321285+0000","last_fullsized":"2024-09-21T05:52:48.321285+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:34.551489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675389+0000","last_change":"2024-09-21T05:50:53.904328+0000","last_active":"2024-09-21T05:52:47.675389+0000","last_peered":"2024-09-21T05:52:47.675389+0000","last_clean":"2024-09-21T05:52:47.675389+0000","last_became_active":"2024-09-21T05:50:53.903887+0000","last_became_peered":"2024-09-21T05:50:53.903887+0000","last_unstale":"2024-09-21T05:52:47.675389+0000","last_undegraded":"2024-09-21T05:52:47.675389+0000","last_fullsized":"2024-09-21T05:52:47.675389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:27.659631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011038+0000","last_change":"2024-09-21T05:50:53.905278+0000","last_active":"2024-09-21T05:52:48.011038+0000","last_peered":"2024-09-21T05:52:48.011038+0000","last_clean":"2024-09-21T05:52:48.011038+0000","last_became_active":"2024-09-21T05:50:53.904633+0000","last_became_peered":"2024-09-21T05:50:53.904633+0000","last_unstale":"2024-09-21T05:52:48.011038+0000","last_undegraded":"2024-09-21T05:52:48.011038+0000","last_fullsized":"2024-09-21T05:52:48.011038+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:26.802336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682752+0000","last_change":"2024-09-21T05:50:53.891621+0000","last_active":"2024-09-21T05:52:47.682752+0000","last_peered":"2024-09-21T05:52:47.682752+0000","last_clean":"2024-09-21T05:52:47.682752+0000","last_became_active":"2024-09-21T05:50:53.891246+0000","last_became_peered":"2024-09-21T05:50:53.891246+0000","last_unstale":"2024-09-21T05:52:47.682752+0000","last_undegraded":"2024-09-21T05:52:47.682752+0000","last_fullsized":"2024-09-21T05:52:47.682752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:21.419789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.679066+0000","last_change":"2024-09-21T05:50:53.902964+0000","last_active":"2024-09-21T05:52:47.679066+0000","last_peered":"2024-09-21T05:52:47.679066+0000","last_clean":"2024-09-21T05:52:47.679066+0000","last_became_active":"2024-09-21T05:50:53.902574+0000","last_became_peered":"2024-09-21T05:50:53.902574+0000","last_unstale":"2024-09-21T05:52:47.679066+0000","last_undegraded":"2024-09-21T05:52:47.679066+0000","last_fullsized":"2024-09-21T05:52:47.679066+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:35.552787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012516+0000","last_change":"2024-09-21T05:50:53.904717+0000","last_active":"2024-09-21T05:52:48.012516+0000","last_peered":"2024-09-21T05:52:48.012516+0000","last_clean":"2024-09-21T05:52:48.012516+0000","last_became_active":"2024-09-21T05:50:53.903152+0000","last_became_peered":"2024-09-21T05:50:53.903152+0000","last_unstale":"2024-09-21T05:52:48.012516+0000","last_undegraded":"2024-09-21T05:52:48.012516+0000","last_fullsized":"2024-09-21T05:52:48.012516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:56.808689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682887+0000","last_change":"2024-09-21T05:50:53.906336+0000","last_active":"2024-09-21T05:52:47.682887+0000","last_peered":"2024-09-21T05:52:47.682887+0000","last_clean":"2024-09-21T05:52:47.682887+0000","last_became_active":"2024-09-21T05:50:53.905942+0000","last_became_peered":"2024-09-21T05:50:53.905942+0000","last_unstale":"2024-09-21T05:52:47.682887+0000","last_undegraded":"2024-09-21T05:52:47.682887+0000","last_fullsized":"2024-09-21T05:52:47.682887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:26.824967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675200+0000","last_change":"2024-09-21T05:50:53.910772+0000","last_active":"2024-09-21T05:52:47.675200+0000","last_peered":"2024-09-21T05:52:47.675200+0000","last_clean":"2024-09-21T05:52:47.675200+0000","last_became_active":"2024-09-21T05:50:53.910394+0000","last_became_peered":"2024-09-21T05:50:53.910394+0000","last_unstale":"2024-09-21T05:52:47.675200+0000","last_undegraded":"2024-09-21T05:52:47.675200+0000","last_fullsized":"2024-09-21T05:52:47.675200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:00.338916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674332+0000","last_change":"2024-09-21T05:50:53.906454+0000","last_active":"2024-09-21T05:52:47.674332+0000","last_peered":"2024-09-21T05:52:47.674332+0000","last_clean":"2024-09-21T05:52:47.674332+0000","last_became_active":"2024-09-21T05:50:53.905947+0000","last_became_peered":"2024-09-21T05:50:53.905947+0000","last_unstale":"2024-09-21T05:52:47.674332+0000","last_undegraded":"2024-09-21T05:52:47.674332+0000","last_fullsized":"2024-09-21T05:52:47.674332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:57.358615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674433+0000","last_change":"2024-09-21T05:50:53.903690+0000","last_active":"2024-09-21T05:52:47.674433+0000","last_peered":"2024-09-21T05:52:47.674433+0000","last_clean":"2024-09-21T05:52:47.674433+0000","last_became_active":"2024-09-21T05:50:53.900672+0000","last_became_peered":"2024-09-21T05:50:53.900672+0000","last_unstale":"2024-09-21T05:52:47.674433+0000","last_undegraded":"2024-09-21T05:52:47.674433+0000","last_fullsized":"2024-09-21T05:52:47.674433+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:42.005312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010976+0000","last_change":"2024-09-21T05:50:53.888711+0000","last_active":"2024-09-21T05:52:48.010976+0000","last_peered":"2024-09-21T05:52:48.010976+0000","last_clean":"2024-09-21T05:52:48.010976+0000","last_became_active":"2024-09-21T05:50:53.888302+0000","last_became_peered":"2024-09-21T05:50:53.888302+0000","last_unstale":"2024-09-21T05:52:48.010976+0000","last_undegraded":"2024-09-21T05:52:48.010976+0000","last_fullsized":"2024-09-21T05:52:48.010976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:25.766696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699100+0000","last_change":"2024-09-21T05:50:53.898848+0000","last_active":"2024-09-21T05:52:47.699100+0000","last_peered":"2024-09-21T05:52:47.699100+0000","last_clean":"2024-09-21T05:52:47.699100+0000","last_became_active":"2024-09-21T05:50:53.897785+0000","last_became_peered":"2024-09-21T05:50:53.897785+0000","last_unstale":"2024-09-21T05:52:47.699100+0000","last_undegraded":"2024-09-21T05:52:47.699100+0000","last_fullsized":"2024-09-21T05:52:47.699100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:25.099224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681452+0000","last_change":"2024-09-21T05:50:53.899051+0000","last_active":"2024-09-21T05:52:47.681452+0000","last_peered":"2024-09-21T05:52:47.681452+0000","last_clean":"2024-09-21T05:52:47.681452+0000","last_became_active":"2024-09-21T05:50:53.898381+0000","last_became_peered":"2024-09-21T05:50:53.898381+0000","last_unstale":"2024-09-21T05:52:47.681452+0000","last_undegraded":"2024-09-21T05:52:47.681452+0000","last_fullsized":"2024-09-21T05:52:47.681452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:05.958547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011512+0000","last_change":"2024-09-21T05:50:53.896079+0000","last_active":"2024-09-21T05:52:48.011512+0000","last_peered":"2024-09-21T05:52:48.011512+0000","last_clean":"2024-09-21T05:52:48.011512+0000","last_became_active":"2024-09-21T05:50:53.895659+0000","last_became_peered":"2024-09-21T05:50:53.895659+0000","last_unstale":"2024-09-21T05:52:48.011512+0000","last_undegraded":"2024-09-21T05:52:48.011512+0000","last_fullsized":"2024-09-21T05:52:48.011512+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:50.151899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675981+0000","last_change":"2024-09-21T05:50:53.894899+0000","last_active":"2024-09-21T05:52:47.675981+0000","last_peered":"2024-09-21T05:52:47.675981+0000","last_clean":"2024-09-21T05:52:47.675981+0000","last_became_active":"2024-09-21T05:50:53.894530+0000","last_became_peered":"2024-09-21T05:50:53.894530+0000","last_unstale":"2024-09-21T05:52:47.675981+0000","last_undegraded":"2024-09-21T05:52:47.675981+0000","last_fullsized":"2024-09-21T05:52:47.675981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:15.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010925+0000","last_change":"2024-09-21T05:51:47.376927+0000","last_active":"2024-09-21T05:52:48.010925+0000","last_peered":"2024-09-21T05:52:48.010925+0000","last_clean":"2024-09-21T05:52:48.010925+0000","last_became_active":"2024-09-21T05:51:47.376534+0000","last_became_peered":"2024-09-21T05:51:47.376534+0000","last_unstale":"2024-09-21T05:52:48.010925+0000","last_undegraded":"2024-09-21T05:52:48.010925+0000","last_fullsized":"2024-09-21T05:52:48.010925+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:26.353085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.680854+0000","last_change":"2024-09-21T05:50:53.903196+0000","last_active":"2024-09-21T05:52:47.680854+0000","last_peered":"2024-09-21T05:52:47.680854+0000","last_clean":"2024-09-21T05:52:47.680854+0000","last_became_active":"2024-09-21T05:50:53.902825+0000","last_became_peered":"2024-09-21T05:50:53.902825+0000","last_unstale":"2024-09-21T05:52:47.680854+0000","last_undegraded":"2024-09-21T05:52:47.680854+0000","last_fullsized":"2024-09-21T05:52:47.680854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:13.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010520+0000","last_change":"2024-09-21T05:50:53.902249+0000","last_active":"2024-09-21T05:52:48.010520+0000","last_peered":"2024-09-21T05:52:48.010520+0000","last_clean":"2024-09-21T05:52:48.010520+0000","last_became_active":"2024-09-21T05:50:53.901828+0000","last_became_peered":"2024-09-21T05:50:53.901828+0000","last_unstale":"2024-09-21T05:52:48.010520+0000","last_undegraded":"2024-09-21T05:52:48.010520+0000","last_fullsized":"2024-09-21T05:52:48.010520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:51.200179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.676219+0000","last_change":"2024-09-21T05:50:53.897170+0000","last_active":"2024-09-21T05:52:47.676219+0000","last_peered":"2024-09-21T05:52:47.676219+0000","last_clean":"2024-09-21T05:52:47.676219+0000","last_became_active":"2024-09-21T05:50:53.895337+0000","last_became_peered":"2024-09-21T05:50:53.895337+0000","last_unstale":"2024-09-21T05:52:47.676219+0000","last_undegraded":"2024-09-21T05:52:47.676219+0000","last_fullsized":"2024-09-21T05:52:47.676219+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:19.869698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698957+0000","last_change":"2024-09-21T05:50:53.899575+0000","last_active":"2024-09-21T05:52:47.698957+0000","last_peered":"2024-09-21T05:52:47.698957+0000","last_clean":"2024-09-21T05:52:47.698957+0000","last_became_active":"2024-09-21T05:50:53.898274+0000","last_became_peered":"2024-09-21T05:50:53.898274+0000","last_unstale":"2024-09-21T05:52:47.698957+0000","last_undegraded":"2024-09-21T05:52:47.698957+0000","last_fullsized":"2024-09-21T05:52:47.698957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:28.188691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674665+0000","last_change":"2024-09-21T05:50:53.908381+0000","last_active":"2024-09-21T05:52:47.674665+0000","last_peered":"2024-09-21T05:52:47.674665+0000","last_clean":"2024-09-21T05:52:47.674665+0000","last_became_active":"2024-09-21T05:50:53.906731+0000","last_became_peered":"2024-09-21T05:50:53.906731+0000","last_unstale":"2024-09-21T05:52:47.674665+0000","last_undegraded":"2024-09-21T05:52:47.674665+0000","last_fullsized":"2024-09-21T05:52:47.674665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:59.254561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674671+0000","last_change":"2024-09-21T05:50:53.904619+0000","last_active":"2024-09-21T05:52:47.674671+0000","last_peered":"2024-09-21T05:52:47.674671+0000","last_clean":"2024-09-21T05:52:47.674671+0000","last_became_active":"2024-09-21T05:50:53.903901+0000","last_became_peered":"2024-09-21T05:50:53.903901+0000","last_unstale":"2024-09-21T05:52:47.674671+0000","last_undegraded":"2024-09-21T05:52:47.674671+0000","last_fullsized":"2024-09-21T05:52:47.674671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:25.531973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682851+0000","last_change":"2024-09-21T05:50:53.903557+0000","last_active":"2024-09-21T05:52:47.682851+0000","last_peered":"2024-09-21T05:52:47.682851+0000","last_clean":"2024-09-21T05:52:47.682851+0000","last_became_active":"2024-09-21T05:50:53.903195+0000","last_became_peered":"2024-09-21T05:50:53.903195+0000","last_unstale":"2024-09-21T05:52:47.682851+0000","last_undegraded":"2024-09-21T05:52:47.682851+0000","last_fullsized":"2024-09-21T05:52:47.682851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:32.268063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70065,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":143,"num_read_kb":142,"num_write":89,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":210195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678054,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":521686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874283,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28704,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716448,"statfs":{"total":95995035648,"available":95965642752,"internally_reserved":0,"allocated":1716224,"data_stored":1177419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037810,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1044480,"data_stored":526364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234039,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1044480,"data_stored":522290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32792,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712360,"statfs":{"total":95995035648,"available":95961456640,"internally_reserved":0,"allocated":1638400,"data_stored":1116732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626497,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":517590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822728,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1642496,"data_stored":1112236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018956,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1040384,"data_stored":521708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215185,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1040384,"data_stored":517694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444120,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1114112,"data_stored":586891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1110016,"data_stored":586857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1036288,"data_stored":517680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:52:56.309 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T05:52:56.309 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T05:52:56.309 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T05:52:56.309 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T05:52:56.725 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:56.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:56 smithi144 ceph-mon[34351]: from='client.25130 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:56.884 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:56 smithi037 ceph-mon[30631]: from='client.25130 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:56.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:56 smithi067 ceph-mon[34443]: from='client.25130 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:52:57.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.345+0000 7f4ee9200640 1 -- 172.21.15.37:0/3020576624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee41094c0 msgr2=0x7f4ee41098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.345+0000 7f4ee9200640 1 --2- 172.21.15.37:0/3020576624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee41094c0 0x7f4ee41098d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0009900 tx=0x7f4ed002a3f0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.345+0000 7f4ee9200640 1 -- 172.21.15.37:0/3020576624 shutdown_connections 2024-09-21T05:52:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.345+0000 7f4ee9200640 1 --2- 172.21.15.37:0/3020576624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ee4109e10 0x7f4ee4110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.345+0000 7f4ee9200640 1 --2- 172.21.15.37:0/3020576624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee41094c0 0x7f4ee41098d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.345+0000 7f4ee9200640 1 --2- 172.21.15.37:0/3020576624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ee4103b80 0x7f4ee4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.345+0000 7f4ee9200640 1 -- 172.21.15.37:0/3020576624 >> 172.21.15.37:0/3020576624 conn(0x7f4ee40ff5d0 msgr2=0x7f4ee4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.345+0000 7f4ee9200640 1 -- 172.21.15.37:0/3020576624 shutdown_connections 2024-09-21T05:52:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.345+0000 7f4ee9200640 1 -- 172.21.15.37:0/3020576624 wait complete. 2024-09-21T05:52:57.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.346+0000 7f4ee9200640 1 Processor -- start 2024-09-21T05:52:57.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.347+0000 7f4ee9200640 1 -- start start 2024-09-21T05:52:57.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.347+0000 7f4ee9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ee4103b80 0x7f4ee419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:57.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.347+0000 7f4ee9200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee41094c0 0x7f4ee419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:57.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.347+0000 7f4ee9200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ee4109e10 0x7f4ee419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:57.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.347+0000 7f4ee9200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee4113b20 con 0x7f4ee41094c0 2024-09-21T05:52:57.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.347+0000 7f4ee9200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee41139a0 con 0x7f4ee4109e10 2024-09-21T05:52:57.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.347+0000 7f4ee9200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee4113ca0 con 0x7f4ee4103b80 2024-09-21T05:52:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.347+0000 7f4ee1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ee4103b80 0x7f4ee419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.347+0000 7f4ee1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee41094c0 0x7f4ee419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.347+0000 7f4ee1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ee4103b80 0x7f4ee419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47626/0 (socket says 172.21.15.37:47626) 2024-09-21T05:52:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.347+0000 7f4ee1e00640 1 -- 172.21.15.37:0/3513825521 learned_addr learned my addr 172.21.15.37:0/3513825521 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.348+0000 7f4ee2800640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ee4109e10 0x7f4ee419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.348+0000 7f4ee1e00640 1 -- 172.21.15.37:0/3513825521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ee4109e10 msgr2=0x7f4ee419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.348+0000 7f4ee1e00640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ee4109e10 0x7f4ee419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.348+0000 7f4ee1e00640 1 -- 172.21.15.37:0/3513825521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee41094c0 msgr2=0x7f4ee419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.348+0000 7f4ee1e00640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee41094c0 0x7f4ee419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.348+0000 7f4ee1e00640 1 -- 172.21.15.37:0/3513825521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee41a0420 con 0x7f4ee4103b80 2024-09-21T05:52:57.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.348+0000 7f4ee2800640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ee4109e10 0x7f4ee419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:52:57.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.348+0000 7f4ee1e00640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ee4103b80 0x7f4ee419a4b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400ea60 tx=0x7f4ed400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:57.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.349+0000 7f4edaa00640 1 -- 172.21.15.37:0/3513825521 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed400cde0 con 0x7f4ee4103b80 2024-09-21T05:52:57.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.349+0000 7f4edaa00640 1 -- 172.21.15.37:0/3513825521 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ed40035f0 con 0x7f4ee4103b80 2024-09-21T05:52:57.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.349+0000 7f4ee9200640 1 -- 172.21.15.37:0/3513825521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee41a0710 con 0x7f4ee4103b80 2024-09-21T05:52:57.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.349+0000 7f4edaa00640 1 -- 172.21.15.37:0/3513825521 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4010690 con 0x7f4ee4103b80 2024-09-21T05:52:57.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.349+0000 7f4ee9200640 1 -- 172.21.15.37:0/3513825521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee41a6e70 con 0x7f4ee4103b80 2024-09-21T05:52:57.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.350+0000 7f4ee9200640 1 -- 172.21.15.37:0/3513825521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee4103f90 con 0x7f4ee4103b80 2024-09-21T05:52:57.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.352+0000 7f4edaa00640 1 -- 172.21.15.37:0/3513825521 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f4ed40037a0 con 0x7f4ee4103b80 2024-09-21T05:52:57.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.354+0000 7f4edaa00640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4ec80b6620 0x7f4ec80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:57.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.354+0000 7f4edaa00640 1 -- 172.21.15.37:0/3513825521 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f4ed40e7d10 con 0x7f4ee4103b80 2024-09-21T05:52:57.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.354+0000 7f4ee1400640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4ec80b6620 0x7f4ec80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:57.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.355+0000 7f4ee1400640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4ec80b6620 0x7f4ec80b8b30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4ed002a9e0 tx=0x7f4ed0005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:57.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.356+0000 7f4edaa00640 1 -- 172.21.15.37:0/3513825521 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ed4056710 con 0x7f4ee4103b80 2024-09-21T05:52:57.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.594+0000 7f4ee9200640 1 -- 172.21.15.37:0/3513825521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4ee419b5e0 con 0x7f4ee4103b80 2024-09-21T05:52:57.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.595+0000 7f4edaa00640 1 -- 172.21.15.37:0/3513825521 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4ed40ae010 con 0x7f4ee4103b80 2024-09-21T05:52:57.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:52:57.598 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T05:52:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.598+0000 7f4ee9200640 1 -- 172.21.15.37:0/3513825521 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4ec80b6620 msgr2=0x7f4ec80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.598+0000 7f4ee9200640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4ec80b6620 0x7f4ec80b8b30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4ed002a9e0 tx=0x7f4ed0005a20 comp rx=0 tx=0).stop 2024-09-21T05:52:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.598+0000 7f4ee9200640 1 -- 172.21.15.37:0/3513825521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ee4103b80 msgr2=0x7f4ee419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.598+0000 7f4ee9200640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ee4103b80 0x7f4ee419a4b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400ea60 tx=0x7f4ed400ef20 comp rx=0 tx=0).stop 2024-09-21T05:52:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.598+0000 7f4ee9200640 1 -- 172.21.15.37:0/3513825521 shutdown_connections 2024-09-21T05:52:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.598+0000 7f4ee9200640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4ec80b6620 0x7f4ec80b8b30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.598+0000 7f4ee9200640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ee4109e10 0x7f4ee419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.598+0000 7f4ee9200640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee41094c0 0x7f4ee419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.598+0000 7f4ee9200640 1 --2- 172.21.15.37:0/3513825521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ee4103b80 0x7f4ee419a4b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.598+0000 7f4ee9200640 1 -- 172.21.15.37:0/3513825521 >> 172.21.15.37:0/3513825521 conn(0x7f4ee40ff5d0 msgr2=0x7f4ee41019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.598+0000 7f4ee9200640 1 -- 172.21.15.37:0/3513825521 shutdown_connections 2024-09-21T05:52:57.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:57.598+0000 7f4ee9200640 1 -- 172.21.15.37:0/3513825521 wait complete. 2024-09-21T05:52:57.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:57 smithi144 ceph-mon[34351]: pgmap v385: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-21T05:52:57.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:57 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3513825521' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T05:52:57.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:57 smithi037 ceph-mon[30631]: pgmap v385: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-21T05:52:57.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:57 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3513825521' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T05:52:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:57 smithi067 ceph-mon[34443]: pgmap v385: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-21T05:52:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:57 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3513825521' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T05:52:58.357 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T05:52:58.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:52:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:52:59.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.365+0000 7f77a4a00640 1 -- 172.21.15.37:0/3419336259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a0109c40 msgr2=0x7f77a0110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:59.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.365+0000 7f77a4a00640 1 --2- 172.21.15.37:0/3419336259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a0109c40 0x7f77a0110470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7798009ca0 tx=0x7f779802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.365+0000 7f77a4a00640 1 -- 172.21.15.37:0/3419336259 shutdown_connections 2024-09-21T05:52:59.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.365+0000 7f77a4a00640 1 --2- 172.21.15.37:0/3419336259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a0109c40 0x7f77a0110470 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.365+0000 7f77a4a00640 1 --2- 172.21.15.37:0/3419336259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77a01092f0 0x7f77a0109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.365+0000 7f77a4a00640 1 --2- 172.21.15.37:0/3419336259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a01039b0 0x7f77a0103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.365+0000 7f77a4a00640 1 -- 172.21.15.37:0/3419336259 >> 172.21.15.37:0/3419336259 conn(0x7f77a00ff440 msgr2=0x7f77a0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:59.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.365+0000 7f77a4a00640 1 -- 172.21.15.37:0/3419336259 shutdown_connections 2024-09-21T05:52:59.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.365+0000 7f77a4a00640 1 -- 172.21.15.37:0/3419336259 wait complete. 2024-09-21T05:52:59.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.366+0000 7f77a4a00640 1 Processor -- start 2024-09-21T05:52:59.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.366+0000 7f77a4a00640 1 -- start start 2024-09-21T05:52:59.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.367+0000 7f77a4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77a01039b0 0x7f77a0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.367+0000 7f77a4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a01092f0 0x7f77a0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.367+0000 7f77a4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a0109c40 0x7f77a0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.367+0000 7f77a4a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f77a0113900 con 0x7f77a0109c40 2024-09-21T05:52:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.367+0000 7f77a4a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f77a0113780 con 0x7f77a01092f0 2024-09-21T05:52:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.367+0000 7f77a4a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f77a0113a80 con 0x7f77a01039b0 2024-09-21T05:52:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.367+0000 7f779f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a0109c40 0x7f77a0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.367+0000 7f779f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a0109c40 0x7f77a0076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50574/0 (socket says 172.21.15.37:50574) 2024-09-21T05:52:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.367+0000 7f779f200640 1 -- 172.21.15.37:0/1401089845 learned_addr learned my addr 172.21.15.37:0/1401089845 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:52:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.367+0000 7f779e800640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77a01039b0 0x7f77a0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.367+0000 7f7795e00640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a01092f0 0x7f77a0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:59.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.368+0000 7f779f200640 1 -- 172.21.15.37:0/1401089845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77a01039b0 msgr2=0x7f77a0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:59.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.368+0000 7f779f200640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77a01039b0 0x7f77a0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.368+0000 7f779f200640 1 -- 172.21.15.37:0/1401089845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a01092f0 msgr2=0x7f77a0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:59.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.368+0000 7f779f200640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a01092f0 0x7f77a0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.368+0000 7f779f200640 1 -- 172.21.15.37:0/1401089845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a01a8550 con 0x7f77a0109c40 2024-09-21T05:52:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.368+0000 7f779f200640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a0109c40 0x7f77a0076190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f77980098d0 tx=0x7f77980317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.368+0000 7f7797e00640 1 -- 172.21.15.37:0/1401089845 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798003b70 con 0x7f77a0109c40 2024-09-21T05:52:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.369+0000 7f7797e00640 1 -- 172.21.15.37:0/1401089845 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7798003d10 con 0x7f77a0109c40 2024-09-21T05:52:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.369+0000 7f77a4a00640 1 -- 172.21.15.37:0/1401089845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a01a87e0 con 0x7f77a0109c40 2024-09-21T05:52:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.369+0000 7f7797e00640 1 -- 172.21.15.37:0/1401089845 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779802fa20 con 0x7f77a0109c40 2024-09-21T05:52:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.369+0000 7f77a4a00640 1 -- 172.21.15.37:0/1401089845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a01a8d20 con 0x7f77a0109c40 2024-09-21T05:52:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.370+0000 7f77a4a00640 1 -- 172.21.15.37:0/1401089845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a0103dc0 con 0x7f77a0109c40 2024-09-21T05:52:59.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.372+0000 7f7797e00640 1 -- 172.21.15.37:0/1401089845 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f779802fbe0 con 0x7f77a0109c40 2024-09-21T05:52:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.374+0000 7f7797e00640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f77840b65a0 0x7f77840b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:52:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.374+0000 7f7797e00640 1 -- 172.21.15.37:0/1401089845 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7798108d50 con 0x7f77a0109c40 2024-09-21T05:52:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.374+0000 7f779e800640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f77840b65a0 0x7f77840b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:52:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.375+0000 7f779e800640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f77840b65a0 0x7f77840b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f77a0077160 tx=0x7f7790005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:52:59.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.376+0000 7f7797e00640 1 -- 172.21.15.37:0/1401089845 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f77980cf0e0 con 0x7f77a0109c40 2024-09-21T05:52:59.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.614+0000 7f77a4a00640 1 -- 172.21.15.37:0/1401089845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77a0076a10 con 0x7f77a0109c40 2024-09-21T05:52:59.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.615+0000 7f7797e00640 1 -- 172.21.15.37:0/1401089845 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f77a0076a10 con 0x7f77a0109c40 2024-09-21T05:52:59.618 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:52:59.618 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:52:59.618 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:52:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.618+0000 7f77a4a00640 1 -- 172.21.15.37:0/1401089845 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f77840b65a0 msgr2=0x7f77840b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.618+0000 7f77a4a00640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f77840b65a0 0x7f77840b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f77a0077160 tx=0x7f7790005f90 comp rx=0 tx=0).stop 2024-09-21T05:52:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.618+0000 7f77a4a00640 1 -- 172.21.15.37:0/1401089845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a0109c40 msgr2=0x7f77a0076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:52:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.618+0000 7f77a4a00640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a0109c40 0x7f77a0076190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f77980098d0 tx=0x7f77980317b0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.619+0000 7f77a4a00640 1 -- 172.21.15.37:0/1401089845 shutdown_connections 2024-09-21T05:52:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.619+0000 7f77a4a00640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a0109c40 0x7f77a0076190 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.619+0000 7f77a4a00640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f77840b65a0 0x7f77840b8ab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.619+0000 7f77a4a00640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77a01092f0 0x7f77a0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.619+0000 7f77a4a00640 1 --2- 172.21.15.37:0/1401089845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77a01039b0 0x7f77a0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:52:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.619+0000 7f77a4a00640 1 -- 172.21.15.37:0/1401089845 >> 172.21.15.37:0/1401089845 conn(0x7f77a00ff440 msgr2=0x7f77a0101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:52:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.619+0000 7f77a4a00640 1 -- 172.21.15.37:0/1401089845 shutdown_connections 2024-09-21T05:52:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:52:59.619+0000 7f77a4a00640 1 -- 172.21.15.37:0/1401089845 wait complete. 2024-09-21T05:52:59.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:59 smithi144 ceph-mon[34351]: pgmap v386: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 967 B/s rd, 1 op/s 2024-09-21T05:52:59.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:52:59 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1401089845' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:59.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:59 smithi037 ceph-mon[30631]: pgmap v386: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 967 B/s rd, 1 op/s 2024-09-21T05:52:59.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:52:59 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1401089845' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:52:59.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:59 smithi067 ceph-mon[34443]: pgmap v386: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 967 B/s rd, 1 op/s 2024-09-21T05:52:59.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:52:59 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1401089845' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:00.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:00.712 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:01.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.426+0000 7f70e7200640 1 -- 172.21.15.37:0/3281348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70e81039b0 msgr2=0x7f70e8103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:01.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.426+0000 7f70e7200640 1 --2- 172.21.15.37:0/3281348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70e81039b0 0x7f70e8103dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009900 tx=0x7f70d802a410 comp rx=0 tx=0).stop 2024-09-21T05:53:01.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.426+0000 7f70e7200640 1 -- 172.21.15.37:0/3281348 shutdown_connections 2024-09-21T05:53:01.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.426+0000 7f70e7200640 1 --2- 172.21.15.37:0/3281348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e8109c40 0x7f70e8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.426+0000 7f70e7200640 1 --2- 172.21.15.37:0/3281348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e81092f0 0x7f70e8109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.426+0000 7f70e7200640 1 --2- 172.21.15.37:0/3281348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70e81039b0 0x7f70e8103dc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.426+0000 7f70e7200640 1 -- 172.21.15.37:0/3281348 >> 172.21.15.37:0/3281348 conn(0x7f70e80ff440 msgr2=0x7f70e8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:01.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.426+0000 7f70e7200640 1 -- 172.21.15.37:0/3281348 shutdown_connections 2024-09-21T05:53:01.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.426+0000 7f70e7200640 1 -- 172.21.15.37:0/3281348 wait complete. 2024-09-21T05:53:01.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.427+0000 7f70e7200640 1 Processor -- start 2024-09-21T05:53:01.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.428+0000 7f70e7200640 1 -- start start 2024-09-21T05:53:01.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.428+0000 7f70e7200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e81039b0 0x7f70e819c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:01.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.428+0000 7f70e7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e81092f0 0x7f70e819cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:01.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.428+0000 7f70e7200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70e8109c40 0x7f70e81a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:01.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.428+0000 7f70e7200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8113950 con 0x7f70e8109c40 2024-09-21T05:53:01.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.428+0000 7f70e7200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f70e81137d0 con 0x7f70e81039b0 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.428+0000 7f70e7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8113ad0 con 0x7f70e81092f0 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.428+0000 7f70e6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70e8109c40 0x7f70e81a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.428+0000 7f70e6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70e8109c40 0x7f70e81a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36748/0 (socket says 172.21.15.37:36748) 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.428+0000 7f70e5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e81039b0 0x7f70e819c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.428+0000 7f70e6800640 1 -- 172.21.15.37:0/2864581330 learned_addr learned my addr 172.21.15.37:0/2864581330 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.428+0000 7f70dd400640 1 --2- 172.21.15.37:0/2864581330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e81092f0 0x7f70e819cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.429+0000 7f70e5e00640 1 -- 172.21.15.37:0/2864581330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e81092f0 msgr2=0x7f70e819cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.429+0000 7f70e5e00640 1 --2- 172.21.15.37:0/2864581330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e81092f0 0x7f70e819cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.429+0000 7f70e5e00640 1 -- 172.21.15.37:0/2864581330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70e8109c40 msgr2=0x7f70e81a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.429+0000 7f70e5e00640 1 --2- 172.21.15.37:0/2864581330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70e8109c40 0x7f70e81a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.429+0000 7f70e5e00640 1 -- 172.21.15.37:0/2864581330 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e81a24b0 con 0x7f70e81039b0 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.429+0000 7f70e5e00640 1 --2- 172.21.15.37:0/2864581330 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e81039b0 0x7f70e819c540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70d802aa00 tx=0x7f70d8003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.429+0000 7f70df400640 1 -- 172.21.15.37:0/2864581330 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d803f070 con 0x7f70e81039b0 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.430+0000 7f70df400640 1 -- 172.21.15.37:0/2864581330 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d8031b50 con 0x7f70e81039b0 2024-09-21T05:53:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.430+0000 7f70e7200640 1 -- 172.21.15.37:0/2864581330 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e81a2740 con 0x7f70e81039b0 2024-09-21T05:53:01.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.430+0000 7f70df400640 1 -- 172.21.15.37:0/2864581330 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8035030 con 0x7f70e81039b0 2024-09-21T05:53:01.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.430+0000 7f70e7200640 1 -- 172.21.15.37:0/2864581330 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e81a8f00 con 0x7f70e81039b0 2024-09-21T05:53:01.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.431+0000 7f70e7200640 1 -- 172.21.15.37:0/2864581330 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e8104c30 con 0x7f70e81039b0 2024-09-21T05:53:01.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.433+0000 7f70df400640 1 -- 172.21.15.37:0/2864581330 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f70d8042070 con 0x7f70e81039b0 2024-09-21T05:53:01.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.435+0000 7f70df400640 1 --2- 172.21.15.37:0/2864581330 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f70cc0b65a0 0x7f70cc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:01.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.435+0000 7f70df400640 1 -- 172.21.15.37:0/2864581330 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f70d8107fe0 con 0x7f70e81039b0 2024-09-21T05:53:01.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.435+0000 7f70dd400640 1 --2- 172.21.15.37:0/2864581330 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f70cc0b65a0 0x7f70cc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:01.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.436+0000 7f70dd400640 1 --2- 172.21.15.37:0/2864581330 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f70cc0b65a0 0x7f70cc0b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f70e8109a60 tx=0x7f70d0005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:01.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.437+0000 7f70df400640 1 -- 172.21.15.37:0/2864581330 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70d8031d00 con 0x7f70e81039b0 2024-09-21T05:53:01.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.673+0000 7f70e7200640 1 -- 172.21.15.37:0/2864581330 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70e81a90d0 con 0x7f70e81039b0 2024-09-21T05:53:01.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.674+0000 7f70df400640 1 -- 172.21.15.37:0/2864581330 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f70d80d2720 con 0x7f70e81039b0 2024-09-21T05:53:01.677 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:01.677 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:53:01.677 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:53:01.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.676+0000 7f70e7200640 1 -- 172.21.15.37:0/2864581330 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f70cc0b65a0 msgr2=0x7f70cc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:01.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.676+0000 7f70e7200640 1 --2- 172.21.15.37:0/2864581330 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f70cc0b65a0 0x7f70cc0b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f70e8109a60 tx=0x7f70d0005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:01.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.676+0000 7f70e7200640 1 -- 172.21.15.37:0/2864581330 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e81039b0 msgr2=0x7f70e819c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:01.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.676+0000 7f70e7200640 1 --2- 172.21.15.37:0/2864581330 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e81039b0 0x7f70e819c540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70d802aa00 tx=0x7f70d8003b90 comp rx=0 tx=0).stop 2024-09-21T05:53:01.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.676+0000 7f70e7200640 1 -- 172.21.15.37:0/2864581330 shutdown_connections 2024-09-21T05:53:01.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.676+0000 7f70e7200640 1 --2- 172.21.15.37:0/2864581330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70e8109c40 0x7f70e81a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.676+0000 7f70e7200640 1 --2- 172.21.15.37:0/2864581330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e81092f0 0x7f70e819cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.676+0000 7f70e7200640 1 --2- 172.21.15.37:0/2864581330 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f70cc0b65a0 0x7f70cc0b8ab0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.676+0000 7f70e7200640 1 --2- 172.21.15.37:0/2864581330 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e81039b0 0x7f70e819c540 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:01.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.677+0000 7f70e7200640 1 -- 172.21.15.37:0/2864581330 >> 172.21.15.37:0/2864581330 conn(0x7f70e80ff440 msgr2=0x7f70e8108990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:01.680 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:01 smithi037 ceph-mon[30631]: pgmap v387: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:01.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.677+0000 7f70e7200640 1 -- 172.21.15.37:0/2864581330 shutdown_connections 2024-09-21T05:53:01.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:01.678+0000 7f70e7200640 1 -- 172.21.15.37:0/2864581330 wait complete. 2024-09-21T05:53:01.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:01 smithi067 ceph-mon[34443]: pgmap v387: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:02.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:01 smithi144 ceph-mon[34351]: pgmap v387: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:02.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:53:02.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:02 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2864581330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:02.828 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:02.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:02 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2864581330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:03.024 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:02 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2864581330' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:03.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.461+0000 7f0caf200640 1 -- 172.21.15.37:0/1399074859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cb010ff10 msgr2=0x7f0cb0112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:03.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.461+0000 7f0caf200640 1 --2- 172.21.15.37:0/1399074859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cb010ff10 0x7f0cb0112350 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009ca0 tx=0x7f0ca802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:03.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.461+0000 7f0caf200640 1 -- 172.21.15.37:0/1399074859 shutdown_connections 2024-09-21T05:53:03.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.461+0000 7f0caf200640 1 --2- 172.21.15.37:0/1399074859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cb010ff10 0x7f0cb0112350 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:03.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.461+0000 7f0caf200640 1 --2- 172.21.15.37:0/1399074859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cb0076100 0x7f0cb010f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:03.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.461+0000 7f0caf200640 1 --2- 172.21.15.37:0/1399074859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cb00757b0 0x7f0cb0075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:03.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.461+0000 7f0caf200640 1 -- 172.21.15.37:0/1399074859 >> 172.21.15.37:0/1399074859 conn(0x7f0cb00ff440 msgr2=0x7f0cb0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:03.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.461+0000 7f0caf200640 1 -- 172.21.15.37:0/1399074859 shutdown_connections 2024-09-21T05:53:03.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.461+0000 7f0caf200640 1 -- 172.21.15.37:0/1399074859 wait complete. 2024-09-21T05:53:03.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.462+0000 7f0caf200640 1 Processor -- start 2024-09-21T05:53:03.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.462+0000 7f0caf200640 1 -- start start 2024-09-21T05:53:03.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.463+0000 7f0caf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cb00757b0 0x7f0cb019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:03.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.463+0000 7f0caf200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cb0076100 0x7f0cb019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:03.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.463+0000 7f0caf200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cb010ff10 0x7f0cb01a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:03.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.463+0000 7f0caf200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb0115ac0 con 0x7f0cb0076100 2024-09-21T05:53:03.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.463+0000 7f0caf200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb0115940 con 0x7f0cb010ff10 2024-09-21T05:53:03.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.463+0000 7f0caf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb0115c40 con 0x7f0cb00757b0 2024-09-21T05:53:03.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.463+0000 7f0cad400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cb0076100 0x7f0cb019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:03.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.463+0000 7f0cad400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cb0076100 0x7f0cb019ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36768/0 (socket says 172.21.15.37:36768) 2024-09-21T05:53:03.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.463+0000 7f0cad400640 1 -- 172.21.15.37:0/2358914246 learned_addr learned my addr 172.21.15.37:0/2358914246 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:03.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.463+0000 7f0cade00640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cb00757b0 0x7f0cb019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:03.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.463+0000 7f0cae800640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cb010ff10 0x7f0cb01a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:03.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.464+0000 7f0cad400640 1 -- 172.21.15.37:0/2358914246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cb00757b0 msgr2=0x7f0cb019c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:03.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.464+0000 7f0cad400640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cb00757b0 0x7f0cb019c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:03.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.464+0000 7f0cad400640 1 -- 172.21.15.37:0/2358914246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cb010ff10 msgr2=0x7f0cb01a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:03.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.464+0000 7f0cad400640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cb010ff10 0x7f0cb01a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:03.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.464+0000 7f0cad400640 1 -- 172.21.15.37:0/2358914246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb01a23e0 con 0x7f0cb0076100 2024-09-21T05:53:03.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.464+0000 7f0cade00640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cb00757b0 0x7f0cb019c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:03.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.464+0000 7f0cad400640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cb0076100 0x7f0cb019ca10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00e9c0 tx=0x7f0c9c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:03.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.464+0000 7f0ca6a00640 1 -- 172.21.15.37:0/2358914246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c00cd80 con 0x7f0cb0076100 2024-09-21T05:53:03.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.465+0000 7f0caf200640 1 -- 172.21.15.37:0/2358914246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb01a26d0 con 0x7f0cb0076100 2024-09-21T05:53:03.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.465+0000 7f0ca6a00640 1 -- 172.21.15.37:0/2358914246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c9c0035f0 con 0x7f0cb0076100 2024-09-21T05:53:03.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.465+0000 7f0ca6a00640 1 -- 172.21.15.37:0/2358914246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c010690 con 0x7f0cb0076100 2024-09-21T05:53:03.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.465+0000 7f0caf200640 1 -- 172.21.15.37:0/2358914246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb01a8e30 con 0x7f0cb0076100 2024-09-21T05:53:03.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.466+0000 7f0caf200640 1 -- 172.21.15.37:0/2358914246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb0075bc0 con 0x7f0cb0076100 2024-09-21T05:53:03.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.468+0000 7f0ca6a00640 1 -- 172.21.15.37:0/2358914246 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f0c9c004000 con 0x7f0cb0076100 2024-09-21T05:53:03.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.470+0000 7f0ca6a00640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0c940b6620 0x7f0c940b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:03.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.470+0000 7f0ca6a00640 1 -- 172.21.15.37:0/2358914246 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f0c9c0e7d40 con 0x7f0cb0076100 2024-09-21T05:53:03.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.470+0000 7f0cade00640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0c940b6620 0x7f0c940b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:03.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.471+0000 7f0cade00640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0c940b6620 0x7f0c940b8b30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009fc0 tx=0x7f0ca0005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:03.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.475+0000 7f0ca6a00640 1 -- 172.21.15.37:0/2358914246 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0c9c0ae040 con 0x7f0cb0076100 2024-09-21T05:53:03.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.681+0000 7f0caf200640 1 -- 172.21.15.37:0/2358914246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0cb01a91a0 con 0x7f0cb0076100 2024-09-21T05:53:03.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.683+0000 7f0ca6a00640 1 -- 172.21.15.37:0/2358914246 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24836 (secure 0 0 0) 0x7f0c9c0b2420 con 0x7f0cb0076100 2024-09-21T05:53:03.686 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:03.686 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":90,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:52:47.670174+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:50:49.791290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:50:51.877662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:51:01.928796+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:53:03.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.686+0000 7f0caf200640 1 -- 172.21.15.37:0/2358914246 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0c940b6620 msgr2=0x7f0c940b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:03.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.686+0000 7f0caf200640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0c940b6620 0x7f0c940b8b30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009fc0 tx=0x7f0ca0005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:03.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.686+0000 7f0caf200640 1 -- 172.21.15.37:0/2358914246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cb0076100 msgr2=0x7f0cb019ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:03.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.686+0000 7f0caf200640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cb0076100 0x7f0cb019ca10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00e9c0 tx=0x7f0c9c00ee80 comp rx=0 tx=0).stop 2024-09-21T05:53:03.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.686+0000 7f0caf200640 1 -- 172.21.15.37:0/2358914246 shutdown_connections 2024-09-21T05:53:03.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.686+0000 7f0caf200640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0c940b6620 0x7f0c940b8b30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:03.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.686+0000 7f0caf200640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cb010ff10 0x7f0cb01a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:03.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.686+0000 7f0caf200640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cb0076100 0x7f0cb019ca10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:03.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.686+0000 7f0caf200640 1 --2- 172.21.15.37:0/2358914246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cb00757b0 0x7f0cb019c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:03.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.686+0000 7f0caf200640 1 -- 172.21.15.37:0/2358914246 >> 172.21.15.37:0/2358914246 conn(0x7f0cb00ff440 msgr2=0x7f0cb0109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:03.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.686+0000 7f0caf200640 1 -- 172.21.15.37:0/2358914246 shutdown_connections 2024-09-21T05:53:03.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:03.686+0000 7f0caf200640 1 -- 172.21.15.37:0/2358914246 wait complete. 2024-09-21T05:53:03.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:03 smithi037 ceph-mon[30631]: pgmap v388: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:53:03.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:03 smithi067 ceph-mon[34443]: pgmap v388: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:53:04.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:03 smithi144 ceph-mon[34351]: pgmap v388: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:53:04.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:04.875 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:04.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:04 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2358914246' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:04.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:04 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2358914246' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:05.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:04 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2358914246' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.485+0000 7f56f3200640 1 -- 172.21.15.37:0/3470045396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ec103b80 msgr2=0x7f56ec103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.485+0000 7f56f3200640 1 --2- 172.21.15.37:0/3470045396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ec103b80 0x7f56ec103f90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009900 tx=0x7f56dc02a410 comp rx=0 tx=0).stop 2024-09-21T05:53:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.485+0000 7f56f3200640 1 -- 172.21.15.37:0/3470045396 shutdown_connections 2024-09-21T05:53:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.485+0000 7f56f3200640 1 --2- 172.21.15.37:0/3470045396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ec109e10 0x7f56ec110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.485+0000 7f56f3200640 1 --2- 172.21.15.37:0/3470045396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec1094c0 0x7f56ec1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.485+0000 7f56f3200640 1 --2- 172.21.15.37:0/3470045396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ec103b80 0x7f56ec103f90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.485+0000 7f56f3200640 1 -- 172.21.15.37:0/3470045396 >> 172.21.15.37:0/3470045396 conn(0x7f56ec0ff5d0 msgr2=0x7f56ec101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:05.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.485+0000 7f56f3200640 1 -- 172.21.15.37:0/3470045396 shutdown_connections 2024-09-21T05:53:05.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.485+0000 7f56f3200640 1 -- 172.21.15.37:0/3470045396 wait complete. 2024-09-21T05:53:05.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.486+0000 7f56f3200640 1 Processor -- start 2024-09-21T05:53:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.487+0000 7f56f3200640 1 -- start start 2024-09-21T05:53:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.487+0000 7f56f3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ec103b80 0x7f56ec19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.487+0000 7f56f3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ec1094c0 0x7f56ec19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.487+0000 7f56f3200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec109e10 0x7f56ec19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.487+0000 7f56f3200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec113b20 con 0x7f56ec103b80 2024-09-21T05:53:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.487+0000 7f56f3200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec1139a0 con 0x7f56ec109e10 2024-09-21T05:53:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.487+0000 7f56f3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec113ca0 con 0x7f56ec1094c0 2024-09-21T05:53:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.487+0000 7f56ebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ec103b80 0x7f56ec19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.487+0000 7f56ebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ec103b80 0x7f56ec19a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36798/0 (socket says 172.21.15.37:36798) 2024-09-21T05:53:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.487+0000 7f56ebe00640 1 -- 172.21.15.37:0/990628089 learned_addr learned my addr 172.21.15.37:0/990628089 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.487+0000 7f56f1200640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec109e10 0x7f56ec19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.488+0000 7f56e3e00640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ec1094c0 0x7f56ec19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.488+0000 7f56ebe00640 1 -- 172.21.15.37:0/990628089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ec1094c0 msgr2=0x7f56ec19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.488+0000 7f56ebe00640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ec1094c0 0x7f56ec19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.488+0000 7f56ebe00640 1 -- 172.21.15.37:0/990628089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec109e10 msgr2=0x7f56ec19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.488+0000 7f56ebe00640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec109e10 0x7f56ec19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.488+0000 7f56ebe00640 1 -- 172.21.15.37:0/990628089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec1a0440 con 0x7f56ec103b80 2024-09-21T05:53:05.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.488+0000 7f56f1200640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec109e10 0x7f56ec19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:05.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.488+0000 7f56ebe00640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ec103b80 0x7f56ec19a4d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f56dc005ab0 tx=0x7f56dc003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:05.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.489+0000 7f56e9600640 1 -- 172.21.15.37:0/990628089 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc03f070 con 0x7f56ec103b80 2024-09-21T05:53:05.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.489+0000 7f56e9600640 1 -- 172.21.15.37:0/990628089 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56dc031d60 con 0x7f56ec103b80 2024-09-21T05:53:05.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.489+0000 7f56e9600640 1 -- 172.21.15.37:0/990628089 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc035030 con 0x7f56ec103b80 2024-09-21T05:53:05.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.489+0000 7f56f3200640 1 -- 172.21.15.37:0/990628089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ec1a06d0 con 0x7f56ec103b80 2024-09-21T05:53:05.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.489+0000 7f56f3200640 1 -- 172.21.15.37:0/990628089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ec1a6e90 con 0x7f56ec103b80 2024-09-21T05:53:05.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.490+0000 7f56f3200640 1 -- 172.21.15.37:0/990628089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ec104e00 con 0x7f56ec103b80 2024-09-21T05:53:05.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.493+0000 7f56e9600640 1 -- 172.21.15.37:0/990628089 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f56dc042070 con 0x7f56ec103b80 2024-09-21T05:53:05.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.494+0000 7f56e9600640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f56d00b65a0 0x7f56d00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:05.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.494+0000 7f56e9600640 1 -- 172.21.15.37:0/990628089 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f56dc108670 con 0x7f56ec103b80 2024-09-21T05:53:05.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.494+0000 7f56e3e00640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f56d00b65a0 0x7f56d00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:05.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.495+0000 7f56e3e00640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f56d00b65a0 0x7f56d00b8ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f56ec109010 tx=0x7f56d4005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:05.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.496+0000 7f56e9600640 1 -- 172.21.15.37:0/990628089 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f56dc0d2d50 con 0x7f56ec103b80 2024-09-21T05:53:05.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.733+0000 7f56f3200640 1 -- 172.21.15.37:0/990628089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56ec103f90 con 0x7f56ec103b80 2024-09-21T05:53:05.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.734+0000 7f56e9600640 1 -- 172.21.15.37:0/990628089 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f56ec103f90 con 0x7f56ec103b80 2024-09-21T05:53:05.736 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:05.737 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:53:05.737 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:53:05.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.736+0000 7f56f3200640 1 -- 172.21.15.37:0/990628089 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f56d00b65a0 msgr2=0x7f56d00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.736+0000 7f56f3200640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f56d00b65a0 0x7f56d00b8ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f56ec109010 tx=0x7f56d4005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:05.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.736+0000 7f56f3200640 1 -- 172.21.15.37:0/990628089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ec103b80 msgr2=0x7f56ec19a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:05.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.736+0000 7f56f3200640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ec103b80 0x7f56ec19a4d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f56dc005ab0 tx=0x7f56dc003c80 comp rx=0 tx=0).stop 2024-09-21T05:53:05.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.736+0000 7f56f3200640 1 -- 172.21.15.37:0/990628089 shutdown_connections 2024-09-21T05:53:05.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.736+0000 7f56f3200640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f56d00b65a0 0x7f56d00b8ab0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.736+0000 7f56f3200640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec109e10 0x7f56ec19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.736+0000 7f56f3200640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ec1094c0 0x7f56ec19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.737+0000 7f56f3200640 1 --2- 172.21.15.37:0/990628089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ec103b80 0x7f56ec19a4d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:05.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.737+0000 7f56f3200640 1 -- 172.21.15.37:0/990628089 >> 172.21.15.37:0/990628089 conn(0x7f56ec0ff5d0 msgr2=0x7f56ec1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:05.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.737+0000 7f56f3200640 1 -- 172.21.15.37:0/990628089 shutdown_connections 2024-09-21T05:53:05.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:05.737+0000 7f56f3200640 1 -- 172.21.15.37:0/990628089 wait complete. 2024-09-21T05:53:05.897 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:05 smithi067 ceph-mon[34443]: pgmap v389: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:05.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:05 smithi037 ceph-mon[30631]: pgmap v389: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:06.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:05 smithi144 ceph-mon[34351]: pgmap v389: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:06.520 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T05:50:54.973656+0000', 'modified': '2024-09-21T05:51:49.877112+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24731}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24706': {'gid': 24706, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6839/2186109815', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6838', 'nonce': 2186109815}, {'type': 'v1', 'addr': '172.21.15.144:6839', 'nonce': 2186109815}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24731': {'gid': 24731, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.67:6839/2815536303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6838', 'nonce': 2815536303}, {'type': 'v1', 'addr': '172.21.15.67:6839', 'nonce': 2815536303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24731, 'qdb_cluster': [24731]} 2024-09-21T05:53:06.520 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T05:53:06.520 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T05:53:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:06.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:06 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/990628089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:06.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:06 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/990628089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:07.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:06 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/990628089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.527+0000 7fb29ce00640 1 -- 172.21.15.37:0/3352580143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb298109e10 msgr2=0x7fb298110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.527+0000 7fb29ce00640 1 --2- 172.21.15.37:0/3352580143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb298109e10 0x7fb298110640 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb290009ca0 tx=0x7fb29002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.527+0000 7fb29ce00640 1 -- 172.21.15.37:0/3352580143 shutdown_connections 2024-09-21T05:53:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.527+0000 7fb29ce00640 1 --2- 172.21.15.37:0/3352580143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb298109e10 0x7fb298110640 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.527+0000 7fb29ce00640 1 --2- 172.21.15.37:0/3352580143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2981094c0 0x7fb2981098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.527+0000 7fb29ce00640 1 --2- 172.21.15.37:0/3352580143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb298103b80 0x7fb298103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.527+0000 7fb29ce00640 1 -- 172.21.15.37:0/3352580143 >> 172.21.15.37:0/3352580143 conn(0x7fb2980ff5d0 msgr2=0x7fb298101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.527+0000 7fb29ce00640 1 -- 172.21.15.37:0/3352580143 shutdown_connections 2024-09-21T05:53:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.527+0000 7fb29ce00640 1 -- 172.21.15.37:0/3352580143 wait complete. 2024-09-21T05:53:07.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.528+0000 7fb29ce00640 1 Processor -- start 2024-09-21T05:53:07.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb29ce00640 1 -- start start 2024-09-21T05:53:07.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb29ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb298103b80 0x7fb29819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb29ce00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2981094c0 0x7fb29819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb29ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb298109e10 0x7fb29819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb29ce00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb298113b20 con 0x7fb298109e10 2024-09-21T05:53:07.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb29ce00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb2981139a0 con 0x7fb2981094c0 2024-09-21T05:53:07.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb29ce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb298113ca0 con 0x7fb298103b80 2024-09-21T05:53:07.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb295400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2981094c0 0x7fb29819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb296800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb298109e10 0x7fb29819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb295e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb298103b80 0x7fb29819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb295400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2981094c0 0x7fb29819aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:56508/0 (socket says 172.21.15.37:56508) 2024-09-21T05:53:07.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb296800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb298109e10 0x7fb29819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36806/0 (socket says 172.21.15.37:36806) 2024-09-21T05:53:07.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb296800640 1 -- 172.21.15.37:0/196157586 learned_addr learned my addr 172.21.15.37:0/196157586 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:07.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.529+0000 7fb295e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb298103b80 0x7fb29819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:57732/0 (socket says 172.21.15.37:57732) 2024-09-21T05:53:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.530+0000 7fb295400640 1 -- 172.21.15.37:0/196157586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb298103b80 msgr2=0x7fb29819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.530+0000 7fb295400640 1 --2- 172.21.15.37:0/196157586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb298103b80 0x7fb29819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.530+0000 7fb295400640 1 -- 172.21.15.37:0/196157586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb298109e10 msgr2=0x7fb29819fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.530+0000 7fb295400640 1 --2- 172.21.15.37:0/196157586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb298109e10 0x7fb29819fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.530+0000 7fb295400640 1 -- 172.21.15.37:0/196157586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2981a0460 con 0x7fb2981094c0 2024-09-21T05:53:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.530+0000 7fb295400640 1 --2- 172.21.15.37:0/196157586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2981094c0 0x7fb29819aa90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb29806ca10 tx=0x7fb28400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.530+0000 7fb28ea00640 1 -- 172.21.15.37:0/196157586 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28400cd00 con 0x7fb2981094c0 2024-09-21T05:53:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.531+0000 7fb28ea00640 1 -- 172.21.15.37:0/196157586 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2840035f0 con 0x7fb2981094c0 2024-09-21T05:53:07.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.531+0000 7fb29ce00640 1 -- 172.21.15.37:0/196157586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2981a0750 con 0x7fb2981094c0 2024-09-21T05:53:07.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.531+0000 7fb28ea00640 1 -- 172.21.15.37:0/196157586 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284010690 con 0x7fb2981094c0 2024-09-21T05:53:07.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.531+0000 7fb29ce00640 1 -- 172.21.15.37:0/196157586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2980755f0 con 0x7fb2981094c0 2024-09-21T05:53:07.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.534+0000 7fb2a3a33740 1 Processor -- start 2024-09-21T05:53:07.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.534+0000 7fb2a3a33740 1 -- start start 2024-09-21T05:53:07.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.534+0000 7fb2a3a33740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 0x55c6a0503490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.534+0000 7fb2a3a33740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a01340a0 0x55c6a05039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.534+0000 7fb2a3a33740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a013c280 0x55c6a0503f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.534+0000 7fb2a3a33740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c6a047ad50 con 0x55c6a015cf60 2024-09-21T05:53:07.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.534+0000 7fb2a3a33740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c6a046a180 con 0x55c6a013c280 2024-09-21T05:53:07.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.534+0000 7fb2a3a33740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c6a046df90 con 0x55c6a01340a0 2024-09-21T05:53:07.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.535+0000 7fb296800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 0x55c6a0503490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.535+0000 7fb28ea00640 1 -- 172.21.15.37:0/196157586 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7fb2840037a0 con 0x7fb2981094c0 2024-09-21T05:53:07.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.535+0000 7fb296800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 0x55c6a0503490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36820/0 (socket says 172.21.15.37:36820) 2024-09-21T05:53:07.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.535+0000 7fb296800640 1 -- 172.21.15.37:0/1979790483 learned_addr learned my addr 172.21.15.37:0/1979790483 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:07.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.535+0000 7fb295e00640 1 --2- 172.21.15.37:0/1979790483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a01340a0 0x55c6a05039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.535+0000 7fb295400640 1 --2- 172.21.15.37:0/1979790483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a013c280 0x55c6a0503f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.535+0000 7fb296800640 1 -- 172.21.15.37:0/1979790483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a01340a0 msgr2=0x55c6a05039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.535+0000 7fb296800640 1 --2- 172.21.15.37:0/1979790483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a01340a0 0x55c6a05039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.535+0000 7fb296800640 1 -- 172.21.15.37:0/1979790483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a013c280 msgr2=0x55c6a0503f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.535+0000 7fb296800640 1 --2- 172.21.15.37:0/1979790483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a013c280 0x55c6a0503f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.535+0000 7fb296800640 1 -- 172.21.15.37:0/1979790483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a0434a70 con 0x55c6a015cf60 2024-09-21T05:53:07.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.535+0000 7fb295400640 1 --2- 172.21.15.37:0/1979790483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a013c280 0x55c6a0503f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:07.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.536+0000 7fb296800640 1 --2- 172.21.15.37:0/1979790483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 0x55c6a0503490 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb2900094c0 tx=0x7fb290009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c586591858706409 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:07.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.536+0000 7fb283400640 1 -- 172.21.15.37:0/1979790483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290031db0 con 0x55c6a015cf60 2024-09-21T05:53:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.536+0000 7fb283400640 1 -- 172.21.15.37:0/1979790483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb290036030 con 0x55c6a015cf60 2024-09-21T05:53:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.536+0000 7fb283400640 1 -- 172.21.15.37:0/1979790483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2900042a0 con 0x55c6a015cf60 2024-09-21T05:53:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.536+0000 7fb28ea00640 1 --2- 172.21.15.37:0/196157586 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb27c0b65a0 0x7fb27c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.537+0000 7fb28ea00640 1 -- 172.21.15.37:0/196157586 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fb2840e7aa0 con 0x7fb2981094c0 2024-09-21T05:53:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.537+0000 7fb295e00640 1 --2- 172.21.15.37:0/196157586 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb27c0b65a0 0x7fb27c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.537+0000 7fb2a3a33740 1 -- 172.21.15.37:0/1979790483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 msgr2=0x55c6a0503490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.537+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/1979790483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 0x55c6a0503490 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb2900094c0 tx=0x7fb290009a10 comp rx=0 tx=0).stop 2024-09-21T05:53:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.537+0000 7fb2a3a33740 1 -- 172.21.15.37:0/1979790483 shutdown_connections 2024-09-21T05:53:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.537+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/1979790483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a013c280 0x55c6a0503f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.537+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/1979790483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a01340a0 0x55c6a05039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.537+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/1979790483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 0x55c6a0503490 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.537+0000 7fb2a3a33740 1 -- 172.21.15.37:0/1979790483 >> 172.21.15.37:0/1979790483 conn(0x55c6a0151350 msgr2=0x55c6a0501380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:07.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.537+0000 7fb295e00640 1 --2- 172.21.15.37:0/196157586 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb27c0b65a0 0x7fb27c0b8ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55c6a0502110 tx=0x7fb288005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:07.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.537+0000 7fb2a3a33740 1 -- 172.21.15.37:0/1979790483 shutdown_connections 2024-09-21T05:53:07.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.537+0000 7fb2a3a33740 1 -- 172.21.15.37:0/1979790483 wait complete. 2024-09-21T05:53:07.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.538+0000 7fb2a3a33740 1 -- start start 2024-09-21T05:53:07.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.538+0000 7fb2a3a33740 1 Processor -- start 2024-09-21T05:53:07.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.539+0000 7fb2a3a33740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a01340a0 0x55c6a050f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.539+0000 7fb2a3a33740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a013c280 0x55c6a050f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.539+0000 7fb2a3a33740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 0x55c6a051ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.539+0000 7fb2a3a33740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c6a02cb5f0 con 0x55c6a015cf60 2024-09-21T05:53:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.539+0000 7fb2a3a33740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c6a0405460 con 0x55c6a01340a0 2024-09-21T05:53:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.539+0000 7fb2a3a33740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c6a0511a90 con 0x55c6a013c280 2024-09-21T05:53:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.539+0000 7fb2a3a33740 10 client.0 _ll_register_callbacks cb 0x55c6a0415210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.539+0000 7fb296800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 0x55c6a051ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.539+0000 7fb295e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a01340a0 0x55c6a050f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.539+0000 7fb296800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 0x55c6a051ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36834/0 (socket says 172.21.15.37:36834) 2024-09-21T05:53:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.539+0000 7fb296800640 1 -- 172.21.15.37:0/2592873790 learned_addr learned my addr 172.21.15.37:0/2592873790 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.539+0000 7fb295400640 1 --2- 172.21.15.37:0/2592873790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a013c280 0x55c6a050f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.540+0000 7fb296800640 1 -- 172.21.15.37:0/2592873790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a013c280 msgr2=0x55c6a050f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.540+0000 7fb296800640 1 --2- 172.21.15.37:0/2592873790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a013c280 0x55c6a050f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.540+0000 7fb296800640 1 -- 172.21.15.37:0/2592873790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a01340a0 msgr2=0x55c6a050f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.540+0000 7fb296800640 1 --2- 172.21.15.37:0/2592873790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a01340a0 0x55c6a050f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.540+0000 7fb296800640 1 -- 172.21.15.37:0/2592873790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a01c8540 con 0x55c6a015cf60 2024-09-21T05:53:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.540+0000 7fb295e00640 1 --2- 172.21.15.37:0/2592873790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a01340a0 0x55c6a050f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.540+0000 7fb296800640 1 --2- 172.21.15.37:0/2592873790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 0x55c6a051ad80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb290003cc0 tx=0x7fb29002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c6480f2c312c68 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.540+0000 7fb277e00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T05:53:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.540+0000 7fb277e00640 1 -- 172.21.15.37:0/2592873790 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290009860 con 0x55c6a015cf60 2024-09-21T05:53:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.540+0000 7fb277e00640 1 -- 172.21.15.37:0/2592873790 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fb290031660 con 0x55c6a015cf60 2024-09-21T05:53:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.540+0000 7fb2a3a33740 1 -- 172.21.15.37:0/2592873790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c6a0407a70 con 0x55c6a015cf60 2024-09-21T05:53:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.541+0000 7fb277e00640 1 -- 172.21.15.37:0/2592873790 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb290031860 con 0x55c6a015cf60 2024-09-21T05:53:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.541+0000 7fb2a3a33740 10 client.15141 fetch_fsmap learned FSMap version 21 2024-09-21T05:53:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.541+0000 7fb2a3a33740 1 -- 172.21.15.37:0/2592873790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c6a04226f0 con 0x55c6a015cf60 2024-09-21T05:53:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.541+0000 7fb277e00640 1 -- 172.21.15.37:0/2592873790 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c6a0407a70 con 0x55c6a015cf60 2024-09-21T05:53:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.541+0000 7fb277e00640 1 -- 172.21.15.37:0/2592873790 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb29004e070 con 0x55c6a015cf60 2024-09-21T05:53:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.541+0000 7fb2a3a33740 10 client.15141 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:53:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.541+0000 7fb2a3a33740 10 client.15141 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:53:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.541+0000 7fb2a3a33740 20 client.15141 populate_metadata read hostname 'smithi037' 2024-09-21T05:53:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.541+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/2592873790 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c6a011b8e0 0x55c6a0520fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.541+0000 7fb2a3a33740 4 client.15141 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:53:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.541+0000 7fb2a3a33740 1 -- 172.21.15.37:0/2592873790 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6a047cca0 con 0x55c6a011b8e0 2024-09-21T05:53:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.542+0000 7fb295e00640 1 --2- 172.21.15.37:0/2592873790 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c6a011b8e0 0x55c6a0520fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.542+0000 7fb295e00640 1 --2- 172.21.15.37:0/2592873790 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c6a011b8e0 0x55c6a0520fb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32cf7a9f5bb9c806 server_cookie=d0db50fd19da46db in_seq=0 out_seq=0 2024-09-21T05:53:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.542+0000 7fb277e00640 10 client.15141 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:53:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.543+0000 7fb277e00640 1 -- 172.21.15.37:0/2592873790 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c6a047cca0 con 0x55c6a011b8e0 2024-09-21T05:53:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.543+0000 7fb277e00640 10 client.15141 handle_command_reply: tid=0 2024-09-21T05:53:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.543+0000 7fb2a3a33740 1 client.15141 shutdown 2024-09-21T05:53:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.543+0000 7fb2a3a33740 1 -- 172.21.15.37:0/2592873790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 msgr2=0x55c6a051ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.543+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/2592873790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 0x55c6a051ad80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb290003cc0 tx=0x7fb29002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.543+0000 7fb2a3a33740 1 -- 172.21.15.37:0/2592873790 shutdown_connections 2024-09-21T05:53:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.543+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/2592873790 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c6a011b8e0 0x55c6a0520fb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.543+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/2592873790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a015cf60 0x55c6a051ad80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.543+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/2592873790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a013c280 0x55c6a050f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.543+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/2592873790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a01340a0 0x55c6a050f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.543+0000 7fb2a3a33740 1 -- 172.21.15.37:0/2592873790 >> 172.21.15.37:0/2592873790 conn(0x55c6a0151350 msgr2=0x55c6a0506670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.543+0000 7fb277e00640 0 client.15141 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:53:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.544+0000 7fb2a3a33740 1 -- 172.21.15.37:0/2592873790 shutdown_connections 2024-09-21T05:53:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.544+0000 7fb2a3a33740 1 -- 172.21.15.37:0/2592873790 wait complete. 2024-09-21T05:53:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.544+0000 7fb2a3a33740 20 client.15141 trim_cache size 0 max 16384 2024-09-21T05:53:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.563+0000 7fb2a3a33740 1 Processor -- start 2024-09-21T05:53:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.563+0000 7fb2a3a33740 1 -- start start 2024-09-21T05:53:07.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.563+0000 7fb2a3a33740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 0x55c6a051acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.563+0000 7fb2a3a33740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a013c280 0x55c6a0500ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.563+0000 7fb2a3a33740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a015cf60 0x55c6a0501220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.563+0000 7fb2a3a33740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c6a051f2f0 con 0x55c6a01340a0 2024-09-21T05:53:07.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.563+0000 7fb2a3a33740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c6a051f9c0 con 0x55c6a015cf60 2024-09-21T05:53:07.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.563+0000 7fb2a3a33740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c6a0520090 con 0x55c6a013c280 2024-09-21T05:53:07.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.563+0000 7fb295e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 0x55c6a051acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.563+0000 7fb295e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 0x55c6a051acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36846/0 (socket says 172.21.15.37:36846) 2024-09-21T05:53:07.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.563+0000 7fb295e00640 1 -- 172.21.15.37:0/413064999 learned_addr learned my addr 172.21.15.37:0/413064999 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:07.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.563+0000 7fb295400640 1 --2- 172.21.15.37:0/413064999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a013c280 0x55c6a0500ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.563+0000 7fb296800640 1 --2- 172.21.15.37:0/413064999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a015cf60 0x55c6a0501220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.564+0000 7fb295e00640 1 -- 172.21.15.37:0/413064999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a013c280 msgr2=0x55c6a0500ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.564+0000 7fb295e00640 1 --2- 172.21.15.37:0/413064999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a013c280 0x55c6a0500ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.564+0000 7fb295e00640 1 -- 172.21.15.37:0/413064999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a015cf60 msgr2=0x55c6a0501220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.564+0000 7fb295e00640 1 --2- 172.21.15.37:0/413064999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a015cf60 0x55c6a0501220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.564+0000 7fb295e00640 1 -- 172.21.15.37:0/413064999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a0505780 con 0x55c6a01340a0 2024-09-21T05:53:07.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.564+0000 7fb296800640 1 --2- 172.21.15.37:0/413064999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a015cf60 0x55c6a0501220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:07.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.564+0000 7fb295e00640 1 --2- 172.21.15.37:0/413064999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 0x55c6a051acf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb288004140 tx=0x7fb28801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596795c6d99782d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:07.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.564+0000 7fb282a00640 1 -- 172.21.15.37:0/413064999 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28801ebb0 con 0x55c6a01340a0 2024-09-21T05:53:07.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.565+0000 7fb282a00640 1 -- 172.21.15.37:0/413064999 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb28801ed50 con 0x55c6a01340a0 2024-09-21T05:53:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.565+0000 7fb282a00640 1 -- 172.21.15.37:0/413064999 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2880035f0 con 0x55c6a01340a0 2024-09-21T05:53:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.565+0000 7fb2a3a33740 1 -- 172.21.15.37:0/413064999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 msgr2=0x55c6a051acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.565+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/413064999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 0x55c6a051acf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb288004140 tx=0x7fb28801b000 comp rx=0 tx=0).stop 2024-09-21T05:53:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.565+0000 7fb2a3a33740 1 -- 172.21.15.37:0/413064999 shutdown_connections 2024-09-21T05:53:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.565+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/413064999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a015cf60 0x55c6a0501220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.565+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/413064999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a013c280 0x55c6a0500ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.565+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/413064999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 0x55c6a051acf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.565+0000 7fb2a3a33740 1 -- 172.21.15.37:0/413064999 >> 172.21.15.37:0/413064999 conn(0x55c6a0151350 msgr2=0x55c6a050f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.566+0000 7fb2a3a33740 1 -- 172.21.15.37:0/413064999 shutdown_connections 2024-09-21T05:53:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.566+0000 7fb2a3a33740 1 -- 172.21.15.37:0/413064999 wait complete. 2024-09-21T05:53:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.566+0000 7fb2a3a33740 1 -- start start 2024-09-21T05:53:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.566+0000 7fb2a3a33740 1 Processor -- start 2024-09-21T05:53:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb2a3a33740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 0x55c6a0529640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb2a3a33740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a013c280 0x55c6a0529c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb2a3a33740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a015cf60 0x55c6a0519e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb2a3a33740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c6a0520e30 con 0x55c6a01340a0 2024-09-21T05:53:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb2a3a33740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c6a0520760 con 0x55c6a013c280 2024-09-21T05:53:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb2a3a33740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c6a0521500 con 0x55c6a015cf60 2024-09-21T05:53:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb2a3a33740 10 client.0 _ll_register_callbacks cb 0x7fb29002f4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb295e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 0x55c6a0529640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb295e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 0x55c6a0529640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36860/0 (socket says 172.21.15.37:36860) 2024-09-21T05:53:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb295e00640 1 -- 172.21.15.37:0/4082969339 learned_addr learned my addr 172.21.15.37:0/4082969339 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb295400640 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a013c280 0x55c6a0529c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb296800640 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a015cf60 0x55c6a0519e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb295400640 1 -- 172.21.15.37:0/4082969339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a015cf60 msgr2=0x55c6a0519e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb295400640 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a015cf60 0x55c6a0519e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb295400640 1 -- 172.21.15.37:0/4082969339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 msgr2=0x55c6a0529640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb295400640 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 0x55c6a0529640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb295400640 1 -- 172.21.15.37:0/4082969339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a051a5b0 con 0x55c6a013c280 2024-09-21T05:53:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.567+0000 7fb295e00640 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 0x55c6a0529640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.568+0000 7fb295400640 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a013c280 0x55c6a0529c00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb2840e5020 tx=0x7fb2840ad0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5cad588b7e94a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.568+0000 7fb277e00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:53:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.568+0000 7fb277e00640 1 -- 172.21.15.37:0/4082969339 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2840a91f0 con 0x55c6a013c280 2024-09-21T05:53:07.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.568+0000 7fb277e00640 1 -- 172.21.15.37:0/4082969339 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fb2840b0de0 con 0x55c6a013c280 2024-09-21T05:53:07.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.568+0000 7fb2a3a33740 1 -- 172.21.15.37:0/4082969339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb28801ed50 con 0x55c6a013c280 2024-09-21T05:53:07.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.568+0000 7fb277e00640 1 -- 172.21.15.37:0/4082969339 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb2840ad1b0 con 0x55c6a013c280 2024-09-21T05:53:07.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.568+0000 7fb2a3a33740 10 client.25178 fetch_fsmap learned FSMap version 21 2024-09-21T05:53:07.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.568+0000 7fb2a3a33740 1 -- 172.21.15.37:0/4082969339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c6a0525d50 con 0x55c6a013c280 2024-09-21T05:53:07.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.568+0000 7fb277e00640 1 -- 172.21.15.37:0/4082969339 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb28801ed50 con 0x55c6a013c280 2024-09-21T05:53:07.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.569+0000 7fb277e00640 1 -- 172.21.15.37:0/4082969339 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb2840ac370 con 0x55c6a013c280 2024-09-21T05:53:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.569+0000 7fb2a3a33740 10 client.25178 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:53:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.569+0000 7fb2a3a33740 10 client.25178 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:53:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.569+0000 7fb2a3a33740 20 client.25178 populate_metadata read hostname 'smithi037' 2024-09-21T05:53:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.569+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c6a00f0c90 0x55c6a058f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.569+0000 7fb2a3a33740 4 client.25178 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:53:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.569+0000 7fb2a3a33740 1 -- 172.21.15.37:0/4082969339 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "status"}) -- 0x55c6a0478750 con 0x55c6a00f0c90 2024-09-21T05:53:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.569+0000 7fb295e00640 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c6a00f0c90 0x55c6a058f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb295e00640 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c6a00f0c90 0x55c6a058f8d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1889415d54201859 server_cookie=2a93330a21ab8ddc in_seq=0 out_seq=0 2024-09-21T05:53:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb277e00640 10 client.25178 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:53:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb277e00640 1 -- 172.21.15.37:0/4082969339 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c6a0478750 con 0x55c6a00f0c90 2024-09-21T05:53:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb277e00640 10 client.25178 handle_command_reply: tid=0 2024-09-21T05:53:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb2a3a33740 1 client.25178 shutdown 2024-09-21T05:53:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb2a3a33740 1 -- 172.21.15.37:0/4082969339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a013c280 msgr2=0x55c6a0529c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a013c280 0x55c6a0529c00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb2840e5020 tx=0x7fb2840ad0c0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb2a3a33740 1 -- 172.21.15.37:0/4082969339 shutdown_connections 2024-09-21T05:53:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c6a00f0c90 0x55c6a058f8d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6a015cf60 0x55c6a0519e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb277e00640 0 client.25178 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:53:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c6a013c280 0x55c6a0529c00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb2a3a33740 1 --2- 172.21.15.37:0/4082969339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a01340a0 0x55c6a0529640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb2a3a33740 1 -- 172.21.15.37:0/4082969339 >> 172.21.15.37:0/4082969339 conn(0x55c6a0151350 msgr2=0x55c6a050a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb2a3a33740 1 -- 172.21.15.37:0/4082969339 shutdown_connections 2024-09-21T05:53:07.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.570+0000 7fb2a3a33740 1 -- 172.21.15.37:0/4082969339 wait complete. 2024-09-21T05:53:07.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.571+0000 7fb2a3a33740 20 client.25178 trim_cache size 0 max 16384 2024-09-21T05:53:07.578 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:53:07.578 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "0c10cdda-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:53:07.578 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-09-21T05:53:07.578 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24731, 2024-09-21T05:53:07.578 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T05:53:07.578 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T05:53:07.578 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T05:53:07.578 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 131.677917288, 2024-09-21T05:53:07.579 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 21, 2024-09-21T05:53:07.579 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 90, 2024-09-21T05:53:07.579 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 88, 2024-09-21T05:53:07.579 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 146.89759239200001 2024-09-21T05:53:07.579 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:53:07.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.571+0000 7fb29ce00640 1 -- 172.21.15.37:0/196157586 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb27c0b65a0 msgr2=0x7fb27c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.571+0000 7fb29ce00640 1 --2- 172.21.15.37:0/196157586 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb27c0b65a0 0x7fb27c0b8ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55c6a0502110 tx=0x7fb288005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.571+0000 7fb29ce00640 1 -- 172.21.15.37:0/196157586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2981094c0 msgr2=0x7fb29819aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.571+0000 7fb29ce00640 1 --2- 172.21.15.37:0/196157586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2981094c0 0x7fb29819aa90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb29806ca10 tx=0x7fb28400ee50 comp rx=0 tx=0).stop 2024-09-21T05:53:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.571+0000 7fb29ce00640 1 -- 172.21.15.37:0/196157586 shutdown_connections 2024-09-21T05:53:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.571+0000 7fb29ce00640 1 --2- 172.21.15.37:0/196157586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb298109e10 0x7fb29819fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.571+0000 7fb29ce00640 1 --2- 172.21.15.37:0/196157586 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb27c0b65a0 0x7fb27c0b8ab0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.571+0000 7fb29ce00640 1 --2- 172.21.15.37:0/196157586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2981094c0 0x7fb29819aa90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.571+0000 7fb29ce00640 1 --2- 172.21.15.37:0/196157586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb298103b80 0x7fb29819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.571+0000 7fb29ce00640 1 -- 172.21.15.37:0/196157586 >> 172.21.15.37:0/196157586 conn(0x7fb2980ff5d0 msgr2=0x7fb298106a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.571+0000 7fb29ce00640 1 -- 172.21.15.37:0/196157586 shutdown_connections 2024-09-21T05:53:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:07.571+0000 7fb29ce00640 1 -- 172.21.15.37:0/196157586 wait complete. 2024-09-21T05:53:07.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:07 smithi037 ceph-mon[30631]: pgmap v390: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:53:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:07 smithi067 ceph-mon[34443]: pgmap v390: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:53:08.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:07 smithi144 ceph-mon[34351]: pgmap v390: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:53:08.452 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T05:53:08.452 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T05:53:08.464 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T05:53:08.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T05:53:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:09.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.472+0000 7f9bcb200640 1 -- 172.21.15.37:0/447532510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bcc104640 msgr2=0x7f9bcc104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:09.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.472+0000 7f9bcb200640 1 --2- 172.21.15.37:0/447532510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bcc104640 0x7f9bcc104a50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009900 tx=0x7f9bb402a480 comp rx=0 tx=0).stop 2024-09-21T05:53:09.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.472+0000 7f9bcb200640 1 -- 172.21.15.37:0/447532510 shutdown_connections 2024-09-21T05:53:09.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.472+0000 7f9bcb200640 1 --2- 172.21.15.37:0/447532510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc104fe0 0x7f9bcc10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:09.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.472+0000 7f9bcb200640 1 --2- 172.21.15.37:0/447532510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bcc104640 0x7f9bcc104a50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:09.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.472+0000 7f9bcb200640 1 --2- 172.21.15.37:0/447532510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bcc1035b0 0x7f9bcc103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:09.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.472+0000 7f9bcb200640 1 -- 172.21.15.37:0/447532510 >> 172.21.15.37:0/447532510 conn(0x7f9bcc0fef20 msgr2=0x7f9bcc1013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.472+0000 7f9bcb200640 1 -- 172.21.15.37:0/447532510 shutdown_connections 2024-09-21T05:53:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.472+0000 7f9bcb200640 1 -- 172.21.15.37:0/447532510 wait complete. 2024-09-21T05:53:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.473+0000 7f9bcb200640 1 Processor -- start 2024-09-21T05:53:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.474+0000 7f9bcb200640 1 -- start start 2024-09-21T05:53:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.474+0000 7f9bcb200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bcc1035b0 0x7f9bcc19c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.474+0000 7f9bcb200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc104640 0x7f9bcc19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.474+0000 7f9bcb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bcc104fe0 0x7f9bcc19d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.474+0000 7f9bcb200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc10f230 con 0x7f9bcc1035b0 2024-09-21T05:53:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.474+0000 7f9bcb200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc10f0b0 con 0x7f9bcc104640 2024-09-21T05:53:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.474+0000 7f9bcb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc10f3b0 con 0x7f9bcc104fe0 2024-09-21T05:53:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.474+0000 7f9bc9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bcc1035b0 0x7f9bcc19c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.474+0000 7f9bc1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc104640 0x7f9bcc19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.474+0000 7f9bc1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc104640 0x7f9bcc19c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:56556/0 (socket says 172.21.15.37:56556) 2024-09-21T05:53:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.474+0000 7f9bc1400640 1 -- 172.21.15.37:0/3158489816 learned_addr learned my addr 172.21.15.37:0/3158489816 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.475+0000 7f9bca800640 1 --2- 172.21.15.37:0/3158489816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bcc104fe0 0x7f9bcc19d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:09.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.475+0000 7f9bc1400640 1 -- 172.21.15.37:0/3158489816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bcc104fe0 msgr2=0x7f9bcc19d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:09.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.475+0000 7f9bc1400640 1 --2- 172.21.15.37:0/3158489816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bcc104fe0 0x7f9bcc19d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:09.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.475+0000 7f9bc1400640 1 -- 172.21.15.37:0/3158489816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bcc1035b0 msgr2=0x7f9bcc19c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:09.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.475+0000 7f9bc1400640 1 --2- 172.21.15.37:0/3158489816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bcc1035b0 0x7f9bcc19c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:09.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.475+0000 7f9bc1400640 1 -- 172.21.15.37:0/3158489816 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc19dac0 con 0x7f9bcc104640 2024-09-21T05:53:09.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.475+0000 7f9bc1400640 1 --2- 172.21.15.37:0/3158489816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc104640 0x7f9bcc19c700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4031440 tx=0x7f9bb4003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:09.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.476+0000 7f9bc3400640 1 -- 172.21.15.37:0/3158489816 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb403f070 con 0x7f9bcc104640 2024-09-21T05:53:09.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.476+0000 7f9bc3400640 1 -- 172.21.15.37:0/3158489816 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bb4031c50 con 0x7f9bcc104640 2024-09-21T05:53:09.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.476+0000 7f9bcb200640 1 -- 172.21.15.37:0/3158489816 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bcc19dd50 con 0x7f9bcc104640 2024-09-21T05:53:09.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.476+0000 7f9bc3400640 1 -- 172.21.15.37:0/3158489816 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4035030 con 0x7f9bcc104640 2024-09-21T05:53:09.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.476+0000 7f9bcb200640 1 -- 172.21.15.37:0/3158489816 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bcc1a42e0 con 0x7f9bcc104640 2024-09-21T05:53:09.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.477+0000 7f9bcb200640 1 -- 172.21.15.37:0/3158489816 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bcc1a4540 con 0x7f9bcc104640 2024-09-21T05:53:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.479+0000 7f9bc3400640 1 -- 172.21.15.37:0/3158489816 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f9bb4042070 con 0x7f9bcc104640 2024-09-21T05:53:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.481+0000 7f9bc3400640 1 --2- 172.21.15.37:0/3158489816 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9bb00b65a0 0x7f9bb00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.481+0000 7f9bc3400640 1 -- 172.21.15.37:0/3158489816 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f9bb4108830 con 0x7f9bcc104640 2024-09-21T05:53:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.481+0000 7f9bc9e00640 1 --2- 172.21.15.37:0/3158489816 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9bb00b65a0 0x7f9bb00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:09.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.482+0000 7f9bc9e00640 1 --2- 172.21.15.37:0/3158489816 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9bb00b65a0 0x7f9bb00b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009bd0 tx=0x7f9bbc005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:09.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.483+0000 7f9bc3400640 1 -- 172.21.15.37:0/3158489816 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9bb40d2f10 con 0x7f9bcc104640 2024-09-21T05:53:09.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.701+0000 7f9bcb200640 1 -- 172.21.15.37:0/3158489816 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f9bcc076d10 con 0x7f9bb00b65a0 2024-09-21T05:53:09.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.702+0000 7f9bc3400640 1 -- 172.21.15.37:0/3158489816 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9bcc076d10 con 0x7f9bb00b65a0 2024-09-21T05:53:09.704 INFO:teuthology.orchestra.run.smithi037.stdout:Backend: cephadm 2024-09-21T05:53:09.704 INFO:teuthology.orchestra.run.smithi037.stdout:Available: Yes 2024-09-21T05:53:09.705 INFO:teuthology.orchestra.run.smithi037.stdout:Paused: No 2024-09-21T05:53:09.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.704+0000 7f9bcb200640 1 -- 172.21.15.37:0/3158489816 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9bb00b65a0 msgr2=0x7f9bb00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:09.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.704+0000 7f9bcb200640 1 --2- 172.21.15.37:0/3158489816 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9bb00b65a0 0x7f9bb00b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009bd0 tx=0x7f9bbc005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:09.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.704+0000 7f9bcb200640 1 -- 172.21.15.37:0/3158489816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc104640 msgr2=0x7f9bcc19c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:09.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.704+0000 7f9bcb200640 1 --2- 172.21.15.37:0/3158489816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc104640 0x7f9bcc19c700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4031440 tx=0x7f9bb4003c10 comp rx=0 tx=0).stop 2024-09-21T05:53:09.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.704+0000 7f9bcb200640 1 -- 172.21.15.37:0/3158489816 shutdown_connections 2024-09-21T05:53:09.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.704+0000 7f9bcb200640 1 --2- 172.21.15.37:0/3158489816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bcc104fe0 0x7f9bcc19d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:09.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.704+0000 7f9bcb200640 1 --2- 172.21.15.37:0/3158489816 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9bb00b65a0 0x7f9bb00b8ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:09.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.704+0000 7f9bcb200640 1 --2- 172.21.15.37:0/3158489816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bcc104640 0x7f9bcc19c700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:09.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.704+0000 7f9bcb200640 1 --2- 172.21.15.37:0/3158489816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bcc1035b0 0x7f9bcc19c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:09.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.704+0000 7f9bcb200640 1 -- 172.21.15.37:0/3158489816 >> 172.21.15.37:0/3158489816 conn(0x7f9bcc0fef20 msgr2=0x7f9bcc0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:09.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.705+0000 7f9bcb200640 1 -- 172.21.15.37:0/3158489816 shutdown_connections 2024-09-21T05:53:09.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:09.705+0000 7f9bcb200640 1 -- 172.21.15.37:0/3158489816 wait complete. 2024-09-21T05:53:09.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:09 smithi037 ceph-mon[30631]: pgmap v391: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:09.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:09 smithi067 ceph-mon[34443]: pgmap v391: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:09 smithi144 ceph-mon[34351]: pgmap v391: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:10.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T05:53:10.909 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:10.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:10 smithi037 ceph-mon[30631]: from='client.25184 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:10.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:10 smithi067 ceph-mon[34443]: from='client.25184 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:11.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:10 smithi144 ceph-mon[34351]: from='client.25184 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:11.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.546+0000 7f76acc00640 1 -- 172.21.15.37:0/1410379004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a80770e0 msgr2=0x7f76a80757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:11.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.546+0000 7f76acc00640 1 --2- 172.21.15.37:0/1410379004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a80770e0 0x7f76a80757b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7698009900 tx=0x7f769802a410 comp rx=0 tx=0).stop 2024-09-21T05:53:11.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.546+0000 7f76acc00640 1 -- 172.21.15.37:0/1410379004 shutdown_connections 2024-09-21T05:53:11.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.547+0000 7f76acc00640 1 --2- 172.21.15.37:0/1410379004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76a810fee0 0x7f76a8112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.547+0000 7f76acc00640 1 --2- 172.21.15.37:0/1410379004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76a8075cf0 0x7f76a8076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.547+0000 7f76acc00640 1 --2- 172.21.15.37:0/1410379004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a80770e0 0x7f76a80757b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.547+0000 7f76acc00640 1 -- 172.21.15.37:0/1410379004 >> 172.21.15.37:0/1410379004 conn(0x7f76a80ff0c0 msgr2=0x7f76a8101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:11.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.547+0000 7f76acc00640 1 -- 172.21.15.37:0/1410379004 shutdown_connections 2024-09-21T05:53:11.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.547+0000 7f76acc00640 1 -- 172.21.15.37:0/1410379004 wait complete. 2024-09-21T05:53:11.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.548+0000 7f76acc00640 1 Processor -- start 2024-09-21T05:53:11.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.548+0000 7f76acc00640 1 -- start start 2024-09-21T05:53:11.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.548+0000 7f76acc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a8075cf0 0x7f76a81a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:11.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.548+0000 7f76acc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76a80770e0 0x7f76a81a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:11.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.548+0000 7f76acc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76a810fee0 0x7f76a81a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:11.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.549+0000 7f76acc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f76a81159e0 con 0x7f76a8075cf0 2024-09-21T05:53:11.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.549+0000 7f76acc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f76a8115860 con 0x7f76a80770e0 2024-09-21T05:53:11.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.549+0000 7f76acc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f76a8115b60 con 0x7f76a810fee0 2024-09-21T05:53:11.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.549+0000 7f76a5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a8075cf0 0x7f76a81a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.549+0000 7f76a5400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76a80770e0 0x7f76a81a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.549+0000 7f76a5400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76a80770e0 0x7f76a81a0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:45306/0 (socket says 172.21.15.37:45306) 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.549+0000 7f76a6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76a810fee0 0x7f76a81a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.549+0000 7f76a5400640 1 -- 172.21.15.37:0/908109667 learned_addr learned my addr 172.21.15.37:0/908109667 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.549+0000 7f76a5400640 1 -- 172.21.15.37:0/908109667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76a810fee0 msgr2=0x7f76a81a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.549+0000 7f76a5400640 1 --2- 172.21.15.37:0/908109667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76a810fee0 0x7f76a81a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.549+0000 7f76a5400640 1 -- 172.21.15.37:0/908109667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a8075cf0 msgr2=0x7f76a81a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.549+0000 7f76a5400640 1 --2- 172.21.15.37:0/908109667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a8075cf0 0x7f76a81a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.549+0000 7f76a5400640 1 -- 172.21.15.37:0/908109667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a81a1fd0 con 0x7f76a80770e0 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.550+0000 7f76a5400640 1 --2- 172.21.15.37:0/908109667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76a80770e0 0x7f76a81a0c10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f769400e9f0 tx=0x7f769400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.550+0000 7f769ea00640 1 -- 172.21.15.37:0/908109667 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769400cd80 con 0x7f76a80770e0 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.550+0000 7f769ea00640 1 -- 172.21.15.37:0/908109667 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76940108e0 con 0x7f76a80770e0 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.550+0000 7f769ea00640 1 -- 172.21.15.37:0/908109667 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694018980 con 0x7f76a80770e0 2024-09-21T05:53:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.550+0000 7f76acc00640 1 -- 172.21.15.37:0/908109667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a81a22c0 con 0x7f76a80770e0 2024-09-21T05:53:11.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.550+0000 7f76acc00640 1 -- 172.21.15.37:0/908109667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a81a89c0 con 0x7f76a80770e0 2024-09-21T05:53:11.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.551+0000 7f76acc00640 1 -- 172.21.15.37:0/908109667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a8076100 con 0x7f76a80770e0 2024-09-21T05:53:11.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.554+0000 7f769ea00640 1 -- 172.21.15.37:0/908109667 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f7694010430 con 0x7f76a80770e0 2024-09-21T05:53:11.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.555+0000 7f769ea00640 1 --2- 172.21.15.37:0/908109667 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f768c0b65a0 0x7f768c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:11.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.555+0000 7f769ea00640 1 -- 172.21.15.37:0/908109667 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f76940e8080 con 0x7f76a80770e0 2024-09-21T05:53:11.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.556+0000 7f76a5e00640 1 --2- 172.21.15.37:0/908109667 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f768c0b65a0 0x7f768c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:11.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.556+0000 7f76a5e00640 1 --2- 172.21.15.37:0/908109667 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f768c0b65a0 0x7f768c0b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7698031490 tx=0x7f7698005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:11.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.557+0000 7f769ea00640 1 -- 172.21.15.37:0/908109667 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76940b2760 con 0x7f76a80770e0 2024-09-21T05:53:11.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.764+0000 7f76acc00640 1 -- 172.21.15.37:0/908109667 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f76a8063800 con 0x7f768c0b65a0 2024-09-21T05:53:11.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.776+0000 7f769ea00640 1 -- 172.21.15.37:0/908109667 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f76a8063800 con 0x7f768c0b65a0 2024-09-21T05:53:11.779 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:53:11.779 INFO:teuthology.orchestra.run.smithi037.stdout:mds.a smithi037 running (2m) 17s ago 2m 80.7M - 19.3.0-5120-g18432218 ddce307e1f32 f94f9c88a7e9 2024-09-21T05:53:11.779 INFO:teuthology.orchestra.run.smithi037.stdout:mds.b smithi067 running (2m) 19s ago 2m 93.3M - 19.3.0-5120-g18432218 ddce307e1f32 7ea473fb763d 2024-09-21T05:53:11.779 INFO:teuthology.orchestra.run.smithi037.stdout:mds.c smithi144 running (2m) 19s ago 2m 83.2M - 19.3.0-5120-g18432218 ddce307e1f32 528f81ce7b52 2024-09-21T05:53:11.779 INFO:teuthology.orchestra.run.smithi037.stdout:mds.d smithi037 running (2m) 17s ago 2m 80.7M - 19.3.0-5120-g18432218 ddce307e1f32 b11eda651d28 2024-09-21T05:53:11.779 INFO:teuthology.orchestra.run.smithi037.stdout:mds.e smithi067 running (2m) 19s ago 2m 86.9M - 19.3.0-5120-g18432218 ddce307e1f32 b77f6d6dbd24 2024-09-21T05:53:11.779 INFO:teuthology.orchestra.run.smithi037.stdout:mds.f smithi144 running (2m) 19s ago 2m 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 fde8f51b11a7 2024-09-21T05:53:11.779 INFO:teuthology.orchestra.run.smithi037.stdout:mds.g smithi037 running (2m) 17s ago 2m 80.7M - 19.3.0-5120-g18432218 ddce307e1f32 171307452f4f 2024-09-21T05:53:11.779 INFO:teuthology.orchestra.run.smithi037.stdout:mds.h smithi067 running (2m) 19s ago 2m 82.5M - 19.3.0-5120-g18432218 ddce307e1f32 e4a148a54a25 2024-09-21T05:53:11.779 INFO:teuthology.orchestra.run.smithi037.stdout:mds.i smithi144 running (2m) 19s ago 2m 87.2M - 19.3.0-5120-g18432218 ddce307e1f32 22dbfef21f1f 2024-09-21T05:53:11.779 INFO:teuthology.orchestra.run.smithi037.stdout:mds.j smithi037 running (3m) 17s ago 2m 80.8M - 19.3.0-5120-g18432218 ddce307e1f32 03932e431185 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:mds.k smithi067 running (3m) 19s ago 3m 82.4M - 19.3.0-5120-g18432218 ddce307e1f32 8fc114606522 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:mds.l smithi144 running (3m) 19s ago 3m 84.7M - 19.3.0-5120-g18432218 ddce307e1f32 91a5a2896474 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.x smithi037 *:9283,8765 running (11m) 17s ago 11m 592M - 19.3.0-5120-g18432218 ddce307e1f32 1ffbce206b29 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.y smithi067 *:8443,8765 running (9m) 19s ago 9m 527M - 19.3.0-5120-g18432218 ddce307e1f32 36b1bb4f4b85 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.z smithi144 *:8443,8765 running (9m) 19s ago 9m 527M - 19.3.0-5120-g18432218 ddce307e1f32 5e62b2b9b8e1 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:mon.a smithi037 running (11m) 17s ago 11m 119M 2048M 19.3.0-5120-g18432218 ddce307e1f32 c8ccf76dc429 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:mon.b smithi067 running (9m) 19s ago 9m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 149ddd59da5c 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:mon.c smithi144 running (9m) 19s ago 9m 111M 2048M 19.3.0-5120-g18432218 ddce307e1f32 7790fe3a62af 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (8m) 17s ago 8m 119M 4273M 19.3.0-5120-g18432218 ddce307e1f32 a438eb8e1385 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi067 running (7m) 19s ago 7m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 b1a8d61ca3e2 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi144 running (7m) 19s ago 7m 124M 4272M 19.3.0-5120-g18432218 ddce307e1f32 6c5b5c10b018 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi037 running (7m) 17s ago 7m 118M 4273M 19.3.0-5120-g18432218 ddce307e1f32 c0bc85baf402 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi067 running (6m) 19s ago 6m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 4a98621b4bf9 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi144 running (6m) 19s ago 6m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 6eb2ab0b7dc9 2024-09-21T05:53:11.780 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 smithi037 running (5m) 17s ago 5m 110M 4273M 19.3.0-5120-g18432218 ddce307e1f32 fd466fcee6a8 2024-09-21T05:53:11.781 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 smithi067 running (5m) 19s ago 5m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 817a4017e49f 2024-09-21T05:53:11.781 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 smithi144 running (4m) 19s ago 4m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 af8a4901297e 2024-09-21T05:53:11.781 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 smithi037 running (4m) 17s ago 4m 116M 4273M 19.3.0-5120-g18432218 ddce307e1f32 0ab81d673621 2024-09-21T05:53:11.781 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 smithi067 running (3m) 19s ago 3m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 d940274a7e21 2024-09-21T05:53:11.781 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 smithi144 running (3m) 19s ago 3m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 6cc9df58bb68 2024-09-21T05:53:11.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.779+0000 7f76acc00640 1 -- 172.21.15.37:0/908109667 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f768c0b65a0 msgr2=0x7f768c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:11.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.779+0000 7f76acc00640 1 --2- 172.21.15.37:0/908109667 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f768c0b65a0 0x7f768c0b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7698031490 tx=0x7f7698005a20 comp rx=0 tx=0).stop 2024-09-21T05:53:11.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.779+0000 7f76acc00640 1 -- 172.21.15.37:0/908109667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76a80770e0 msgr2=0x7f76a81a0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:11.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.779+0000 7f76acc00640 1 --2- 172.21.15.37:0/908109667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76a80770e0 0x7f76a81a0c10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f769400e9f0 tx=0x7f769400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.779+0000 7f76acc00640 1 -- 172.21.15.37:0/908109667 shutdown_connections 2024-09-21T05:53:11.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.779+0000 7f76acc00640 1 --2- 172.21.15.37:0/908109667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76a810fee0 0x7f76a81a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.779+0000 7f76acc00640 1 --2- 172.21.15.37:0/908109667 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f768c0b65a0 0x7f768c0b8ab0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.779+0000 7f76acc00640 1 --2- 172.21.15.37:0/908109667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76a80770e0 0x7f76a81a0c10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.779+0000 7f76acc00640 1 --2- 172.21.15.37:0/908109667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a8075cf0 0x7f76a81a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:11.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.779+0000 7f76acc00640 1 -- 172.21.15.37:0/908109667 >> 172.21.15.37:0/908109667 conn(0x7f76a80ff0c0 msgr2=0x7f76a8103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:11.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.779+0000 7f76acc00640 1 -- 172.21.15.37:0/908109667 shutdown_connections 2024-09-21T05:53:11.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:11.779+0000 7f76acc00640 1 -- 172.21.15.37:0/908109667 wait complete. 2024-09-21T05:53:11.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:11 smithi037 ceph-mon[30631]: pgmap v392: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:11.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:11 smithi067 ceph-mon[34443]: pgmap v392: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:11 smithi144 ceph-mon[34351]: pgmap v392: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:12.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T05:53:12.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:12 smithi037 ceph-mon[30631]: from='client.25190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:12.939 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:12.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:12 smithi067 ceph-mon[34443]: from='client.25190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:13.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:12 smithi144 ceph-mon[34351]: from='client.25190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:13.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.525+0000 7ff70ca00640 1 -- 172.21.15.37:0/1553028618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff708109490 msgr2=0x7ff70810b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:13.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.525+0000 7ff70ca00640 1 --2- 172.21.15.37:0/1553028618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff708109490 0x7ff70810b9a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff700009ca0 tx=0x7ff70002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.525+0000 7ff70ca00640 1 -- 172.21.15.37:0/1553028618 shutdown_connections 2024-09-21T05:53:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.525+0000 7ff70ca00640 1 --2- 172.21.15.37:0/1553028618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff708109490 0x7ff70810b9a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.525+0000 7ff70ca00640 1 --2- 172.21.15.37:0/1553028618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7081068f0 0x7ff708108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.525+0000 7ff70ca00640 1 --2- 172.21.15.37:0/1553028618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff70806c6e0 0x7ff7081063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.525+0000 7ff70ca00640 1 -- 172.21.15.37:0/1553028618 >> 172.21.15.37:0/1553028618 conn(0x7ff7080fdfd0 msgr2=0x7ff708100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.525+0000 7ff70ca00640 1 -- 172.21.15.37:0/1553028618 shutdown_connections 2024-09-21T05:53:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.525+0000 7ff70ca00640 1 -- 172.21.15.37:0/1553028618 wait complete. 2024-09-21T05:53:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.526+0000 7ff70ca00640 1 Processor -- start 2024-09-21T05:53:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.526+0000 7ff70ca00640 1 -- start start 2024-09-21T05:53:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.527+0000 7ff70ca00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff70806c6e0 0x7ff70819c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.527+0000 7ff70ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7081068f0 0x7ff70819c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.527+0000 7ff70ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff708109490 0x7ff70819d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.527+0000 7ff70ca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff70810f400 con 0x7ff708109490 2024-09-21T05:53:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.527+0000 7ff70ca00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff70810f280 con 0x7ff70806c6e0 2024-09-21T05:53:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.527+0000 7ff70ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff70810f580 con 0x7ff7081068f0 2024-09-21T05:53:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.527+0000 7ff706800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff708109490 0x7ff70819d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.527+0000 7ff706800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff708109490 0x7ff70819d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56248/0 (socket says 172.21.15.37:56248) 2024-09-21T05:53:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.527+0000 7ff706800640 1 -- 172.21.15.37:0/1082268557 learned_addr learned my addr 172.21.15.37:0/1082268557 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.527+0000 7ff705e00640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff70806c6e0 0x7ff70819c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.527+0000 7ff6fd400640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7081068f0 0x7ff70819c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.528+0000 7ff706800640 1 -- 172.21.15.37:0/1082268557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7081068f0 msgr2=0x7ff70819c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.528+0000 7ff706800640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7081068f0 0x7ff70819c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.528+0000 7ff706800640 1 -- 172.21.15.37:0/1082268557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff70806c6e0 msgr2=0x7ff70819c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.528+0000 7ff706800640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff70806c6e0 0x7ff70819c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.528+0000 7ff706800640 1 -- 172.21.15.37:0/1082268557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70819dbd0 con 0x7ff708109490 2024-09-21T05:53:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.528+0000 7ff706800640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff708109490 0x7ff70819d3b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff700009430 tx=0x7ff7000316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.528+0000 7ff6ff400640 1 -- 172.21.15.37:0/1082268557 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700003b70 con 0x7ff708109490 2024-09-21T05:53:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.528+0000 7ff6ff400640 1 -- 172.21.15.37:0/1082268557 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff700003d10 con 0x7ff708109490 2024-09-21T05:53:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.528+0000 7ff70ca00640 1 -- 172.21.15.37:0/1082268557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff70819de60 con 0x7ff708109490 2024-09-21T05:53:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.528+0000 7ff6ff400640 1 -- 172.21.15.37:0/1082268557 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70002fb40 con 0x7ff708109490 2024-09-21T05:53:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.528+0000 7ff70ca00640 1 -- 172.21.15.37:0/1082268557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7081a45c0 con 0x7ff708109490 2024-09-21T05:53:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.530+0000 7ff70ca00640 1 -- 172.21.15.37:0/1082268557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff708106d40 con 0x7ff708109490 2024-09-21T05:53:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.534+0000 7ff6ff400640 1 -- 172.21.15.37:0/1082268557 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7ff700004610 con 0x7ff708109490 2024-09-21T05:53:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.535+0000 7ff6ff400640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff6ec0b65a0 0x7ff6ec0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.535+0000 7ff6ff400640 1 -- 172.21.15.37:0/1082268557 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7ff700108cd0 con 0x7ff708109490 2024-09-21T05:53:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.536+0000 7ff705e00640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff6ec0b65a0 0x7ff6ec0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.536+0000 7ff705e00640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff6ec0b65a0 0x7ff6ec0b8ab0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80095f0 tx=0x7ff6f8005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.538+0000 7ff6ff400640 1 -- 172.21.15.37:0/1082268557 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7000cefd0 con 0x7ff708109490 2024-09-21T05:53:13.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.744+0000 7ff70ca00640 1 -- 172.21.15.37:0/1082268557 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7ff708063800 con 0x7ff6ec0b65a0 2024-09-21T05:53:13.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.750+0000 7ff6ff400640 1 -- 172.21.15.37:0/1082268557 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7ff708063800 con 0x7ff6ec0b65a0 2024-09-21T05:53:13.752 INFO:teuthology.orchestra.run.smithi037.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T05:53:13.752 INFO:teuthology.orchestra.run.smithi037.stdout:mds.all 12/12 21s ago 3m smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-21T05:53:13.752 INFO:teuthology.orchestra.run.smithi037.stdout:mgr 3/3 21s ago 9m smithi037=x;smithi067=y;smithi144=z;count:3 2024-09-21T05:53:13.753 INFO:teuthology.orchestra.run.smithi037.stdout:mon 3/3 21s ago 9m smithi037:172.21.15.37=a;smithi067:172.21.15.67=b;smithi144:172.21.15.144=c;count:3 2024-09-21T05:53:13.753 INFO:teuthology.orchestra.run.smithi037.stdout:osd 12 21s ago - 2024-09-21T05:53:13.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.753+0000 7ff70ca00640 1 -- 172.21.15.37:0/1082268557 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff6ec0b65a0 msgr2=0x7ff6ec0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:13.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.753+0000 7ff70ca00640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff6ec0b65a0 0x7ff6ec0b8ab0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80095f0 tx=0x7ff6f8005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:13.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.753+0000 7ff70ca00640 1 -- 172.21.15.37:0/1082268557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff708109490 msgr2=0x7ff70819d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:13.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.753+0000 7ff70ca00640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff708109490 0x7ff70819d3b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff700009430 tx=0x7ff7000316f0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.753+0000 7ff70ca00640 1 -- 172.21.15.37:0/1082268557 shutdown_connections 2024-09-21T05:53:13.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.753+0000 7ff70ca00640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff708109490 0x7ff70819d3b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.753+0000 7ff70ca00640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7081068f0 0x7ff70819c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.753+0000 7ff70ca00640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ff6ec0b65a0 0x7ff6ec0b8ab0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.753+0000 7ff70ca00640 1 --2- 172.21.15.37:0/1082268557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff70806c6e0 0x7ff70819c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:13.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.753+0000 7ff70ca00640 1 -- 172.21.15.37:0/1082268557 >> 172.21.15.37:0/1082268557 conn(0x7ff7080fdfd0 msgr2=0x7ff708104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:13.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.753+0000 7ff70ca00640 1 -- 172.21.15.37:0/1082268557 shutdown_connections 2024-09-21T05:53:13.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:13.753+0000 7ff70ca00640 1 -- 172.21.15.37:0/1082268557 wait complete. 2024-09-21T05:53:13.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:13 smithi067 ceph-mon[34443]: pgmap v393: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:53:14.109 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:13 smithi037 ceph-mon[30631]: pgmap v393: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:53:14.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:13 smithi144 ceph-mon[34351]: pgmap v393: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:53:14.479 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T05:53:14.862 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:14.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:14 smithi037 ceph-mon[30631]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:14.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:14 smithi067 ceph-mon[34443]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:15.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:14 smithi144 ceph-mon[34351]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:15.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.485+0000 7f2520e00640 1 -- 172.21.15.37:0/599194139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f251c103750 msgr2=0x7f251c103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:15.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.485+0000 7f2520e00640 1 --2- 172.21.15.37:0/599194139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f251c103750 0x7f251c103bc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f250c009900 tx=0x7f250c02a480 comp rx=0 tx=0).stop 2024-09-21T05:53:15.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.485+0000 7f2520e00640 1 -- 172.21.15.37:0/599194139 shutdown_connections 2024-09-21T05:53:15.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.485+0000 7f2520e00640 1 --2- 172.21.15.37:0/599194139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f251c105180 0x7f251c10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.485+0000 7f2520e00640 1 --2- 172.21.15.37:0/599194139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f251c1047e0 0x7f251c104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.485+0000 7f2520e00640 1 --2- 172.21.15.37:0/599194139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f251c103750 0x7f251c103bc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.485+0000 7f2520e00640 1 -- 172.21.15.37:0/599194139 >> 172.21.15.37:0/599194139 conn(0x7f251c0ff0c0 msgr2=0x7f251c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:15.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.485+0000 7f2520e00640 1 -- 172.21.15.37:0/599194139 shutdown_connections 2024-09-21T05:53:15.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.485+0000 7f2520e00640 1 -- 172.21.15.37:0/599194139 wait complete. 2024-09-21T05:53:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.486+0000 7f2520e00640 1 Processor -- start 2024-09-21T05:53:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.486+0000 7f2520e00640 1 -- start start 2024-09-21T05:53:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.486+0000 7f2520e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f251c103750 0x7f251c19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.486+0000 7f2520e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f251c1047e0 0x7f251c19c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.486+0000 7f2520e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f251c105180 0x7f251c19d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.486+0000 7f2520e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f251c10f3e0 con 0x7f251c1047e0 2024-09-21T05:53:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.486+0000 7f2520e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f251c10f260 con 0x7f251c105180 2024-09-21T05:53:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.486+0000 7f2520e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f251c10f560 con 0x7f251c103750 2024-09-21T05:53:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.487+0000 7f2519e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f251c103750 0x7f251c19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.487+0000 7f2513e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f251c1047e0 0x7f251c19c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.487+0000 7f2519e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f251c103750 0x7f251c19c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:35942/0 (socket says 172.21.15.37:35942) 2024-09-21T05:53:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.487+0000 7f2519e00640 1 -- 172.21.15.37:0/2821123914 learned_addr learned my addr 172.21.15.37:0/2821123914 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.487+0000 7f251a800640 1 --2- 172.21.15.37:0/2821123914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f251c105180 0x7f251c19d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.487+0000 7f2513e00640 1 -- 172.21.15.37:0/2821123914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f251c103750 msgr2=0x7f251c19c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:15.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.487+0000 7f2513e00640 1 --2- 172.21.15.37:0/2821123914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f251c103750 0x7f251c19c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.487+0000 7f2513e00640 1 -- 172.21.15.37:0/2821123914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f251c105180 msgr2=0x7f251c19d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:15.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.487+0000 7f2513e00640 1 --2- 172.21.15.37:0/2821123914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f251c105180 0x7f251c19d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.487+0000 7f2513e00640 1 -- 172.21.15.37:0/2821123914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f251c19dc10 con 0x7f251c1047e0 2024-09-21T05:53:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.488+0000 7f2513e00640 1 --2- 172.21.15.37:0/2821123914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f251c1047e0 0x7f251c19c850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f250400e9f0 tx=0x7f250400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.488+0000 7f2512a00640 1 -- 172.21.15.37:0/2821123914 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250400ccc0 con 0x7f251c1047e0 2024-09-21T05:53:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.488+0000 7f2512a00640 1 -- 172.21.15.37:0/2821123914 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2504005020 con 0x7f251c1047e0 2024-09-21T05:53:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.488+0000 7f2520e00640 1 -- 172.21.15.37:0/2821123914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f251c19df00 con 0x7f251c1047e0 2024-09-21T05:53:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.488+0000 7f2512a00640 1 -- 172.21.15.37:0/2821123914 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2504004a00 con 0x7f251c1047e0 2024-09-21T05:53:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.488+0000 7f2520e00640 1 -- 172.21.15.37:0/2821123914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f251c1a4600 con 0x7f251c1047e0 2024-09-21T05:53:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.489+0000 7f2520e00640 1 -- 172.21.15.37:0/2821123914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f251c1a47d0 con 0x7f251c1047e0 2024-09-21T05:53:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.492+0000 7f2512a00640 1 -- 172.21.15.37:0/2821123914 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f2504004ba0 con 0x7f251c1047e0 2024-09-21T05:53:15.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.493+0000 7f2512a00640 1 --2- 172.21.15.37:0/2821123914 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f25000b65a0 0x7f25000b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:15.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.493+0000 7f2512a00640 1 -- 172.21.15.37:0/2821123914 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f25040e7870 con 0x7f251c1047e0 2024-09-21T05:53:15.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.493+0000 7f2519e00640 1 --2- 172.21.15.37:0/2821123914 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f25000b65a0 0x7f25000b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:15.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.494+0000 7f2519e00640 1 --2- 172.21.15.37:0/2821123914 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f25000b65a0 0x7f25000b8ab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f250c005f70 tx=0x7f250c0314a0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:15.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.497+0000 7f2512a00640 1 -- 172.21.15.37:0/2821123914 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25040adb70 con 0x7f251c1047e0 2024-09-21T05:53:15.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.703+0000 7f2520e00640 1 -- 172.21.15.37:0/2821123914 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f251c076d10 con 0x7f25000b65a0 2024-09-21T05:53:15.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.704+0000 7f2512a00640 1 -- 172.21.15.37:0/2821123914 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f251c076d10 con 0x7f25000b65a0 2024-09-21T05:53:15.706 INFO:teuthology.orchestra.run.smithi037.stdout:HOST ADDR LABELS STATUS 2024-09-21T05:53:15.707 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 172.21.15.37 2024-09-21T05:53:15.707 INFO:teuthology.orchestra.run.smithi037.stdout:smithi067 172.21.15.67 2024-09-21T05:53:15.707 INFO:teuthology.orchestra.run.smithi037.stdout:smithi144 172.21.15.144 2024-09-21T05:53:15.707 INFO:teuthology.orchestra.run.smithi037.stdout:3 hosts in cluster 2024-09-21T05:53:15.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.706+0000 7f2520e00640 1 -- 172.21.15.37:0/2821123914 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f25000b65a0 msgr2=0x7f25000b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:15.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.706+0000 7f2520e00640 1 --2- 172.21.15.37:0/2821123914 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f25000b65a0 0x7f25000b8ab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f250c005f70 tx=0x7f250c0314a0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.706+0000 7f2520e00640 1 -- 172.21.15.37:0/2821123914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f251c1047e0 msgr2=0x7f251c19c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:15.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.706+0000 7f2520e00640 1 --2- 172.21.15.37:0/2821123914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f251c1047e0 0x7f251c19c850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f250400e9f0 tx=0x7f250400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.707+0000 7f2520e00640 1 -- 172.21.15.37:0/2821123914 shutdown_connections 2024-09-21T05:53:15.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.707+0000 7f2520e00640 1 --2- 172.21.15.37:0/2821123914 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f25000b65a0 0x7f25000b8ab0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.707+0000 7f2520e00640 1 --2- 172.21.15.37:0/2821123914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f251c105180 0x7f251c19d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.707+0000 7f2520e00640 1 --2- 172.21.15.37:0/2821123914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f251c1047e0 0x7f251c19c850 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.707+0000 7f2520e00640 1 --2- 172.21.15.37:0/2821123914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f251c103750 0x7f251c19c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:15.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.707+0000 7f2520e00640 1 -- 172.21.15.37:0/2821123914 >> 172.21.15.37:0/2821123914 conn(0x7f251c0ff0c0 msgr2=0x7f251c0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:15.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.707+0000 7f2520e00640 1 -- 172.21.15.37:0/2821123914 shutdown_connections 2024-09-21T05:53:15.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:15.707+0000 7f2520e00640 1 -- 172.21.15.37:0/2821123914 wait complete. 2024-09-21T05:53:15.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:15 smithi067 ceph-mon[34443]: pgmap v394: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:16.081 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:15 smithi037 ceph-mon[30631]: pgmap v394: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:16.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:15 smithi144 ceph-mon[34351]: pgmap v394: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:16.625 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T05:53:16.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:16 smithi037 ceph-mon[30631]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:16.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:16 smithi067 ceph-mon[34443]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:17.013 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:17.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:16 smithi144 ceph-mon[34351]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.711+0000 7f3645a00640 1 -- 172.21.15.37:0/2523044243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f364010b5b0 msgr2=0x7f364010d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.711+0000 7f3645a00640 1 --2- 172.21.15.37:0/2523044243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f364010b5b0 0x7f364010d9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3638009ca0 tx=0x7f363802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.712+0000 7f3645a00640 1 -- 172.21.15.37:0/2523044243 shutdown_connections 2024-09-21T05:53:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.712+0000 7f3645a00640 1 --2- 172.21.15.37:0/2523044243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f364010b5b0 0x7f364010d9f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.712+0000 7f3645a00640 1 --2- 172.21.15.37:0/2523044243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3640075c90 0x7f36400760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.712+0000 7f3645a00640 1 --2- 172.21.15.37:0/2523044243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3640077080 0x7f3640075750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.712+0000 7f3645a00640 1 -- 172.21.15.37:0/2523044243 >> 172.21.15.37:0/2523044243 conn(0x7f36400fef20 msgr2=0x7f36401013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.712+0000 7f3645a00640 1 -- 172.21.15.37:0/2523044243 shutdown_connections 2024-09-21T05:53:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.712+0000 7f3645a00640 1 -- 172.21.15.37:0/2523044243 wait complete. 2024-09-21T05:53:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.713+0000 7f3645a00640 1 Processor -- start 2024-09-21T05:53:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.713+0000 7f3645a00640 1 -- start start 2024-09-21T05:53:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.713+0000 7f3645a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3640075c90 0x7f364019c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.713+0000 7f3645a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3640077080 0x7f364019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.713+0000 7f3645a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f364010b5b0 0x7f364019d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.713+0000 7f3645a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3640111440 con 0x7f364010b5b0 2024-09-21T05:53:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.713+0000 7f3645a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f36401112c0 con 0x7f3640075c90 2024-09-21T05:53:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.713+0000 7f3645a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f36401115c0 con 0x7f3640077080 2024-09-21T05:53:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.714+0000 7f363fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3640075c90 0x7f364019c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.714+0000 7f3645000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f364010b5b0 0x7f364019d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.714+0000 7f3645000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f364010b5b0 0x7f364019d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56260/0 (socket says 172.21.15.37:56260) 2024-09-21T05:53:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.714+0000 7f363f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3640077080 0x7f364019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.714+0000 7f3645000640 1 -- 172.21.15.37:0/3458966460 learned_addr learned my addr 172.21.15.37:0/3458966460 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.714+0000 7f363fe00640 1 -- 172.21.15.37:0/3458966460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3640077080 msgr2=0x7f364019c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.714+0000 7f363fe00640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3640077080 0x7f364019c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.714+0000 7f363fe00640 1 -- 172.21.15.37:0/3458966460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f364010b5b0 msgr2=0x7f364019d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.714+0000 7f363fe00640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f364010b5b0 0x7f364019d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.714+0000 7f363fe00640 1 -- 172.21.15.37:0/3458966460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364019da30 con 0x7f3640075c90 2024-09-21T05:53:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.714+0000 7f363f400640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3640077080 0x7f364019c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.714+0000 7f3645000640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f364010b5b0 0x7f364019d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.715+0000 7f363fe00640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3640075c90 0x7f364019c000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f363000e9f0 tx=0x7f363000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.715+0000 7f363cc00640 1 -- 172.21.15.37:0/3458966460 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363000cd80 con 0x7f3640075c90 2024-09-21T05:53:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.715+0000 7f363cc00640 1 -- 172.21.15.37:0/3458966460 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36300035f0 con 0x7f3640075c90 2024-09-21T05:53:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.715+0000 7f3645a00640 1 -- 172.21.15.37:0/3458966460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364019dd20 con 0x7f3640075c90 2024-09-21T05:53:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.715+0000 7f363cc00640 1 -- 172.21.15.37:0/3458966460 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630010670 con 0x7f3640075c90 2024-09-21T05:53:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.715+0000 7f3645a00640 1 -- 172.21.15.37:0/3458966460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36401a4420 con 0x7f3640075c90 2024-09-21T05:53:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.716+0000 7f3645a00640 1 -- 172.21.15.37:0/3458966460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36401a4650 con 0x7f3640075c90 2024-09-21T05:53:17.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.718+0000 7f363cc00640 1 -- 172.21.15.37:0/3458966460 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 154563+0+0 (secure 0 0 0) 0x7f36300037a0 con 0x7f3640075c90 2024-09-21T05:53:17.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.720+0000 7f363cc00640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f36240b6620 0x7f36240b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:17.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.720+0000 7f363cc00640 1 -- 172.21.15.37:0/3458966460 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f36300e7dc0 con 0x7f3640075c90 2024-09-21T05:53:17.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.720+0000 7f363f400640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f36240b6620 0x7f36240b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:17.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.721+0000 7f363f400640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f36240b6620 0x7f36240b8b30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f362c009fc0 tx=0x7f362c005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:17.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.722+0000 7f363cc00640 1 -- 172.21.15.37:0/3458966460 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36300ae0c0 con 0x7f3640075c90 2024-09-21T05:53:17.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:17 smithi037 ceph-mon[30631]: pgmap v395: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:53:17.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.931+0000 7f3645a00640 1 -- 172.21.15.37:0/3458966460 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f36400ffa40 con 0x7f36240b6620 2024-09-21T05:53:17.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.933+0000 7f363cc00640 1 -- 172.21.15.37:0/3458966460 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f36400ffa40 con 0x7f36240b6620 2024-09-21T05:53:17.935 INFO:teuthology.orchestra.run.smithi037.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T05:53:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005T400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-09-21T05:53:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:smithi067 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53440042400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T05:53:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:smithi144 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62050085400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T05:53:17.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.936+0000 7f3645a00640 1 -- 172.21.15.37:0/3458966460 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f36240b6620 msgr2=0x7f36240b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:17.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.936+0000 7f3645a00640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f36240b6620 0x7f36240b8b30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f362c009fc0 tx=0x7f362c005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:17.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.936+0000 7f3645a00640 1 -- 172.21.15.37:0/3458966460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3640075c90 msgr2=0x7f364019c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:17.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.936+0000 7f3645a00640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3640075c90 0x7f364019c000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f363000e9f0 tx=0x7f363000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:17.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.936+0000 7f3645a00640 1 -- 172.21.15.37:0/3458966460 shutdown_connections 2024-09-21T05:53:17.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.936+0000 7f3645a00640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f364010b5b0 0x7f364019d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:17.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.936+0000 7f3645a00640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3640077080 0x7f364019c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:17.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.936+0000 7f3645a00640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f36240b6620 0x7f36240b8b30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:17.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.936+0000 7f3645a00640 1 --2- 172.21.15.37:0/3458966460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3640075c90 0x7f364019c000 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:17.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.936+0000 7f3645a00640 1 -- 172.21.15.37:0/3458966460 >> 172.21.15.37:0/3458966460 conn(0x7f36400fef20 msgr2=0x7f36400ff330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:17.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.936+0000 7f3645a00640 1 -- 172.21.15.37:0/3458966460 shutdown_connections 2024-09-21T05:53:17.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:17.936+0000 7f3645a00640 1 -- 172.21.15.37:0/3458966460 wait complete. 2024-09-21T05:53:17.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:17 smithi067 ceph-mon[34443]: pgmap v395: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:53:18.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:17 smithi144 ceph-mon[34351]: pgmap v395: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:53:18.671 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T05:53:18.681 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T05:53:18.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T05:53:18.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:18 smithi037 ceph-mon[30631]: from='client.25208 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:18.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:18 smithi067 ceph-mon[34443]: from='client.25208 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:19.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:18 smithi144 ceph-mon[34351]: from='client.25208 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:53:19.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.704+0000 7f1ceec00640 1 -- 172.21.15.37:0/1381709389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8103570 msgr2=0x7f1ce81039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:19.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.704+0000 7f1ceec00640 1 --2- 172.21.15.37:0/1381709389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8103570 0x7f1ce81039e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009900 tx=0x7f1cdc02a480 comp rx=0 tx=0).stop 2024-09-21T05:53:19.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.704+0000 7f1ceec00640 1 -- 172.21.15.37:0/1381709389 shutdown_connections 2024-09-21T05:53:19.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.704+0000 7f1ceec00640 1 --2- 172.21.15.37:0/1381709389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ce8104fa0 0x7f1ce810b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.704+0000 7f1ceec00640 1 --2- 172.21.15.37:0/1381709389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce8104600 0x7f1ce8104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.704+0000 7f1ceec00640 1 --2- 172.21.15.37:0/1381709389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8103570 0x7f1ce81039e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.704+0000 7f1ceec00640 1 -- 172.21.15.37:0/1381709389 >> 172.21.15.37:0/1381709389 conn(0x7f1ce80feec0 msgr2=0x7f1ce8101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.705+0000 7f1ceec00640 1 -- 172.21.15.37:0/1381709389 shutdown_connections 2024-09-21T05:53:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.705+0000 7f1ceec00640 1 -- 172.21.15.37:0/1381709389 wait complete. 2024-09-21T05:53:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.705+0000 7f1ceec00640 1 Processor -- start 2024-09-21T05:53:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.706+0000 7f1ceec00640 1 -- start start 2024-09-21T05:53:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.706+0000 7f1ceec00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ce8103570 0x7f1ce8076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.706+0000 7f1ceec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8104600 0x7f1ce8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.706+0000 7f1ceec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce8104fa0 0x7f1ce8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.706+0000 7f1ceec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce810f210 con 0x7f1ce8104600 2024-09-21T05:53:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.706+0000 7f1ceec00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce810f090 con 0x7f1ce8103570 2024-09-21T05:53:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.706+0000 7f1ceec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce810f390 con 0x7f1ce8104fa0 2024-09-21T05:53:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.706+0000 7f1cece00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8104600 0x7f1ce8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.706+0000 7f1cece00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8104600 0x7f1ce8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56276/0 (socket says 172.21.15.37:56276) 2024-09-21T05:53:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.706+0000 7f1ced800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ce8103570 0x7f1ce8076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.706+0000 7f1cece00640 1 -- 172.21.15.37:0/573018416 learned_addr learned my addr 172.21.15.37:0/573018416 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.707+0000 7f1cee200640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce8104fa0 0x7f1ce8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.707+0000 7f1ced800640 1 -- 172.21.15.37:0/573018416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce8104fa0 msgr2=0x7f1ce8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.707+0000 7f1ced800640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce8104fa0 0x7f1ce8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.707+0000 7f1ced800640 1 -- 172.21.15.37:0/573018416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8104600 msgr2=0x7f1ce8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.707+0000 7f1ced800640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8104600 0x7f1ce8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.707+0000 7f1ced800640 1 -- 172.21.15.37:0/573018416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce8076350 con 0x7f1ce8103570 2024-09-21T05:53:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.707+0000 7f1cece00640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8104600 0x7f1ce8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.707+0000 7f1ced800640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ce8103570 0x7f1ce8076e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc02aa70 tx=0x7f1cdc003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.708+0000 7f1ce6000640 1 -- 172.21.15.37:0/573018416 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc03f070 con 0x7f1ce8103570 2024-09-21T05:53:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.708+0000 7f1ce6000640 1 -- 172.21.15.37:0/573018416 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cdc031c50 con 0x7f1ce8103570 2024-09-21T05:53:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.708+0000 7f1ceec00640 1 -- 172.21.15.37:0/573018416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce81a3ed0 con 0x7f1ce8103570 2024-09-21T05:53:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.708+0000 7f1ce6000640 1 -- 172.21.15.37:0/573018416 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc035030 con 0x7f1ce8103570 2024-09-21T05:53:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.708+0000 7f1ceec00640 1 -- 172.21.15.37:0/573018416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce81a4270 con 0x7f1ce8103570 2024-09-21T05:53:19.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.709+0000 7f1ceec00640 1 -- 172.21.15.37:0/573018416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce810a750 con 0x7f1ce8103570 2024-09-21T05:53:19.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.711+0000 7f1ce6000640 1 -- 172.21.15.37:0/573018416 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1cdc042070 con 0x7f1ce8103570 2024-09-21T05:53:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.713+0000 7f1ce6000640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1cd00b6590 0x7f1cd00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.713+0000 7f1ce6000640 1 -- 172.21.15.37:0/573018416 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f1cdc108750 con 0x7f1ce8103570 2024-09-21T05:53:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.713+0000 7f1cece00640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1cd00b6590 0x7f1cd00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:19.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.714+0000 7f1cece00640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1cd00b6590 0x7f1cd00b8aa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4011500 tx=0x7f1cd4005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:19.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.715+0000 7f1ce6000640 1 -- 172.21.15.37:0/573018416 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1cdc0d2f90 con 0x7f1ce8103570 2024-09-21T05:53:19.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:19 smithi037 ceph-mon[30631]: pgmap v396: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:19.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:19 smithi037 ceph-mon[30631]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T05:53:19.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.952+0000 7f1ceec00640 1 -- 172.21.15.37:0/573018416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1ce802e7a0 con 0x7f1ce8103570 2024-09-21T05:53:19.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.953+0000 7f1ce6000640 1 -- 172.21.15.37:0/573018416 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3050 (secure 0 0 0) 0x7f1cdc0d7ed0 con 0x7f1ce8103570 2024-09-21T05:53:19.955 INFO:teuthology.orchestra.run.smithi037.stdout:e21 2024-09-21T05:53:19.955 INFO:teuthology.orchestra.run.smithi037.stdout:btime 2024-09-21T05:51:50:445515+0000 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 21 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-09-21T05:50:54.973656+0000 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-09-21T05:51:49.877112+0000 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 300 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-09-21T05:53:19.956 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=24731} 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3,4] 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 0 2024-09-21T05:53:19.957 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 24731 members: 24731 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b{0:24731} state up:active seq 5 addr [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.i{0:24706} state up:standby-replay seq 1 addr [v2:172.21.15.144:6838/2186109815,v1:172.21.15.144:6839/2186109815] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.j{-1:14619} state up:standby seq 1 addr [v2:172.21.15.37:6834/2170500784,v1:172.21.15.37:6835/2170500784] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d{-1:14631} state up:standby seq 1 addr [v2:172.21.15.37:6836/2573014939,v1:172.21.15.37:6837/2573014939] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.g{-1:14679} state up:standby seq 1 addr [v2:172.21.15.37:6838/2136415371,v1:172.21.15.37:6839/2136415371] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a{-1:14691} state up:standby seq 1 addr [v2:172.21.15.37:6840/1236048708,v1:172.21.15.37:6841/1236048708] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.l{-1:24631} state up:standby seq 1 addr [v2:172.21.15.144:6832/3966820038,v1:172.21.15.144:6833/3966820038] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.k{-1:24638} state up:standby seq 1 addr [v2:172.21.15.67:6832/2950882558,v1:172.21.15.67:6833/2950882558] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.e{-1:24668} state up:standby seq 1 addr [v2:172.21.15.67:6834/2708261252,v1:172.21.15.67:6835/2708261252] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.f{-1:24679} state up:standby seq 1 addr [v2:172.21.15.144:6834/3872897790,v1:172.21.15.144:6835/3872897790] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:19.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c{-1:24691} state up:standby seq 1 addr [v2:172.21.15.144:6836/1687841256,v1:172.21.15.144:6837/1687841256] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:19.959 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.h{-1:24695} state up:standby seq 1 addr [v2:172.21.15.67:6836/2398426210,v1:172.21.15.67:6837/2398426210] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T05:53:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:53:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.956+0000 7f1ceec00640 1 -- 172.21.15.37:0/573018416 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1cd00b6590 msgr2=0x7f1cd00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.956+0000 7f1ceec00640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1cd00b6590 0x7f1cd00b8aa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4011500 tx=0x7f1cd4005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.956+0000 7f1ceec00640 1 -- 172.21.15.37:0/573018416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ce8103570 msgr2=0x7f1ce8076e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.956+0000 7f1ceec00640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ce8103570 0x7f1ce8076e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc02aa70 tx=0x7f1cdc003c10 comp rx=0 tx=0).stop 2024-09-21T05:53:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.957+0000 7f1ceec00640 1 -- 172.21.15.37:0/573018416 shutdown_connections 2024-09-21T05:53:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.957+0000 7f1ceec00640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce8104fa0 0x7f1ce8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.957+0000 7f1ceec00640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8104600 0x7f1ce8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.957+0000 7f1ceec00640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1cd00b6590 0x7f1cd00b8aa0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.957+0000 7f1ceec00640 1 --2- 172.21.15.37:0/573018416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ce8103570 0x7f1ce8076e40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.957+0000 7f1ceec00640 1 -- 172.21.15.37:0/573018416 >> 172.21.15.37:0/573018416 conn(0x7f1ce80feec0 msgr2=0x7f1ce8107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.957+0000 7f1ceec00640 1 -- 172.21.15.37:0/573018416 shutdown_connections 2024-09-21T05:53:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:19.957+0000 7f1ceec00640 1 -- 172.21.15.37:0/573018416 wait complete. 2024-09-21T05:53:19.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:19 smithi067 ceph-mon[34443]: pgmap v396: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:19.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:19 smithi067 ceph-mon[34443]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T05:53:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:19 smithi144 ceph-mon[34351]: pgmap v396: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:19 smithi144 ceph-mon[34351]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T05:53:20.721 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T05:53:20.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:20 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/573018416' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T05:53:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:21.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:20 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/573018416' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T05:53:21.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:20 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/573018416' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T05:53:21.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.789+0000 7fec61200640 1 -- 172.21.15.37:0/3352213593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c105790 msgr2=0x7fec5c105c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:21.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.789+0000 7fec61200640 1 --2- 172.21.15.37:0/3352213593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c105790 0x7fec5c105c00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009860 tx=0x7fec4c02a3d0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.789+0000 7fec61200640 1 -- 172.21.15.37:0/3352213593 shutdown_connections 2024-09-21T05:53:21.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.789+0000 7fec61200640 1 --2- 172.21.15.37:0/3352213593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c1071c0 0x7fec5c10db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.789+0000 7fec61200640 1 --2- 172.21.15.37:0/3352213593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec5c106820 0x7fec5c106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.789+0000 7fec61200640 1 --2- 172.21.15.37:0/3352213593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c105790 0x7fec5c105c00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.789+0000 7fec61200640 1 -- 172.21.15.37:0/3352213593 >> 172.21.15.37:0/3352213593 conn(0x7fec5c1010e0 msgr2=0x7fec5c1035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:21.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.789+0000 7fec61200640 1 -- 172.21.15.37:0/3352213593 shutdown_connections 2024-09-21T05:53:21.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.789+0000 7fec61200640 1 -- 172.21.15.37:0/3352213593 wait complete. 2024-09-21T05:53:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.790+0000 7fec61200640 1 Processor -- start 2024-09-21T05:53:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.790+0000 7fec61200640 1 -- start start 2024-09-21T05:53:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.791+0000 7fec61200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c105790 0x7fec5c077bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.791+0000 7fec61200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec5c106820 0x7fec5c078220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.791+0000 7fec61200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c1071c0 0x7fec5c078dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.791+0000 7fec61200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c111420 con 0x7fec5c1071c0 2024-09-21T05:53:21.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.791+0000 7fec61200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c1112a0 con 0x7fec5c106820 2024-09-21T05:53:21.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.791+0000 7fec61200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c1115a0 con 0x7fec5c105790 2024-09-21T05:53:21.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.791+0000 7fec5be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c1071c0 0x7fec5c078dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.791+0000 7fec5be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c1071c0 0x7fec5c078dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37708/0 (socket says 172.21.15.37:37708) 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.791+0000 7fec5be00640 1 -- 172.21.15.37:0/916675885 learned_addr learned my addr 172.21.15.37:0/916675885 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.791+0000 7fec5b400640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c105790 0x7fec5c077bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.791+0000 7fec53e00640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec5c106820 0x7fec5c078220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.792+0000 7fec5be00640 1 -- 172.21.15.37:0/916675885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c105790 msgr2=0x7fec5c077bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.792+0000 7fec5be00640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c105790 0x7fec5c077bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.792+0000 7fec5be00640 1 -- 172.21.15.37:0/916675885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec5c106820 msgr2=0x7fec5c078220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.792+0000 7fec5be00640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec5c106820 0x7fec5c078220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.792+0000 7fec5be00640 1 -- 172.21.15.37:0/916675885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c0795e0 con 0x7fec5c1071c0 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.792+0000 7fec5be00640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c1071c0 0x7fec5c078dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fec5400efc0 tx=0x7fec5400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.792+0000 7fec58c00640 1 -- 172.21.15.37:0/916675885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54003970 con 0x7fec5c1071c0 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.792+0000 7fec61200640 1 -- 172.21.15.37:0/916675885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5c0798d0 con 0x7fec5c1071c0 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.792+0000 7fec58c00640 1 -- 172.21.15.37:0/916675885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec54004020 con 0x7fec5c1071c0 2024-09-21T05:53:21.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.792+0000 7fec58c00640 1 -- 172.21.15.37:0/916675885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5400b940 con 0x7fec5c1071c0 2024-09-21T05:53:21.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.792+0000 7fec61200640 1 -- 172.21.15.37:0/916675885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec5c079fa0 con 0x7fec5c1071c0 2024-09-21T05:53:21.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.794+0000 7fec61200640 1 -- 172.21.15.37:0/916675885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec5c105c00 con 0x7fec5c1071c0 2024-09-21T05:53:21.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.796+0000 7fec58c00640 1 -- 172.21.15.37:0/916675885 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fec5401d020 con 0x7fec5c1071c0 2024-09-21T05:53:21.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.798+0000 7fec58c00640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fec400b6510 0x7fec400b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:21.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.798+0000 7fec58c00640 1 -- 172.21.15.37:0/916675885 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fec540e7ba0 con 0x7fec5c1071c0 2024-09-21T05:53:21.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.798+0000 7fec5b400640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fec400b6510 0x7fec400b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.799+0000 7fec5b400640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fec400b6510 0x7fec400b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fec4c02a9c0 tx=0x7fec4c030980 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:21.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:21.800+0000 7fec58c00640 1 -- 172.21.15.37:0/916675885 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec540ae000 con 0x7fec5c1071c0 2024-09-21T05:53:21.885 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:21 smithi037 ceph-mon[30631]: pgmap v397: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:21 smithi067 ceph-mon[34443]: pgmap v397: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:22.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.029+0000 7fec61200640 1 -- 172.21.15.37:0/916675885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fec5c10c970 con 0x7fec5c1071c0 2024-09-21T05:53:22.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.030+0000 7fec58c00640 1 -- 172.21.15.37:0/916675885 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v90) ==== 56+0+5691 (secure 0 0 0) 0x7fec5c10c970 con 0x7fec5c1071c0 2024-09-21T05:53:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 90 2024-09-21T05:53:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T05:53:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-09-21T05:41:47.035307+0000 2024-09-21T05:53:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-09-21T05:52:47.670174+0000 2024-09-21T05:53:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T05:53:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:crush_version 27 2024-09-21T05:53:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:full_ratio 0.95 2024-09-21T05:53:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:backfillfull_ratio 0.9 2024-09-21T05:53:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:nearfull_ratio 0.85 2024-09-21T05:53:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:require_min_compat_client luminous 2024-09-21T05:53:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:min_compat_client luminous 2024-09-21T05:53:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:require_osd_release squid 2024-09-21T05:53:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:stretch_mode_enabled false 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 86 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:max_osd 12 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6802/2521687946,v1:172.21.15.37:6803/2521687946] [v2:172.21.15.37:6804/2521687946,v1:172.21.15.37:6805/2521687946] exists,up 99c3eca3-ee08-45d9-b6d0-65e4035e1d7a 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 up in weight 1 up_from 13 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.67:6800/2228599458,v1:172.21.15.67:6801/2228599458] [v2:172.21.15.67:6802/2228599458,v1:172.21.15.67:6803/2228599458] exists,up 15d6817e-4cde-4448-9263-3b3fad8c6d1d 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 up in weight 1 up_from 17 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6800/289727060,v1:172.21.15.144:6801/289727060] [v2:172.21.15.144:6802/289727060,v1:172.21.15.144:6803/289727060] exists,up 091d2006-39ee-41d2-9bfd-dd13cb6bb4a3 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 up in weight 1 up_from 24 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6810/2990917769,v1:172.21.15.37:6811/2990917769] [v2:172.21.15.37:6812/2990917769,v1:172.21.15.37:6813/2990917769] exists,up 1a7cd518-9d45-43e5-8605-4948d7bda060 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 up in weight 1 up_from 30 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.67:6808/2545409743,v1:172.21.15.67:6809/2545409743] [v2:172.21.15.67:6810/2545409743,v1:172.21.15.67:6811/2545409743] exists,up d0d79b65-1a85-43bf-92f6-ed3061c53901 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 up in weight 1 up_from 36 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6808/2813200791,v1:172.21.15.144:6809/2813200791] [v2:172.21.15.144:6810/2813200791,v1:172.21.15.144:6811/2813200791] exists,up c3aabba3-6ac9-451e-b445-1573f10856ab 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 up in weight 1 up_from 42 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6818/3607526668,v1:172.21.15.37:6819/3607526668] [v2:172.21.15.37:6820/3607526668,v1:172.21.15.37:6821/3607526668] exists,up 2e6451b5-b06c-4998-aebb-7fa806f2e4dc 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 up in weight 1 up_from 48 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.67:6816/286051723,v1:172.21.15.67:6817/286051723] [v2:172.21.15.67:6818/286051723,v1:172.21.15.67:6819/286051723] exists,up edac908f-40fe-42ee-a1ea-52f413776785 2024-09-21T05:53:22.035 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 up in weight 1 up_from 54 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6816/335694551,v1:172.21.15.144:6817/335694551] [v2:172.21.15.144:6818/335694551,v1:172.21.15.144:6819/335694551] exists,up 85372a82-dd7e-4de9-a3d5-bf000d2dd9c7 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 up in weight 1 up_from 60 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6826/2945950355,v1:172.21.15.37:6827/2945950355] [v2:172.21.15.37:6828/2945950355,v1:172.21.15.37:6829/2945950355] exists,up 996af6b7-e17f-4a58-94f5-1a7bfec6f702 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 up in weight 1 up_from 65 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.67:6824/3613225854,v1:172.21.15.67:6825/3613225854] [v2:172.21.15.67:6826/3613225854,v1:172.21.15.67:6827/3613225854] exists,up 9a37f19e-3ade-4852-b887-426e26953433 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 up in weight 1 up_from 71 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6824/2555236890,v1:172.21.15.144:6825/2555236890] [v2:172.21.15.144:6826/2555236890,v1:172.21.15.144:6827/2555236890] exists,up b3f23e60-4d29-4b07-aec5-1d497ee617cb 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.0 [7,11] 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.4 [2,11] 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.10 [2,1] 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.1a [8,4] 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.14 [4,6] 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.17 [4,7] 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.1e [3,9] 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.21 [4,8] 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.25 [5,9] 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.38 [3,9] 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.2 [9,1] 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.10 [9,8] 2024-09-21T05:53:22.036 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.14 [9,8] 2024-09-21T05:53:22.037 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.1c [5,10] 2024-09-21T05:53:22.037 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/3445479674 expires 2024-09-22T05:42:46.114425+0000 2024-09-21T05:53:22.037 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/3127564274 expires 2024-09-22T05:42:46.114425+0000 2024-09-21T05:53:22.037 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/3632867796 expires 2024-09-22T05:42:46.114425+0000 2024-09-21T05:53:22.037 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/802100173 expires 2024-09-22T05:42:16.118181+0000 2024-09-21T05:53:22.037 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/1221065954 expires 2024-09-22T05:42:46.114425+0000 2024-09-21T05:53:22.037 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/3632867796 expires 2024-09-22T05:42:46.114425+0000 2024-09-21T05:53:22.037 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/831572416 expires 2024-09-22T05:42:16.118181+0000 2024-09-21T05:53:22.037 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/3921659116 expires 2024-09-22T05:42:16.118181+0000 2024-09-21T05:53:22.037 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/1872213512 expires 2024-09-22T05:42:16.118181+0000 2024-09-21T05:53:22.037 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/1872213512 expires 2024-09-22T05:42:16.118181+0000 2024-09-21T05:53:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.032+0000 7fec61200640 1 -- 172.21.15.37:0/916675885 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fec400b6510 msgr2=0x7fec400b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.032+0000 7fec61200640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fec400b6510 0x7fec400b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fec4c02a9c0 tx=0x7fec4c030980 comp rx=0 tx=0).stop 2024-09-21T05:53:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.032+0000 7fec61200640 1 -- 172.21.15.37:0/916675885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c1071c0 msgr2=0x7fec5c078dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.032+0000 7fec61200640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c1071c0 0x7fec5c078dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fec5400efc0 tx=0x7fec5400c800 comp rx=0 tx=0).stop 2024-09-21T05:53:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.033+0000 7fec61200640 1 -- 172.21.15.37:0/916675885 shutdown_connections 2024-09-21T05:53:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.033+0000 7fec61200640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c1071c0 0x7fec5c078dc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.033+0000 7fec61200640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fec400b6510 0x7fec400b8a20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.033+0000 7fec61200640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec5c106820 0x7fec5c078220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.033+0000 7fec61200640 1 --2- 172.21.15.37:0/916675885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec5c105790 0x7fec5c077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.033+0000 7fec61200640 1 -- 172.21.15.37:0/916675885 >> 172.21.15.37:0/916675885 conn(0x7fec5c1010e0 msgr2=0x7fec5c109b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.033+0000 7fec61200640 1 -- 172.21.15.37:0/916675885 shutdown_connections 2024-09-21T05:53:22.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:22.033+0000 7fec61200640 1 -- 172.21.15.37:0/916675885 wait complete. 2024-09-21T05:53:22.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:21 smithi144 ceph-mon[34351]: pgmap v397: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:22.883 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:22 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/916675885' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T05:53:22.924 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T05:53:22.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:22.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:22 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/916675885' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T05:53:23.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:22 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/916675885' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T05:53:23.321 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.920+0000 7f6d3a800640 1 -- 172.21.15.37:0/3750990955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d341094c0 msgr2=0x7f6d341098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.920+0000 7f6d3a800640 1 --2- 172.21.15.37:0/3750990955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d341094c0 0x7f6d341098d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009900 tx=0x7f6d1c02a3f0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.920+0000 7f6d3a800640 1 -- 172.21.15.37:0/3750990955 shutdown_connections 2024-09-21T05:53:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.920+0000 7f6d3a800640 1 --2- 172.21.15.37:0/3750990955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d34109e10 0x7f6d34110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.920+0000 7f6d3a800640 1 --2- 172.21.15.37:0/3750990955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d341094c0 0x7f6d341098d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.920+0000 7f6d3a800640 1 --2- 172.21.15.37:0/3750990955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d34103b80 0x7f6d34103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.920+0000 7f6d3a800640 1 -- 172.21.15.37:0/3750990955 >> 172.21.15.37:0/3750990955 conn(0x7f6d340ff5d0 msgr2=0x7f6d34101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.920+0000 7f6d3a800640 1 -- 172.21.15.37:0/3750990955 shutdown_connections 2024-09-21T05:53:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.920+0000 7f6d3a800640 1 -- 172.21.15.37:0/3750990955 wait complete. 2024-09-21T05:53:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.921+0000 7f6d3a800640 1 Processor -- start 2024-09-21T05:53:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.921+0000 7f6d3a800640 1 -- start start 2024-09-21T05:53:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.922+0000 7f6d3a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d34103b80 0x7f6d3419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.922+0000 7f6d3a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d341094c0 0x7f6d3419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.922+0000 7f6d3a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d34109e10 0x7f6d341a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.922+0000 7f6d3a800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6d34113b20 con 0x7f6d34103b80 2024-09-21T05:53:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.922+0000 7f6d3a800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6d341139a0 con 0x7f6d34109e10 2024-09-21T05:53:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.922+0000 7f6d3a800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6d34113ca0 con 0x7f6d341094c0 2024-09-21T05:53:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.922+0000 7f6d33400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d34103b80 0x7f6d3419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.922+0000 7f6d33400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d34103b80 0x7f6d3419c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37720/0 (socket says 172.21.15.37:37720) 2024-09-21T05:53:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.922+0000 7f6d33400640 1 -- 172.21.15.37:0/2177001310 learned_addr learned my addr 172.21.15.37:0/2177001310 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.922+0000 7f6d2be00640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d341094c0 0x7f6d3419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.922+0000 7f6d33e00640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d34109e10 0x7f6d341a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.922+0000 7f6d33400640 1 -- 172.21.15.37:0/2177001310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d341094c0 msgr2=0x7f6d3419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.922+0000 7f6d33400640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d341094c0 0x7f6d3419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.923+0000 7f6d33400640 1 -- 172.21.15.37:0/2177001310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d34109e10 msgr2=0x7f6d341a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.923+0000 7f6d33400640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d34109e10 0x7f6d341a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.923+0000 7f6d33400640 1 -- 172.21.15.37:0/2177001310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d341a2680 con 0x7f6d34103b80 2024-09-21T05:53:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.923+0000 7f6d33e00640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d34109e10 0x7f6d341a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.923+0000 7f6d33400640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d34103b80 0x7f6d3419c710 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400e9f0 tx=0x7f6d2400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.923+0000 7f6d30c00640 1 -- 172.21.15.37:0/2177001310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2400cd80 con 0x7f6d34103b80 2024-09-21T05:53:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.923+0000 7f6d30c00640 1 -- 172.21.15.37:0/2177001310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d240054d0 con 0x7f6d34103b80 2024-09-21T05:53:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.923+0000 7f6d3a800640 1 -- 172.21.15.37:0/2177001310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d341a2970 con 0x7f6d34103b80 2024-09-21T05:53:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.923+0000 7f6d30c00640 1 -- 172.21.15.37:0/2177001310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24010690 con 0x7f6d34103b80 2024-09-21T05:53:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.923+0000 7f6d3a800640 1 -- 172.21.15.37:0/2177001310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d341a90d0 con 0x7f6d34103b80 2024-09-21T05:53:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.925+0000 7f6d3a800640 1 -- 172.21.15.37:0/2177001310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d34103f90 con 0x7f6d34103b80 2024-09-21T05:53:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.927+0000 7f6d30c00640 1 -- 172.21.15.37:0/2177001310 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f6d24004e30 con 0x7f6d34103b80 2024-09-21T05:53:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.929+0000 7f6d30c00640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6d180b6510 0x7f6d180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.929+0000 7f6d30c00640 1 -- 172.21.15.37:0/2177001310 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f6d240e7d90 con 0x7f6d34103b80 2024-09-21T05:53:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.929+0000 7f6d2be00640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6d180b6510 0x7f6d180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.930+0000 7f6d2be00640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6d180b6510 0x7f6d180b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c02a9e0 tx=0x7f6d1c005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:23.931+0000 7f6d30c00640 1 -- 172.21.15.37:0/2177001310 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d240ae1f0 con 0x7f6d34103b80 2024-09-21T05:53:23.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:23 smithi067 ceph-mon[34443]: pgmap v398: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:24.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:23 smithi144 ceph-mon[34351]: pgmap v398: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:24.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:23 smithi037 ceph-mon[30631]: pgmap v398: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:24.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.171+0000 7f6d3a800640 1 -- 172.21.15.37:0/2177001310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d3419d840 con 0x7f6d34103b80 2024-09-21T05:53:24.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.172+0000 7f6d30c00640 1 -- 172.21.15.37:0/2177001310 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f6d3419d840 con 0x7f6d34103b80 2024-09-21T05:53:24.175 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:24.175 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:53:24.175 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:53:24.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.174+0000 7f6d3a800640 1 -- 172.21.15.37:0/2177001310 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6d180b6510 msgr2=0x7f6d180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:24.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.174+0000 7f6d3a800640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6d180b6510 0x7f6d180b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c02a9e0 tx=0x7f6d1c005a20 comp rx=0 tx=0).stop 2024-09-21T05:53:24.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.174+0000 7f6d3a800640 1 -- 172.21.15.37:0/2177001310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d34103b80 msgr2=0x7f6d3419c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:24.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.174+0000 7f6d3a800640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d34103b80 0x7f6d3419c710 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400e9f0 tx=0x7f6d2400edf0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.175+0000 7f6d3a800640 1 -- 172.21.15.37:0/2177001310 shutdown_connections 2024-09-21T05:53:24.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.175+0000 7f6d3a800640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6d180b6510 0x7f6d180b8a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.175+0000 7f6d3a800640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d34109e10 0x7f6d341a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.175+0000 7f6d3a800640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d341094c0 0x7f6d3419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.175+0000 7f6d3a800640 1 --2- 172.21.15.37:0/2177001310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d34103b80 0x7f6d3419c710 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:24.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.175+0000 7f6d3a800640 1 -- 172.21.15.37:0/2177001310 >> 172.21.15.37:0/2177001310 conn(0x7f6d340ff5d0 msgr2=0x7f6d34106b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:24.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.175+0000 7f6d3a800640 1 -- 172.21.15.37:0/2177001310 shutdown_connections 2024-09-21T05:53:24.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:24.175+0000 7f6d3a800640 1 -- 172.21.15.37:0/2177001310 wait complete. 2024-09-21T05:53:24.875 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:24 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2177001310' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:24.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:24.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:24 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2177001310' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:25.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:24 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2177001310' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:25.298 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:25.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.942+0000 7f607aa00640 1 -- 172.21.15.37:0/2202700752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f607410ff90 msgr2=0x7f60741123b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:25.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.942+0000 7f607aa00640 1 --2- 172.21.15.37:0/2202700752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f607410ff90 0x7f60741123b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f606c009ca0 tx=0x7f606c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:25.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.942+0000 7f607aa00640 1 -- 172.21.15.37:0/2202700752 shutdown_connections 2024-09-21T05:53:25.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.942+0000 7f607aa00640 1 --2- 172.21.15.37:0/2202700752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f607410ff90 0x7f60741123b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:25.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.942+0000 7f607aa00640 1 --2- 172.21.15.37:0/2202700752 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6074076080 0x7f607410fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:25.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.942+0000 7f607aa00640 1 --2- 172.21.15.37:0/2202700752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6074075730 0x7f6074075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:25.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.942+0000 7f607aa00640 1 -- 172.21.15.37:0/2202700752 >> 172.21.15.37:0/2202700752 conn(0x7f60740ff400 msgr2=0x7f6074101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:25.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.942+0000 7f607aa00640 1 -- 172.21.15.37:0/2202700752 shutdown_connections 2024-09-21T05:53:25.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.942+0000 7f607aa00640 1 -- 172.21.15.37:0/2202700752 wait complete. 2024-09-21T05:53:25.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.943+0000 7f607aa00640 1 Processor -- start 2024-09-21T05:53:25.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.943+0000 7f607aa00640 1 -- start start 2024-09-21T05:53:25.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.944+0000 7f607aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6074075730 0x7f607419c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:25.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.944+0000 7f607aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6074076080 0x7f607419ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:25.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.944+0000 7f607aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607410ff90 0x7f60741a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:25.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.944+0000 7f607aa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6074115b20 con 0x7f6074075730 2024-09-21T05:53:25.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.944+0000 7f607aa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f60741159a0 con 0x7f6074076080 2024-09-21T05:53:25.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.944+0000 7f607aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6074115ca0 con 0x7f607410ff90 2024-09-21T05:53:25.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.944+0000 7f6079600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6074075730 0x7f607419c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:25.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.944+0000 7f6079600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6074075730 0x7f607419c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37730/0 (socket says 172.21.15.37:37730) 2024-09-21T05:53:25.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.944+0000 7f6079600640 1 -- 172.21.15.37:0/64438157 learned_addr learned my addr 172.21.15.37:0/64438157 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:25.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.944+0000 7f6078c00640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6074076080 0x7f607419ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:25.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.944+0000 7f607a000640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607410ff90 0x7f60741a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.944+0000 7f6079600640 1 -- 172.21.15.37:0/64438157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607410ff90 msgr2=0x7f60741a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.945+0000 7f6079600640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607410ff90 0x7f60741a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.945+0000 7f6079600640 1 -- 172.21.15.37:0/64438157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6074076080 msgr2=0x7f607419ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.945+0000 7f6079600640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6074076080 0x7f607419ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.945+0000 7f6079600640 1 -- 172.21.15.37:0/64438157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60741a23e0 con 0x7f6074075730 2024-09-21T05:53:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.945+0000 7f6078c00640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6074076080 0x7f607419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.945+0000 7f6079600640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6074075730 0x7f607419c470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f606800e9f0 tx=0x7f606800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.945+0000 7f6072000640 1 -- 172.21.15.37:0/64438157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606800cd80 con 0x7f6074075730 2024-09-21T05:53:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.945+0000 7f607aa00640 1 -- 172.21.15.37:0/64438157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60741a26d0 con 0x7f6074075730 2024-09-21T05:53:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.945+0000 7f6072000640 1 -- 172.21.15.37:0/64438157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60680108e0 con 0x7f6074075730 2024-09-21T05:53:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.945+0000 7f6072000640 1 -- 172.21.15.37:0/64438157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6068018980 con 0x7f6074075730 2024-09-21T05:53:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.945+0000 7f607aa00640 1 -- 172.21.15.37:0/64438157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60741a8e30 con 0x7f6074075730 2024-09-21T05:53:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.946+0000 7f607aa00640 1 -- 172.21.15.37:0/64438157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6074075b40 con 0x7f6074075730 2024-09-21T05:53:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.949+0000 7f6072000640 1 -- 172.21.15.37:0/64438157 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f6068010430 con 0x7f6074075730 2024-09-21T05:53:25.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.950+0000 7f6072000640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f605c0b6590 0x7f605c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:25.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.950+0000 7f6072000640 1 -- 172.21.15.37:0/64438157 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f60680e79a0 con 0x7f6074075730 2024-09-21T05:53:25.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.951+0000 7f6078c00640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f605c0b6590 0x7f605c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:25.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.951+0000 7f6078c00640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f605c0b6590 0x7f605c0b8aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6074112560 tx=0x7f6060005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:25.954+0000 7f6072000640 1 -- 172.21.15.37:0/64438157 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60680b21e0 con 0x7f6074075730 2024-09-21T05:53:25.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:25 smithi067 ceph-mon[34443]: pgmap v399: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:26.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:25 smithi144 ceph-mon[34351]: pgmap v399: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:26.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:25 smithi037 ceph-mon[30631]: pgmap v399: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.190+0000 7f607aa00640 1 -- 172.21.15.37:0/64438157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f607419d5a0 con 0x7f6074075730 2024-09-21T05:53:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.191+0000 7f6072000640 1 -- 172.21.15.37:0/64438157 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f60680b7120 con 0x7f6074075730 2024-09-21T05:53:26.193 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:26.193 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:53:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.193+0000 7f607aa00640 1 -- 172.21.15.37:0/64438157 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f605c0b6590 msgr2=0x7f605c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.193+0000 7f607aa00640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f605c0b6590 0x7f605c0b8aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6074112560 tx=0x7f6060005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.193+0000 7f607aa00640 1 -- 172.21.15.37:0/64438157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6074075730 msgr2=0x7f607419c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.193+0000 7f607aa00640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6074075730 0x7f607419c470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f606800e9f0 tx=0x7f606800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.193+0000 7f607aa00640 1 -- 172.21.15.37:0/64438157 shutdown_connections 2024-09-21T05:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.193+0000 7f607aa00640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607410ff90 0x7f60741a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.193+0000 7f607aa00640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f605c0b6590 0x7f605c0b8aa0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.193+0000 7f607aa00640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6074076080 0x7f607419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.193+0000 7f607aa00640 1 --2- 172.21.15.37:0/64438157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6074075730 0x7f607419c470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.193+0000 7f607aa00640 1 -- 172.21.15.37:0/64438157 >> 172.21.15.37:0/64438157 conn(0x7f60740ff400 msgr2=0x7f6074100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.193+0000 7f607aa00640 1 -- 172.21.15.37:0/64438157 shutdown_connections 2024-09-21T05:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:26.193+0000 7f607aa00640 1 -- 172.21.15.37:0/64438157 wait complete. 2024-09-21T05:53:26.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:26 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/64438157' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:26.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:53:26.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:26 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/64438157' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:27.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:26 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/64438157' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:27.846 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:27 smithi037 ceph-mon[30631]: pgmap v400: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:27.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:27 smithi067 ceph-mon[34443]: pgmap v400: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.026+0000 7efd31800640 1 -- 172.21.15.37:0/217594833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd2c10de10 msgr2=0x7efd2c110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.026+0000 7efd31800640 1 --2- 172.21.15.37:0/217594833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd2c10de10 0x7efd2c110300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efd24009ca0 tx=0x7efd2402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:53:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.026+0000 7efd31800640 1 -- 172.21.15.37:0/217594833 shutdown_connections 2024-09-21T05:53:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.026+0000 7efd31800640 1 --2- 172.21.15.37:0/217594833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd2c10de10 0x7efd2c110300 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.026+0000 7efd31800640 1 --2- 172.21.15.37:0/217594833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2c105300 0x7efd2c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.026+0000 7efd31800640 1 --2- 172.21.15.37:0/217594833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd2c1049b0 0x7efd2c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.026+0000 7efd31800640 1 -- 172.21.15.37:0/217594833 >> 172.21.15.37:0/217594833 conn(0x7efd2c079760 msgr2=0x7efd2c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.026+0000 7efd31800640 1 -- 172.21.15.37:0/217594833 shutdown_connections 2024-09-21T05:53:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.026+0000 7efd31800640 1 -- 172.21.15.37:0/217594833 wait complete. 2024-09-21T05:53:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.027+0000 7efd31800640 1 Processor -- start 2024-09-21T05:53:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.028+0000 7efd31800640 1 -- start start 2024-09-21T05:53:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.028+0000 7efd31800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2c1049b0 0x7efd2c1026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.028+0000 7efd31800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd2c105300 0x7efd2c102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.028+0000 7efd31800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd2c10de10 0x7efd2c103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.028+0000 7efd31800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c113a90 con 0x7efd2c105300 2024-09-21T05:53:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.028+0000 7efd31800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c113910 con 0x7efd2c10de10 2024-09-21T05:53:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.028+0000 7efd31800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c113c10 con 0x7efd2c1049b0 2024-09-21T05:53:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.028+0000 7efd2aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2c1049b0 0x7efd2c1026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.028+0000 7efd2aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2c1049b0 0x7efd2c1026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41718/0 (socket says 172.21.15.37:41718) 2024-09-21T05:53:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.028+0000 7efd2aa00640 1 -- 172.21.15.37:0/1353179875 learned_addr learned my addr 172.21.15.37:0/1353179875 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.028+0000 7efd22000640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd2c105300 0x7efd2c102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.028+0000 7efd2b400640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd2c10de10 0x7efd2c103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.029+0000 7efd2aa00640 1 -- 172.21.15.37:0/1353179875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd2c10de10 msgr2=0x7efd2c103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.029+0000 7efd2aa00640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd2c10de10 0x7efd2c103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.029+0000 7efd2aa00640 1 -- 172.21.15.37:0/1353179875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd2c105300 msgr2=0x7efd2c102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.029+0000 7efd2aa00640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd2c105300 0x7efd2c102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.029+0000 7efd2aa00640 1 -- 172.21.15.37:0/1353179875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c1a8760 con 0x7efd2c1049b0 2024-09-21T05:53:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.029+0000 7efd2aa00640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2c1049b0 0x7efd2c1026f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00e9f0 tx=0x7efd1c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.029+0000 7efd23e00640 1 -- 172.21.15.37:0/1353179875 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c00cd80 con 0x7efd2c1049b0 2024-09-21T05:53:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.030+0000 7efd31800640 1 -- 172.21.15.37:0/1353179875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c1a8a50 con 0x7efd2c1049b0 2024-09-21T05:53:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.030+0000 7efd23e00640 1 -- 172.21.15.37:0/1353179875 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd1c0108e0 con 0x7efd2c1049b0 2024-09-21T05:53:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.030+0000 7efd23e00640 1 -- 172.21.15.37:0/1353179875 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c018980 con 0x7efd2c1049b0 2024-09-21T05:53:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.030+0000 7efd31800640 1 -- 172.21.15.37:0/1353179875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c1a8fe0 con 0x7efd2c1049b0 2024-09-21T05:53:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.031+0000 7efd31800640 1 -- 172.21.15.37:0/1353179875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd2c06c2c0 con 0x7efd2c1049b0 2024-09-21T05:53:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.033+0000 7efd23e00640 1 -- 172.21.15.37:0/1353179875 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7efd1c010430 con 0x7efd2c1049b0 2024-09-21T05:53:28.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.035+0000 7efd23e00640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7efd100b6590 0x7efd100b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:28.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.035+0000 7efd23e00640 1 -- 172.21.15.37:0/1353179875 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7efd1c0e7ef0 con 0x7efd2c1049b0 2024-09-21T05:53:28.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.035+0000 7efd22000640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7efd100b6590 0x7efd100b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.036+0000 7efd22000640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7efd100b6590 0x7efd100b8aa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efd2c10fb40 tx=0x7efd14005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.037+0000 7efd23e00640 1 -- 172.21.15.37:0/1353179875 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd1c0ae350 con 0x7efd2c1049b0 2024-09-21T05:53:28.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:27 smithi144 ceph-mon[34351]: pgmap v400: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.235+0000 7efd31800640 1 -- 172.21.15.37:0/1353179875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd2c1039f0 con 0x7efd2c1049b0 2024-09-21T05:53:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.237+0000 7efd23e00640 1 -- 172.21.15.37:0/1353179875 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24836 (secure 0 0 0) 0x7efd1c0b2730 con 0x7efd2c1049b0 2024-09-21T05:53:28.240 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:28.240 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":90,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:52:47.670174+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:50:49.791290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:50:51.877662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:51:01.928796+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:53:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.239+0000 7efd31800640 1 -- 172.21.15.37:0/1353179875 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7efd100b6590 msgr2=0x7efd100b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.239+0000 7efd31800640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7efd100b6590 0x7efd100b8aa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efd2c10fb40 tx=0x7efd14005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.239+0000 7efd31800640 1 -- 172.21.15.37:0/1353179875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2c1049b0 msgr2=0x7efd2c1026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.239+0000 7efd31800640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2c1049b0 0x7efd2c1026f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00e9f0 tx=0x7efd1c00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.239+0000 7efd31800640 1 -- 172.21.15.37:0/1353179875 shutdown_connections 2024-09-21T05:53:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.239+0000 7efd31800640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7efd100b6590 0x7efd100b8aa0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.239+0000 7efd31800640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd2c10de10 0x7efd2c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.239+0000 7efd31800640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd2c105300 0x7efd2c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.239+0000 7efd31800640 1 --2- 172.21.15.37:0/1353179875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2c1049b0 0x7efd2c1026f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.239+0000 7efd31800640 1 -- 172.21.15.37:0/1353179875 >> 172.21.15.37:0/1353179875 conn(0x7efd2c079760 msgr2=0x7efd2c107930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.240+0000 7efd31800640 1 -- 172.21.15.37:0/1353179875 shutdown_connections 2024-09-21T05:53:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:28.240+0000 7efd31800640 1 -- 172.21.15.37:0/1353179875 wait complete. 2024-09-21T05:53:28.902 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:28 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1353179875' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:28.943 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T05:50:54.973656+0000', 'modified': '2024-09-21T05:51:49.877112+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24731}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24706': {'gid': 24706, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6839/2186109815', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6838', 'nonce': 2186109815}, {'type': 'v1', 'addr': '172.21.15.144:6839', 'nonce': 2186109815}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24731': {'gid': 24731, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.67:6839/2815536303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6838', 'nonce': 2815536303}, {'type': 'v1', 'addr': '172.21.15.67:6839', 'nonce': 2815536303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24731, 'qdb_cluster': [24731]} 2024-09-21T05:53:28.943 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T05:53:28.943 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T05:53:28.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:28 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1353179875' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:29.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:28 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1353179875' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:29.322 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:29.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.968+0000 7fb23ee00640 1 -- 172.21.15.37:0/3268288801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb238105d80 msgr2=0x7fb238106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.968+0000 7fb23ee00640 1 --2- 172.21.15.37:0/3268288801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb238105d80 0x7fb238106190 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb228009900 tx=0x7fb22802a410 comp rx=0 tx=0).stop 2024-09-21T05:53:29.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.968+0000 7fb23ee00640 1 -- 172.21.15.37:0/3268288801 shutdown_connections 2024-09-21T05:53:29.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.968+0000 7fb23ee00640 1 --2- 172.21.15.37:0/3268288801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb23810c010 0x7fb238112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.968+0000 7fb23ee00640 1 --2- 172.21.15.37:0/3268288801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb23810b6c0 0x7fb23810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.968+0000 7fb23ee00640 1 --2- 172.21.15.37:0/3268288801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb238105d80 0x7fb238106190 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.968+0000 7fb23ee00640 1 -- 172.21.15.37:0/3268288801 >> 172.21.15.37:0/3268288801 conn(0x7fb238101810 msgr2=0x7fb238103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:29.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.969+0000 7fb23ee00640 1 -- 172.21.15.37:0/3268288801 shutdown_connections 2024-09-21T05:53:29.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.969+0000 7fb23ee00640 1 -- 172.21.15.37:0/3268288801 wait complete. 2024-09-21T05:53:29.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.970+0000 7fb23ee00640 1 Processor -- start 2024-09-21T05:53:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.970+0000 7fb23ee00640 1 -- start start 2024-09-21T05:53:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.970+0000 7fb23ee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb238105d80 0x7fb23819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.970+0000 7fb23ee00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb23810b6c0 0x7fb23819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.970+0000 7fb23ee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb23810c010 0x7fb2381a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.970+0000 7fb23ee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb238115d20 con 0x7fb238105d80 2024-09-21T05:53:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.970+0000 7fb23ee00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb238115ba0 con 0x7fb23810b6c0 2024-09-21T05:53:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.970+0000 7fb23ee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb238115ea0 con 0x7fb23810c010 2024-09-21T05:53:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.970+0000 7fb237e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb238105d80 0x7fb23819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.970+0000 7fb237400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb23810b6c0 0x7fb23819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.971+0000 7fb237400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb23810b6c0 0x7fb23819cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:42506/0 (socket says 172.21.15.37:42506) 2024-09-21T05:53:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.971+0000 7fb237e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb238105d80 0x7fb23819c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37764/0 (socket says 172.21.15.37:37764) 2024-09-21T05:53:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.971+0000 7fb237400640 1 -- 172.21.15.37:0/3186012213 learned_addr learned my addr 172.21.15.37:0/3186012213 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.971+0000 7fb23ce00640 1 --2- 172.21.15.37:0/3186012213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb23810c010 0x7fb2381a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.971+0000 7fb237400640 1 -- 172.21.15.37:0/3186012213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb23810c010 msgr2=0x7fb2381a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.971+0000 7fb237400640 1 --2- 172.21.15.37:0/3186012213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb23810c010 0x7fb2381a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.971+0000 7fb237400640 1 -- 172.21.15.37:0/3186012213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb238105d80 msgr2=0x7fb23819c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.971+0000 7fb237400640 1 --2- 172.21.15.37:0/3186012213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb238105d80 0x7fb23819c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.971+0000 7fb237400640 1 -- 172.21.15.37:0/3186012213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2381a2660 con 0x7fb23810b6c0 2024-09-21T05:53:29.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.971+0000 7fb237400640 1 --2- 172.21.15.37:0/3186012213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb23810b6c0 0x7fb23819cc90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb22400e9f0 tx=0x7fb22400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:29.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.972+0000 7fb234c00640 1 -- 172.21.15.37:0/3186012213 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22400ccc0 con 0x7fb23810b6c0 2024-09-21T05:53:29.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.972+0000 7fb23ee00640 1 -- 172.21.15.37:0/3186012213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2381a2950 con 0x7fb23810b6c0 2024-09-21T05:53:29.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.972+0000 7fb234c00640 1 -- 172.21.15.37:0/3186012213 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2240108e0 con 0x7fb23810b6c0 2024-09-21T05:53:29.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.972+0000 7fb234c00640 1 -- 172.21.15.37:0/3186012213 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224018860 con 0x7fb23810b6c0 2024-09-21T05:53:29.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.972+0000 7fb23ee00640 1 -- 172.21.15.37:0/3186012213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2381a90b0 con 0x7fb23810b6c0 2024-09-21T05:53:29.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.975+0000 7fb245a2a740 1 Processor -- start 2024-09-21T05:53:29.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.975+0000 7fb245a2a740 1 -- start start 2024-09-21T05:53:29.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.975+0000 7fb234c00640 1 -- 172.21.15.37:0/3186012213 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fb224010430 con 0x7fb23810b6c0 2024-09-21T05:53:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.975+0000 7fb245a2a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0506cf60 0x55db05413490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.975+0000 7fb245a2a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db050440a0 0x55db054139d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.975+0000 7fb245a2a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db0504c280 0x55db05413f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.975+0000 7fb245a2a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55db0538ad50 con 0x55db0504c280 2024-09-21T05:53:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.975+0000 7fb245a2a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55db0537a180 con 0x55db050440a0 2024-09-21T05:53:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.975+0000 7fb245a2a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55db0537df90 con 0x55db0506cf60 2024-09-21T05:53:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.976+0000 7fb23ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0506cf60 0x55db05413490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.976+0000 7fb23ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0506cf60 0x55db05413490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41740/0 (socket says 172.21.15.37:41740) 2024-09-21T05:53:29.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.976+0000 7fb237e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db050440a0 0x55db054139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.976+0000 7fb23ce00640 1 -- 172.21.15.37:0/973895032 learned_addr learned my addr 172.21.15.37:0/973895032 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:29.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.976+0000 7fb237400640 1 --2- 172.21.15.37:0/973895032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db0504c280 0x55db05413f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.976+0000 7fb23ce00640 1 -- 172.21.15.37:0/973895032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db050440a0 msgr2=0x55db054139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:29.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.976+0000 7fb23ce00640 1 --2- 172.21.15.37:0/973895032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db050440a0 0x55db054139d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.976+0000 7fb23ce00640 1 -- 172.21.15.37:0/973895032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db0504c280 msgr2=0x55db05413f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:29.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.976+0000 7fb23ce00640 1 --2- 172.21.15.37:0/973895032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db0504c280 0x55db05413f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.976+0000 7fb23ce00640 1 -- 172.21.15.37:0/973895032 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db05344a70 con 0x55db0506cf60 2024-09-21T05:53:29.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.977+0000 7fb23ce00640 1 --2- 172.21.15.37:0/973895032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0506cf60 0x55db05413490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb230009fd0 tx=0x7fb2300118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71d1a9eab08fda47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:29.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.977+0000 7fb22d600640 1 -- 172.21.15.37:0/973895032 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230004d20 con 0x55db0506cf60 2024-09-21T05:53:29.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.977+0000 7fb22d600640 1 -- 172.21.15.37:0/973895032 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb230004050 con 0x55db0506cf60 2024-09-21T05:53:29.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.977+0000 7fb22d600640 1 -- 172.21.15.37:0/973895032 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230005280 con 0x55db0506cf60 2024-09-21T05:53:29.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.977+0000 7fb234c00640 1 --2- 172.21.15.37:0/3186012213 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb21c0b6510 0x7fb21c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.977+0000 7fb234c00640 1 -- 172.21.15.37:0/3186012213 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fb2240e7990 con 0x7fb23810b6c0 2024-09-21T05:53:29.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.977+0000 7fb237e00640 1 --2- 172.21.15.37:0/3186012213 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb21c0b6510 0x7fb21c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.978+0000 7fb245a2a740 1 -- 172.21.15.37:0/973895032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0506cf60 msgr2=0x55db05413490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.978+0000 7fb245a2a740 1 --2- 172.21.15.37:0/973895032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0506cf60 0x55db05413490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb230009fd0 tx=0x7fb2300118d0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.978+0000 7fb245a2a740 1 -- 172.21.15.37:0/973895032 shutdown_connections 2024-09-21T05:53:29.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.978+0000 7fb245a2a740 1 --2- 172.21.15.37:0/973895032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db0504c280 0x55db05413f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.978+0000 7fb245a2a740 1 --2- 172.21.15.37:0/973895032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db050440a0 0x55db054139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.978+0000 7fb245a2a740 1 --2- 172.21.15.37:0/973895032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0506cf60 0x55db05413490 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.978+0000 7fb245a2a740 1 -- 172.21.15.37:0/973895032 >> 172.21.15.37:0/973895032 conn(0x55db05061350 msgr2=0x55db05411380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:29.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.978+0000 7fb245a2a740 1 -- 172.21.15.37:0/973895032 shutdown_connections 2024-09-21T05:53:29.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.978+0000 7fb245a2a740 1 -- 172.21.15.37:0/973895032 wait complete. 2024-09-21T05:53:29.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.978+0000 7fb237e00640 1 --2- 172.21.15.37:0/3186012213 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb21c0b6510 0x7fb21c0b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb228005ab0 tx=0x7fb228005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.979+0000 7fb245a2a740 1 -- start start 2024-09-21T05:53:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.979+0000 7fb245a2a740 1 Processor -- start 2024-09-21T05:53:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb245a2a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db050440a0 0x55db0541f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb245a2a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db0541f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb245a2a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db0506cf60 0x55db0542af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb245a2a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55db051db5f0 con 0x55db050440a0 2024-09-21T05:53:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb245a2a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55db05315460 con 0x55db0506cf60 2024-09-21T05:53:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb245a2a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55db05421c70 con 0x55db0504c280 2024-09-21T05:53:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb245a2a740 10 client.0 _ll_register_callbacks cb 0x55db05325210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb237e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db050440a0 0x55db0541f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb237e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db050440a0 0x55db0541f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37776/0 (socket says 172.21.15.37:37776) 2024-09-21T05:53:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb237e00640 1 -- 172.21.15.37:0/2516177025 learned_addr learned my addr 172.21.15.37:0/2516177025 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb237400640 1 --2- 172.21.15.37:0/2516177025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db0541f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb23ce00640 1 --2- 172.21.15.37:0/2516177025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db0506cf60 0x55db0542af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb237e00640 1 -- 172.21.15.37:0/2516177025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 msgr2=0x55db0541f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb237e00640 1 --2- 172.21.15.37:0/2516177025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db0541f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb237e00640 1 -- 172.21.15.37:0/2516177025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db0506cf60 msgr2=0x55db0542af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb237e00640 1 --2- 172.21.15.37:0/2516177025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db0506cf60 0x55db0542af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.980+0000 7fb237e00640 1 -- 172.21.15.37:0/2516177025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db050d8540 con 0x55db050440a0 2024-09-21T05:53:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.981+0000 7fb237e00640 1 --2- 172.21.15.37:0/2516177025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db050440a0 0x55db0541f090 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb228009900 tx=0x7fb228009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16063b268e1224df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.981+0000 7fb222000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T05:53:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.981+0000 7fb222000640 1 -- 172.21.15.37:0/2516177025 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22804e070 con 0x55db050440a0 2024-09-21T05:53:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.981+0000 7fb222000640 1 -- 172.21.15.37:0/2516177025 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fb228004b80 con 0x55db050440a0 2024-09-21T05:53:29.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.981+0000 7fb245a2a740 1 -- 172.21.15.37:0/2516177025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55db05317a70 con 0x55db050440a0 2024-09-21T05:53:29.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.981+0000 7fb222000640 1 -- 172.21.15.37:0/2516177025 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb22805a050 con 0x55db050440a0 2024-09-21T05:53:29.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.982+0000 7fb245a2a740 10 client.15219 fetch_fsmap learned FSMap version 21 2024-09-21T05:53:29.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.982+0000 7fb245a2a740 1 -- 172.21.15.37:0/2516177025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55db053326f0 con 0x55db050440a0 2024-09-21T05:53:29.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.982+0000 7fb222000640 1 -- 172.21.15.37:0/2516177025 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55db05317a70 con 0x55db050440a0 2024-09-21T05:53:29.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.982+0000 7fb222000640 1 -- 172.21.15.37:0/2516177025 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb2280324b0 con 0x55db050440a0 2024-09-21T05:53:29.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.982+0000 7fb245a2a740 10 client.15219 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:53:29.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.982+0000 7fb245a2a740 10 client.15219 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:53:29.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.982+0000 7fb245a2a740 20 client.15219 populate_metadata read hostname 'smithi037' 2024-09-21T05:53:29.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.982+0000 7fb245a2a740 1 --2- 172.21.15.37:0/2516177025 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55db0502b8e0 0x55db054315d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:29.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.982+0000 7fb245a2a740 4 client.15219 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:53:29.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.982+0000 7fb245a2a740 1 -- 172.21.15.37:0/2516177025 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db0538cca0 con 0x55db0502b8e0 2024-09-21T05:53:29.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.983+0000 7fb237400640 1 --2- 172.21.15.37:0/2516177025 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55db0502b8e0 0x55db054315d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:29.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.983+0000 7fb237400640 1 --2- 172.21.15.37:0/2516177025 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55db0502b8e0 0x55db054315d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcb8b80613945abf server_cookie=b7a9c3a8f634d36f in_seq=0 out_seq=0 2024-09-21T05:53:29.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.983+0000 7fb222000640 10 client.15219 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:53:29.990 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:29 smithi037 ceph-mon[30631]: pgmap v401: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:29.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.984+0000 7fb222000640 1 -- 172.21.15.37:0/2516177025 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55db0538cca0 con 0x55db0502b8e0 2024-09-21T05:53:29.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.984+0000 7fb222000640 10 client.15219 handle_command_reply: tid=0 2024-09-21T05:53:29.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.984+0000 7fb245a2a740 1 client.15219 shutdown 2024-09-21T05:53:29.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.984+0000 7fb245a2a740 1 -- 172.21.15.37:0/2516177025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db050440a0 msgr2=0x55db0541f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:29.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.984+0000 7fb245a2a740 1 --2- 172.21.15.37:0/2516177025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db050440a0 0x55db0541f090 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb228009900 tx=0x7fb228009260 comp rx=0 tx=0).stop 2024-09-21T05:53:29.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.984+0000 7fb245a2a740 1 -- 172.21.15.37:0/2516177025 shutdown_connections 2024-09-21T05:53:29.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.984+0000 7fb245a2a740 1 --2- 172.21.15.37:0/2516177025 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55db0502b8e0 0x55db054315d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.984+0000 7fb245a2a740 1 --2- 172.21.15.37:0/2516177025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db0506cf60 0x55db0542af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.984+0000 7fb245a2a740 1 --2- 172.21.15.37:0/2516177025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db0541f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.984+0000 7fb245a2a740 1 --2- 172.21.15.37:0/2516177025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db050440a0 0x55db0541f090 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.985+0000 7fb245a2a740 1 -- 172.21.15.37:0/2516177025 >> 172.21.15.37:0/2516177025 conn(0x55db05061350 msgr2=0x55db05416670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.984+0000 7fb222000640 0 client.15219 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:53:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.985+0000 7fb245a2a740 1 -- 172.21.15.37:0/2516177025 shutdown_connections 2024-09-21T05:53:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.985+0000 7fb245a2a740 1 -- 172.21.15.37:0/2516177025 wait complete. 2024-09-21T05:53:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:29.985+0000 7fb245a2a740 20 client.15219 trim_cache size 0 max 16384 2024-09-21T05:53:29.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:29 smithi067 ceph-mon[34443]: pgmap v401: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:30.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.011+0000 7fb245a2a740 1 Processor -- start 2024-09-21T05:53:30.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.011+0000 7fb245a2a740 1 -- start start 2024-09-21T05:53:30.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.011+0000 7fb245a2a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db050440a0 0x55db0541a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:30.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.011+0000 7fb245a2a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db0541a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:30.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.011+0000 7fb245a2a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db0506cf60 0x55db0541f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:30.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.011+0000 7fb245a2a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55db0542f910 con 0x55db0506cf60 2024-09-21T05:53:30.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.011+0000 7fb245a2a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55db0542ffe0 con 0x55db050440a0 2024-09-21T05:53:30.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.011+0000 7fb245a2a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55db054306b0 con 0x55db0504c280 2024-09-21T05:53:30.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.012+0000 7fb23ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db0506cf60 0x55db0541f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:30.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.012+0000 7fb237400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db0541a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.012+0000 7fb23ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db0506cf60 0x55db0541f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37790/0 (socket says 172.21.15.37:37790) 2024-09-21T05:53:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.012+0000 7fb237e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db050440a0 0x55db0541a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.012+0000 7fb23ce00640 1 -- 172.21.15.37:0/2402630376 learned_addr learned my addr 172.21.15.37:0/2402630376 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.012+0000 7fb237400640 1 -- 172.21.15.37:0/2402630376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db050440a0 msgr2=0x55db0541a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.012+0000 7fb237400640 1 --2- 172.21.15.37:0/2402630376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db050440a0 0x55db0541a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.012+0000 7fb237400640 1 -- 172.21.15.37:0/2402630376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db0506cf60 msgr2=0x55db0541f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.012+0000 7fb237400640 1 --2- 172.21.15.37:0/2402630376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db0506cf60 0x55db0541f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.012+0000 7fb237400640 1 -- 172.21.15.37:0/2402630376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0542f740 con 0x55db0504c280 2024-09-21T05:53:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.012+0000 7fb237e00640 1 --2- 172.21.15.37:0/2402630376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db050440a0 0x55db0541a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.013+0000 7fb237400640 1 --2- 172.21.15.37:0/2402630376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db0541a580 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb2240e5060 tx=0x7fb2240e4f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=940b59c09a37d68b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.013+0000 7fb22cc00640 1 -- 172.21.15.37:0/2402630376 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224010720 con 0x55db0504c280 2024-09-21T05:53:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.013+0000 7fb22cc00640 1 -- 172.21.15.37:0/2402630376 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2240e9e50 con 0x55db0504c280 2024-09-21T05:53:30.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.013+0000 7fb22cc00640 1 -- 172.21.15.37:0/2402630376 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2240b7110 con 0x55db0504c280 2024-09-21T05:53:30.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.014+0000 7fb245a2a740 1 -- 172.21.15.37:0/2402630376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 msgr2=0x55db0541a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:30.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.014+0000 7fb245a2a740 1 --2- 172.21.15.37:0/2402630376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db0541a580 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb2240e5060 tx=0x7fb2240e4f30 comp rx=0 tx=0).stop 2024-09-21T05:53:30.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.014+0000 7fb245a2a740 1 -- 172.21.15.37:0/2402630376 shutdown_connections 2024-09-21T05:53:30.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.014+0000 7fb245a2a740 1 --2- 172.21.15.37:0/2402630376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db0506cf60 0x55db0541f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.014+0000 7fb245a2a740 1 --2- 172.21.15.37:0/2402630376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db0541a580 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.014+0000 7fb245a2a740 1 --2- 172.21.15.37:0/2402630376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db050440a0 0x55db0541a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.014+0000 7fb245a2a740 1 -- 172.21.15.37:0/2402630376 >> 172.21.15.37:0/2402630376 conn(0x55db05061350 msgr2=0x55db05419300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:30.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.014+0000 7fb245a2a740 1 -- 172.21.15.37:0/2402630376 shutdown_connections 2024-09-21T05:53:30.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.014+0000 7fb245a2a740 1 -- 172.21.15.37:0/2402630376 wait complete. 2024-09-21T05:53:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.014+0000 7fb245a2a740 1 -- start start 2024-09-21T05:53:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.014+0000 7fb245a2a740 1 Processor -- start 2024-09-21T05:53:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.015+0000 7fb245a2a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db050440a0 0x55db0543a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.015+0000 7fb245a2a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db05433520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.015+0000 7fb245a2a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db0506cf60 0x55db05433a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.015+0000 7fb245a2a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55db05431450 con 0x55db050440a0 2024-09-21T05:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.015+0000 7fb245a2a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55db05430d80 con 0x55db0506cf60 2024-09-21T05:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.015+0000 7fb245a2a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55db05431b20 con 0x55db0504c280 2024-09-21T05:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.015+0000 7fb245a2a740 10 client.0 _ll_register_callbacks cb 0x7fb228004500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.015+0000 7fb237400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db05433520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.015+0000 7fb237e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db050440a0 0x55db0543a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.015+0000 7fb237400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db05433520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41778/0 (socket says 172.21.15.37:41778) 2024-09-21T05:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.015+0000 7fb237400640 1 -- 172.21.15.37:0/3998277793 learned_addr learned my addr 172.21.15.37:0/3998277793 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.015+0000 7fb23ce00640 1 --2- 172.21.15.37:0/3998277793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db0506cf60 0x55db05433a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.016+0000 7fb237400640 1 -- 172.21.15.37:0/3998277793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db0506cf60 msgr2=0x55db05433a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.016+0000 7fb237400640 1 --2- 172.21.15.37:0/3998277793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db0506cf60 0x55db05433a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.016+0000 7fb237400640 1 -- 172.21.15.37:0/3998277793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db050440a0 msgr2=0x55db0543a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.016+0000 7fb237400640 1 --2- 172.21.15.37:0/3998277793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db050440a0 0x55db0543a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.016+0000 7fb237400640 1 -- 172.21.15.37:0/3998277793 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db05434210 con 0x55db0504c280 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.016+0000 7fb237e00640 1 --2- 172.21.15.37:0/3998277793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db050440a0 0x55db0543a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.016+0000 7fb237400640 1 --2- 172.21.15.37:0/3998277793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db05433520 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb2240e5030 tx=0x7fb22400ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e517252310d0d2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.016+0000 7fb222000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.016+0000 7fb222000640 1 -- 172.21.15.37:0/3998277793 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224010720 con 0x55db0504c280 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.016+0000 7fb245a2a740 1 -- 172.21.15.37:0/3998277793 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2240e9e50 con 0x55db0504c280 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.016+0000 7fb222000640 1 -- 172.21.15.37:0/3998277793 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fb2240a90f0 con 0x55db0504c280 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.017+0000 7fb222000640 1 -- 172.21.15.37:0/3998277793 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb2240b7110 con 0x55db0504c280 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.017+0000 7fb245a2a740 10 client.25270 fetch_fsmap learned FSMap version 21 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.017+0000 7fb245a2a740 1 -- 172.21.15.37:0/3998277793 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55db0549caa0 con 0x55db0504c280 2024-09-21T05:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.017+0000 7fb222000640 1 -- 172.21.15.37:0/3998277793 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2240e9e50 con 0x55db0504c280 2024-09-21T05:53:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.017+0000 7fb222000640 1 -- 172.21.15.37:0/3998277793 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb2240b3590 con 0x55db0504c280 2024-09-21T05:53:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.017+0000 7fb245a2a740 10 client.25270 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:53:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.017+0000 7fb245a2a740 10 client.25270 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:53:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.017+0000 7fb245a2a740 20 client.25270 populate_metadata read hostname 'smithi037' 2024-09-21T05:53:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.017+0000 7fb245a2a740 1 --2- 172.21.15.37:0/3998277793 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55db05000c90 0x55db0549fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.017+0000 7fb245a2a740 4 client.25270 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:53:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.017+0000 7fb245a2a740 1 -- 172.21.15.37:0/3998277793 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "status"}) -- 0x55db05388750 con 0x55db05000c90 2024-09-21T05:53:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.018+0000 7fb237e00640 1 --2- 172.21.15.37:0/3998277793 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55db05000c90 0x55db0549fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.018+0000 7fb237e00640 1 --2- 172.21.15.37:0/3998277793 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55db05000c90 0x55db0549fdd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b778abe3c8da254b server_cookie=49d0f91ec5e3f0a1 in_seq=0 out_seq=0 2024-09-21T05:53:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.018+0000 7fb222000640 10 client.25270 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:53:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.018+0000 7fb222000640 1 -- 172.21.15.37:0/3998277793 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55db05388750 con 0x55db05000c90 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.018+0000 7fb222000640 10 client.25270 handle_command_reply: tid=0 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.018+0000 7fb245a2a740 1 client.25270 shutdown 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.019+0000 7fb245a2a740 1 -- 172.21.15.37:0/3998277793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 msgr2=0x55db05433520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.019+0000 7fb245a2a740 1 --2- 172.21.15.37:0/3998277793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db05433520 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb2240e5030 tx=0x7fb22400ce60 comp rx=0 tx=0).stop 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.019+0000 7fb245a2a740 1 -- 172.21.15.37:0/3998277793 shutdown_connections 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.019+0000 7fb245a2a740 1 --2- 172.21.15.37:0/3998277793 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55db05000c90 0x55db0549fdd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.019+0000 7fb245a2a740 1 --2- 172.21.15.37:0/3998277793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db0506cf60 0x55db05433a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.019+0000 7fb245a2a740 1 --2- 172.21.15.37:0/3998277793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db0504c280 0x55db05433520 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.019+0000 7fb245a2a740 1 --2- 172.21.15.37:0/3998277793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db050440a0 0x55db0543a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.019+0000 7fb222000640 0 client.25270 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.019+0000 7fb245a2a740 1 -- 172.21.15.37:0/3998277793 >> 172.21.15.37:0/3998277793 conn(0x55db05061350 msgr2=0x55db0541f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.019+0000 7fb245a2a740 1 -- 172.21.15.37:0/3998277793 shutdown_connections 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.019+0000 7fb245a2a740 1 -- 172.21.15.37:0/3998277793 wait complete. 2024-09-21T05:53:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.019+0000 7fb245a2a740 20 client.25270 trim_cache size 0 max 16384 2024-09-21T05:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "0c10cdda-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-09-21T05:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24731, 2024-09-21T05:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T05:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T05:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T05:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 154.12651354799999, 2024-09-21T05:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 21, 2024-09-21T05:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 90, 2024-09-21T05:53:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 88, 2024-09-21T05:53:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 169.346188273 2024-09-21T05:53:30.026 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:53:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.020+0000 7fb23ee00640 1 -- 172.21.15.37:0/3186012213 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb21c0b6510 msgr2=0x7fb21c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.020+0000 7fb23ee00640 1 --2- 172.21.15.37:0/3186012213 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb21c0b6510 0x7fb21c0b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb228005ab0 tx=0x7fb228005a20 comp rx=0 tx=0).stop 2024-09-21T05:53:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.020+0000 7fb23ee00640 1 -- 172.21.15.37:0/3186012213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb23810b6c0 msgr2=0x7fb23819cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.020+0000 7fb23ee00640 1 --2- 172.21.15.37:0/3186012213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb23810b6c0 0x7fb23819cc90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb22400e9f0 tx=0x7fb22400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.020+0000 7fb23ee00640 1 -- 172.21.15.37:0/3186012213 shutdown_connections 2024-09-21T05:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.020+0000 7fb23ee00640 1 --2- 172.21.15.37:0/3186012213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb23810c010 0x7fb2381a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.020+0000 7fb23ee00640 1 --2- 172.21.15.37:0/3186012213 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb21c0b6510 0x7fb21c0b8a20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.020+0000 7fb23ee00640 1 --2- 172.21.15.37:0/3186012213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb23810b6c0 0x7fb23819cc90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.020+0000 7fb23ee00640 1 --2- 172.21.15.37:0/3186012213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb238105d80 0x7fb23819c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.020+0000 7fb23ee00640 1 -- 172.21.15.37:0/3186012213 >> 172.21.15.37:0/3186012213 conn(0x7fb238101810 msgr2=0x7fb23810ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.020+0000 7fb23ee00640 1 -- 172.21.15.37:0/3186012213 shutdown_connections 2024-09-21T05:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:30.020+0000 7fb23ee00640 1 -- 172.21.15.37:0/3186012213 wait complete. 2024-09-21T05:53:30.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:29 smithi144 ceph-mon[34351]: pgmap v401: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:30.801 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T05:53:30.821 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T05:53:30.821 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T05:53:30.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:30.821 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-21T05:53:30.859 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T05:53:30.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:30.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T05:53:30.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:30.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-09-21T05:53:31.250 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-21T05:53:31.250 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T05:53:31.250 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:31.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T05:53:31.634 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:32.099 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:31 smithi037 ceph-mon[30631]: pgmap v402: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:32.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:31 smithi144 ceph-mon[34351]: pgmap v402: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:32.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:31 smithi067 ceph-mon[34443]: pgmap v402: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.278+0000 7f22e6e00640 1 -- 172.21.15.37:0/2223250469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e01094c0 msgr2=0x7f22e01098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.278+0000 7f22e6e00640 1 --2- 172.21.15.37:0/2223250469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e01094c0 0x7f22e01098d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009900 tx=0x7f22c802a410 comp rx=0 tx=0).stop 2024-09-21T05:53:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.278+0000 7f22e6e00640 1 -- 172.21.15.37:0/2223250469 shutdown_connections 2024-09-21T05:53:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.278+0000 7f22e6e00640 1 --2- 172.21.15.37:0/2223250469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22e0109e10 0x7f22e0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:32.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.278+0000 7f22e6e00640 1 --2- 172.21.15.37:0/2223250469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e01094c0 0x7f22e01098d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:32.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.278+0000 7f22e6e00640 1 --2- 172.21.15.37:0/2223250469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22e0103b80 0x7f22e0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:32.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.278+0000 7f22e6e00640 1 -- 172.21.15.37:0/2223250469 >> 172.21.15.37:0/2223250469 conn(0x7f22e00ff5d0 msgr2=0x7f22e0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:32.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.278+0000 7f22e6e00640 1 -- 172.21.15.37:0/2223250469 shutdown_connections 2024-09-21T05:53:32.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.278+0000 7f22e6e00640 1 -- 172.21.15.37:0/2223250469 wait complete. 2024-09-21T05:53:32.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.279+0000 7f22e6e00640 1 Processor -- start 2024-09-21T05:53:32.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.279+0000 7f22e6e00640 1 -- start start 2024-09-21T05:53:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.279+0000 7f22e6e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e0103b80 0x7f22e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22e6e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22e01094c0 0x7f22e0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22e6e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22e0109e10 0x7f22e0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22e6e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22e0113b20 con 0x7f22e0103b80 2024-09-21T05:53:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22e6e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f22e01139a0 con 0x7f22e0109e10 2024-09-21T05:53:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22e6e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f22e0113ca0 con 0x7f22e01094c0 2024-09-21T05:53:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e0103b80 0x7f22e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22e01094c0 0x7f22e0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22e01094c0 0x7f22e0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:35250/0 (socket says 172.21.15.37:35250) 2024-09-21T05:53:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e0103b80 0x7f22e0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33988/0 (socket says 172.21.15.37:33988) 2024-09-21T05:53:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22d7400640 1 -- 172.21.15.37:0/1416837721 learned_addr learned my addr 172.21.15.37:0/1416837721 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22e4e00640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22e0109e10 0x7f22e0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22dfe00640 1 -- 172.21.15.37:0/1416837721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22e01094c0 msgr2=0x7f22e0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22dfe00640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22e01094c0 0x7f22e0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22dfe00640 1 -- 172.21.15.37:0/1416837721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22e0109e10 msgr2=0x7f22e0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22dfe00640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22e0109e10 0x7f22e0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22dfe00640 1 -- 172.21.15.37:0/1416837721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e01a8790 con 0x7f22e0103b80 2024-09-21T05:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.280+0000 7f22e4e00640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22e0109e10 0x7f22e0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.281+0000 7f22dfe00640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e0103b80 0x7f22e0075710 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f22d000e9f0 tx=0x7f22d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.281+0000 7f22dd600640 1 -- 172.21.15.37:0/1416837721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d000ccc0 con 0x7f22e0103b80 2024-09-21T05:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.281+0000 7f22dd600640 1 -- 172.21.15.37:0/1416837721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22d0005020 con 0x7f22e0103b80 2024-09-21T05:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.281+0000 7f22e6e00640 1 -- 172.21.15.37:0/1416837721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e01a8a80 con 0x7f22e0103b80 2024-09-21T05:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.281+0000 7f22dd600640 1 -- 172.21.15.37:0/1416837721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d000ce60 con 0x7f22e0103b80 2024-09-21T05:53:32.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.281+0000 7f22e6e00640 1 -- 172.21.15.37:0/1416837721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e01a8f90 con 0x7f22e0103b80 2024-09-21T05:53:32.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.282+0000 7f22e6e00640 1 -- 172.21.15.37:0/1416837721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e0103f90 con 0x7f22e0103b80 2024-09-21T05:53:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.285+0000 7f22dd600640 1 -- 172.21.15.37:0/1416837721 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f22d00051d0 con 0x7f22e0103b80 2024-09-21T05:53:32.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.286+0000 7f22dd600640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f22c40b6590 0x7f22c40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:32.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.286+0000 7f22dd600640 1 -- 172.21.15.37:0/1416837721 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f22d00e76d0 con 0x7f22e0103b80 2024-09-21T05:53:32.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.286+0000 7f22d7400640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f22c40b6590 0x7f22c40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:32.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.287+0000 7f22d7400640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f22c40b6590 0x7f22c40b8aa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f22c8006010 tx=0x7f22c8005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.288+0000 7f22dd600640 1 -- 172.21.15.37:0/1416837721 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22d00adbc0 con 0x7f22e0103b80 2024-09-21T05:53:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.525+0000 7f22e6e00640 1 -- 172.21.15.37:0/1416837721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f22e0076a10 con 0x7f22e0103b80 2024-09-21T05:53:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.526+0000 7f22dd600640 1 -- 172.21.15.37:0/1416837721 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+88 (secure 0 0 0) 0x7f22e0076a10 con 0x7f22e0103b80 2024-09-21T05:53:32.528 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T05:53:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.529+0000 7f22e6e00640 1 -- 172.21.15.37:0/1416837721 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f22c40b6590 msgr2=0x7f22c40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.529+0000 7f22e6e00640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f22c40b6590 0x7f22c40b8aa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f22c8006010 tx=0x7f22c8005a20 comp rx=0 tx=0).stop 2024-09-21T05:53:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.529+0000 7f22e6e00640 1 -- 172.21.15.37:0/1416837721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e0103b80 msgr2=0x7f22e0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.529+0000 7f22e6e00640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e0103b80 0x7f22e0075710 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f22d000e9f0 tx=0x7f22d000edf0 comp rx=0 tx=0).stop 2024-09-21T05:53:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.529+0000 7f22e6e00640 1 -- 172.21.15.37:0/1416837721 shutdown_connections 2024-09-21T05:53:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.529+0000 7f22e6e00640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f22c40b6590 0x7f22c40b8aa0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.529+0000 7f22e6e00640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22e0109e10 0x7f22e0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.529+0000 7f22e6e00640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22e01094c0 0x7f22e0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.529+0000 7f22e6e00640 1 --2- 172.21.15.37:0/1416837721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e0103b80 0x7f22e0075710 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.529+0000 7f22e6e00640 1 -- 172.21.15.37:0/1416837721 >> 172.21.15.37:0/1416837721 conn(0x7f22e00ff5d0 msgr2=0x7f22e01019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.529+0000 7f22e6e00640 1 -- 172.21.15.37:0/1416837721 shutdown_connections 2024-09-21T05:53:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:32.529+0000 7f22e6e00640 1 -- 172.21.15.37:0/1416837721 wait complete. 2024-09-21T05:53:32.904 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:32 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1416837721' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:53:33.024 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:32 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1416837721' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:53:33.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:32 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1416837721' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T05:53:33.411 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T05:53:33.412 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T05:53:33.412 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-09-21T05:53:33.412 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T05:53:33.412 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:33.412 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T05:53:33.412 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T05:53:33.412 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T05:53:33.412 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T05:53:33.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:33.412 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-09-21T05:53:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T05:53:33.448 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T05:53:33.448 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42015sec preferred_lft 42015sec 2024-09-21T05:53:33.449 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-09-21T05:53:33.450 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-21T05:53:33.450 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T05:53:33.450 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-09-21T05:53:33.450 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-09-21T05:53:33.451 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T05:53:33.451 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:53:33.451 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T05:53:33.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-09-21T05:53:33.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-09-21T05:53:33.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-09-21T05:53:33.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T05:53:33.451 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T05:53:33.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:53:33.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:33.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:33.678 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T05:53:33.734 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-09-21T05:53:33.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:33.737 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-09-21T05:53:33.774 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-09-21T05:53:33.774 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T05:53:33.774 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T05:53:33.774 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T05:53:33.774 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T05:53:33.774 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:53:33.774 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T05:53:33.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T05:53:33.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T05:53:33.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T05:53:33.775 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T05:53:33.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:53:33.912 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:33 smithi037 ceph-mon[30631]: pgmap v403: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:33.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:33.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:33.976 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-21T05:53:34.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:34.012 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-09-21T05:53:34.088 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:53:34.088 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T05:53:34.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T05:53:34.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T05:53:34.088 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T05:53:34.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:33 smithi144 ceph-mon[34351]: pgmap v403: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:34.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:53:34.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:33 smithi067 ceph-mon[34443]: pgmap v403: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:34.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:34.268 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T05:53:34.268 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:53:34.268 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T05:53:34.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T05:53:34.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T05:53:34.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T05:53:34.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T05:53:34.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T05:53:34.269 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T05:53:34.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:53:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:34.493 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T05:53:34.493 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T05:53:34.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-09-21T05:53:34.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T05:53:34.493 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T05:53:34.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:53:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:34.665 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T05:53:34.665 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:34.701 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T05:53:34.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T05:53:34.702 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:34.778 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T05:53:34.778 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T05:53:34.778 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/3177fa0a-d66d-446f-8260-6a576a389877 2024-09-21T05:53:34.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:34.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/3177fa0a-d66d-446f-8260-6a576a389877 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-21T05:53:34.978 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-21T05:53:34.978 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-09-21T05:53:35.663 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-21T05:53:35.663 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-09-21T05:53:35.663 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.67:6789,172.21.15.144:6789" 2024-09-21T05:53:35.663 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@0c10cdda-77dc-11ef-baf5-efdc52797490.cephfs=/volumes/qa/sv_1/3177fa0a-d66d-446f-8260-6a576a389877 2024-09-21T05:53:35.663 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync,name=0,key=0,mon_addr=172.21.15.37:6789/172.21.15.67:6789/172.21.15.144:6789" will pass to kernel 2024-09-21T05:53:35.665 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T05:53:35.665 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-09-21T05:53:35.665 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T05:53:35.665 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T05:53:35.665 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T05:53:35.668 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T05:53:35.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T05:53:35.668 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:35.729 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T05:53:35.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T05:53:35.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:35.822 INFO:teuthology.orchestra.run.smithi037.stdout:client25279 2024-09-21T05:53:35.822 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:53:35.822 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T05:53:35.858 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T05:53:35.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:35 smithi037 ceph-mon[30631]: pgmap v404: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:35.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T05:53:35.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:35.991 INFO:teuthology.orchestra.run.smithi037.stdout:client25279 2024-09-21T05:53:35.991 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T05:53:36.048 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:35 smithi067 ceph-mon[34443]: pgmap v404: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:36.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T05:53:36.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:36.121 INFO:teuthology.orchestra.run.smithi037.stdout:client25279 2024-09-21T05:53:36.122 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490.client25279/status') 2024-09-21T05:53:36.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:35 smithi144 ceph-mon[34351]: pgmap v404: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:53:36.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T05:53:36.222 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.25279 (3)172.21.15.37:0/2768366541 2024-09-21T05:53:36.222 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2024-09-21T05:53:36.222 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2024-09-21T05:53:36.222 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2024-09-21T05:53:36.223 INFO:teuthology.orchestra.run.smithi037.stderr:71 bytes copied, 5.9111e-05 s, 1.2 MB/s 2024-09-21T05:53:36.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T05:53:36.233 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T05:53:36.245 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-21T05:53:36.261 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T05:53:36.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:53:36.640 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:37.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.398+0000 7f503be00640 1 -- 172.21.15.37:0/1515148593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f503c1092f0 msgr2=0x7f503c109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:37.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.398+0000 7f503be00640 1 --2- 172.21.15.37:0/1515148593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f503c1092f0 0x7f503c109700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5024009900 tx=0x7f502402a410 comp rx=0 tx=0).stop 2024-09-21T05:53:37.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.398+0000 7f503be00640 1 -- 172.21.15.37:0/1515148593 shutdown_connections 2024-09-21T05:53:37.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.398+0000 7f503be00640 1 --2- 172.21.15.37:0/1515148593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f503c109c40 0x7f503c110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.398+0000 7f503be00640 1 --2- 172.21.15.37:0/1515148593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f503c1092f0 0x7f503c109700 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.398+0000 7f503be00640 1 --2- 172.21.15.37:0/1515148593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f503c1039b0 0x7f503c103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.398+0000 7f503be00640 1 -- 172.21.15.37:0/1515148593 >> 172.21.15.37:0/1515148593 conn(0x7f503c0ff400 msgr2=0x7f503c101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:37.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.399+0000 7f503be00640 1 -- 172.21.15.37:0/1515148593 shutdown_connections 2024-09-21T05:53:37.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.399+0000 7f503be00640 1 -- 172.21.15.37:0/1515148593 wait complete. 2024-09-21T05:53:37.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.400+0000 7f503be00640 1 Processor -- start 2024-09-21T05:53:37.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.400+0000 7f503be00640 1 -- start start 2024-09-21T05:53:37.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.400+0000 7f503be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f503c1039b0 0x7f503c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:37.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.400+0000 7f503be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f503c1092f0 0x7f503c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:37.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.400+0000 7f503be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f503c109c40 0x7f503c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:37.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.400+0000 7f503be00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f503c113900 con 0x7f503c1039b0 2024-09-21T05:53:37.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.400+0000 7f503be00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f503c113780 con 0x7f503c109c40 2024-09-21T05:53:37.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.400+0000 7f503be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f503c113a80 con 0x7f503c1092f0 2024-09-21T05:53:37.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.400+0000 7f503aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f503c1039b0 0x7f503c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:37.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.400+0000 7f503aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f503c1039b0 0x7f503c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34014/0 (socket says 172.21.15.37:34014) 2024-09-21T05:53:37.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.400+0000 7f503aa00640 1 -- 172.21.15.37:0/2739986460 learned_addr learned my addr 172.21.15.37:0/2739986460 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:37.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.401+0000 7f503b400640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f503c109c40 0x7f503c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:37.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.401+0000 7f5033e00640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f503c1092f0 0x7f503c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:37.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.401+0000 7f503aa00640 1 -- 172.21.15.37:0/2739986460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f503c1092f0 msgr2=0x7f503c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:37.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.401+0000 7f503aa00640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f503c1092f0 0x7f503c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.401+0000 7f503aa00640 1 -- 172.21.15.37:0/2739986460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f503c109c40 msgr2=0x7f503c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:37.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.401+0000 7f503aa00640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f503c109c40 0x7f503c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.401+0000 7f503aa00640 1 -- 172.21.15.37:0/2739986460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503c1a8590 con 0x7f503c1039b0 2024-09-21T05:53:37.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.401+0000 7f503aa00640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f503c1039b0 0x7f503c075710 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f502c00e9f0 tx=0x7f502c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:37.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.401+0000 7f5033400640 1 -- 172.21.15.37:0/2739986460 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c00cd80 con 0x7f503c1039b0 2024-09-21T05:53:37.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.402+0000 7f5033400640 1 -- 172.21.15.37:0/2739986460 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f502c0108e0 con 0x7f503c1039b0 2024-09-21T05:53:37.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.402+0000 7f503be00640 1 -- 172.21.15.37:0/2739986460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503c1a8880 con 0x7f503c1039b0 2024-09-21T05:53:37.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.402+0000 7f5033400640 1 -- 172.21.15.37:0/2739986460 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c018980 con 0x7f503c1039b0 2024-09-21T05:53:37.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.402+0000 7f503be00640 1 -- 172.21.15.37:0/2739986460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f503c1a8d90 con 0x7f503c1039b0 2024-09-21T05:53:37.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.403+0000 7f503be00640 1 -- 172.21.15.37:0/2739986460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f503c103dc0 con 0x7f503c1039b0 2024-09-21T05:53:37.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.405+0000 7f5033400640 1 -- 172.21.15.37:0/2739986460 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f502c010430 con 0x7f503c1039b0 2024-09-21T05:53:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.407+0000 7f5033400640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f50200b6510 0x7f50200b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.407+0000 7f5033400640 1 -- 172.21.15.37:0/2739986460 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f502c0e7ed0 con 0x7f503c1039b0 2024-09-21T05:53:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.407+0000 7f5033e00640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f50200b6510 0x7f50200b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:37.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.408+0000 7f5033e00640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f50200b6510 0x7f50200b8a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5024009230 tx=0x7f5024031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:37.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.409+0000 7f5033400640 1 -- 172.21.15.37:0/2739986460 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f502c0b2710 con 0x7f503c1039b0 2024-09-21T05:53:37.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.604+0000 7f503be00640 1 -- 172.21.15.37:0/2739986460 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f503c063800 con 0x7f50200b6510 2024-09-21T05:53:37.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.611+0000 7f5033400640 1 -- 172.21.15.37:0/2739986460 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340392 (secure 0 0 0) 0x7f503c063800 con 0x7f50200b6510 2024-09-21T05:53:37.618 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:37.620 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T05:53:37.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.615+0000 7f503be00640 1 -- 172.21.15.37:0/2739986460 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f50200b6510 msgr2=0x7f50200b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:37.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.615+0000 7f503be00640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f50200b6510 0x7f50200b8a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5024009230 tx=0x7f5024031400 comp rx=0 tx=0).stop 2024-09-21T05:53:37.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.615+0000 7f503be00640 1 -- 172.21.15.37:0/2739986460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f503c1039b0 msgr2=0x7f503c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:37.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.615+0000 7f503be00640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f503c1039b0 0x7f503c075710 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f502c00e9f0 tx=0x7f502c00eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.615+0000 7f503be00640 1 -- 172.21.15.37:0/2739986460 shutdown_connections 2024-09-21T05:53:37.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.615+0000 7f503be00640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f50200b6510 0x7f50200b8a20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.615+0000 7f503be00640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f503c109c40 0x7f503c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.615+0000 7f503be00640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f503c1092f0 0x7f503c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.615+0000 7f503be00640 1 --2- 172.21.15.37:0/2739986460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f503c1039b0 0x7f503c075710 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:37.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.615+0000 7f503be00640 1 -- 172.21.15.37:0/2739986460 >> 172.21.15.37:0/2739986460 conn(0x7f503c0ff400 msgr2=0x7f503c101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:37.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.615+0000 7f503be00640 1 -- 172.21.15.37:0/2739986460 shutdown_connections 2024-09-21T05:53:37.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:37.615+0000 7f503be00640 1 -- 172.21.15.37:0/2739986460 wait complete. 2024-09-21T05:53:37.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:37 smithi037 ceph-mon[30631]: pgmap v405: 129 pgs: 129 active+clean; 646 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:38.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:37 smithi144 ceph-mon[34351]: pgmap v405: 129 pgs: 129 active+clean; 646 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:38.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:37 smithi067 ceph-mon[34443]: pgmap v405: 129 pgs: 129 active+clean; 646 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T05:53:38.429 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":405,"stamp":"2024-09-21T05:53:36.272368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661227,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":310,"num_read_kb":252,"num_write":223,"num_write_kb":2258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":675,"ondisk_log_size":675,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384204,"kb_used_data":14156,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557620,"statfs":{"total":1151940427776,"available":1151547002880,"internally_reserved":0,"allocated":14495744,"data_stored":8225894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":311,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003603"},"pg_stats":[{"pgid":"2.1f","version":"79'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012748+0000","last_change":"2024-09-21T05:50:50.846365+0000","last_active":"2024-09-21T05:52:48.012748+0000","last_peered":"2024-09-21T05:52:48.012748+0000","last_clean":"2024-09-21T05:52:48.012748+0000","last_became_active":"2024-09-21T05:50:50.845924+0000","last_became_peered":"2024-09-21T05:50:50.845924+0000","last_unstale":"2024-09-21T05:52:48.012748+0000","last_undegraded":"2024-09-21T05:52:48.012748+0000","last_fullsized":"2024-09-21T05:52:48.012748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:39.056271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.628415+0000","last_change":"2024-09-21T05:51:47.377003+0000","last_active":"2024-09-21T05:53:16.628415+0000","last_peered":"2024-09-21T05:53:16.628415+0000","last_clean":"2024-09-21T05:53:16.628415+0000","last_became_active":"2024-09-21T05:51:47.376624+0000","last_became_peered":"2024-09-21T05:51:47.376624+0000","last_unstale":"2024-09-21T05:53:16.628415+0000","last_undegraded":"2024-09-21T05:53:16.628415+0000","last_fullsized":"2024-09-21T05:53:16.628415+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:20.569002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678029+0000","last_change":"2024-09-21T05:51:03.940107+0000","last_active":"2024-09-21T05:52:47.678029+0000","last_peered":"2024-09-21T05:52:47.678029+0000","last_clean":"2024-09-21T05:52:47.678029+0000","last_became_active":"2024-09-21T05:51:03.939723+0000","last_became_peered":"2024-09-21T05:51:03.939723+0000","last_unstale":"2024-09-21T05:52:47.678029+0000","last_undegraded":"2024-09-21T05:52:47.678029+0000","last_fullsized":"2024-09-21T05:52:47.678029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:15.116461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321731+0000","last_change":"2024-09-21T05:50:51.162120+0000","last_active":"2024-09-21T05:52:48.321731+0000","last_peered":"2024-09-21T05:52:48.321731+0000","last_clean":"2024-09-21T05:52:48.321731+0000","last_became_active":"2024-09-21T05:50:51.161679+0000","last_became_peered":"2024-09-21T05:50:51.161679+0000","last_unstale":"2024-09-21T05:52:48.321731+0000","last_undegraded":"2024-09-21T05:52:48.321731+0000","last_fullsized":"2024-09-21T05:52:48.321731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:10.028536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.647305+0000","last_change":"2024-09-21T05:50:53.907800+0000","last_active":"2024-09-21T05:53:16.647305+0000","last_peered":"2024-09-21T05:53:16.647305+0000","last_clean":"2024-09-21T05:53:16.647305+0000","last_became_active":"2024-09-21T05:50:53.906695+0000","last_became_peered":"2024-09-21T05:50:53.906695+0000","last_unstale":"2024-09-21T05:53:16.647305+0000","last_undegraded":"2024-09-21T05:53:16.647305+0000","last_fullsized":"2024-09-21T05:53:16.647305+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:45.999010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699064+0000","last_change":"2024-09-21T05:51:03.947020+0000","last_active":"2024-09-21T05:52:47.699064+0000","last_peered":"2024-09-21T05:52:47.699064+0000","last_clean":"2024-09-21T05:52:47.699064+0000","last_became_active":"2024-09-21T05:51:03.946387+0000","last_became_peered":"2024-09-21T05:51:03.946387+0000","last_unstale":"2024-09-21T05:52:47.699064+0000","last_undegraded":"2024-09-21T05:52:47.699064+0000","last_fullsized":"2024-09-21T05:52:47.699064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:02.073199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677355+0000","last_change":"2024-09-21T05:50:50.850606+0000","last_active":"2024-09-21T05:52:47.677355+0000","last_peered":"2024-09-21T05:52:47.677355+0000","last_clean":"2024-09-21T05:52:47.677355+0000","last_became_active":"2024-09-21T05:50:50.850244+0000","last_became_peered":"2024-09-21T05:50:50.850244+0000","last_unstale":"2024-09-21T05:52:47.677355+0000","last_undegraded":"2024-09-21T05:52:47.677355+0000","last_fullsized":"2024-09-21T05:52:47.677355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:39.437099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645012+0000","last_change":"2024-09-21T05:50:53.897805+0000","last_active":"2024-09-21T05:53:16.645012+0000","last_peered":"2024-09-21T05:53:16.645012+0000","last_clean":"2024-09-21T05:53:16.645012+0000","last_became_active":"2024-09-21T05:50:53.896977+0000","last_became_peered":"2024-09-21T05:50:53.896977+0000","last_unstale":"2024-09-21T05:53:16.645012+0000","last_undegraded":"2024-09-21T05:53:16.645012+0000","last_fullsized":"2024-09-21T05:53:16.645012+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:35.538322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698802+0000","last_change":"2024-09-21T05:51:03.939519+0000","last_active":"2024-09-21T05:52:47.698802+0000","last_peered":"2024-09-21T05:52:47.698802+0000","last_clean":"2024-09-21T05:52:47.698802+0000","last_became_active":"2024-09-21T05:51:03.938429+0000","last_became_peered":"2024-09-21T05:51:03.938429+0000","last_unstale":"2024-09-21T05:52:47.698802+0000","last_undegraded":"2024-09-21T05:52:47.698802+0000","last_fullsized":"2024-09-21T05:52:47.698802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:09.236561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677115+0000","last_change":"2024-09-21T05:50:50.847640+0000","last_active":"2024-09-21T05:52:47.677115+0000","last_peered":"2024-09-21T05:52:47.677115+0000","last_clean":"2024-09-21T05:52:47.677115+0000","last_became_active":"2024-09-21T05:50:50.847101+0000","last_became_peered":"2024-09-21T05:50:50.847101+0000","last_unstale":"2024-09-21T05:52:47.677115+0000","last_undegraded":"2024-09-21T05:52:47.677115+0000","last_fullsized":"2024-09-21T05:52:47.677115+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:09.087655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641403+0000","last_change":"2024-09-21T05:50:53.889855+0000","last_active":"2024-09-21T05:53:16.641403+0000","last_peered":"2024-09-21T05:53:16.641403+0000","last_clean":"2024-09-21T05:53:16.641403+0000","last_became_active":"2024-09-21T05:50:53.889444+0000","last_became_peered":"2024-09-21T05:50:53.889444+0000","last_unstale":"2024-09-21T05:53:16.641403+0000","last_undegraded":"2024-09-21T05:53:16.641403+0000","last_fullsized":"2024-09-21T05:53:16.641403+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:47.480986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698671+0000","last_change":"2024-09-21T05:51:03.946866+0000","last_active":"2024-09-21T05:52:47.698671+0000","last_peered":"2024-09-21T05:52:47.698671+0000","last_clean":"2024-09-21T05:52:47.698671+0000","last_became_active":"2024-09-21T05:51:03.946332+0000","last_became_peered":"2024-09-21T05:51:03.946332+0000","last_unstale":"2024-09-21T05:52:47.698671+0000","last_undegraded":"2024-09-21T05:52:47.698671+0000","last_fullsized":"2024-09-21T05:52:47.698671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:43.527937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645506+0000","last_change":"2024-09-21T05:50:53.900395+0000","last_active":"2024-09-21T05:53:16.645506+0000","last_peered":"2024-09-21T05:53:16.645506+0000","last_clean":"2024-09-21T05:53:16.645506+0000","last_became_active":"2024-09-21T05:50:53.894925+0000","last_became_peered":"2024-09-21T05:50:53.894925+0000","last_unstale":"2024-09-21T05:53:16.645506+0000","last_undegraded":"2024-09-21T05:53:16.645506+0000","last_fullsized":"2024-09-21T05:53:16.645506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.939120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.676506+0000","last_change":"2024-09-21T05:50:50.851145+0000","last_active":"2024-09-21T05:52:47.676506+0000","last_peered":"2024-09-21T05:52:47.676506+0000","last_clean":"2024-09-21T05:52:47.676506+0000","last_became_active":"2024-09-21T05:50:50.850641+0000","last_became_peered":"2024-09-21T05:50:50.850641+0000","last_unstale":"2024-09-21T05:52:47.676506+0000","last_undegraded":"2024-09-21T05:52:47.676506+0000","last_fullsized":"2024-09-21T05:52:47.676506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:34.560798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699204+0000","last_change":"2024-09-21T05:51:03.991798+0000","last_active":"2024-09-21T05:52:47.699204+0000","last_peered":"2024-09-21T05:52:47.699204+0000","last_clean":"2024-09-21T05:52:47.699204+0000","last_became_active":"2024-09-21T05:51:03.991173+0000","last_became_peered":"2024-09-21T05:51:03.991173+0000","last_unstale":"2024-09-21T05:52:47.699204+0000","last_undegraded":"2024-09-21T05:52:47.699204+0000","last_fullsized":"2024-09-21T05:52:47.699204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:46.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.634436+0000","last_change":"2024-09-21T05:50:53.892293+0000","last_active":"2024-09-21T05:53:16.634436+0000","last_peered":"2024-09-21T05:53:16.634436+0000","last_clean":"2024-09-21T05:53:16.634436+0000","last_became_active":"2024-09-21T05:50:53.891814+0000","last_became_peered":"2024-09-21T05:50:53.891814+0000","last_unstale":"2024-09-21T05:53:16.634436+0000","last_undegraded":"2024-09-21T05:53:16.634436+0000","last_fullsized":"2024-09-21T05:53:16.634436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:14.810409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678731+0000","last_change":"2024-09-21T05:50:50.846360+0000","last_active":"2024-09-21T05:52:47.678731+0000","last_peered":"2024-09-21T05:52:47.678731+0000","last_clean":"2024-09-21T05:52:47.678731+0000","last_became_active":"2024-09-21T05:50:50.845972+0000","last_became_peered":"2024-09-21T05:50:50.845972+0000","last_unstale":"2024-09-21T05:52:47.678731+0000","last_undegraded":"2024-09-21T05:52:47.678731+0000","last_fullsized":"2024-09-21T05:52:47.678731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.023239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699296+0000","last_change":"2024-09-21T05:51:03.938903+0000","last_active":"2024-09-21T05:52:47.699296+0000","last_peered":"2024-09-21T05:52:47.699296+0000","last_clean":"2024-09-21T05:52:47.699296+0000","last_became_active":"2024-09-21T05:51:03.938312+0000","last_became_peered":"2024-09-21T05:51:03.938312+0000","last_unstale":"2024-09-21T05:52:47.699296+0000","last_undegraded":"2024-09-21T05:52:47.699296+0000","last_fullsized":"2024-09-21T05:52:47.699296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:01.851758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.635971+0000","last_change":"2024-09-21T05:50:53.907529+0000","last_active":"2024-09-21T05:53:16.635971+0000","last_peered":"2024-09-21T05:53:16.635971+0000","last_clean":"2024-09-21T05:53:16.635971+0000","last_became_active":"2024-09-21T05:50:53.907154+0000","last_became_peered":"2024-09-21T05:50:53.907154+0000","last_unstale":"2024-09-21T05:53:16.635971+0000","last_undegraded":"2024-09-21T05:53:16.635971+0000","last_fullsized":"2024-09-21T05:53:16.635971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:22.586642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321422+0000","last_change":"2024-09-21T05:50:50.838939+0000","last_active":"2024-09-21T05:52:48.321422+0000","last_peered":"2024-09-21T05:52:48.321422+0000","last_clean":"2024-09-21T05:52:48.321422+0000","last_became_active":"2024-09-21T05:50:50.838457+0000","last_became_peered":"2024-09-21T05:50:50.838457+0000","last_unstale":"2024-09-21T05:52:48.321422+0000","last_undegraded":"2024-09-21T05:52:48.321422+0000","last_fullsized":"2024-09-21T05:52:48.321422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:54.259046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011123+0000","last_change":"2024-09-21T05:51:03.944824+0000","last_active":"2024-09-21T05:52:48.011123+0000","last_peered":"2024-09-21T05:52:48.011123+0000","last_clean":"2024-09-21T05:52:48.011123+0000","last_became_active":"2024-09-21T05:51:03.938856+0000","last_became_peered":"2024-09-21T05:51:03.938856+0000","last_unstale":"2024-09-21T05:52:48.011123+0000","last_undegraded":"2024-09-21T05:52:48.011123+0000","last_fullsized":"2024-09-21T05:52:48.011123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:12.111775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.582040+0000","last_change":"2024-09-21T05:50:53.891676+0000","last_active":"2024-09-21T05:53:16.582040+0000","last_peered":"2024-09-21T05:53:16.582040+0000","last_clean":"2024-09-21T05:53:16.582040+0000","last_became_active":"2024-09-21T05:50:53.891339+0000","last_became_peered":"2024-09-21T05:50:53.891339+0000","last_unstale":"2024-09-21T05:53:16.582040+0000","last_undegraded":"2024-09-21T05:53:16.582040+0000","last_fullsized":"2024-09-21T05:53:16.582040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:41.707680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675446+0000","last_change":"2024-09-21T05:50:51.162492+0000","last_active":"2024-09-21T05:52:47.675446+0000","last_peered":"2024-09-21T05:52:47.675446+0000","last_clean":"2024-09-21T05:52:47.675446+0000","last_became_active":"2024-09-21T05:50:51.162108+0000","last_became_peered":"2024-09-21T05:50:51.162108+0000","last_unstale":"2024-09-21T05:52:47.675446+0000","last_undegraded":"2024-09-21T05:52:47.675446+0000","last_fullsized":"2024-09-21T05:52:47.675446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.387568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699051+0000","last_change":"2024-09-21T05:51:03.992550+0000","last_active":"2024-09-21T05:52:47.699051+0000","last_peered":"2024-09-21T05:52:47.699051+0000","last_clean":"2024-09-21T05:52:47.699051+0000","last_became_active":"2024-09-21T05:51:03.991865+0000","last_became_peered":"2024-09-21T05:51:03.991865+0000","last_unstale":"2024-09-21T05:52:47.699051+0000","last_undegraded":"2024-09-21T05:52:47.699051+0000","last_fullsized":"2024-09-21T05:52:47.699051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:50.204058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.636651+0000","last_change":"2024-09-21T05:50:53.884376+0000","last_active":"2024-09-21T05:53:16.636651+0000","last_peered":"2024-09-21T05:53:16.636651+0000","last_clean":"2024-09-21T05:53:16.636651+0000","last_became_active":"2024-09-21T05:50:53.884033+0000","last_became_peered":"2024-09-21T05:50:53.884033+0000","last_unstale":"2024-09-21T05:53:16.636651+0000","last_undegraded":"2024-09-21T05:53:16.636651+0000","last_fullsized":"2024-09-21T05:53:16.636651+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.359191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699406+0000","last_change":"2024-09-21T05:50:50.869502+0000","last_active":"2024-09-21T05:52:47.699406+0000","last_peered":"2024-09-21T05:52:47.699406+0000","last_clean":"2024-09-21T05:52:47.699406+0000","last_became_active":"2024-09-21T05:50:50.869071+0000","last_became_peered":"2024-09-21T05:50:50.869071+0000","last_unstale":"2024-09-21T05:52:47.699406+0000","last_undegraded":"2024-09-21T05:52:47.699406+0000","last_fullsized":"2024-09-21T05:52:47.699406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:48.364902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678176+0000","last_change":"2024-09-21T05:51:03.931945+0000","last_active":"2024-09-21T05:52:47.678176+0000","last_peered":"2024-09-21T05:52:47.678176+0000","last_clean":"2024-09-21T05:52:47.678176+0000","last_became_active":"2024-09-21T05:51:03.931411+0000","last_became_peered":"2024-09-21T05:51:03.931411+0000","last_unstale":"2024-09-21T05:52:47.678176+0000","last_undegraded":"2024-09-21T05:52:47.678176+0000","last_fullsized":"2024-09-21T05:52:47.678176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.910547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641081+0000","last_change":"2024-09-21T05:50:53.897995+0000","last_active":"2024-09-21T05:53:16.641081+0000","last_peered":"2024-09-21T05:53:16.641081+0000","last_clean":"2024-09-21T05:53:16.641081+0000","last_became_active":"2024-09-21T05:50:53.895797+0000","last_became_peered":"2024-09-21T05:50:53.895797+0000","last_unstale":"2024-09-21T05:53:16.641081+0000","last_undegraded":"2024-09-21T05:53:16.641081+0000","last_fullsized":"2024-09-21T05:53:16.641081+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.484867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.920142+0000","last_change":"2024-09-21T05:50:50.845853+0000","last_active":"2024-09-21T05:53:16.920142+0000","last_peered":"2024-09-21T05:53:16.920142+0000","last_clean":"2024-09-21T05:53:16.920142+0000","last_became_active":"2024-09-21T05:50:50.845495+0000","last_became_peered":"2024-09-21T05:50:50.845495+0000","last_unstale":"2024-09-21T05:53:16.920142+0000","last_undegraded":"2024-09-21T05:53:16.920142+0000","last_fullsized":"2024-09-21T05:53:16.920142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:47.960498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.320673+0000","last_change":"2024-09-21T05:51:03.991380+0000","last_active":"2024-09-21T05:52:48.320673+0000","last_peered":"2024-09-21T05:52:48.320673+0000","last_clean":"2024-09-21T05:52:48.320673+0000","last_became_active":"2024-09-21T05:51:03.990911+0000","last_became_peered":"2024-09-21T05:51:03.990911+0000","last_unstale":"2024-09-21T05:52:48.320673+0000","last_undegraded":"2024-09-21T05:52:48.320673+0000","last_fullsized":"2024-09-21T05:52:48.320673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:01.779692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.625116+0000","last_change":"2024-09-21T05:50:53.910190+0000","last_active":"2024-09-21T05:53:16.625116+0000","last_peered":"2024-09-21T05:53:16.625116+0000","last_clean":"2024-09-21T05:53:16.625116+0000","last_became_active":"2024-09-21T05:50:53.909649+0000","last_became_peered":"2024-09-21T05:50:53.909649+0000","last_unstale":"2024-09-21T05:53:16.625116+0000","last_undegraded":"2024-09-21T05:53:16.625116+0000","last_fullsized":"2024-09-21T05:53:16.625116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:14.582217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677473+0000","last_change":"2024-09-21T05:50:51.163512+0000","last_active":"2024-09-21T05:52:47.677473+0000","last_peered":"2024-09-21T05:52:47.677473+0000","last_clean":"2024-09-21T05:52:47.677473+0000","last_became_active":"2024-09-21T05:50:51.161959+0000","last_became_peered":"2024-09-21T05:50:51.161959+0000","last_unstale":"2024-09-21T05:52:47.677473+0000","last_undegraded":"2024-09-21T05:52:47.677473+0000","last_fullsized":"2024-09-21T05:52:47.677473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:51.701990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682240+0000","last_change":"2024-09-21T05:51:03.936815+0000","last_active":"2024-09-21T05:52:47.682240+0000","last_peered":"2024-09-21T05:52:47.682240+0000","last_clean":"2024-09-21T05:52:47.682240+0000","last_became_active":"2024-09-21T05:51:03.936365+0000","last_became_peered":"2024-09-21T05:51:03.936365+0000","last_unstale":"2024-09-21T05:52:47.682240+0000","last_undegraded":"2024-09-21T05:52:47.682240+0000","last_fullsized":"2024-09-21T05:52:47.682240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:59.820159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.624247+0000","last_change":"2024-09-21T05:50:53.892772+0000","last_active":"2024-09-21T05:53:16.624247+0000","last_peered":"2024-09-21T05:53:16.624247+0000","last_clean":"2024-09-21T05:53:16.624247+0000","last_became_active":"2024-09-21T05:50:53.892378+0000","last_became_peered":"2024-09-21T05:50:53.892378+0000","last_unstale":"2024-09-21T05:53:16.624247+0000","last_undegraded":"2024-09-21T05:53:16.624247+0000","last_fullsized":"2024-09-21T05:53:16.624247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:34.438067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011995+0000","last_change":"2024-09-21T05:51:47.378160+0000","last_active":"2024-09-21T05:52:48.011995+0000","last_peered":"2024-09-21T05:52:48.011995+0000","last_clean":"2024-09-21T05:52:48.011995+0000","last_became_active":"2024-09-21T05:51:47.377779+0000","last_became_peered":"2024-09-21T05:51:47.377779+0000","last_unstale":"2024-09-21T05:52:48.011995+0000","last_undegraded":"2024-09-21T05:52:48.011995+0000","last_fullsized":"2024-09-21T05:52:48.011995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:27.780273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012450+0000","last_change":"2024-09-21T05:52:48.011820+0000","last_active":"2024-09-21T05:52:48.012450+0000","last_peered":"2024-09-21T05:52:48.012450+0000","last_clean":"2024-09-21T05:52:48.012450+0000","last_became_active":"2024-09-21T05:52:48.011191+0000","last_became_peered":"2024-09-21T05:52:48.011191+0000","last_unstale":"2024-09-21T05:52:48.012450+0000","last_undegraded":"2024-09-21T05:52:48.012450+0000","last_fullsized":"2024-09-21T05:52:48.012450+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:45.598281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.620513+0000","last_change":"2024-09-21T05:50:53.899306+0000","last_active":"2024-09-21T05:53:16.620513+0000","last_peered":"2024-09-21T05:53:16.620513+0000","last_clean":"2024-09-21T05:53:16.620513+0000","last_became_active":"2024-09-21T05:50:53.898921+0000","last_became_peered":"2024-09-21T05:50:53.898921+0000","last_unstale":"2024-09-21T05:53:16.620513+0000","last_undegraded":"2024-09-21T05:53:16.620513+0000","last_fullsized":"2024-09-21T05:53:16.620513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:45.698584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681190+0000","last_change":"2024-09-21T05:50:50.844394+0000","last_active":"2024-09-21T05:52:47.681190+0000","last_peered":"2024-09-21T05:52:47.681190+0000","last_clean":"2024-09-21T05:52:47.681190+0000","last_became_active":"2024-09-21T05:50:50.843771+0000","last_became_peered":"2024-09-21T05:50:50.843771+0000","last_unstale":"2024-09-21T05:52:47.681190+0000","last_undegraded":"2024-09-21T05:52:47.681190+0000","last_fullsized":"2024-09-21T05:52:47.681190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:14.372917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009778+0000","last_change":"2024-09-21T05:51:03.941277+0000","last_active":"2024-09-21T05:52:48.009778+0000","last_peered":"2024-09-21T05:52:48.009778+0000","last_clean":"2024-09-21T05:52:48.009778+0000","last_became_active":"2024-09-21T05:51:03.940659+0000","last_became_peered":"2024-09-21T05:51:03.940659+0000","last_unstale":"2024-09-21T05:52:48.009778+0000","last_undegraded":"2024-09-21T05:52:48.009778+0000","last_fullsized":"2024-09-21T05:52:48.009778+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:40.217023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640245+0000","last_change":"2024-09-21T05:50:53.895399+0000","last_active":"2024-09-21T05:53:16.640245+0000","last_peered":"2024-09-21T05:53:16.640245+0000","last_clean":"2024-09-21T05:53:16.640245+0000","last_became_active":"2024-09-21T05:50:53.895022+0000","last_became_peered":"2024-09-21T05:50:53.895022+0000","last_unstale":"2024-09-21T05:53:16.640245+0000","last_undegraded":"2024-09-21T05:53:16.640245+0000","last_fullsized":"2024-09-21T05:53:16.640245+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:02.056015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010036+0000","last_change":"2024-09-21T05:50:51.162215+0000","last_active":"2024-09-21T05:52:48.010036+0000","last_peered":"2024-09-21T05:52:48.010036+0000","last_clean":"2024-09-21T05:52:48.010036+0000","last_became_active":"2024-09-21T05:50:51.161812+0000","last_became_peered":"2024-09-21T05:50:51.161812+0000","last_unstale":"2024-09-21T05:52:48.010036+0000","last_undegraded":"2024-09-21T05:52:48.010036+0000","last_fullsized":"2024-09-21T05:52:48.010036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:05.237806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009907+0000","last_change":"2024-09-21T05:51:03.991488+0000","last_active":"2024-09-21T05:52:48.009907+0000","last_peered":"2024-09-21T05:52:48.009907+0000","last_clean":"2024-09-21T05:52:48.009907+0000","last_became_active":"2024-09-21T05:51:03.990866+0000","last_became_peered":"2024-09-21T05:51:03.990866+0000","last_unstale":"2024-09-21T05:52:48.009907+0000","last_undegraded":"2024-09-21T05:52:48.009907+0000","last_fullsized":"2024-09-21T05:52:48.009907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:41.061421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.629178+0000","last_change":"2024-09-21T05:50:53.895076+0000","last_active":"2024-09-21T05:53:16.629178+0000","last_peered":"2024-09-21T05:53:16.629178+0000","last_clean":"2024-09-21T05:53:16.629178+0000","last_became_active":"2024-09-21T05:50:53.893888+0000","last_became_peered":"2024-09-21T05:50:53.893888+0000","last_unstale":"2024-09-21T05:53:16.629178+0000","last_undegraded":"2024-09-21T05:53:16.629178+0000","last_fullsized":"2024-09-21T05:53:16.629178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:13.397806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681934+0000","last_change":"2024-09-21T05:51:47.376540+0000","last_active":"2024-09-21T05:52:47.681934+0000","last_peered":"2024-09-21T05:52:47.681934+0000","last_clean":"2024-09-21T05:52:47.681934+0000","last_became_active":"2024-09-21T05:51:47.376163+0000","last_became_peered":"2024-09-21T05:51:47.376163+0000","last_unstale":"2024-09-21T05:52:47.681934+0000","last_undegraded":"2024-09-21T05:52:47.681934+0000","last_fullsized":"2024-09-21T05:52:47.681934+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:51.217674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010533+0000","last_change":"2024-09-21T05:51:03.991711+0000","last_active":"2024-09-21T05:52:48.010533+0000","last_peered":"2024-09-21T05:52:48.010533+0000","last_clean":"2024-09-21T05:52:48.010533+0000","last_became_active":"2024-09-21T05:51:03.991200+0000","last_became_peered":"2024-09-21T05:51:03.991200+0000","last_unstale":"2024-09-21T05:52:48.010533+0000","last_undegraded":"2024-09-21T05:52:48.010533+0000","last_fullsized":"2024-09-21T05:52:48.010533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:40.981303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.635878+0000","last_change":"2024-09-21T05:50:53.887913+0000","last_active":"2024-09-21T05:53:16.635878+0000","last_peered":"2024-09-21T05:53:16.635878+0000","last_clean":"2024-09-21T05:53:16.635878+0000","last_became_active":"2024-09-21T05:50:53.887583+0000","last_became_peered":"2024-09-21T05:50:53.887583+0000","last_unstale":"2024-09-21T05:53:16.635878+0000","last_undegraded":"2024-09-21T05:53:16.635878+0000","last_fullsized":"2024-09-21T05:53:16.635878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:05.941780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699391+0000","last_change":"2024-09-21T05:50:50.846370+0000","last_active":"2024-09-21T05:52:47.699391+0000","last_peered":"2024-09-21T05:52:47.699391+0000","last_clean":"2024-09-21T05:52:47.699391+0000","last_became_active":"2024-09-21T05:50:50.845890+0000","last_became_peered":"2024-09-21T05:50:50.845890+0000","last_unstale":"2024-09-21T05:52:47.699391+0000","last_undegraded":"2024-09-21T05:52:47.699391+0000","last_fullsized":"2024-09-21T05:52:47.699391+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:15.180734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":118,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.680908+0000","last_change":"2024-09-21T05:49:33.762460+0000","last_active":"2024-09-21T05:52:47.680908+0000","last_peered":"2024-09-21T05:52:47.680908+0000","last_clean":"2024-09-21T05:52:47.680908+0000","last_became_active":"2024-09-21T05:49:33.705194+0000","last_became_peered":"2024-09-21T05:49:33.705194+0000","last_unstale":"2024-09-21T05:52:47.680908+0000","last_undegraded":"2024-09-21T05:52:47.680908+0000","last_fullsized":"2024-09-21T05:52:47.680908+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_clean_scrub_stamp":"2024-09-21T05:45:49.237325+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:39.194122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681362+0000","last_change":"2024-09-21T05:51:03.938790+0000","last_active":"2024-09-21T05:52:47.681362+0000","last_peered":"2024-09-21T05:52:47.681362+0000","last_clean":"2024-09-21T05:52:47.681362+0000","last_became_active":"2024-09-21T05:51:03.938214+0000","last_became_peered":"2024-09-21T05:51:03.938214+0000","last_unstale":"2024-09-21T05:52:47.681362+0000","last_undegraded":"2024-09-21T05:52:47.681362+0000","last_fullsized":"2024-09-21T05:52:47.681362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:11.512500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645921+0000","last_change":"2024-09-21T05:50:53.893475+0000","last_active":"2024-09-21T05:53:16.645921+0000","last_peered":"2024-09-21T05:53:16.645921+0000","last_clean":"2024-09-21T05:53:16.645921+0000","last_became_active":"2024-09-21T05:50:53.892946+0000","last_became_peered":"2024-09-21T05:50:53.892946+0000","last_unstale":"2024-09-21T05:53:16.645921+0000","last_undegraded":"2024-09-21T05:53:16.645921+0000","last_fullsized":"2024-09-21T05:53:16.645921+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:23.612285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678724+0000","last_change":"2024-09-21T05:50:51.162170+0000","last_active":"2024-09-21T05:52:47.678724+0000","last_peered":"2024-09-21T05:52:47.678724+0000","last_clean":"2024-09-21T05:52:47.678724+0000","last_became_active":"2024-09-21T05:50:51.161685+0000","last_became_peered":"2024-09-21T05:50:51.161685+0000","last_unstale":"2024-09-21T05:52:47.678724+0000","last_undegraded":"2024-09-21T05:52:47.678724+0000","last_fullsized":"2024-09-21T05:52:47.678724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:14.922423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675290+0000","last_change":"2024-09-21T05:51:03.937061+0000","last_active":"2024-09-21T05:52:47.675290+0000","last_peered":"2024-09-21T05:52:47.675290+0000","last_clean":"2024-09-21T05:52:47.675290+0000","last_became_active":"2024-09-21T05:51:03.936306+0000","last_became_peered":"2024-09-21T05:51:03.936306+0000","last_unstale":"2024-09-21T05:52:47.675290+0000","last_undegraded":"2024-09-21T05:52:47.675290+0000","last_fullsized":"2024-09-21T05:52:47.675290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:51.057973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640342+0000","last_change":"2024-09-21T05:50:53.893930+0000","last_active":"2024-09-21T05:53:16.640342+0000","last_peered":"2024-09-21T05:53:16.640342+0000","last_clean":"2024-09-21T05:53:16.640342+0000","last_became_active":"2024-09-21T05:50:53.893155+0000","last_became_peered":"2024-09-21T05:50:53.893155+0000","last_unstale":"2024-09-21T05:53:16.640342+0000","last_undegraded":"2024-09-21T05:53:16.640342+0000","last_fullsized":"2024-09-21T05:53:16.640342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:46.097408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011053+0000","last_change":"2024-09-21T05:50:50.847890+0000","last_active":"2024-09-21T05:52:48.011053+0000","last_peered":"2024-09-21T05:52:48.011053+0000","last_clean":"2024-09-21T05:52:48.011053+0000","last_became_active":"2024-09-21T05:50:50.847549+0000","last_became_peered":"2024-09-21T05:50:50.847549+0000","last_unstale":"2024-09-21T05:52:48.011053+0000","last_undegraded":"2024-09-21T05:52:48.011053+0000","last_fullsized":"2024-09-21T05:52:48.011053+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:14.998849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674513+0000","last_change":"2024-09-21T05:51:03.940674+0000","last_active":"2024-09-21T05:52:47.674513+0000","last_peered":"2024-09-21T05:52:47.674513+0000","last_clean":"2024-09-21T05:52:47.674513+0000","last_became_active":"2024-09-21T05:51:03.940222+0000","last_became_peered":"2024-09-21T05:51:03.940222+0000","last_unstale":"2024-09-21T05:52:47.674513+0000","last_undegraded":"2024-09-21T05:52:47.674513+0000","last_fullsized":"2024-09-21T05:52:47.674513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:58.497147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641922+0000","last_change":"2024-09-21T05:50:53.895191+0000","last_active":"2024-09-21T05:53:16.641922+0000","last_peered":"2024-09-21T05:53:16.641922+0000","last_clean":"2024-09-21T05:53:16.641922+0000","last_became_active":"2024-09-21T05:50:53.892894+0000","last_became_peered":"2024-09-21T05:50:53.892894+0000","last_unstale":"2024-09-21T05:53:16.641922+0000","last_undegraded":"2024-09-21T05:53:16.641922+0000","last_fullsized":"2024-09-21T05:53:16.641922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:41.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011748+0000","last_change":"2024-09-21T05:50:50.844301+0000","last_active":"2024-09-21T05:52:48.011748+0000","last_peered":"2024-09-21T05:52:48.011748+0000","last_clean":"2024-09-21T05:52:48.011748+0000","last_became_active":"2024-09-21T05:50:50.843878+0000","last_became_peered":"2024-09-21T05:50:50.843878+0000","last_unstale":"2024-09-21T05:52:48.011748+0000","last_undegraded":"2024-09-21T05:52:48.011748+0000","last_fullsized":"2024-09-21T05:52:48.011748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:53.150300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009615+0000","last_change":"2024-09-21T05:51:03.931684+0000","last_active":"2024-09-21T05:52:48.009615+0000","last_peered":"2024-09-21T05:52:48.009615+0000","last_clean":"2024-09-21T05:52:48.009615+0000","last_became_active":"2024-09-21T05:51:03.931225+0000","last_became_peered":"2024-09-21T05:51:03.931225+0000","last_unstale":"2024-09-21T05:52:48.009615+0000","last_undegraded":"2024-09-21T05:52:48.009615+0000","last_fullsized":"2024-09-21T05:52:48.009615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:51.993481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637668+0000","last_change":"2024-09-21T05:50:53.892740+0000","last_active":"2024-09-21T05:53:16.637668+0000","last_peered":"2024-09-21T05:53:16.637668+0000","last_clean":"2024-09-21T05:53:16.637668+0000","last_became_active":"2024-09-21T05:50:53.892381+0000","last_became_peered":"2024-09-21T05:50:53.892381+0000","last_unstale":"2024-09-21T05:53:16.637668+0000","last_undegraded":"2024-09-21T05:53:16.637668+0000","last_fullsized":"2024-09-21T05:53:16.637668+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:20.038644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677796+0000","last_change":"2024-09-21T05:50:50.850077+0000","last_active":"2024-09-21T05:52:47.677796+0000","last_peered":"2024-09-21T05:52:47.677796+0000","last_clean":"2024-09-21T05:52:47.677796+0000","last_became_active":"2024-09-21T05:50:50.849553+0000","last_became_peered":"2024-09-21T05:50:50.849553+0000","last_unstale":"2024-09-21T05:52:47.677796+0000","last_undegraded":"2024-09-21T05:52:47.677796+0000","last_fullsized":"2024-09-21T05:52:47.677796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:09.764465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009537+0000","last_change":"2024-09-21T05:51:03.930231+0000","last_active":"2024-09-21T05:52:48.009537+0000","last_peered":"2024-09-21T05:52:48.009537+0000","last_clean":"2024-09-21T05:52:48.009537+0000","last_became_active":"2024-09-21T05:51:03.929907+0000","last_became_peered":"2024-09-21T05:51:03.929907+0000","last_unstale":"2024-09-21T05:52:48.009537+0000","last_undegraded":"2024-09-21T05:52:48.009537+0000","last_fullsized":"2024-09-21T05:52:48.009537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:18.829725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640149+0000","last_change":"2024-09-21T05:50:53.888988+0000","last_active":"2024-09-21T05:53:16.640149+0000","last_peered":"2024-09-21T05:53:16.640149+0000","last_clean":"2024-09-21T05:53:16.640149+0000","last_became_active":"2024-09-21T05:50:53.888599+0000","last_became_peered":"2024-09-21T05:50:53.888599+0000","last_unstale":"2024-09-21T05:53:16.640149+0000","last_undegraded":"2024-09-21T05:53:16.640149+0000","last_fullsized":"2024-09-21T05:53:16.640149+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:32.353201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":68,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677086+0000","last_change":"2024-09-21T05:51:47.383528+0000","last_active":"2024-09-21T05:52:47.677086+0000","last_peered":"2024-09-21T05:52:47.677086+0000","last_clean":"2024-09-21T05:52:47.677086+0000","last_became_active":"2024-09-21T05:51:47.376325+0000","last_became_peered":"2024-09-21T05:51:47.376325+0000","last_unstale":"2024-09-21T05:52:47.677086+0000","last_undegraded":"2024-09-21T05:52:47.677086+0000","last_fullsized":"2024-09-21T05:52:47.677086+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:47.659961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009829+0000","last_change":"2024-09-21T05:51:03.946581+0000","last_active":"2024-09-21T05:52:48.009829+0000","last_peered":"2024-09-21T05:52:48.009829+0000","last_clean":"2024-09-21T05:52:48.009829+0000","last_became_active":"2024-09-21T05:51:03.946170+0000","last_became_peered":"2024-09-21T05:51:03.946170+0000","last_unstale":"2024-09-21T05:52:48.009829+0000","last_undegraded":"2024-09-21T05:52:48.009829+0000","last_fullsized":"2024-09-21T05:52:48.009829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:59.302647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.622157+0000","last_change":"2024-09-21T05:50:53.890164+0000","last_active":"2024-09-21T05:53:16.622157+0000","last_peered":"2024-09-21T05:53:16.622157+0000","last_clean":"2024-09-21T05:53:16.622157+0000","last_became_active":"2024-09-21T05:50:53.889309+0000","last_became_peered":"2024-09-21T05:50:53.889309+0000","last_unstale":"2024-09-21T05:53:16.622157+0000","last_undegraded":"2024-09-21T05:53:16.622157+0000","last_fullsized":"2024-09-21T05:53:16.622157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:18.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699112+0000","last_change":"2024-09-21T05:50:50.844080+0000","last_active":"2024-09-21T05:52:47.699112+0000","last_peered":"2024-09-21T05:52:47.699112+0000","last_clean":"2024-09-21T05:52:47.699112+0000","last_became_active":"2024-09-21T05:50:50.842929+0000","last_became_peered":"2024-09-21T05:50:50.842929+0000","last_unstale":"2024-09-21T05:52:47.699112+0000","last_undegraded":"2024-09-21T05:52:47.699112+0000","last_fullsized":"2024-09-21T05:52:47.699112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:49.623189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010942+0000","last_change":"2024-09-21T05:51:03.939228+0000","last_active":"2024-09-21T05:52:48.010942+0000","last_peered":"2024-09-21T05:52:48.010942+0000","last_clean":"2024-09-21T05:52:48.010942+0000","last_became_active":"2024-09-21T05:51:03.937857+0000","last_became_peered":"2024-09-21T05:51:03.937857+0000","last_unstale":"2024-09-21T05:52:48.010942+0000","last_undegraded":"2024-09-21T05:52:48.010942+0000","last_fullsized":"2024-09-21T05:52:48.010942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:54.147008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.643581+0000","last_change":"2024-09-21T05:50:53.890755+0000","last_active":"2024-09-21T05:53:16.643581+0000","last_peered":"2024-09-21T05:53:16.643581+0000","last_clean":"2024-09-21T05:53:16.643581+0000","last_became_active":"2024-09-21T05:50:53.890286+0000","last_became_peered":"2024-09-21T05:50:53.890286+0000","last_unstale":"2024-09-21T05:53:16.643581+0000","last_undegraded":"2024-09-21T05:53:16.643581+0000","last_fullsized":"2024-09-21T05:53:16.643581+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:50.767355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010406+0000","last_change":"2024-09-21T05:50:50.852722+0000","last_active":"2024-09-21T05:52:48.010406+0000","last_peered":"2024-09-21T05:52:48.010406+0000","last_clean":"2024-09-21T05:52:48.010406+0000","last_became_active":"2024-09-21T05:50:50.852211+0000","last_became_peered":"2024-09-21T05:50:50.852211+0000","last_unstale":"2024-09-21T05:52:48.010406+0000","last_undegraded":"2024-09-21T05:52:48.010406+0000","last_fullsized":"2024-09-21T05:52:48.010406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:44.392153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.014263+0000","last_change":"2024-09-21T05:52:48.013503+0000","last_active":"2024-09-21T05:52:48.014263+0000","last_peered":"2024-09-21T05:52:48.014263+0000","last_clean":"2024-09-21T05:52:48.014263+0000","last_became_active":"2024-09-21T05:52:48.012908+0000","last_became_peered":"2024-09-21T05:52:48.012908+0000","last_unstale":"2024-09-21T05:52:48.014263+0000","last_undegraded":"2024-09-21T05:52:48.014263+0000","last_fullsized":"2024-09-21T05:52:48.014263+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:59.512334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641672+0000","last_change":"2024-09-21T05:50:53.903935+0000","last_active":"2024-09-21T05:53:16.641672+0000","last_peered":"2024-09-21T05:53:16.641672+0000","last_clean":"2024-09-21T05:53:16.641672+0000","last_became_active":"2024-09-21T05:50:53.903604+0000","last_became_peered":"2024-09-21T05:50:53.903604+0000","last_unstale":"2024-09-21T05:53:16.641672+0000","last_undegraded":"2024-09-21T05:53:16.641672+0000","last_fullsized":"2024-09-21T05:53:16.641672+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:49.552901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678699+0000","last_change":"2024-09-21T05:50:50.848254+0000","last_active":"2024-09-21T05:52:47.678699+0000","last_peered":"2024-09-21T05:52:47.678699+0000","last_clean":"2024-09-21T05:52:47.678699+0000","last_became_active":"2024-09-21T05:50:50.847834+0000","last_became_peered":"2024-09-21T05:50:50.847834+0000","last_unstale":"2024-09-21T05:52:47.678699+0000","last_undegraded":"2024-09-21T05:52:47.678699+0000","last_fullsized":"2024-09-21T05:52:47.678699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:36.579763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009610+0000","last_change":"2024-09-21T05:51:03.941732+0000","last_active":"2024-09-21T05:52:48.009610+0000","last_peered":"2024-09-21T05:52:48.009610+0000","last_clean":"2024-09-21T05:52:48.009610+0000","last_became_active":"2024-09-21T05:51:03.941144+0000","last_became_peered":"2024-09-21T05:51:03.941144+0000","last_unstale":"2024-09-21T05:52:48.009610+0000","last_undegraded":"2024-09-21T05:52:48.009610+0000","last_fullsized":"2024-09-21T05:52:48.009610+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:38.117642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.620240+0000","last_change":"2024-09-21T05:50:53.904574+0000","last_active":"2024-09-21T05:53:16.620240+0000","last_peered":"2024-09-21T05:53:16.620240+0000","last_clean":"2024-09-21T05:53:16.620240+0000","last_became_active":"2024-09-21T05:50:53.904215+0000","last_became_peered":"2024-09-21T05:50:53.904215+0000","last_unstale":"2024-09-21T05:53:16.620240+0000","last_undegraded":"2024-09-21T05:53:16.620240+0000","last_fullsized":"2024-09-21T05:53:16.620240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:49.662725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":312,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:35.652285+0000","last_change":"2024-09-21T05:50:50.850929+0000","last_active":"2024-09-21T05:53:35.652285+0000","last_peered":"2024-09-21T05:53:35.652285+0000","last_clean":"2024-09-21T05:53:35.652285+0000","last_became_active":"2024-09-21T05:50:50.850495+0000","last_became_peered":"2024-09-21T05:50:50.850495+0000","last_unstale":"2024-09-21T05:53:35.652285+0000","last_undegraded":"2024-09-21T05:53:35.652285+0000","last_fullsized":"2024-09-21T05:53:35.652285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:45.224063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69827,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":182,"num_write":38,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011525+0000","last_change":"2024-09-21T05:51:03.944010+0000","last_active":"2024-09-21T05:52:48.011525+0000","last_peered":"2024-09-21T05:52:48.011525+0000","last_clean":"2024-09-21T05:52:48.011525+0000","last_became_active":"2024-09-21T05:51:03.942942+0000","last_became_peered":"2024-09-21T05:51:03.942942+0000","last_unstale":"2024-09-21T05:52:48.011525+0000","last_undegraded":"2024-09-21T05:52:48.011525+0000","last_fullsized":"2024-09-21T05:52:48.011525+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:38.846493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.639338+0000","last_change":"2024-09-21T05:51:47.376326+0000","last_active":"2024-09-21T05:53:16.639338+0000","last_peered":"2024-09-21T05:53:16.639338+0000","last_clean":"2024-09-21T05:53:16.639338+0000","last_became_active":"2024-09-21T05:51:47.375993+0000","last_became_peered":"2024-09-21T05:51:47.375993+0000","last_unstale":"2024-09-21T05:53:16.639338+0000","last_undegraded":"2024-09-21T05:53:16.639338+0000","last_fullsized":"2024-09-21T05:53:16.639338+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:13.193571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010874+0000","last_change":"2024-09-21T05:50:51.162682+0000","last_active":"2024-09-21T05:52:48.010874+0000","last_peered":"2024-09-21T05:52:48.010874+0000","last_clean":"2024-09-21T05:52:48.010874+0000","last_became_active":"2024-09-21T05:50:51.162244+0000","last_became_peered":"2024-09-21T05:50:51.162244+0000","last_unstale":"2024-09-21T05:52:48.010874+0000","last_undegraded":"2024-09-21T05:52:48.010874+0000","last_fullsized":"2024-09-21T05:52:48.010874+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.595096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699172+0000","last_change":"2024-09-21T05:51:03.939666+0000","last_active":"2024-09-21T05:52:47.699172+0000","last_peered":"2024-09-21T05:52:47.699172+0000","last_clean":"2024-09-21T05:52:47.699172+0000","last_became_active":"2024-09-21T05:51:03.938311+0000","last_became_peered":"2024-09-21T05:51:03.938311+0000","last_unstale":"2024-09-21T05:52:47.699172+0000","last_undegraded":"2024-09-21T05:52:47.699172+0000","last_fullsized":"2024-09-21T05:52:47.699172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:31.407900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640807+0000","last_change":"2024-09-21T05:51:47.588416+0000","last_active":"2024-09-21T05:53:16.640807+0000","last_peered":"2024-09-21T05:53:16.640807+0000","last_clean":"2024-09-21T05:53:16.640807+0000","last_became_active":"2024-09-21T05:51:47.587905+0000","last_became_peered":"2024-09-21T05:51:47.587905+0000","last_unstale":"2024-09-21T05:53:16.640807+0000","last_undegraded":"2024-09-21T05:53:16.640807+0000","last_fullsized":"2024-09-21T05:53:16.640807+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:05.821048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681491+0000","last_change":"2024-09-21T05:50:50.846164+0000","last_active":"2024-09-21T05:52:47.681491+0000","last_peered":"2024-09-21T05:52:47.681491+0000","last_clean":"2024-09-21T05:52:47.681491+0000","last_became_active":"2024-09-21T05:50:50.845775+0000","last_became_peered":"2024-09-21T05:50:50.845775+0000","last_unstale":"2024-09-21T05:52:47.681491+0000","last_undegraded":"2024-09-21T05:52:47.681491+0000","last_fullsized":"2024-09-21T05:52:47.681491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:45.356626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.701383+0000","last_change":"2024-09-21T05:52:47.700832+0000","last_active":"2024-09-21T05:52:47.701383+0000","last_peered":"2024-09-21T05:52:47.701383+0000","last_clean":"2024-09-21T05:52:47.701383+0000","last_became_active":"2024-09-21T05:52:47.700372+0000","last_became_peered":"2024-09-21T05:52:47.700372+0000","last_unstale":"2024-09-21T05:52:47.701383+0000","last_undegraded":"2024-09-21T05:52:47.701383+0000","last_fullsized":"2024-09-21T05:52:47.701383+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.887433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.644971+0000","last_change":"2024-09-21T05:50:53.903005+0000","last_active":"2024-09-21T05:53:16.644971+0000","last_peered":"2024-09-21T05:53:16.644971+0000","last_clean":"2024-09-21T05:53:16.644971+0000","last_became_active":"2024-09-21T05:50:53.902590+0000","last_became_peered":"2024-09-21T05:50:53.902590+0000","last_unstale":"2024-09-21T05:53:16.644971+0000","last_undegraded":"2024-09-21T05:53:16.644971+0000","last_fullsized":"2024-09-21T05:53:16.644971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:46.602723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011645+0000","last_change":"2024-09-21T05:50:50.846682+0000","last_active":"2024-09-21T05:52:48.011645+0000","last_peered":"2024-09-21T05:52:48.011645+0000","last_clean":"2024-09-21T05:52:48.011645+0000","last_became_active":"2024-09-21T05:50:50.846305+0000","last_became_peered":"2024-09-21T05:50:50.846305+0000","last_unstale":"2024-09-21T05:52:48.011645+0000","last_undegraded":"2024-09-21T05:52:48.011645+0000","last_fullsized":"2024-09-21T05:52:48.011645+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:30.946247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.320808+0000","last_change":"2024-09-21T05:51:03.931781+0000","last_active":"2024-09-21T05:52:48.320808+0000","last_peered":"2024-09-21T05:52:48.320808+0000","last_clean":"2024-09-21T05:52:48.320808+0000","last_became_active":"2024-09-21T05:51:03.930921+0000","last_became_peered":"2024-09-21T05:51:03.930921+0000","last_unstale":"2024-09-21T05:52:48.320808+0000","last_undegraded":"2024-09-21T05:52:48.320808+0000","last_fullsized":"2024-09-21T05:52:48.320808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:03.284929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674758+0000","last_change":"2024-09-21T05:51:03.947521+0000","last_active":"2024-09-21T05:52:47.674758+0000","last_peered":"2024-09-21T05:52:47.674758+0000","last_clean":"2024-09-21T05:52:47.674758+0000","last_became_active":"2024-09-21T05:51:03.947074+0000","last_became_peered":"2024-09-21T05:51:03.947074+0000","last_unstale":"2024-09-21T05:52:47.674758+0000","last_undegraded":"2024-09-21T05:52:47.674758+0000","last_fullsized":"2024-09-21T05:52:47.674758+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:51.313988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640063+0000","last_change":"2024-09-21T05:50:53.911791+0000","last_active":"2024-09-21T05:53:16.640063+0000","last_peered":"2024-09-21T05:53:16.640063+0000","last_clean":"2024-09-21T05:53:16.640063+0000","last_became_active":"2024-09-21T05:50:53.911392+0000","last_became_peered":"2024-09-21T05:50:53.911392+0000","last_unstale":"2024-09-21T05:53:16.640063+0000","last_undegraded":"2024-09-21T05:53:16.640063+0000","last_fullsized":"2024-09-21T05:53:16.640063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:45.688626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010697+0000","last_change":"2024-09-21T05:50:50.853383+0000","last_active":"2024-09-21T05:52:48.010697+0000","last_peered":"2024-09-21T05:52:48.010697+0000","last_clean":"2024-09-21T05:52:48.010697+0000","last_became_active":"2024-09-21T05:50:50.853006+0000","last_became_peered":"2024-09-21T05:50:50.853006+0000","last_unstale":"2024-09-21T05:52:48.010697+0000","last_undegraded":"2024-09-21T05:52:48.010697+0000","last_fullsized":"2024-09-21T05:52:48.010697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:14.838953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682519+0000","last_change":"2024-09-21T05:51:03.945415+0000","last_active":"2024-09-21T05:52:47.682519+0000","last_peered":"2024-09-21T05:52:47.682519+0000","last_clean":"2024-09-21T05:52:47.682519+0000","last_became_active":"2024-09-21T05:51:03.945019+0000","last_became_peered":"2024-09-21T05:51:03.945019+0000","last_unstale":"2024-09-21T05:52:47.682519+0000","last_undegraded":"2024-09-21T05:52:47.682519+0000","last_fullsized":"2024-09-21T05:52:47.682519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:27.006823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.629274+0000","last_change":"2024-09-21T05:50:53.897515+0000","last_active":"2024-09-21T05:53:16.629274+0000","last_peered":"2024-09-21T05:53:16.629274+0000","last_clean":"2024-09-21T05:53:16.629274+0000","last_became_active":"2024-09-21T05:50:53.897070+0000","last_became_peered":"2024-09-21T05:50:53.897070+0000","last_unstale":"2024-09-21T05:53:16.629274+0000","last_undegraded":"2024-09-21T05:53:16.629274+0000","last_fullsized":"2024-09-21T05:53:16.629274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:16.971379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009930+0000","last_change":"2024-09-21T05:50:50.844937+0000","last_active":"2024-09-21T05:52:48.009930+0000","last_peered":"2024-09-21T05:52:48.009930+0000","last_clean":"2024-09-21T05:52:48.009930+0000","last_became_active":"2024-09-21T05:50:50.844048+0000","last_became_peered":"2024-09-21T05:50:50.844048+0000","last_unstale":"2024-09-21T05:52:48.009930+0000","last_undegraded":"2024-09-21T05:52:48.009930+0000","last_fullsized":"2024-09-21T05:52:48.009930+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:28.764620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010674+0000","last_change":"2024-09-21T05:51:47.587919+0000","last_active":"2024-09-21T05:52:48.010674+0000","last_peered":"2024-09-21T05:52:48.010674+0000","last_clean":"2024-09-21T05:52:48.010674+0000","last_became_active":"2024-09-21T05:51:47.587418+0000","last_became_peered":"2024-09-21T05:51:47.587418+0000","last_unstale":"2024-09-21T05:52:48.010674+0000","last_undegraded":"2024-09-21T05:52:48.010674+0000","last_fullsized":"2024-09-21T05:52:48.010674+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:29.800848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641399+0000","last_change":"2024-09-21T05:50:53.890761+0000","last_active":"2024-09-21T05:53:16.641399+0000","last_peered":"2024-09-21T05:53:16.641399+0000","last_clean":"2024-09-21T05:53:16.641399+0000","last_became_active":"2024-09-21T05:50:53.890394+0000","last_became_peered":"2024-09-21T05:50:53.890394+0000","last_unstale":"2024-09-21T05:53:16.641399+0000","last_undegraded":"2024-09-21T05:53:16.641399+0000","last_fullsized":"2024-09-21T05:53:16.641399+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.176920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.014167+0000","last_change":"2024-09-21T05:52:48.014051+0000","last_active":"2024-09-21T05:52:48.014167+0000","last_peered":"2024-09-21T05:52:48.014167+0000","last_clean":"2024-09-21T05:52:48.014167+0000","last_became_active":"2024-09-21T05:52:48.013422+0000","last_became_peered":"2024-09-21T05:52:48.013422+0000","last_unstale":"2024-09-21T05:52:48.014167+0000","last_undegraded":"2024-09-21T05:52:48.014167+0000","last_fullsized":"2024-09-21T05:52:48.014167+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:18.380310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,10],"acting":[2,6,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010663+0000","last_change":"2024-09-21T05:50:50.852630+0000","last_active":"2024-09-21T05:52:48.010663+0000","last_peered":"2024-09-21T05:52:48.010663+0000","last_clean":"2024-09-21T05:52:48.010663+0000","last_became_active":"2024-09-21T05:50:50.852255+0000","last_became_peered":"2024-09-21T05:50:50.852255+0000","last_unstale":"2024-09-21T05:52:48.010663+0000","last_undegraded":"2024-09-21T05:52:48.010663+0000","last_fullsized":"2024-09-21T05:52:48.010663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:18.094082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.630538+0000","last_change":"2024-09-21T05:50:53.902303+0000","last_active":"2024-09-21T05:53:16.630538+0000","last_peered":"2024-09-21T05:53:16.630538+0000","last_clean":"2024-09-21T05:53:16.630538+0000","last_became_active":"2024-09-21T05:50:53.901910+0000","last_became_peered":"2024-09-21T05:50:53.901910+0000","last_unstale":"2024-09-21T05:53:16.630538+0000","last_undegraded":"2024-09-21T05:53:16.630538+0000","last_fullsized":"2024-09-21T05:53:16.630538+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:06.651235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678933+0000","last_change":"2024-09-21T05:51:03.932268+0000","last_active":"2024-09-21T05:52:47.678933+0000","last_peered":"2024-09-21T05:52:47.678933+0000","last_clean":"2024-09-21T05:52:47.678933+0000","last_became_active":"2024-09-21T05:51:03.931849+0000","last_became_peered":"2024-09-21T05:51:03.931849+0000","last_unstale":"2024-09-21T05:52:47.678933+0000","last_undegraded":"2024-09-21T05:52:47.678933+0000","last_fullsized":"2024-09-21T05:52:47.678933+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:53.622621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.631866+0000","last_change":"2024-09-21T05:50:53.897205+0000","last_active":"2024-09-21T05:53:16.631866+0000","last_peered":"2024-09-21T05:53:16.631866+0000","last_clean":"2024-09-21T05:53:16.631866+0000","last_became_active":"2024-09-21T05:50:53.896811+0000","last_became_peered":"2024-09-21T05:50:53.896811+0000","last_unstale":"2024-09-21T05:53:16.631866+0000","last_undegraded":"2024-09-21T05:53:16.631866+0000","last_fullsized":"2024-09-21T05:53:16.631866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:13.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.625137+0000","last_change":"2024-09-21T05:51:47.376606+0000","last_active":"2024-09-21T05:53:16.625137+0000","last_peered":"2024-09-21T05:53:16.625137+0000","last_clean":"2024-09-21T05:53:16.625137+0000","last_became_active":"2024-09-21T05:51:47.376203+0000","last_became_peered":"2024-09-21T05:51:47.376203+0000","last_unstale":"2024-09-21T05:53:16.625137+0000","last_undegraded":"2024-09-21T05:53:16.625137+0000","last_fullsized":"2024-09-21T05:53:16.625137+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:34.698021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.632441+0000","last_change":"2024-09-21T05:50:53.910991+0000","last_active":"2024-09-21T05:53:16.632441+0000","last_peered":"2024-09-21T05:53:16.632441+0000","last_clean":"2024-09-21T05:53:16.632441+0000","last_became_active":"2024-09-21T05:50:53.910720+0000","last_became_peered":"2024-09-21T05:50:53.910720+0000","last_unstale":"2024-09-21T05:53:16.632441+0000","last_undegraded":"2024-09-21T05:53:16.632441+0000","last_fullsized":"2024-09-21T05:53:16.632441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.653746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.634552+0000","last_change":"2024-09-21T05:50:53.894065+0000","last_active":"2024-09-21T05:53:16.634552+0000","last_peered":"2024-09-21T05:53:16.634552+0000","last_clean":"2024-09-21T05:53:16.634552+0000","last_became_active":"2024-09-21T05:50:53.892630+0000","last_became_peered":"2024-09-21T05:50:53.892630+0000","last_unstale":"2024-09-21T05:53:16.634552+0000","last_undegraded":"2024-09-21T05:53:16.634552+0000","last_fullsized":"2024-09-21T05:53:16.634552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:09.025667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.636013+0000","last_change":"2024-09-21T05:50:53.899586+0000","last_active":"2024-09-21T05:53:16.636013+0000","last_peered":"2024-09-21T05:53:16.636013+0000","last_clean":"2024-09-21T05:53:16.636013+0000","last_became_active":"2024-09-21T05:50:53.899066+0000","last_became_peered":"2024-09-21T05:50:53.899066+0000","last_unstale":"2024-09-21T05:53:16.636013+0000","last_undegraded":"2024-09-21T05:53:16.636013+0000","last_fullsized":"2024-09-21T05:53:16.636013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:07.678164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.622595+0000","last_change":"2024-09-21T05:51:47.375063+0000","last_active":"2024-09-21T05:53:16.622595+0000","last_peered":"2024-09-21T05:53:16.622595+0000","last_clean":"2024-09-21T05:53:16.622595+0000","last_became_active":"2024-09-21T05:51:47.374645+0000","last_became_peered":"2024-09-21T05:51:47.374645+0000","last_unstale":"2024-09-21T05:53:16.622595+0000","last_undegraded":"2024-09-21T05:53:16.622595+0000","last_fullsized":"2024-09-21T05:53:16.622595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:29.572438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.625339+0000","last_change":"2024-09-21T05:50:53.901688+0000","last_active":"2024-09-21T05:53:16.625339+0000","last_peered":"2024-09-21T05:53:16.625339+0000","last_clean":"2024-09-21T05:53:16.625339+0000","last_became_active":"2024-09-21T05:50:53.901245+0000","last_became_peered":"2024-09-21T05:50:53.901245+0000","last_unstale":"2024-09-21T05:53:16.625339+0000","last_undegraded":"2024-09-21T05:53:16.625339+0000","last_fullsized":"2024-09-21T05:53:16.625339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:41.401357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.623074+0000","last_change":"2024-09-21T05:50:53.908954+0000","last_active":"2024-09-21T05:53:16.623074+0000","last_peered":"2024-09-21T05:53:16.623074+0000","last_clean":"2024-09-21T05:53:16.623074+0000","last_became_active":"2024-09-21T05:50:53.897605+0000","last_became_peered":"2024-09-21T05:50:53.897605+0000","last_unstale":"2024-09-21T05:53:16.623074+0000","last_undegraded":"2024-09-21T05:53:16.623074+0000","last_fullsized":"2024-09-21T05:53:16.623074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:15.634597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.636800+0000","last_change":"2024-09-21T05:50:53.900106+0000","last_active":"2024-09-21T05:53:16.636800+0000","last_peered":"2024-09-21T05:53:16.636800+0000","last_clean":"2024-09-21T05:53:16.636800+0000","last_became_active":"2024-09-21T05:50:53.899697+0000","last_became_peered":"2024-09-21T05:50:53.899697+0000","last_unstale":"2024-09-21T05:53:16.636800+0000","last_undegraded":"2024-09-21T05:53:16.636800+0000","last_fullsized":"2024-09-21T05:53:16.636800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.599501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.621162+0000","last_change":"2024-09-21T05:50:53.899644+0000","last_active":"2024-09-21T05:53:16.621162+0000","last_peered":"2024-09-21T05:53:16.621162+0000","last_clean":"2024-09-21T05:53:16.621162+0000","last_became_active":"2024-09-21T05:50:53.899246+0000","last_became_peered":"2024-09-21T05:50:53.899246+0000","last_unstale":"2024-09-21T05:53:16.621162+0000","last_undegraded":"2024-09-21T05:53:16.621162+0000","last_fullsized":"2024-09-21T05:53:16.621162+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:34.551489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.643578+0000","last_change":"2024-09-21T05:50:53.904328+0000","last_active":"2024-09-21T05:53:16.643578+0000","last_peered":"2024-09-21T05:53:16.643578+0000","last_clean":"2024-09-21T05:53:16.643578+0000","last_became_active":"2024-09-21T05:50:53.903887+0000","last_became_peered":"2024-09-21T05:50:53.903887+0000","last_unstale":"2024-09-21T05:53:16.643578+0000","last_undegraded":"2024-09-21T05:53:16.643578+0000","last_fullsized":"2024-09-21T05:53:16.643578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:27.659631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641985+0000","last_change":"2024-09-21T05:50:53.905278+0000","last_active":"2024-09-21T05:53:16.641985+0000","last_peered":"2024-09-21T05:53:16.641985+0000","last_clean":"2024-09-21T05:53:16.641985+0000","last_became_active":"2024-09-21T05:50:53.904633+0000","last_became_peered":"2024-09-21T05:50:53.904633+0000","last_unstale":"2024-09-21T05:53:16.641985+0000","last_undegraded":"2024-09-21T05:53:16.641985+0000","last_fullsized":"2024-09-21T05:53:16.641985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:26.802336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.642195+0000","last_change":"2024-09-21T05:50:53.891621+0000","last_active":"2024-09-21T05:53:16.642195+0000","last_peered":"2024-09-21T05:53:16.642195+0000","last_clean":"2024-09-21T05:53:16.642195+0000","last_became_active":"2024-09-21T05:50:53.891246+0000","last_became_peered":"2024-09-21T05:50:53.891246+0000","last_unstale":"2024-09-21T05:53:16.642195+0000","last_undegraded":"2024-09-21T05:53:16.642195+0000","last_fullsized":"2024-09-21T05:53:16.642195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:21.419789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.626978+0000","last_change":"2024-09-21T05:50:53.902964+0000","last_active":"2024-09-21T05:53:16.626978+0000","last_peered":"2024-09-21T05:53:16.626978+0000","last_clean":"2024-09-21T05:53:16.626978+0000","last_became_active":"2024-09-21T05:50:53.902574+0000","last_became_peered":"2024-09-21T05:50:53.902574+0000","last_unstale":"2024-09-21T05:53:16.626978+0000","last_undegraded":"2024-09-21T05:53:16.626978+0000","last_fullsized":"2024-09-21T05:53:16.626978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:35.552787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.639981+0000","last_change":"2024-09-21T05:50:53.904717+0000","last_active":"2024-09-21T05:53:16.639981+0000","last_peered":"2024-09-21T05:53:16.639981+0000","last_clean":"2024-09-21T05:53:16.639981+0000","last_became_active":"2024-09-21T05:50:53.903152+0000","last_became_peered":"2024-09-21T05:50:53.903152+0000","last_unstale":"2024-09-21T05:53:16.639981+0000","last_undegraded":"2024-09-21T05:53:16.639981+0000","last_fullsized":"2024-09-21T05:53:16.639981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:56.808689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645213+0000","last_change":"2024-09-21T05:50:53.906336+0000","last_active":"2024-09-21T05:53:16.645213+0000","last_peered":"2024-09-21T05:53:16.645213+0000","last_clean":"2024-09-21T05:53:16.645213+0000","last_became_active":"2024-09-21T05:50:53.905942+0000","last_became_peered":"2024-09-21T05:50:53.905942+0000","last_unstale":"2024-09-21T05:53:16.645213+0000","last_undegraded":"2024-09-21T05:53:16.645213+0000","last_fullsized":"2024-09-21T05:53:16.645213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:26.824967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.646758+0000","last_change":"2024-09-21T05:50:53.910772+0000","last_active":"2024-09-21T05:53:16.646758+0000","last_peered":"2024-09-21T05:53:16.646758+0000","last_clean":"2024-09-21T05:53:16.646758+0000","last_became_active":"2024-09-21T05:50:53.910394+0000","last_became_peered":"2024-09-21T05:50:53.910394+0000","last_unstale":"2024-09-21T05:53:16.646758+0000","last_undegraded":"2024-09-21T05:53:16.646758+0000","last_fullsized":"2024-09-21T05:53:16.646758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:00.338916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.635467+0000","last_change":"2024-09-21T05:50:53.906454+0000","last_active":"2024-09-21T05:53:16.635467+0000","last_peered":"2024-09-21T05:53:16.635467+0000","last_clean":"2024-09-21T05:53:16.635467+0000","last_became_active":"2024-09-21T05:50:53.905947+0000","last_became_peered":"2024-09-21T05:50:53.905947+0000","last_unstale":"2024-09-21T05:53:16.635467+0000","last_undegraded":"2024-09-21T05:53:16.635467+0000","last_fullsized":"2024-09-21T05:53:16.635467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:57.358615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.632851+0000","last_change":"2024-09-21T05:50:53.903690+0000","last_active":"2024-09-21T05:53:16.632851+0000","last_peered":"2024-09-21T05:53:16.632851+0000","last_clean":"2024-09-21T05:53:16.632851+0000","last_became_active":"2024-09-21T05:50:53.900672+0000","last_became_peered":"2024-09-21T05:50:53.900672+0000","last_unstale":"2024-09-21T05:53:16.632851+0000","last_undegraded":"2024-09-21T05:53:16.632851+0000","last_fullsized":"2024-09-21T05:53:16.632851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:42.005312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637208+0000","last_change":"2024-09-21T05:50:53.888711+0000","last_active":"2024-09-21T05:53:16.637208+0000","last_peered":"2024-09-21T05:53:16.637208+0000","last_clean":"2024-09-21T05:53:16.637208+0000","last_became_active":"2024-09-21T05:50:53.888302+0000","last_became_peered":"2024-09-21T05:50:53.888302+0000","last_unstale":"2024-09-21T05:53:16.637208+0000","last_undegraded":"2024-09-21T05:53:16.637208+0000","last_fullsized":"2024-09-21T05:53:16.637208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:25.766696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637942+0000","last_change":"2024-09-21T05:50:53.898848+0000","last_active":"2024-09-21T05:53:16.637942+0000","last_peered":"2024-09-21T05:53:16.637942+0000","last_clean":"2024-09-21T05:53:16.637942+0000","last_became_active":"2024-09-21T05:50:53.897785+0000","last_became_peered":"2024-09-21T05:50:53.897785+0000","last_unstale":"2024-09-21T05:53:16.637942+0000","last_undegraded":"2024-09-21T05:53:16.637942+0000","last_fullsized":"2024-09-21T05:53:16.637942+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:25.099224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.646192+0000","last_change":"2024-09-21T05:50:53.899051+0000","last_active":"2024-09-21T05:53:16.646192+0000","last_peered":"2024-09-21T05:53:16.646192+0000","last_clean":"2024-09-21T05:53:16.646192+0000","last_became_active":"2024-09-21T05:50:53.898381+0000","last_became_peered":"2024-09-21T05:50:53.898381+0000","last_unstale":"2024-09-21T05:53:16.646192+0000","last_undegraded":"2024-09-21T05:53:16.646192+0000","last_fullsized":"2024-09-21T05:53:16.646192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:05.958547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.639314+0000","last_change":"2024-09-21T05:50:53.896079+0000","last_active":"2024-09-21T05:53:16.639314+0000","last_peered":"2024-09-21T05:53:16.639314+0000","last_clean":"2024-09-21T05:53:16.639314+0000","last_became_active":"2024-09-21T05:50:53.895659+0000","last_became_peered":"2024-09-21T05:50:53.895659+0000","last_unstale":"2024-09-21T05:53:16.639314+0000","last_undegraded":"2024-09-21T05:53:16.639314+0000","last_fullsized":"2024-09-21T05:53:16.639314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:50.151899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637936+0000","last_change":"2024-09-21T05:50:53.894899+0000","last_active":"2024-09-21T05:53:16.637936+0000","last_peered":"2024-09-21T05:53:16.637936+0000","last_clean":"2024-09-21T05:53:16.637936+0000","last_became_active":"2024-09-21T05:50:53.894530+0000","last_became_peered":"2024-09-21T05:50:53.894530+0000","last_unstale":"2024-09-21T05:53:16.637936+0000","last_undegraded":"2024-09-21T05:53:16.637936+0000","last_fullsized":"2024-09-21T05:53:16.637936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:15.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637061+0000","last_change":"2024-09-21T05:51:47.376927+0000","last_active":"2024-09-21T05:53:16.637061+0000","last_peered":"2024-09-21T05:53:16.637061+0000","last_clean":"2024-09-21T05:53:16.637061+0000","last_became_active":"2024-09-21T05:51:47.376534+0000","last_became_peered":"2024-09-21T05:51:47.376534+0000","last_unstale":"2024-09-21T05:53:16.637061+0000","last_undegraded":"2024-09-21T05:53:16.637061+0000","last_fullsized":"2024-09-21T05:53:16.637061+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:26.353085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641137+0000","last_change":"2024-09-21T05:50:53.903196+0000","last_active":"2024-09-21T05:53:16.641137+0000","last_peered":"2024-09-21T05:53:16.641137+0000","last_clean":"2024-09-21T05:53:16.641137+0000","last_became_active":"2024-09-21T05:50:53.902825+0000","last_became_peered":"2024-09-21T05:50:53.902825+0000","last_unstale":"2024-09-21T05:53:16.641137+0000","last_undegraded":"2024-09-21T05:53:16.641137+0000","last_fullsized":"2024-09-21T05:53:16.641137+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:13.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.636471+0000","last_change":"2024-09-21T05:50:53.902249+0000","last_active":"2024-09-21T05:53:16.636471+0000","last_peered":"2024-09-21T05:53:16.636471+0000","last_clean":"2024-09-21T05:53:16.636471+0000","last_became_active":"2024-09-21T05:50:53.901828+0000","last_became_peered":"2024-09-21T05:50:53.901828+0000","last_unstale":"2024-09-21T05:53:16.636471+0000","last_undegraded":"2024-09-21T05:53:16.636471+0000","last_fullsized":"2024-09-21T05:53:16.636471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:51.200179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.626871+0000","last_change":"2024-09-21T05:50:53.897170+0000","last_active":"2024-09-21T05:53:16.626871+0000","last_peered":"2024-09-21T05:53:16.626871+0000","last_clean":"2024-09-21T05:53:16.626871+0000","last_became_active":"2024-09-21T05:50:53.895337+0000","last_became_peered":"2024-09-21T05:50:53.895337+0000","last_unstale":"2024-09-21T05:53:16.626871+0000","last_undegraded":"2024-09-21T05:53:16.626871+0000","last_fullsized":"2024-09-21T05:53:16.626871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:19.869698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.629432+0000","last_change":"2024-09-21T05:50:53.899575+0000","last_active":"2024-09-21T05:53:16.629432+0000","last_peered":"2024-09-21T05:53:16.629432+0000","last_clean":"2024-09-21T05:53:16.629432+0000","last_became_active":"2024-09-21T05:50:53.898274+0000","last_became_peered":"2024-09-21T05:50:53.898274+0000","last_unstale":"2024-09-21T05:53:16.629432+0000","last_undegraded":"2024-09-21T05:53:16.629432+0000","last_fullsized":"2024-09-21T05:53:16.629432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:28.188691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.647411+0000","last_change":"2024-09-21T05:50:53.908381+0000","last_active":"2024-09-21T05:53:16.647411+0000","last_peered":"2024-09-21T05:53:16.647411+0000","last_clean":"2024-09-21T05:53:16.647411+0000","last_became_active":"2024-09-21T05:50:53.906731+0000","last_became_peered":"2024-09-21T05:50:53.906731+0000","last_unstale":"2024-09-21T05:53:16.647411+0000","last_undegraded":"2024-09-21T05:53:16.647411+0000","last_fullsized":"2024-09-21T05:53:16.647411+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:59.254561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.631582+0000","last_change":"2024-09-21T05:50:53.904619+0000","last_active":"2024-09-21T05:53:16.631582+0000","last_peered":"2024-09-21T05:53:16.631582+0000","last_clean":"2024-09-21T05:53:16.631582+0000","last_became_active":"2024-09-21T05:50:53.903901+0000","last_became_peered":"2024-09-21T05:50:53.903901+0000","last_unstale":"2024-09-21T05:53:16.631582+0000","last_undegraded":"2024-09-21T05:53:16.631582+0000","last_fullsized":"2024-09-21T05:53:16.631582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:25.531973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645006+0000","last_change":"2024-09-21T05:50:53.903557+0000","last_active":"2024-09-21T05:53:16.645006+0000","last_peered":"2024-09-21T05:53:16.645006+0000","last_clean":"2024-09-21T05:53:16.645006+0000","last_became_active":"2024-09-21T05:50:53.903195+0000","last_became_peered":"2024-09-21T05:50:53.903195+0000","last_unstale":"2024-09-21T05:53:16.645006+0000","last_undegraded":"2024-09-21T05:53:16.645006+0000","last_fullsized":"2024-09-21T05:53:16.645006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:32.268063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70625,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":234,"num_read_kb":188,"num_write":98,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":211253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678062,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":521686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874292,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28700,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716452,"statfs":{"total":95995035648,"available":95965646848,"internally_reserved":0,"allocated":1716224,"data_stored":1177668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037819,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":526364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234048,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":522290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430276,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32784,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712368,"statfs":{"total":95995035648,"available":95961464832,"internally_reserved":0,"allocated":1638400,"data_stored":1116732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626505,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":517590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822737,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36948,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708204,"statfs":{"total":95995035648,"available":95957200896,"internally_reserved":0,"allocated":1642496,"data_stored":1112236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018965,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":521708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215193,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1040384,"data_stored":517694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444128,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1114112,"data_stored":587140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1110016,"data_stored":587106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738476,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":517680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:53:38.435 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:53:38.818 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:39.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:38 smithi144 ceph-mon[34351]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:39.123 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:38 smithi037 ceph-mon[30631]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:39.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:38 smithi067 ceph-mon[34443]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.449+0000 7f7314000640 1 -- 172.21.15.37:0/1909767676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c105300 msgr2=0x7f730c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.449+0000 7f7314000640 1 --2- 172.21.15.37:0/1909767676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c105300 0x7f730c10d850 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009900 tx=0x7f72f802a410 comp rx=0 tx=0).stop 2024-09-21T05:53:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.449+0000 7f7314000640 1 -- 172.21.15.37:0/1909767676 shutdown_connections 2024-09-21T05:53:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.449+0000 7f7314000640 1 --2- 172.21.15.37:0/1909767676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f730c10de10 0x7f730c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.449+0000 7f7314000640 1 --2- 172.21.15.37:0/1909767676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c105300 0x7f730c10d850 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.449+0000 7f7314000640 1 --2- 172.21.15.37:0/1909767676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f730c1049b0 0x7f730c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.449+0000 7f7314000640 1 -- 172.21.15.37:0/1909767676 >> 172.21.15.37:0/1909767676 conn(0x7f730c079760 msgr2=0x7f730c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.449+0000 7f7314000640 1 -- 172.21.15.37:0/1909767676 shutdown_connections 2024-09-21T05:53:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.449+0000 7f7314000640 1 -- 172.21.15.37:0/1909767676 wait complete. 2024-09-21T05:53:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.450+0000 7f7314000640 1 Processor -- start 2024-09-21T05:53:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.450+0000 7f7314000640 1 -- start start 2024-09-21T05:53:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.451+0000 7f7314000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f730c1049b0 0x7f730c1026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.451+0000 7f7314000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c105300 0x7f730c102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:39.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.451+0000 7f7314000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f730c10de10 0x7f730c103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:39.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.451+0000 7f7314000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f730c113ac0 con 0x7f730c105300 2024-09-21T05:53:39.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.451+0000 7f7314000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f730c113940 con 0x7f730c10de10 2024-09-21T05:53:39.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.451+0000 7f7314000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f730c113c40 con 0x7f730c1049b0 2024-09-21T05:53:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.451+0000 7f7310c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c105300 0x7f730c102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.451+0000 7f7312000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f730c10de10 0x7f730c103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.451+0000 7f7310c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c105300 0x7f730c102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34034/0 (socket says 172.21.15.37:34034) 2024-09-21T05:53:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.451+0000 7f7311600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f730c1049b0 0x7f730c1026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.451+0000 7f7312000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f730c10de10 0x7f730c103170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:54434/0 (socket says 172.21.15.37:54434) 2024-09-21T05:53:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.451+0000 7f7310c00640 1 -- 172.21.15.37:0/1209388309 learned_addr learned my addr 172.21.15.37:0/1209388309 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.452+0000 7f7312000640 1 -- 172.21.15.37:0/1209388309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f730c1049b0 msgr2=0x7f730c1026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.452+0000 7f7312000640 1 --2- 172.21.15.37:0/1209388309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f730c1049b0 0x7f730c1026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.452+0000 7f7312000640 1 -- 172.21.15.37:0/1209388309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c105300 msgr2=0x7f730c102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.452+0000 7f7312000640 1 --2- 172.21.15.37:0/1209388309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c105300 0x7f730c102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.452+0000 7f7312000640 1 -- 172.21.15.37:0/1209388309 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c1a8730 con 0x7f730c10de10 2024-09-21T05:53:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.452+0000 7f7312000640 1 --2- 172.21.15.37:0/1209388309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f730c10de10 0x7f730c103170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7304009fd0 tx=0x7f730400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.453+0000 7f730a000640 1 -- 172.21.15.37:0/1209388309 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730400ce20 con 0x7f730c10de10 2024-09-21T05:53:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.453+0000 7f730a000640 1 -- 172.21.15.37:0/1209388309 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7304005020 con 0x7f730c10de10 2024-09-21T05:53:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.453+0000 7f7314000640 1 -- 172.21.15.37:0/1209388309 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c1a8a20 con 0x7f730c10de10 2024-09-21T05:53:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.453+0000 7f730a000640 1 -- 172.21.15.37:0/1209388309 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304010690 con 0x7f730c10de10 2024-09-21T05:53:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.453+0000 7f7314000640 1 -- 172.21.15.37:0/1209388309 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c1a8ee0 con 0x7f730c10de10 2024-09-21T05:53:39.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.454+0000 7f7314000640 1 -- 172.21.15.37:0/1209388309 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730c06c2c0 con 0x7f730c10de10 2024-09-21T05:53:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.456+0000 7f730a000640 1 -- 172.21.15.37:0/1209388309 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f73040054d0 con 0x7f730c10de10 2024-09-21T05:53:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.458+0000 7f730a000640 1 --2- 172.21.15.37:0/1209388309 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f72f40b6510 0x7f72f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.458+0000 7f730a000640 1 -- 172.21.15.37:0/1209388309 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f73040e7db0 con 0x7f730c10de10 2024-09-21T05:53:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.458+0000 7f7311600640 1 --2- 172.21.15.37:0/1209388309 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f72f40b6510 0x7f72f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.459+0000 7f7311600640 1 --2- 172.21.15.37:0/1209388309 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f72f40b6510 0x7f72f40b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f730c104140 tx=0x7f7300005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.460+0000 7f730a000640 1 -- 172.21.15.37:0/1209388309 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f73040ae210 con 0x7f730c10de10 2024-09-21T05:53:39.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.656+0000 7f7314000640 1 -- 172.21.15.37:0/1209388309 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f730c063800 con 0x7f72f40b6510 2024-09-21T05:53:39.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.662+0000 7f730a000640 1 -- 172.21.15.37:0/1209388309 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340392 (secure 0 0 0) 0x7f730c063800 con 0x7f72f40b6510 2024-09-21T05:53:39.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:39.670 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T05:53:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.667+0000 7f7314000640 1 -- 172.21.15.37:0/1209388309 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f72f40b6510 msgr2=0x7f72f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.667+0000 7f7314000640 1 --2- 172.21.15.37:0/1209388309 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f72f40b6510 0x7f72f40b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f730c104140 tx=0x7f7300005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.667+0000 7f7314000640 1 -- 172.21.15.37:0/1209388309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f730c10de10 msgr2=0x7f730c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.667+0000 7f7314000640 1 --2- 172.21.15.37:0/1209388309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f730c10de10 0x7f730c103170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7304009fd0 tx=0x7f730400ef10 comp rx=0 tx=0).stop 2024-09-21T05:53:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.667+0000 7f7314000640 1 -- 172.21.15.37:0/1209388309 shutdown_connections 2024-09-21T05:53:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.667+0000 7f7314000640 1 --2- 172.21.15.37:0/1209388309 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f72f40b6510 0x7f72f40b8a20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.667+0000 7f7314000640 1 --2- 172.21.15.37:0/1209388309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f730c10de10 0x7f730c103170 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.667+0000 7f7314000640 1 --2- 172.21.15.37:0/1209388309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730c105300 0x7f730c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.667+0000 7f7314000640 1 --2- 172.21.15.37:0/1209388309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f730c1049b0 0x7f730c1026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.667+0000 7f7314000640 1 -- 172.21.15.37:0/1209388309 >> 172.21.15.37:0/1209388309 conn(0x7f730c079760 msgr2=0x7f730c1007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.667+0000 7f7314000640 1 -- 172.21.15.37:0/1209388309 shutdown_connections 2024-09-21T05:53:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:39.667+0000 7f7314000640 1 -- 172.21.15.37:0/1209388309 wait complete. 2024-09-21T05:53:39.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:39 smithi037 ceph-mon[30631]: pgmap v406: 129 pgs: 129 active+clean; 646 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T05:53:40.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:39 smithi144 ceph-mon[34351]: pgmap v406: 129 pgs: 129 active+clean; 646 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T05:53:40.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:39 smithi067 ceph-mon[34443]: pgmap v406: 129 pgs: 129 active+clean; 646 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T05:53:40.439 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-21T05:53:38.272980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661227,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":310,"num_read_kb":252,"num_write":223,"num_write_kb":2258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":675,"ondisk_log_size":675,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384204,"kb_used_data":14156,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557620,"statfs":{"total":1151940427776,"available":1151547002880,"internally_reserved":0,"allocated":14495744,"data_stored":8226516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":311,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003662"},"pg_stats":[{"pgid":"2.1f","version":"79'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012748+0000","last_change":"2024-09-21T05:50:50.846365+0000","last_active":"2024-09-21T05:52:48.012748+0000","last_peered":"2024-09-21T05:52:48.012748+0000","last_clean":"2024-09-21T05:52:48.012748+0000","last_became_active":"2024-09-21T05:50:50.845924+0000","last_became_peered":"2024-09-21T05:50:50.845924+0000","last_unstale":"2024-09-21T05:52:48.012748+0000","last_undegraded":"2024-09-21T05:52:48.012748+0000","last_fullsized":"2024-09-21T05:52:48.012748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:39.056271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.628415+0000","last_change":"2024-09-21T05:51:47.377003+0000","last_active":"2024-09-21T05:53:16.628415+0000","last_peered":"2024-09-21T05:53:16.628415+0000","last_clean":"2024-09-21T05:53:16.628415+0000","last_became_active":"2024-09-21T05:51:47.376624+0000","last_became_peered":"2024-09-21T05:51:47.376624+0000","last_unstale":"2024-09-21T05:53:16.628415+0000","last_undegraded":"2024-09-21T05:53:16.628415+0000","last_fullsized":"2024-09-21T05:53:16.628415+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:20.569002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678029+0000","last_change":"2024-09-21T05:51:03.940107+0000","last_active":"2024-09-21T05:52:47.678029+0000","last_peered":"2024-09-21T05:52:47.678029+0000","last_clean":"2024-09-21T05:52:47.678029+0000","last_became_active":"2024-09-21T05:51:03.939723+0000","last_became_peered":"2024-09-21T05:51:03.939723+0000","last_unstale":"2024-09-21T05:52:47.678029+0000","last_undegraded":"2024-09-21T05:52:47.678029+0000","last_fullsized":"2024-09-21T05:52:47.678029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:15.116461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321731+0000","last_change":"2024-09-21T05:50:51.162120+0000","last_active":"2024-09-21T05:52:48.321731+0000","last_peered":"2024-09-21T05:52:48.321731+0000","last_clean":"2024-09-21T05:52:48.321731+0000","last_became_active":"2024-09-21T05:50:51.161679+0000","last_became_peered":"2024-09-21T05:50:51.161679+0000","last_unstale":"2024-09-21T05:52:48.321731+0000","last_undegraded":"2024-09-21T05:52:48.321731+0000","last_fullsized":"2024-09-21T05:52:48.321731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:10.028536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.647305+0000","last_change":"2024-09-21T05:50:53.907800+0000","last_active":"2024-09-21T05:53:16.647305+0000","last_peered":"2024-09-21T05:53:16.647305+0000","last_clean":"2024-09-21T05:53:16.647305+0000","last_became_active":"2024-09-21T05:50:53.906695+0000","last_became_peered":"2024-09-21T05:50:53.906695+0000","last_unstale":"2024-09-21T05:53:16.647305+0000","last_undegraded":"2024-09-21T05:53:16.647305+0000","last_fullsized":"2024-09-21T05:53:16.647305+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:45.999010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699064+0000","last_change":"2024-09-21T05:51:03.947020+0000","last_active":"2024-09-21T05:52:47.699064+0000","last_peered":"2024-09-21T05:52:47.699064+0000","last_clean":"2024-09-21T05:52:47.699064+0000","last_became_active":"2024-09-21T05:51:03.946387+0000","last_became_peered":"2024-09-21T05:51:03.946387+0000","last_unstale":"2024-09-21T05:52:47.699064+0000","last_undegraded":"2024-09-21T05:52:47.699064+0000","last_fullsized":"2024-09-21T05:52:47.699064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:02.073199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677355+0000","last_change":"2024-09-21T05:50:50.850606+0000","last_active":"2024-09-21T05:52:47.677355+0000","last_peered":"2024-09-21T05:52:47.677355+0000","last_clean":"2024-09-21T05:52:47.677355+0000","last_became_active":"2024-09-21T05:50:50.850244+0000","last_became_peered":"2024-09-21T05:50:50.850244+0000","last_unstale":"2024-09-21T05:52:47.677355+0000","last_undegraded":"2024-09-21T05:52:47.677355+0000","last_fullsized":"2024-09-21T05:52:47.677355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:39.437099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645012+0000","last_change":"2024-09-21T05:50:53.897805+0000","last_active":"2024-09-21T05:53:16.645012+0000","last_peered":"2024-09-21T05:53:16.645012+0000","last_clean":"2024-09-21T05:53:16.645012+0000","last_became_active":"2024-09-21T05:50:53.896977+0000","last_became_peered":"2024-09-21T05:50:53.896977+0000","last_unstale":"2024-09-21T05:53:16.645012+0000","last_undegraded":"2024-09-21T05:53:16.645012+0000","last_fullsized":"2024-09-21T05:53:16.645012+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:35.538322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698802+0000","last_change":"2024-09-21T05:51:03.939519+0000","last_active":"2024-09-21T05:52:47.698802+0000","last_peered":"2024-09-21T05:52:47.698802+0000","last_clean":"2024-09-21T05:52:47.698802+0000","last_became_active":"2024-09-21T05:51:03.938429+0000","last_became_peered":"2024-09-21T05:51:03.938429+0000","last_unstale":"2024-09-21T05:52:47.698802+0000","last_undegraded":"2024-09-21T05:52:47.698802+0000","last_fullsized":"2024-09-21T05:52:47.698802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:09.236561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677115+0000","last_change":"2024-09-21T05:50:50.847640+0000","last_active":"2024-09-21T05:52:47.677115+0000","last_peered":"2024-09-21T05:52:47.677115+0000","last_clean":"2024-09-21T05:52:47.677115+0000","last_became_active":"2024-09-21T05:50:50.847101+0000","last_became_peered":"2024-09-21T05:50:50.847101+0000","last_unstale":"2024-09-21T05:52:47.677115+0000","last_undegraded":"2024-09-21T05:52:47.677115+0000","last_fullsized":"2024-09-21T05:52:47.677115+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:09.087655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641403+0000","last_change":"2024-09-21T05:50:53.889855+0000","last_active":"2024-09-21T05:53:16.641403+0000","last_peered":"2024-09-21T05:53:16.641403+0000","last_clean":"2024-09-21T05:53:16.641403+0000","last_became_active":"2024-09-21T05:50:53.889444+0000","last_became_peered":"2024-09-21T05:50:53.889444+0000","last_unstale":"2024-09-21T05:53:16.641403+0000","last_undegraded":"2024-09-21T05:53:16.641403+0000","last_fullsized":"2024-09-21T05:53:16.641403+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:47.480986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698671+0000","last_change":"2024-09-21T05:51:03.946866+0000","last_active":"2024-09-21T05:52:47.698671+0000","last_peered":"2024-09-21T05:52:47.698671+0000","last_clean":"2024-09-21T05:52:47.698671+0000","last_became_active":"2024-09-21T05:51:03.946332+0000","last_became_peered":"2024-09-21T05:51:03.946332+0000","last_unstale":"2024-09-21T05:52:47.698671+0000","last_undegraded":"2024-09-21T05:52:47.698671+0000","last_fullsized":"2024-09-21T05:52:47.698671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:43.527937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645506+0000","last_change":"2024-09-21T05:50:53.900395+0000","last_active":"2024-09-21T05:53:16.645506+0000","last_peered":"2024-09-21T05:53:16.645506+0000","last_clean":"2024-09-21T05:53:16.645506+0000","last_became_active":"2024-09-21T05:50:53.894925+0000","last_became_peered":"2024-09-21T05:50:53.894925+0000","last_unstale":"2024-09-21T05:53:16.645506+0000","last_undegraded":"2024-09-21T05:53:16.645506+0000","last_fullsized":"2024-09-21T05:53:16.645506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.939120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.676506+0000","last_change":"2024-09-21T05:50:50.851145+0000","last_active":"2024-09-21T05:52:47.676506+0000","last_peered":"2024-09-21T05:52:47.676506+0000","last_clean":"2024-09-21T05:52:47.676506+0000","last_became_active":"2024-09-21T05:50:50.850641+0000","last_became_peered":"2024-09-21T05:50:50.850641+0000","last_unstale":"2024-09-21T05:52:47.676506+0000","last_undegraded":"2024-09-21T05:52:47.676506+0000","last_fullsized":"2024-09-21T05:52:47.676506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:34.560798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699204+0000","last_change":"2024-09-21T05:51:03.991798+0000","last_active":"2024-09-21T05:52:47.699204+0000","last_peered":"2024-09-21T05:52:47.699204+0000","last_clean":"2024-09-21T05:52:47.699204+0000","last_became_active":"2024-09-21T05:51:03.991173+0000","last_became_peered":"2024-09-21T05:51:03.991173+0000","last_unstale":"2024-09-21T05:52:47.699204+0000","last_undegraded":"2024-09-21T05:52:47.699204+0000","last_fullsized":"2024-09-21T05:52:47.699204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:46.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.634436+0000","last_change":"2024-09-21T05:50:53.892293+0000","last_active":"2024-09-21T05:53:16.634436+0000","last_peered":"2024-09-21T05:53:16.634436+0000","last_clean":"2024-09-21T05:53:16.634436+0000","last_became_active":"2024-09-21T05:50:53.891814+0000","last_became_peered":"2024-09-21T05:50:53.891814+0000","last_unstale":"2024-09-21T05:53:16.634436+0000","last_undegraded":"2024-09-21T05:53:16.634436+0000","last_fullsized":"2024-09-21T05:53:16.634436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:14.810409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678731+0000","last_change":"2024-09-21T05:50:50.846360+0000","last_active":"2024-09-21T05:52:47.678731+0000","last_peered":"2024-09-21T05:52:47.678731+0000","last_clean":"2024-09-21T05:52:47.678731+0000","last_became_active":"2024-09-21T05:50:50.845972+0000","last_became_peered":"2024-09-21T05:50:50.845972+0000","last_unstale":"2024-09-21T05:52:47.678731+0000","last_undegraded":"2024-09-21T05:52:47.678731+0000","last_fullsized":"2024-09-21T05:52:47.678731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.023239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699296+0000","last_change":"2024-09-21T05:51:03.938903+0000","last_active":"2024-09-21T05:52:47.699296+0000","last_peered":"2024-09-21T05:52:47.699296+0000","last_clean":"2024-09-21T05:52:47.699296+0000","last_became_active":"2024-09-21T05:51:03.938312+0000","last_became_peered":"2024-09-21T05:51:03.938312+0000","last_unstale":"2024-09-21T05:52:47.699296+0000","last_undegraded":"2024-09-21T05:52:47.699296+0000","last_fullsized":"2024-09-21T05:52:47.699296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:01.851758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.635971+0000","last_change":"2024-09-21T05:50:53.907529+0000","last_active":"2024-09-21T05:53:16.635971+0000","last_peered":"2024-09-21T05:53:16.635971+0000","last_clean":"2024-09-21T05:53:16.635971+0000","last_became_active":"2024-09-21T05:50:53.907154+0000","last_became_peered":"2024-09-21T05:50:53.907154+0000","last_unstale":"2024-09-21T05:53:16.635971+0000","last_undegraded":"2024-09-21T05:53:16.635971+0000","last_fullsized":"2024-09-21T05:53:16.635971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:22.586642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321422+0000","last_change":"2024-09-21T05:50:50.838939+0000","last_active":"2024-09-21T05:52:48.321422+0000","last_peered":"2024-09-21T05:52:48.321422+0000","last_clean":"2024-09-21T05:52:48.321422+0000","last_became_active":"2024-09-21T05:50:50.838457+0000","last_became_peered":"2024-09-21T05:50:50.838457+0000","last_unstale":"2024-09-21T05:52:48.321422+0000","last_undegraded":"2024-09-21T05:52:48.321422+0000","last_fullsized":"2024-09-21T05:52:48.321422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:54.259046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011123+0000","last_change":"2024-09-21T05:51:03.944824+0000","last_active":"2024-09-21T05:52:48.011123+0000","last_peered":"2024-09-21T05:52:48.011123+0000","last_clean":"2024-09-21T05:52:48.011123+0000","last_became_active":"2024-09-21T05:51:03.938856+0000","last_became_peered":"2024-09-21T05:51:03.938856+0000","last_unstale":"2024-09-21T05:52:48.011123+0000","last_undegraded":"2024-09-21T05:52:48.011123+0000","last_fullsized":"2024-09-21T05:52:48.011123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:12.111775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.582040+0000","last_change":"2024-09-21T05:50:53.891676+0000","last_active":"2024-09-21T05:53:16.582040+0000","last_peered":"2024-09-21T05:53:16.582040+0000","last_clean":"2024-09-21T05:53:16.582040+0000","last_became_active":"2024-09-21T05:50:53.891339+0000","last_became_peered":"2024-09-21T05:50:53.891339+0000","last_unstale":"2024-09-21T05:53:16.582040+0000","last_undegraded":"2024-09-21T05:53:16.582040+0000","last_fullsized":"2024-09-21T05:53:16.582040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:41.707680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675446+0000","last_change":"2024-09-21T05:50:51.162492+0000","last_active":"2024-09-21T05:52:47.675446+0000","last_peered":"2024-09-21T05:52:47.675446+0000","last_clean":"2024-09-21T05:52:47.675446+0000","last_became_active":"2024-09-21T05:50:51.162108+0000","last_became_peered":"2024-09-21T05:50:51.162108+0000","last_unstale":"2024-09-21T05:52:47.675446+0000","last_undegraded":"2024-09-21T05:52:47.675446+0000","last_fullsized":"2024-09-21T05:52:47.675446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.387568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699051+0000","last_change":"2024-09-21T05:51:03.992550+0000","last_active":"2024-09-21T05:52:47.699051+0000","last_peered":"2024-09-21T05:52:47.699051+0000","last_clean":"2024-09-21T05:52:47.699051+0000","last_became_active":"2024-09-21T05:51:03.991865+0000","last_became_peered":"2024-09-21T05:51:03.991865+0000","last_unstale":"2024-09-21T05:52:47.699051+0000","last_undegraded":"2024-09-21T05:52:47.699051+0000","last_fullsized":"2024-09-21T05:52:47.699051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:50.204058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.636651+0000","last_change":"2024-09-21T05:50:53.884376+0000","last_active":"2024-09-21T05:53:16.636651+0000","last_peered":"2024-09-21T05:53:16.636651+0000","last_clean":"2024-09-21T05:53:16.636651+0000","last_became_active":"2024-09-21T05:50:53.884033+0000","last_became_peered":"2024-09-21T05:50:53.884033+0000","last_unstale":"2024-09-21T05:53:16.636651+0000","last_undegraded":"2024-09-21T05:53:16.636651+0000","last_fullsized":"2024-09-21T05:53:16.636651+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.359191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699406+0000","last_change":"2024-09-21T05:50:50.869502+0000","last_active":"2024-09-21T05:52:47.699406+0000","last_peered":"2024-09-21T05:52:47.699406+0000","last_clean":"2024-09-21T05:52:47.699406+0000","last_became_active":"2024-09-21T05:50:50.869071+0000","last_became_peered":"2024-09-21T05:50:50.869071+0000","last_unstale":"2024-09-21T05:52:47.699406+0000","last_undegraded":"2024-09-21T05:52:47.699406+0000","last_fullsized":"2024-09-21T05:52:47.699406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:48.364902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678176+0000","last_change":"2024-09-21T05:51:03.931945+0000","last_active":"2024-09-21T05:52:47.678176+0000","last_peered":"2024-09-21T05:52:47.678176+0000","last_clean":"2024-09-21T05:52:47.678176+0000","last_became_active":"2024-09-21T05:51:03.931411+0000","last_became_peered":"2024-09-21T05:51:03.931411+0000","last_unstale":"2024-09-21T05:52:47.678176+0000","last_undegraded":"2024-09-21T05:52:47.678176+0000","last_fullsized":"2024-09-21T05:52:47.678176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.910547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641081+0000","last_change":"2024-09-21T05:50:53.897995+0000","last_active":"2024-09-21T05:53:16.641081+0000","last_peered":"2024-09-21T05:53:16.641081+0000","last_clean":"2024-09-21T05:53:16.641081+0000","last_became_active":"2024-09-21T05:50:53.895797+0000","last_became_peered":"2024-09-21T05:50:53.895797+0000","last_unstale":"2024-09-21T05:53:16.641081+0000","last_undegraded":"2024-09-21T05:53:16.641081+0000","last_fullsized":"2024-09-21T05:53:16.641081+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.484867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.920142+0000","last_change":"2024-09-21T05:50:50.845853+0000","last_active":"2024-09-21T05:53:16.920142+0000","last_peered":"2024-09-21T05:53:16.920142+0000","last_clean":"2024-09-21T05:53:16.920142+0000","last_became_active":"2024-09-21T05:50:50.845495+0000","last_became_peered":"2024-09-21T05:50:50.845495+0000","last_unstale":"2024-09-21T05:53:16.920142+0000","last_undegraded":"2024-09-21T05:53:16.920142+0000","last_fullsized":"2024-09-21T05:53:16.920142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:47.960498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.320673+0000","last_change":"2024-09-21T05:51:03.991380+0000","last_active":"2024-09-21T05:52:48.320673+0000","last_peered":"2024-09-21T05:52:48.320673+0000","last_clean":"2024-09-21T05:52:48.320673+0000","last_became_active":"2024-09-21T05:51:03.990911+0000","last_became_peered":"2024-09-21T05:51:03.990911+0000","last_unstale":"2024-09-21T05:52:48.320673+0000","last_undegraded":"2024-09-21T05:52:48.320673+0000","last_fullsized":"2024-09-21T05:52:48.320673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:01.779692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.625116+0000","last_change":"2024-09-21T05:50:53.910190+0000","last_active":"2024-09-21T05:53:16.625116+0000","last_peered":"2024-09-21T05:53:16.625116+0000","last_clean":"2024-09-21T05:53:16.625116+0000","last_became_active":"2024-09-21T05:50:53.909649+0000","last_became_peered":"2024-09-21T05:50:53.909649+0000","last_unstale":"2024-09-21T05:53:16.625116+0000","last_undegraded":"2024-09-21T05:53:16.625116+0000","last_fullsized":"2024-09-21T05:53:16.625116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:14.582217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677473+0000","last_change":"2024-09-21T05:50:51.163512+0000","last_active":"2024-09-21T05:52:47.677473+0000","last_peered":"2024-09-21T05:52:47.677473+0000","last_clean":"2024-09-21T05:52:47.677473+0000","last_became_active":"2024-09-21T05:50:51.161959+0000","last_became_peered":"2024-09-21T05:50:51.161959+0000","last_unstale":"2024-09-21T05:52:47.677473+0000","last_undegraded":"2024-09-21T05:52:47.677473+0000","last_fullsized":"2024-09-21T05:52:47.677473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:51.701990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682240+0000","last_change":"2024-09-21T05:51:03.936815+0000","last_active":"2024-09-21T05:52:47.682240+0000","last_peered":"2024-09-21T05:52:47.682240+0000","last_clean":"2024-09-21T05:52:47.682240+0000","last_became_active":"2024-09-21T05:51:03.936365+0000","last_became_peered":"2024-09-21T05:51:03.936365+0000","last_unstale":"2024-09-21T05:52:47.682240+0000","last_undegraded":"2024-09-21T05:52:47.682240+0000","last_fullsized":"2024-09-21T05:52:47.682240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:59.820159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.624247+0000","last_change":"2024-09-21T05:50:53.892772+0000","last_active":"2024-09-21T05:53:16.624247+0000","last_peered":"2024-09-21T05:53:16.624247+0000","last_clean":"2024-09-21T05:53:16.624247+0000","last_became_active":"2024-09-21T05:50:53.892378+0000","last_became_peered":"2024-09-21T05:50:53.892378+0000","last_unstale":"2024-09-21T05:53:16.624247+0000","last_undegraded":"2024-09-21T05:53:16.624247+0000","last_fullsized":"2024-09-21T05:53:16.624247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:34.438067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011995+0000","last_change":"2024-09-21T05:51:47.378160+0000","last_active":"2024-09-21T05:52:48.011995+0000","last_peered":"2024-09-21T05:52:48.011995+0000","last_clean":"2024-09-21T05:52:48.011995+0000","last_became_active":"2024-09-21T05:51:47.377779+0000","last_became_peered":"2024-09-21T05:51:47.377779+0000","last_unstale":"2024-09-21T05:52:48.011995+0000","last_undegraded":"2024-09-21T05:52:48.011995+0000","last_fullsized":"2024-09-21T05:52:48.011995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:27.780273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012450+0000","last_change":"2024-09-21T05:52:48.011820+0000","last_active":"2024-09-21T05:52:48.012450+0000","last_peered":"2024-09-21T05:52:48.012450+0000","last_clean":"2024-09-21T05:52:48.012450+0000","last_became_active":"2024-09-21T05:52:48.011191+0000","last_became_peered":"2024-09-21T05:52:48.011191+0000","last_unstale":"2024-09-21T05:52:48.012450+0000","last_undegraded":"2024-09-21T05:52:48.012450+0000","last_fullsized":"2024-09-21T05:52:48.012450+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:45.598281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.620513+0000","last_change":"2024-09-21T05:50:53.899306+0000","last_active":"2024-09-21T05:53:16.620513+0000","last_peered":"2024-09-21T05:53:16.620513+0000","last_clean":"2024-09-21T05:53:16.620513+0000","last_became_active":"2024-09-21T05:50:53.898921+0000","last_became_peered":"2024-09-21T05:50:53.898921+0000","last_unstale":"2024-09-21T05:53:16.620513+0000","last_undegraded":"2024-09-21T05:53:16.620513+0000","last_fullsized":"2024-09-21T05:53:16.620513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:45.698584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681190+0000","last_change":"2024-09-21T05:50:50.844394+0000","last_active":"2024-09-21T05:52:47.681190+0000","last_peered":"2024-09-21T05:52:47.681190+0000","last_clean":"2024-09-21T05:52:47.681190+0000","last_became_active":"2024-09-21T05:50:50.843771+0000","last_became_peered":"2024-09-21T05:50:50.843771+0000","last_unstale":"2024-09-21T05:52:47.681190+0000","last_undegraded":"2024-09-21T05:52:47.681190+0000","last_fullsized":"2024-09-21T05:52:47.681190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:14.372917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009778+0000","last_change":"2024-09-21T05:51:03.941277+0000","last_active":"2024-09-21T05:52:48.009778+0000","last_peered":"2024-09-21T05:52:48.009778+0000","last_clean":"2024-09-21T05:52:48.009778+0000","last_became_active":"2024-09-21T05:51:03.940659+0000","last_became_peered":"2024-09-21T05:51:03.940659+0000","last_unstale":"2024-09-21T05:52:48.009778+0000","last_undegraded":"2024-09-21T05:52:48.009778+0000","last_fullsized":"2024-09-21T05:52:48.009778+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:40.217023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640245+0000","last_change":"2024-09-21T05:50:53.895399+0000","last_active":"2024-09-21T05:53:16.640245+0000","last_peered":"2024-09-21T05:53:16.640245+0000","last_clean":"2024-09-21T05:53:16.640245+0000","last_became_active":"2024-09-21T05:50:53.895022+0000","last_became_peered":"2024-09-21T05:50:53.895022+0000","last_unstale":"2024-09-21T05:53:16.640245+0000","last_undegraded":"2024-09-21T05:53:16.640245+0000","last_fullsized":"2024-09-21T05:53:16.640245+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:02.056015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010036+0000","last_change":"2024-09-21T05:50:51.162215+0000","last_active":"2024-09-21T05:52:48.010036+0000","last_peered":"2024-09-21T05:52:48.010036+0000","last_clean":"2024-09-21T05:52:48.010036+0000","last_became_active":"2024-09-21T05:50:51.161812+0000","last_became_peered":"2024-09-21T05:50:51.161812+0000","last_unstale":"2024-09-21T05:52:48.010036+0000","last_undegraded":"2024-09-21T05:52:48.010036+0000","last_fullsized":"2024-09-21T05:52:48.010036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:05.237806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009907+0000","last_change":"2024-09-21T05:51:03.991488+0000","last_active":"2024-09-21T05:52:48.009907+0000","last_peered":"2024-09-21T05:52:48.009907+0000","last_clean":"2024-09-21T05:52:48.009907+0000","last_became_active":"2024-09-21T05:51:03.990866+0000","last_became_peered":"2024-09-21T05:51:03.990866+0000","last_unstale":"2024-09-21T05:52:48.009907+0000","last_undegraded":"2024-09-21T05:52:48.009907+0000","last_fullsized":"2024-09-21T05:52:48.009907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:41.061421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.629178+0000","last_change":"2024-09-21T05:50:53.895076+0000","last_active":"2024-09-21T05:53:16.629178+0000","last_peered":"2024-09-21T05:53:16.629178+0000","last_clean":"2024-09-21T05:53:16.629178+0000","last_became_active":"2024-09-21T05:50:53.893888+0000","last_became_peered":"2024-09-21T05:50:53.893888+0000","last_unstale":"2024-09-21T05:53:16.629178+0000","last_undegraded":"2024-09-21T05:53:16.629178+0000","last_fullsized":"2024-09-21T05:53:16.629178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:13.397806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681934+0000","last_change":"2024-09-21T05:51:47.376540+0000","last_active":"2024-09-21T05:52:47.681934+0000","last_peered":"2024-09-21T05:52:47.681934+0000","last_clean":"2024-09-21T05:52:47.681934+0000","last_became_active":"2024-09-21T05:51:47.376163+0000","last_became_peered":"2024-09-21T05:51:47.376163+0000","last_unstale":"2024-09-21T05:52:47.681934+0000","last_undegraded":"2024-09-21T05:52:47.681934+0000","last_fullsized":"2024-09-21T05:52:47.681934+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:51.217674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010533+0000","last_change":"2024-09-21T05:51:03.991711+0000","last_active":"2024-09-21T05:52:48.010533+0000","last_peered":"2024-09-21T05:52:48.010533+0000","last_clean":"2024-09-21T05:52:48.010533+0000","last_became_active":"2024-09-21T05:51:03.991200+0000","last_became_peered":"2024-09-21T05:51:03.991200+0000","last_unstale":"2024-09-21T05:52:48.010533+0000","last_undegraded":"2024-09-21T05:52:48.010533+0000","last_fullsized":"2024-09-21T05:52:48.010533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:40.981303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.635878+0000","last_change":"2024-09-21T05:50:53.887913+0000","last_active":"2024-09-21T05:53:16.635878+0000","last_peered":"2024-09-21T05:53:16.635878+0000","last_clean":"2024-09-21T05:53:16.635878+0000","last_became_active":"2024-09-21T05:50:53.887583+0000","last_became_peered":"2024-09-21T05:50:53.887583+0000","last_unstale":"2024-09-21T05:53:16.635878+0000","last_undegraded":"2024-09-21T05:53:16.635878+0000","last_fullsized":"2024-09-21T05:53:16.635878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:05.941780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699391+0000","last_change":"2024-09-21T05:50:50.846370+0000","last_active":"2024-09-21T05:52:47.699391+0000","last_peered":"2024-09-21T05:52:47.699391+0000","last_clean":"2024-09-21T05:52:47.699391+0000","last_became_active":"2024-09-21T05:50:50.845890+0000","last_became_peered":"2024-09-21T05:50:50.845890+0000","last_unstale":"2024-09-21T05:52:47.699391+0000","last_undegraded":"2024-09-21T05:52:47.699391+0000","last_fullsized":"2024-09-21T05:52:47.699391+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:15.180734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":118,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.680908+0000","last_change":"2024-09-21T05:49:33.762460+0000","last_active":"2024-09-21T05:52:47.680908+0000","last_peered":"2024-09-21T05:52:47.680908+0000","last_clean":"2024-09-21T05:52:47.680908+0000","last_became_active":"2024-09-21T05:49:33.705194+0000","last_became_peered":"2024-09-21T05:49:33.705194+0000","last_unstale":"2024-09-21T05:52:47.680908+0000","last_undegraded":"2024-09-21T05:52:47.680908+0000","last_fullsized":"2024-09-21T05:52:47.680908+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_clean_scrub_stamp":"2024-09-21T05:45:49.237325+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:39.194122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681362+0000","last_change":"2024-09-21T05:51:03.938790+0000","last_active":"2024-09-21T05:52:47.681362+0000","last_peered":"2024-09-21T05:52:47.681362+0000","last_clean":"2024-09-21T05:52:47.681362+0000","last_became_active":"2024-09-21T05:51:03.938214+0000","last_became_peered":"2024-09-21T05:51:03.938214+0000","last_unstale":"2024-09-21T05:52:47.681362+0000","last_undegraded":"2024-09-21T05:52:47.681362+0000","last_fullsized":"2024-09-21T05:52:47.681362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:11.512500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645921+0000","last_change":"2024-09-21T05:50:53.893475+0000","last_active":"2024-09-21T05:53:16.645921+0000","last_peered":"2024-09-21T05:53:16.645921+0000","last_clean":"2024-09-21T05:53:16.645921+0000","last_became_active":"2024-09-21T05:50:53.892946+0000","last_became_peered":"2024-09-21T05:50:53.892946+0000","last_unstale":"2024-09-21T05:53:16.645921+0000","last_undegraded":"2024-09-21T05:53:16.645921+0000","last_fullsized":"2024-09-21T05:53:16.645921+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:23.612285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678724+0000","last_change":"2024-09-21T05:50:51.162170+0000","last_active":"2024-09-21T05:52:47.678724+0000","last_peered":"2024-09-21T05:52:47.678724+0000","last_clean":"2024-09-21T05:52:47.678724+0000","last_became_active":"2024-09-21T05:50:51.161685+0000","last_became_peered":"2024-09-21T05:50:51.161685+0000","last_unstale":"2024-09-21T05:52:47.678724+0000","last_undegraded":"2024-09-21T05:52:47.678724+0000","last_fullsized":"2024-09-21T05:52:47.678724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:14.922423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675290+0000","last_change":"2024-09-21T05:51:03.937061+0000","last_active":"2024-09-21T05:52:47.675290+0000","last_peered":"2024-09-21T05:52:47.675290+0000","last_clean":"2024-09-21T05:52:47.675290+0000","last_became_active":"2024-09-21T05:51:03.936306+0000","last_became_peered":"2024-09-21T05:51:03.936306+0000","last_unstale":"2024-09-21T05:52:47.675290+0000","last_undegraded":"2024-09-21T05:52:47.675290+0000","last_fullsized":"2024-09-21T05:52:47.675290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:51.057973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640342+0000","last_change":"2024-09-21T05:50:53.893930+0000","last_active":"2024-09-21T05:53:16.640342+0000","last_peered":"2024-09-21T05:53:16.640342+0000","last_clean":"2024-09-21T05:53:16.640342+0000","last_became_active":"2024-09-21T05:50:53.893155+0000","last_became_peered":"2024-09-21T05:50:53.893155+0000","last_unstale":"2024-09-21T05:53:16.640342+0000","last_undegraded":"2024-09-21T05:53:16.640342+0000","last_fullsized":"2024-09-21T05:53:16.640342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:46.097408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011053+0000","last_change":"2024-09-21T05:50:50.847890+0000","last_active":"2024-09-21T05:52:48.011053+0000","last_peered":"2024-09-21T05:52:48.011053+0000","last_clean":"2024-09-21T05:52:48.011053+0000","last_became_active":"2024-09-21T05:50:50.847549+0000","last_became_peered":"2024-09-21T05:50:50.847549+0000","last_unstale":"2024-09-21T05:52:48.011053+0000","last_undegraded":"2024-09-21T05:52:48.011053+0000","last_fullsized":"2024-09-21T05:52:48.011053+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:14.998849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674513+0000","last_change":"2024-09-21T05:51:03.940674+0000","last_active":"2024-09-21T05:52:47.674513+0000","last_peered":"2024-09-21T05:52:47.674513+0000","last_clean":"2024-09-21T05:52:47.674513+0000","last_became_active":"2024-09-21T05:51:03.940222+0000","last_became_peered":"2024-09-21T05:51:03.940222+0000","last_unstale":"2024-09-21T05:52:47.674513+0000","last_undegraded":"2024-09-21T05:52:47.674513+0000","last_fullsized":"2024-09-21T05:52:47.674513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:58.497147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641922+0000","last_change":"2024-09-21T05:50:53.895191+0000","last_active":"2024-09-21T05:53:16.641922+0000","last_peered":"2024-09-21T05:53:16.641922+0000","last_clean":"2024-09-21T05:53:16.641922+0000","last_became_active":"2024-09-21T05:50:53.892894+0000","last_became_peered":"2024-09-21T05:50:53.892894+0000","last_unstale":"2024-09-21T05:53:16.641922+0000","last_undegraded":"2024-09-21T05:53:16.641922+0000","last_fullsized":"2024-09-21T05:53:16.641922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:41.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011748+0000","last_change":"2024-09-21T05:50:50.844301+0000","last_active":"2024-09-21T05:52:48.011748+0000","last_peered":"2024-09-21T05:52:48.011748+0000","last_clean":"2024-09-21T05:52:48.011748+0000","last_became_active":"2024-09-21T05:50:50.843878+0000","last_became_peered":"2024-09-21T05:50:50.843878+0000","last_unstale":"2024-09-21T05:52:48.011748+0000","last_undegraded":"2024-09-21T05:52:48.011748+0000","last_fullsized":"2024-09-21T05:52:48.011748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:53.150300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009615+0000","last_change":"2024-09-21T05:51:03.931684+0000","last_active":"2024-09-21T05:52:48.009615+0000","last_peered":"2024-09-21T05:52:48.009615+0000","last_clean":"2024-09-21T05:52:48.009615+0000","last_became_active":"2024-09-21T05:51:03.931225+0000","last_became_peered":"2024-09-21T05:51:03.931225+0000","last_unstale":"2024-09-21T05:52:48.009615+0000","last_undegraded":"2024-09-21T05:52:48.009615+0000","last_fullsized":"2024-09-21T05:52:48.009615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:51.993481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637668+0000","last_change":"2024-09-21T05:50:53.892740+0000","last_active":"2024-09-21T05:53:16.637668+0000","last_peered":"2024-09-21T05:53:16.637668+0000","last_clean":"2024-09-21T05:53:16.637668+0000","last_became_active":"2024-09-21T05:50:53.892381+0000","last_became_peered":"2024-09-21T05:50:53.892381+0000","last_unstale":"2024-09-21T05:53:16.637668+0000","last_undegraded":"2024-09-21T05:53:16.637668+0000","last_fullsized":"2024-09-21T05:53:16.637668+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:20.038644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677796+0000","last_change":"2024-09-21T05:50:50.850077+0000","last_active":"2024-09-21T05:52:47.677796+0000","last_peered":"2024-09-21T05:52:47.677796+0000","last_clean":"2024-09-21T05:52:47.677796+0000","last_became_active":"2024-09-21T05:50:50.849553+0000","last_became_peered":"2024-09-21T05:50:50.849553+0000","last_unstale":"2024-09-21T05:52:47.677796+0000","last_undegraded":"2024-09-21T05:52:47.677796+0000","last_fullsized":"2024-09-21T05:52:47.677796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:09.764465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009537+0000","last_change":"2024-09-21T05:51:03.930231+0000","last_active":"2024-09-21T05:52:48.009537+0000","last_peered":"2024-09-21T05:52:48.009537+0000","last_clean":"2024-09-21T05:52:48.009537+0000","last_became_active":"2024-09-21T05:51:03.929907+0000","last_became_peered":"2024-09-21T05:51:03.929907+0000","last_unstale":"2024-09-21T05:52:48.009537+0000","last_undegraded":"2024-09-21T05:52:48.009537+0000","last_fullsized":"2024-09-21T05:52:48.009537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:18.829725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640149+0000","last_change":"2024-09-21T05:50:53.888988+0000","last_active":"2024-09-21T05:53:16.640149+0000","last_peered":"2024-09-21T05:53:16.640149+0000","last_clean":"2024-09-21T05:53:16.640149+0000","last_became_active":"2024-09-21T05:50:53.888599+0000","last_became_peered":"2024-09-21T05:50:53.888599+0000","last_unstale":"2024-09-21T05:53:16.640149+0000","last_undegraded":"2024-09-21T05:53:16.640149+0000","last_fullsized":"2024-09-21T05:53:16.640149+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:32.353201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":68,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677086+0000","last_change":"2024-09-21T05:51:47.383528+0000","last_active":"2024-09-21T05:52:47.677086+0000","last_peered":"2024-09-21T05:52:47.677086+0000","last_clean":"2024-09-21T05:52:47.677086+0000","last_became_active":"2024-09-21T05:51:47.376325+0000","last_became_peered":"2024-09-21T05:51:47.376325+0000","last_unstale":"2024-09-21T05:52:47.677086+0000","last_undegraded":"2024-09-21T05:52:47.677086+0000","last_fullsized":"2024-09-21T05:52:47.677086+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:47.659961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009829+0000","last_change":"2024-09-21T05:51:03.946581+0000","last_active":"2024-09-21T05:52:48.009829+0000","last_peered":"2024-09-21T05:52:48.009829+0000","last_clean":"2024-09-21T05:52:48.009829+0000","last_became_active":"2024-09-21T05:51:03.946170+0000","last_became_peered":"2024-09-21T05:51:03.946170+0000","last_unstale":"2024-09-21T05:52:48.009829+0000","last_undegraded":"2024-09-21T05:52:48.009829+0000","last_fullsized":"2024-09-21T05:52:48.009829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:59.302647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.622157+0000","last_change":"2024-09-21T05:50:53.890164+0000","last_active":"2024-09-21T05:53:16.622157+0000","last_peered":"2024-09-21T05:53:16.622157+0000","last_clean":"2024-09-21T05:53:16.622157+0000","last_became_active":"2024-09-21T05:50:53.889309+0000","last_became_peered":"2024-09-21T05:50:53.889309+0000","last_unstale":"2024-09-21T05:53:16.622157+0000","last_undegraded":"2024-09-21T05:53:16.622157+0000","last_fullsized":"2024-09-21T05:53:16.622157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:18.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699112+0000","last_change":"2024-09-21T05:50:50.844080+0000","last_active":"2024-09-21T05:52:47.699112+0000","last_peered":"2024-09-21T05:52:47.699112+0000","last_clean":"2024-09-21T05:52:47.699112+0000","last_became_active":"2024-09-21T05:50:50.842929+0000","last_became_peered":"2024-09-21T05:50:50.842929+0000","last_unstale":"2024-09-21T05:52:47.699112+0000","last_undegraded":"2024-09-21T05:52:47.699112+0000","last_fullsized":"2024-09-21T05:52:47.699112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:49.623189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010942+0000","last_change":"2024-09-21T05:51:03.939228+0000","last_active":"2024-09-21T05:52:48.010942+0000","last_peered":"2024-09-21T05:52:48.010942+0000","last_clean":"2024-09-21T05:52:48.010942+0000","last_became_active":"2024-09-21T05:51:03.937857+0000","last_became_peered":"2024-09-21T05:51:03.937857+0000","last_unstale":"2024-09-21T05:52:48.010942+0000","last_undegraded":"2024-09-21T05:52:48.010942+0000","last_fullsized":"2024-09-21T05:52:48.010942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:54.147008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.643581+0000","last_change":"2024-09-21T05:50:53.890755+0000","last_active":"2024-09-21T05:53:16.643581+0000","last_peered":"2024-09-21T05:53:16.643581+0000","last_clean":"2024-09-21T05:53:16.643581+0000","last_became_active":"2024-09-21T05:50:53.890286+0000","last_became_peered":"2024-09-21T05:50:53.890286+0000","last_unstale":"2024-09-21T05:53:16.643581+0000","last_undegraded":"2024-09-21T05:53:16.643581+0000","last_fullsized":"2024-09-21T05:53:16.643581+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:50.767355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010406+0000","last_change":"2024-09-21T05:50:50.852722+0000","last_active":"2024-09-21T05:52:48.010406+0000","last_peered":"2024-09-21T05:52:48.010406+0000","last_clean":"2024-09-21T05:52:48.010406+0000","last_became_active":"2024-09-21T05:50:50.852211+0000","last_became_peered":"2024-09-21T05:50:50.852211+0000","last_unstale":"2024-09-21T05:52:48.010406+0000","last_undegraded":"2024-09-21T05:52:48.010406+0000","last_fullsized":"2024-09-21T05:52:48.010406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:44.392153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.014263+0000","last_change":"2024-09-21T05:52:48.013503+0000","last_active":"2024-09-21T05:52:48.014263+0000","last_peered":"2024-09-21T05:52:48.014263+0000","last_clean":"2024-09-21T05:52:48.014263+0000","last_became_active":"2024-09-21T05:52:48.012908+0000","last_became_peered":"2024-09-21T05:52:48.012908+0000","last_unstale":"2024-09-21T05:52:48.014263+0000","last_undegraded":"2024-09-21T05:52:48.014263+0000","last_fullsized":"2024-09-21T05:52:48.014263+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:59.512334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641672+0000","last_change":"2024-09-21T05:50:53.903935+0000","last_active":"2024-09-21T05:53:16.641672+0000","last_peered":"2024-09-21T05:53:16.641672+0000","last_clean":"2024-09-21T05:53:16.641672+0000","last_became_active":"2024-09-21T05:50:53.903604+0000","last_became_peered":"2024-09-21T05:50:53.903604+0000","last_unstale":"2024-09-21T05:53:16.641672+0000","last_undegraded":"2024-09-21T05:53:16.641672+0000","last_fullsized":"2024-09-21T05:53:16.641672+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:49.552901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678699+0000","last_change":"2024-09-21T05:50:50.848254+0000","last_active":"2024-09-21T05:52:47.678699+0000","last_peered":"2024-09-21T05:52:47.678699+0000","last_clean":"2024-09-21T05:52:47.678699+0000","last_became_active":"2024-09-21T05:50:50.847834+0000","last_became_peered":"2024-09-21T05:50:50.847834+0000","last_unstale":"2024-09-21T05:52:47.678699+0000","last_undegraded":"2024-09-21T05:52:47.678699+0000","last_fullsized":"2024-09-21T05:52:47.678699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:36.579763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009610+0000","last_change":"2024-09-21T05:51:03.941732+0000","last_active":"2024-09-21T05:52:48.009610+0000","last_peered":"2024-09-21T05:52:48.009610+0000","last_clean":"2024-09-21T05:52:48.009610+0000","last_became_active":"2024-09-21T05:51:03.941144+0000","last_became_peered":"2024-09-21T05:51:03.941144+0000","last_unstale":"2024-09-21T05:52:48.009610+0000","last_undegraded":"2024-09-21T05:52:48.009610+0000","last_fullsized":"2024-09-21T05:52:48.009610+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:38.117642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.620240+0000","last_change":"2024-09-21T05:50:53.904574+0000","last_active":"2024-09-21T05:53:16.620240+0000","last_peered":"2024-09-21T05:53:16.620240+0000","last_clean":"2024-09-21T05:53:16.620240+0000","last_became_active":"2024-09-21T05:50:53.904215+0000","last_became_peered":"2024-09-21T05:50:53.904215+0000","last_unstale":"2024-09-21T05:53:16.620240+0000","last_undegraded":"2024-09-21T05:53:16.620240+0000","last_fullsized":"2024-09-21T05:53:16.620240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:49.662725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":312,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:35.652285+0000","last_change":"2024-09-21T05:50:50.850929+0000","last_active":"2024-09-21T05:53:35.652285+0000","last_peered":"2024-09-21T05:53:35.652285+0000","last_clean":"2024-09-21T05:53:35.652285+0000","last_became_active":"2024-09-21T05:50:50.850495+0000","last_became_peered":"2024-09-21T05:50:50.850495+0000","last_unstale":"2024-09-21T05:53:35.652285+0000","last_undegraded":"2024-09-21T05:53:35.652285+0000","last_fullsized":"2024-09-21T05:53:35.652285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:45.224063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69827,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":182,"num_write":38,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011525+0000","last_change":"2024-09-21T05:51:03.944010+0000","last_active":"2024-09-21T05:52:48.011525+0000","last_peered":"2024-09-21T05:52:48.011525+0000","last_clean":"2024-09-21T05:52:48.011525+0000","last_became_active":"2024-09-21T05:51:03.942942+0000","last_became_peered":"2024-09-21T05:51:03.942942+0000","last_unstale":"2024-09-21T05:52:48.011525+0000","last_undegraded":"2024-09-21T05:52:48.011525+0000","last_fullsized":"2024-09-21T05:52:48.011525+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:38.846493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.639338+0000","last_change":"2024-09-21T05:51:47.376326+0000","last_active":"2024-09-21T05:53:16.639338+0000","last_peered":"2024-09-21T05:53:16.639338+0000","last_clean":"2024-09-21T05:53:16.639338+0000","last_became_active":"2024-09-21T05:51:47.375993+0000","last_became_peered":"2024-09-21T05:51:47.375993+0000","last_unstale":"2024-09-21T05:53:16.639338+0000","last_undegraded":"2024-09-21T05:53:16.639338+0000","last_fullsized":"2024-09-21T05:53:16.639338+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:13.193571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010874+0000","last_change":"2024-09-21T05:50:51.162682+0000","last_active":"2024-09-21T05:52:48.010874+0000","last_peered":"2024-09-21T05:52:48.010874+0000","last_clean":"2024-09-21T05:52:48.010874+0000","last_became_active":"2024-09-21T05:50:51.162244+0000","last_became_peered":"2024-09-21T05:50:51.162244+0000","last_unstale":"2024-09-21T05:52:48.010874+0000","last_undegraded":"2024-09-21T05:52:48.010874+0000","last_fullsized":"2024-09-21T05:52:48.010874+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.595096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699172+0000","last_change":"2024-09-21T05:51:03.939666+0000","last_active":"2024-09-21T05:52:47.699172+0000","last_peered":"2024-09-21T05:52:47.699172+0000","last_clean":"2024-09-21T05:52:47.699172+0000","last_became_active":"2024-09-21T05:51:03.938311+0000","last_became_peered":"2024-09-21T05:51:03.938311+0000","last_unstale":"2024-09-21T05:52:47.699172+0000","last_undegraded":"2024-09-21T05:52:47.699172+0000","last_fullsized":"2024-09-21T05:52:47.699172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:31.407900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640807+0000","last_change":"2024-09-21T05:51:47.588416+0000","last_active":"2024-09-21T05:53:16.640807+0000","last_peered":"2024-09-21T05:53:16.640807+0000","last_clean":"2024-09-21T05:53:16.640807+0000","last_became_active":"2024-09-21T05:51:47.587905+0000","last_became_peered":"2024-09-21T05:51:47.587905+0000","last_unstale":"2024-09-21T05:53:16.640807+0000","last_undegraded":"2024-09-21T05:53:16.640807+0000","last_fullsized":"2024-09-21T05:53:16.640807+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:05.821048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681491+0000","last_change":"2024-09-21T05:50:50.846164+0000","last_active":"2024-09-21T05:52:47.681491+0000","last_peered":"2024-09-21T05:52:47.681491+0000","last_clean":"2024-09-21T05:52:47.681491+0000","last_became_active":"2024-09-21T05:50:50.845775+0000","last_became_peered":"2024-09-21T05:50:50.845775+0000","last_unstale":"2024-09-21T05:52:47.681491+0000","last_undegraded":"2024-09-21T05:52:47.681491+0000","last_fullsized":"2024-09-21T05:52:47.681491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:45.356626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.701383+0000","last_change":"2024-09-21T05:52:47.700832+0000","last_active":"2024-09-21T05:52:47.701383+0000","last_peered":"2024-09-21T05:52:47.701383+0000","last_clean":"2024-09-21T05:52:47.701383+0000","last_became_active":"2024-09-21T05:52:47.700372+0000","last_became_peered":"2024-09-21T05:52:47.700372+0000","last_unstale":"2024-09-21T05:52:47.701383+0000","last_undegraded":"2024-09-21T05:52:47.701383+0000","last_fullsized":"2024-09-21T05:52:47.701383+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.887433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.644971+0000","last_change":"2024-09-21T05:50:53.903005+0000","last_active":"2024-09-21T05:53:16.644971+0000","last_peered":"2024-09-21T05:53:16.644971+0000","last_clean":"2024-09-21T05:53:16.644971+0000","last_became_active":"2024-09-21T05:50:53.902590+0000","last_became_peered":"2024-09-21T05:50:53.902590+0000","last_unstale":"2024-09-21T05:53:16.644971+0000","last_undegraded":"2024-09-21T05:53:16.644971+0000","last_fullsized":"2024-09-21T05:53:16.644971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:46.602723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011645+0000","last_change":"2024-09-21T05:50:50.846682+0000","last_active":"2024-09-21T05:52:48.011645+0000","last_peered":"2024-09-21T05:52:48.011645+0000","last_clean":"2024-09-21T05:52:48.011645+0000","last_became_active":"2024-09-21T05:50:50.846305+0000","last_became_peered":"2024-09-21T05:50:50.846305+0000","last_unstale":"2024-09-21T05:52:48.011645+0000","last_undegraded":"2024-09-21T05:52:48.011645+0000","last_fullsized":"2024-09-21T05:52:48.011645+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:30.946247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.320808+0000","last_change":"2024-09-21T05:51:03.931781+0000","last_active":"2024-09-21T05:52:48.320808+0000","last_peered":"2024-09-21T05:52:48.320808+0000","last_clean":"2024-09-21T05:52:48.320808+0000","last_became_active":"2024-09-21T05:51:03.930921+0000","last_became_peered":"2024-09-21T05:51:03.930921+0000","last_unstale":"2024-09-21T05:52:48.320808+0000","last_undegraded":"2024-09-21T05:52:48.320808+0000","last_fullsized":"2024-09-21T05:52:48.320808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:03.284929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674758+0000","last_change":"2024-09-21T05:51:03.947521+0000","last_active":"2024-09-21T05:52:47.674758+0000","last_peered":"2024-09-21T05:52:47.674758+0000","last_clean":"2024-09-21T05:52:47.674758+0000","last_became_active":"2024-09-21T05:51:03.947074+0000","last_became_peered":"2024-09-21T05:51:03.947074+0000","last_unstale":"2024-09-21T05:52:47.674758+0000","last_undegraded":"2024-09-21T05:52:47.674758+0000","last_fullsized":"2024-09-21T05:52:47.674758+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:51.313988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640063+0000","last_change":"2024-09-21T05:50:53.911791+0000","last_active":"2024-09-21T05:53:16.640063+0000","last_peered":"2024-09-21T05:53:16.640063+0000","last_clean":"2024-09-21T05:53:16.640063+0000","last_became_active":"2024-09-21T05:50:53.911392+0000","last_became_peered":"2024-09-21T05:50:53.911392+0000","last_unstale":"2024-09-21T05:53:16.640063+0000","last_undegraded":"2024-09-21T05:53:16.640063+0000","last_fullsized":"2024-09-21T05:53:16.640063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:45.688626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010697+0000","last_change":"2024-09-21T05:50:50.853383+0000","last_active":"2024-09-21T05:52:48.010697+0000","last_peered":"2024-09-21T05:52:48.010697+0000","last_clean":"2024-09-21T05:52:48.010697+0000","last_became_active":"2024-09-21T05:50:50.853006+0000","last_became_peered":"2024-09-21T05:50:50.853006+0000","last_unstale":"2024-09-21T05:52:48.010697+0000","last_undegraded":"2024-09-21T05:52:48.010697+0000","last_fullsized":"2024-09-21T05:52:48.010697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:14.838953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682519+0000","last_change":"2024-09-21T05:51:03.945415+0000","last_active":"2024-09-21T05:52:47.682519+0000","last_peered":"2024-09-21T05:52:47.682519+0000","last_clean":"2024-09-21T05:52:47.682519+0000","last_became_active":"2024-09-21T05:51:03.945019+0000","last_became_peered":"2024-09-21T05:51:03.945019+0000","last_unstale":"2024-09-21T05:52:47.682519+0000","last_undegraded":"2024-09-21T05:52:47.682519+0000","last_fullsized":"2024-09-21T05:52:47.682519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:27.006823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.629274+0000","last_change":"2024-09-21T05:50:53.897515+0000","last_active":"2024-09-21T05:53:16.629274+0000","last_peered":"2024-09-21T05:53:16.629274+0000","last_clean":"2024-09-21T05:53:16.629274+0000","last_became_active":"2024-09-21T05:50:53.897070+0000","last_became_peered":"2024-09-21T05:50:53.897070+0000","last_unstale":"2024-09-21T05:53:16.629274+0000","last_undegraded":"2024-09-21T05:53:16.629274+0000","last_fullsized":"2024-09-21T05:53:16.629274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:16.971379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009930+0000","last_change":"2024-09-21T05:50:50.844937+0000","last_active":"2024-09-21T05:52:48.009930+0000","last_peered":"2024-09-21T05:52:48.009930+0000","last_clean":"2024-09-21T05:52:48.009930+0000","last_became_active":"2024-09-21T05:50:50.844048+0000","last_became_peered":"2024-09-21T05:50:50.844048+0000","last_unstale":"2024-09-21T05:52:48.009930+0000","last_undegraded":"2024-09-21T05:52:48.009930+0000","last_fullsized":"2024-09-21T05:52:48.009930+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:28.764620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010674+0000","last_change":"2024-09-21T05:51:47.587919+0000","last_active":"2024-09-21T05:52:48.010674+0000","last_peered":"2024-09-21T05:52:48.010674+0000","last_clean":"2024-09-21T05:52:48.010674+0000","last_became_active":"2024-09-21T05:51:47.587418+0000","last_became_peered":"2024-09-21T05:51:47.587418+0000","last_unstale":"2024-09-21T05:52:48.010674+0000","last_undegraded":"2024-09-21T05:52:48.010674+0000","last_fullsized":"2024-09-21T05:52:48.010674+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:29.800848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641399+0000","last_change":"2024-09-21T05:50:53.890761+0000","last_active":"2024-09-21T05:53:16.641399+0000","last_peered":"2024-09-21T05:53:16.641399+0000","last_clean":"2024-09-21T05:53:16.641399+0000","last_became_active":"2024-09-21T05:50:53.890394+0000","last_became_peered":"2024-09-21T05:50:53.890394+0000","last_unstale":"2024-09-21T05:53:16.641399+0000","last_undegraded":"2024-09-21T05:53:16.641399+0000","last_fullsized":"2024-09-21T05:53:16.641399+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.176920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.014611+0000","last_change":"2024-09-21T05:52:48.014051+0000","last_active":"2024-09-21T05:52:48.014611+0000","last_peered":"2024-09-21T05:52:48.014611+0000","last_clean":"2024-09-21T05:52:48.014611+0000","last_became_active":"2024-09-21T05:52:48.013422+0000","last_became_peered":"2024-09-21T05:52:48.013422+0000","last_unstale":"2024-09-21T05:52:48.014611+0000","last_undegraded":"2024-09-21T05:52:48.014611+0000","last_fullsized":"2024-09-21T05:52:48.014611+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:18.380310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,10],"acting":[2,6,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010663+0000","last_change":"2024-09-21T05:50:50.852630+0000","last_active":"2024-09-21T05:52:48.010663+0000","last_peered":"2024-09-21T05:52:48.010663+0000","last_clean":"2024-09-21T05:52:48.010663+0000","last_became_active":"2024-09-21T05:50:50.852255+0000","last_became_peered":"2024-09-21T05:50:50.852255+0000","last_unstale":"2024-09-21T05:52:48.010663+0000","last_undegraded":"2024-09-21T05:52:48.010663+0000","last_fullsized":"2024-09-21T05:52:48.010663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:18.094082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.630538+0000","last_change":"2024-09-21T05:50:53.902303+0000","last_active":"2024-09-21T05:53:16.630538+0000","last_peered":"2024-09-21T05:53:16.630538+0000","last_clean":"2024-09-21T05:53:16.630538+0000","last_became_active":"2024-09-21T05:50:53.901910+0000","last_became_peered":"2024-09-21T05:50:53.901910+0000","last_unstale":"2024-09-21T05:53:16.630538+0000","last_undegraded":"2024-09-21T05:53:16.630538+0000","last_fullsized":"2024-09-21T05:53:16.630538+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:06.651235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678995+0000","last_change":"2024-09-21T05:51:03.932268+0000","last_active":"2024-09-21T05:52:47.678995+0000","last_peered":"2024-09-21T05:52:47.678995+0000","last_clean":"2024-09-21T05:52:47.678995+0000","last_became_active":"2024-09-21T05:51:03.931849+0000","last_became_peered":"2024-09-21T05:51:03.931849+0000","last_unstale":"2024-09-21T05:52:47.678995+0000","last_undegraded":"2024-09-21T05:52:47.678995+0000","last_fullsized":"2024-09-21T05:52:47.678995+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:53.622621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.631866+0000","last_change":"2024-09-21T05:50:53.897205+0000","last_active":"2024-09-21T05:53:16.631866+0000","last_peered":"2024-09-21T05:53:16.631866+0000","last_clean":"2024-09-21T05:53:16.631866+0000","last_became_active":"2024-09-21T05:50:53.896811+0000","last_became_peered":"2024-09-21T05:50:53.896811+0000","last_unstale":"2024-09-21T05:53:16.631866+0000","last_undegraded":"2024-09-21T05:53:16.631866+0000","last_fullsized":"2024-09-21T05:53:16.631866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:13.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.625137+0000","last_change":"2024-09-21T05:51:47.376606+0000","last_active":"2024-09-21T05:53:16.625137+0000","last_peered":"2024-09-21T05:53:16.625137+0000","last_clean":"2024-09-21T05:53:16.625137+0000","last_became_active":"2024-09-21T05:51:47.376203+0000","last_became_peered":"2024-09-21T05:51:47.376203+0000","last_unstale":"2024-09-21T05:53:16.625137+0000","last_undegraded":"2024-09-21T05:53:16.625137+0000","last_fullsized":"2024-09-21T05:53:16.625137+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:34.698021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.632441+0000","last_change":"2024-09-21T05:50:53.910991+0000","last_active":"2024-09-21T05:53:16.632441+0000","last_peered":"2024-09-21T05:53:16.632441+0000","last_clean":"2024-09-21T05:53:16.632441+0000","last_became_active":"2024-09-21T05:50:53.910720+0000","last_became_peered":"2024-09-21T05:50:53.910720+0000","last_unstale":"2024-09-21T05:53:16.632441+0000","last_undegraded":"2024-09-21T05:53:16.632441+0000","last_fullsized":"2024-09-21T05:53:16.632441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.653746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.634552+0000","last_change":"2024-09-21T05:50:53.894065+0000","last_active":"2024-09-21T05:53:16.634552+0000","last_peered":"2024-09-21T05:53:16.634552+0000","last_clean":"2024-09-21T05:53:16.634552+0000","last_became_active":"2024-09-21T05:50:53.892630+0000","last_became_peered":"2024-09-21T05:50:53.892630+0000","last_unstale":"2024-09-21T05:53:16.634552+0000","last_undegraded":"2024-09-21T05:53:16.634552+0000","last_fullsized":"2024-09-21T05:53:16.634552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:09.025667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.636013+0000","last_change":"2024-09-21T05:50:53.899586+0000","last_active":"2024-09-21T05:53:16.636013+0000","last_peered":"2024-09-21T05:53:16.636013+0000","last_clean":"2024-09-21T05:53:16.636013+0000","last_became_active":"2024-09-21T05:50:53.899066+0000","last_became_peered":"2024-09-21T05:50:53.899066+0000","last_unstale":"2024-09-21T05:53:16.636013+0000","last_undegraded":"2024-09-21T05:53:16.636013+0000","last_fullsized":"2024-09-21T05:53:16.636013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:07.678164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.622595+0000","last_change":"2024-09-21T05:51:47.375063+0000","last_active":"2024-09-21T05:53:16.622595+0000","last_peered":"2024-09-21T05:53:16.622595+0000","last_clean":"2024-09-21T05:53:16.622595+0000","last_became_active":"2024-09-21T05:51:47.374645+0000","last_became_peered":"2024-09-21T05:51:47.374645+0000","last_unstale":"2024-09-21T05:53:16.622595+0000","last_undegraded":"2024-09-21T05:53:16.622595+0000","last_fullsized":"2024-09-21T05:53:16.622595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:29.572438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.625339+0000","last_change":"2024-09-21T05:50:53.901688+0000","last_active":"2024-09-21T05:53:16.625339+0000","last_peered":"2024-09-21T05:53:16.625339+0000","last_clean":"2024-09-21T05:53:16.625339+0000","last_became_active":"2024-09-21T05:50:53.901245+0000","last_became_peered":"2024-09-21T05:50:53.901245+0000","last_unstale":"2024-09-21T05:53:16.625339+0000","last_undegraded":"2024-09-21T05:53:16.625339+0000","last_fullsized":"2024-09-21T05:53:16.625339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:41.401357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.623074+0000","last_change":"2024-09-21T05:50:53.908954+0000","last_active":"2024-09-21T05:53:16.623074+0000","last_peered":"2024-09-21T05:53:16.623074+0000","last_clean":"2024-09-21T05:53:16.623074+0000","last_became_active":"2024-09-21T05:50:53.897605+0000","last_became_peered":"2024-09-21T05:50:53.897605+0000","last_unstale":"2024-09-21T05:53:16.623074+0000","last_undegraded":"2024-09-21T05:53:16.623074+0000","last_fullsized":"2024-09-21T05:53:16.623074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:15.634597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.636800+0000","last_change":"2024-09-21T05:50:53.900106+0000","last_active":"2024-09-21T05:53:16.636800+0000","last_peered":"2024-09-21T05:53:16.636800+0000","last_clean":"2024-09-21T05:53:16.636800+0000","last_became_active":"2024-09-21T05:50:53.899697+0000","last_became_peered":"2024-09-21T05:50:53.899697+0000","last_unstale":"2024-09-21T05:53:16.636800+0000","last_undegraded":"2024-09-21T05:53:16.636800+0000","last_fullsized":"2024-09-21T05:53:16.636800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.599501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.621162+0000","last_change":"2024-09-21T05:50:53.899644+0000","last_active":"2024-09-21T05:53:16.621162+0000","last_peered":"2024-09-21T05:53:16.621162+0000","last_clean":"2024-09-21T05:53:16.621162+0000","last_became_active":"2024-09-21T05:50:53.899246+0000","last_became_peered":"2024-09-21T05:50:53.899246+0000","last_unstale":"2024-09-21T05:53:16.621162+0000","last_undegraded":"2024-09-21T05:53:16.621162+0000","last_fullsized":"2024-09-21T05:53:16.621162+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:34.551489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.643578+0000","last_change":"2024-09-21T05:50:53.904328+0000","last_active":"2024-09-21T05:53:16.643578+0000","last_peered":"2024-09-21T05:53:16.643578+0000","last_clean":"2024-09-21T05:53:16.643578+0000","last_became_active":"2024-09-21T05:50:53.903887+0000","last_became_peered":"2024-09-21T05:50:53.903887+0000","last_unstale":"2024-09-21T05:53:16.643578+0000","last_undegraded":"2024-09-21T05:53:16.643578+0000","last_fullsized":"2024-09-21T05:53:16.643578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:27.659631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641985+0000","last_change":"2024-09-21T05:50:53.905278+0000","last_active":"2024-09-21T05:53:16.641985+0000","last_peered":"2024-09-21T05:53:16.641985+0000","last_clean":"2024-09-21T05:53:16.641985+0000","last_became_active":"2024-09-21T05:50:53.904633+0000","last_became_peered":"2024-09-21T05:50:53.904633+0000","last_unstale":"2024-09-21T05:53:16.641985+0000","last_undegraded":"2024-09-21T05:53:16.641985+0000","last_fullsized":"2024-09-21T05:53:16.641985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:26.802336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.642195+0000","last_change":"2024-09-21T05:50:53.891621+0000","last_active":"2024-09-21T05:53:16.642195+0000","last_peered":"2024-09-21T05:53:16.642195+0000","last_clean":"2024-09-21T05:53:16.642195+0000","last_became_active":"2024-09-21T05:50:53.891246+0000","last_became_peered":"2024-09-21T05:50:53.891246+0000","last_unstale":"2024-09-21T05:53:16.642195+0000","last_undegraded":"2024-09-21T05:53:16.642195+0000","last_fullsized":"2024-09-21T05:53:16.642195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:21.419789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.626978+0000","last_change":"2024-09-21T05:50:53.902964+0000","last_active":"2024-09-21T05:53:16.626978+0000","last_peered":"2024-09-21T05:53:16.626978+0000","last_clean":"2024-09-21T05:53:16.626978+0000","last_became_active":"2024-09-21T05:50:53.902574+0000","last_became_peered":"2024-09-21T05:50:53.902574+0000","last_unstale":"2024-09-21T05:53:16.626978+0000","last_undegraded":"2024-09-21T05:53:16.626978+0000","last_fullsized":"2024-09-21T05:53:16.626978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:35.552787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.639981+0000","last_change":"2024-09-21T05:50:53.904717+0000","last_active":"2024-09-21T05:53:16.639981+0000","last_peered":"2024-09-21T05:53:16.639981+0000","last_clean":"2024-09-21T05:53:16.639981+0000","last_became_active":"2024-09-21T05:50:53.903152+0000","last_became_peered":"2024-09-21T05:50:53.903152+0000","last_unstale":"2024-09-21T05:53:16.639981+0000","last_undegraded":"2024-09-21T05:53:16.639981+0000","last_fullsized":"2024-09-21T05:53:16.639981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:56.808689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645213+0000","last_change":"2024-09-21T05:50:53.906336+0000","last_active":"2024-09-21T05:53:16.645213+0000","last_peered":"2024-09-21T05:53:16.645213+0000","last_clean":"2024-09-21T05:53:16.645213+0000","last_became_active":"2024-09-21T05:50:53.905942+0000","last_became_peered":"2024-09-21T05:50:53.905942+0000","last_unstale":"2024-09-21T05:53:16.645213+0000","last_undegraded":"2024-09-21T05:53:16.645213+0000","last_fullsized":"2024-09-21T05:53:16.645213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:26.824967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.646758+0000","last_change":"2024-09-21T05:50:53.910772+0000","last_active":"2024-09-21T05:53:16.646758+0000","last_peered":"2024-09-21T05:53:16.646758+0000","last_clean":"2024-09-21T05:53:16.646758+0000","last_became_active":"2024-09-21T05:50:53.910394+0000","last_became_peered":"2024-09-21T05:50:53.910394+0000","last_unstale":"2024-09-21T05:53:16.646758+0000","last_undegraded":"2024-09-21T05:53:16.646758+0000","last_fullsized":"2024-09-21T05:53:16.646758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:00.338916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.635467+0000","last_change":"2024-09-21T05:50:53.906454+0000","last_active":"2024-09-21T05:53:16.635467+0000","last_peered":"2024-09-21T05:53:16.635467+0000","last_clean":"2024-09-21T05:53:16.635467+0000","last_became_active":"2024-09-21T05:50:53.905947+0000","last_became_peered":"2024-09-21T05:50:53.905947+0000","last_unstale":"2024-09-21T05:53:16.635467+0000","last_undegraded":"2024-09-21T05:53:16.635467+0000","last_fullsized":"2024-09-21T05:53:16.635467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:57.358615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.632851+0000","last_change":"2024-09-21T05:50:53.903690+0000","last_active":"2024-09-21T05:53:16.632851+0000","last_peered":"2024-09-21T05:53:16.632851+0000","last_clean":"2024-09-21T05:53:16.632851+0000","last_became_active":"2024-09-21T05:50:53.900672+0000","last_became_peered":"2024-09-21T05:50:53.900672+0000","last_unstale":"2024-09-21T05:53:16.632851+0000","last_undegraded":"2024-09-21T05:53:16.632851+0000","last_fullsized":"2024-09-21T05:53:16.632851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:42.005312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637208+0000","last_change":"2024-09-21T05:50:53.888711+0000","last_active":"2024-09-21T05:53:16.637208+0000","last_peered":"2024-09-21T05:53:16.637208+0000","last_clean":"2024-09-21T05:53:16.637208+0000","last_became_active":"2024-09-21T05:50:53.888302+0000","last_became_peered":"2024-09-21T05:50:53.888302+0000","last_unstale":"2024-09-21T05:53:16.637208+0000","last_undegraded":"2024-09-21T05:53:16.637208+0000","last_fullsized":"2024-09-21T05:53:16.637208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:25.766696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637942+0000","last_change":"2024-09-21T05:50:53.898848+0000","last_active":"2024-09-21T05:53:16.637942+0000","last_peered":"2024-09-21T05:53:16.637942+0000","last_clean":"2024-09-21T05:53:16.637942+0000","last_became_active":"2024-09-21T05:50:53.897785+0000","last_became_peered":"2024-09-21T05:50:53.897785+0000","last_unstale":"2024-09-21T05:53:16.637942+0000","last_undegraded":"2024-09-21T05:53:16.637942+0000","last_fullsized":"2024-09-21T05:53:16.637942+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:25.099224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.646192+0000","last_change":"2024-09-21T05:50:53.899051+0000","last_active":"2024-09-21T05:53:16.646192+0000","last_peered":"2024-09-21T05:53:16.646192+0000","last_clean":"2024-09-21T05:53:16.646192+0000","last_became_active":"2024-09-21T05:50:53.898381+0000","last_became_peered":"2024-09-21T05:50:53.898381+0000","last_unstale":"2024-09-21T05:53:16.646192+0000","last_undegraded":"2024-09-21T05:53:16.646192+0000","last_fullsized":"2024-09-21T05:53:16.646192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:05.958547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.639314+0000","last_change":"2024-09-21T05:50:53.896079+0000","last_active":"2024-09-21T05:53:16.639314+0000","last_peered":"2024-09-21T05:53:16.639314+0000","last_clean":"2024-09-21T05:53:16.639314+0000","last_became_active":"2024-09-21T05:50:53.895659+0000","last_became_peered":"2024-09-21T05:50:53.895659+0000","last_unstale":"2024-09-21T05:53:16.639314+0000","last_undegraded":"2024-09-21T05:53:16.639314+0000","last_fullsized":"2024-09-21T05:53:16.639314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:50.151899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637936+0000","last_change":"2024-09-21T05:50:53.894899+0000","last_active":"2024-09-21T05:53:16.637936+0000","last_peered":"2024-09-21T05:53:16.637936+0000","last_clean":"2024-09-21T05:53:16.637936+0000","last_became_active":"2024-09-21T05:50:53.894530+0000","last_became_peered":"2024-09-21T05:50:53.894530+0000","last_unstale":"2024-09-21T05:53:16.637936+0000","last_undegraded":"2024-09-21T05:53:16.637936+0000","last_fullsized":"2024-09-21T05:53:16.637936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:15.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637061+0000","last_change":"2024-09-21T05:51:47.376927+0000","last_active":"2024-09-21T05:53:16.637061+0000","last_peered":"2024-09-21T05:53:16.637061+0000","last_clean":"2024-09-21T05:53:16.637061+0000","last_became_active":"2024-09-21T05:51:47.376534+0000","last_became_peered":"2024-09-21T05:51:47.376534+0000","last_unstale":"2024-09-21T05:53:16.637061+0000","last_undegraded":"2024-09-21T05:53:16.637061+0000","last_fullsized":"2024-09-21T05:53:16.637061+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:26.353085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641137+0000","last_change":"2024-09-21T05:50:53.903196+0000","last_active":"2024-09-21T05:53:16.641137+0000","last_peered":"2024-09-21T05:53:16.641137+0000","last_clean":"2024-09-21T05:53:16.641137+0000","last_became_active":"2024-09-21T05:50:53.902825+0000","last_became_peered":"2024-09-21T05:50:53.902825+0000","last_unstale":"2024-09-21T05:53:16.641137+0000","last_undegraded":"2024-09-21T05:53:16.641137+0000","last_fullsized":"2024-09-21T05:53:16.641137+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:13.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.636471+0000","last_change":"2024-09-21T05:50:53.902249+0000","last_active":"2024-09-21T05:53:16.636471+0000","last_peered":"2024-09-21T05:53:16.636471+0000","last_clean":"2024-09-21T05:53:16.636471+0000","last_became_active":"2024-09-21T05:50:53.901828+0000","last_became_peered":"2024-09-21T05:50:53.901828+0000","last_unstale":"2024-09-21T05:53:16.636471+0000","last_undegraded":"2024-09-21T05:53:16.636471+0000","last_fullsized":"2024-09-21T05:53:16.636471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:51.200179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.626871+0000","last_change":"2024-09-21T05:50:53.897170+0000","last_active":"2024-09-21T05:53:16.626871+0000","last_peered":"2024-09-21T05:53:16.626871+0000","last_clean":"2024-09-21T05:53:16.626871+0000","last_became_active":"2024-09-21T05:50:53.895337+0000","last_became_peered":"2024-09-21T05:50:53.895337+0000","last_unstale":"2024-09-21T05:53:16.626871+0000","last_undegraded":"2024-09-21T05:53:16.626871+0000","last_fullsized":"2024-09-21T05:53:16.626871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:19.869698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.629432+0000","last_change":"2024-09-21T05:50:53.899575+0000","last_active":"2024-09-21T05:53:16.629432+0000","last_peered":"2024-09-21T05:53:16.629432+0000","last_clean":"2024-09-21T05:53:16.629432+0000","last_became_active":"2024-09-21T05:50:53.898274+0000","last_became_peered":"2024-09-21T05:50:53.898274+0000","last_unstale":"2024-09-21T05:53:16.629432+0000","last_undegraded":"2024-09-21T05:53:16.629432+0000","last_fullsized":"2024-09-21T05:53:16.629432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:28.188691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.647411+0000","last_change":"2024-09-21T05:50:53.908381+0000","last_active":"2024-09-21T05:53:16.647411+0000","last_peered":"2024-09-21T05:53:16.647411+0000","last_clean":"2024-09-21T05:53:16.647411+0000","last_became_active":"2024-09-21T05:50:53.906731+0000","last_became_peered":"2024-09-21T05:50:53.906731+0000","last_unstale":"2024-09-21T05:53:16.647411+0000","last_undegraded":"2024-09-21T05:53:16.647411+0000","last_fullsized":"2024-09-21T05:53:16.647411+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:59.254561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.631582+0000","last_change":"2024-09-21T05:50:53.904619+0000","last_active":"2024-09-21T05:53:16.631582+0000","last_peered":"2024-09-21T05:53:16.631582+0000","last_clean":"2024-09-21T05:53:16.631582+0000","last_became_active":"2024-09-21T05:50:53.903901+0000","last_became_peered":"2024-09-21T05:50:53.903901+0000","last_unstale":"2024-09-21T05:53:16.631582+0000","last_undegraded":"2024-09-21T05:53:16.631582+0000","last_fullsized":"2024-09-21T05:53:16.631582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:25.531973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645006+0000","last_change":"2024-09-21T05:50:53.903557+0000","last_active":"2024-09-21T05:53:16.645006+0000","last_peered":"2024-09-21T05:53:16.645006+0000","last_clean":"2024-09-21T05:53:16.645006+0000","last_became_active":"2024-09-21T05:50:53.903195+0000","last_became_peered":"2024-09-21T05:50:53.903195+0000","last_unstale":"2024-09-21T05:53:16.645006+0000","last_undegraded":"2024-09-21T05:53:16.645006+0000","last_fullsized":"2024-09-21T05:53:16.645006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:32.268063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70625,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":234,"num_read_kb":188,"num_write":98,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":211875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678063,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":521686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874292,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28700,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716452,"statfs":{"total":95995035648,"available":95965646848,"internally_reserved":0,"allocated":1716224,"data_stored":1177668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037819,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":526364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234048,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":522290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430276,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32784,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712368,"statfs":{"total":95995035648,"available":95961464832,"internally_reserved":0,"allocated":1638400,"data_stored":1116732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626506,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":517590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822737,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36948,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708204,"statfs":{"total":95995035648,"available":95957200896,"internally_reserved":0,"allocated":1642496,"data_stored":1112236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018965,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":521708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215194,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1040384,"data_stored":517694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444129,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1114112,"data_stored":587451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1110016,"data_stored":587417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738476,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":517680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:53:40.444 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T05:53:40.444 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:53:40.826 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:41.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:40 smithi144 ceph-mon[34351]: from='client.25274 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:41.133 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:40 smithi037 ceph-mon[30631]: from='client.25274 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:41.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:40 smithi067 ceph-mon[34443]: from='client.25274 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.466+0000 7fb629800640 1 -- 172.21.15.37:0/1793215568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb624103990 msgr2=0x7fb624103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.466+0000 7fb629800640 1 --2- 172.21.15.37:0/1793215568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb624103990 0x7fb624103da0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb614009860 tx=0x7fb61402a340 comp rx=0 tx=0).stop 2024-09-21T05:53:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.466+0000 7fb629800640 1 -- 172.21.15.37:0/1793215568 shutdown_connections 2024-09-21T05:53:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.466+0000 7fb629800640 1 --2- 172.21.15.37:0/1793215568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb624109c20 0x7fb624110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.466+0000 7fb629800640 1 --2- 172.21.15.37:0/1793215568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6241092d0 0x7fb6241096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.466+0000 7fb629800640 1 --2- 172.21.15.37:0/1793215568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb624103990 0x7fb624103da0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.466+0000 7fb629800640 1 -- 172.21.15.37:0/1793215568 >> 172.21.15.37:0/1793215568 conn(0x7fb6240ff3e0 msgr2=0x7fb624101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:41.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.466+0000 7fb629800640 1 -- 172.21.15.37:0/1793215568 shutdown_connections 2024-09-21T05:53:41.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.467+0000 7fb629800640 1 -- 172.21.15.37:0/1793215568 wait complete. 2024-09-21T05:53:41.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.468+0000 7fb629800640 1 Processor -- start 2024-09-21T05:53:41.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.468+0000 7fb629800640 1 -- start start 2024-09-21T05:53:41.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.469+0000 7fb629800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb624103990 0x7fb62419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:41.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.469+0000 7fb629800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6241092d0 0x7fb62419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:41.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.469+0000 7fb629800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb624109c20 0x7fb62419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:41.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.469+0000 7fb629800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb6241138e0 con 0x7fb624103990 2024-09-21T05:53:41.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.469+0000 7fb629800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb624113760 con 0x7fb6241092d0 2024-09-21T05:53:41.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.469+0000 7fb629800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb624113a60 con 0x7fb624109c20 2024-09-21T05:53:41.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.469+0000 7fb623e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb624103990 0x7fb62419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:41.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.469+0000 7fb623400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6241092d0 0x7fb62419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:41.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.469+0000 7fb623e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb624103990 0x7fb62419a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34850/0 (socket says 172.21.15.37:34850) 2024-09-21T05:53:41.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.469+0000 7fb623e00640 1 -- 172.21.15.37:0/1052605403 learned_addr learned my addr 172.21.15.37:0/1052605403 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:41.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.469+0000 7fb628e00640 1 --2- 172.21.15.37:0/1052605403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb624109c20 0x7fb62419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:41.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.470+0000 7fb623400640 1 -- 172.21.15.37:0/1052605403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb624109c20 msgr2=0x7fb62419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:41.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.470+0000 7fb623400640 1 --2- 172.21.15.37:0/1052605403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb624109c20 0x7fb62419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.470+0000 7fb623400640 1 -- 172.21.15.37:0/1052605403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb624103990 msgr2=0x7fb62419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:41.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.470+0000 7fb623400640 1 --2- 172.21.15.37:0/1052605403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb624103990 0x7fb62419a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.470+0000 7fb623400640 1 -- 172.21.15.37:0/1052605403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6241a0280 con 0x7fb6241092d0 2024-09-21T05:53:41.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.470+0000 7fb623400640 1 --2- 172.21.15.37:0/1052605403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6241092d0 0x7fb62419a8b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb62406c810 tx=0x7fb61000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:41.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.470+0000 7fb620c00640 1 -- 172.21.15.37:0/1052605403 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61000cc40 con 0x7fb6241092d0 2024-09-21T05:53:41.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.470+0000 7fb629800640 1 -- 172.21.15.37:0/1052605403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6241a0570 con 0x7fb6241092d0 2024-09-21T05:53:41.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.470+0000 7fb620c00640 1 -- 172.21.15.37:0/1052605403 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb61000cde0 con 0x7fb6241092d0 2024-09-21T05:53:41.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.470+0000 7fb620c00640 1 -- 172.21.15.37:0/1052605403 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610018760 con 0x7fb6241092d0 2024-09-21T05:53:41.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.471+0000 7fb629800640 1 -- 172.21.15.37:0/1052605403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6241a6cd0 con 0x7fb6241092d0 2024-09-21T05:53:41.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.472+0000 7fb629800640 1 -- 172.21.15.37:0/1052605403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb624103da0 con 0x7fb6241092d0 2024-09-21T05:53:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.475+0000 7fb620c00640 1 -- 172.21.15.37:0/1052605403 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fb610010a90 con 0x7fb6241092d0 2024-09-21T05:53:41.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.476+0000 7fb620c00640 1 --2- 172.21.15.37:0/1052605403 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb6080b6590 0x7fb6080b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:41.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.477+0000 7fb620c00640 1 -- 172.21.15.37:0/1052605403 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fb6100e7df0 con 0x7fb6241092d0 2024-09-21T05:53:41.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.477+0000 7fb623e00640 1 --2- 172.21.15.37:0/1052605403 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb6080b6590 0x7fb6080b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:41.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.477+0000 7fb623e00640 1 --2- 172.21.15.37:0/1052605403 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb6080b6590 0x7fb6080b8aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb6140095f0 tx=0x7fb614030340 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:41.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.477+0000 7fb620c00640 1 -- 172.21.15.37:0/1052605403 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6100b2630 con 0x7fb6241092d0 2024-09-21T05:53:41.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.675+0000 7fb629800640 1 -- 172.21.15.37:0/1052605403 --> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb624063800 con 0x7fb6080b6590 2024-09-21T05:53:41.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.681+0000 7fb620c00640 1 -- 172.21.15.37:0/1052605403 <== mgr.14154 v2:172.21.15.37:6800/3016662141 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340392 (secure 0 0 0) 0x7fb624063800 con 0x7fb6080b6590 2024-09-21T05:53:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:41.689 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T05:53:41.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.686+0000 7fb629800640 1 -- 172.21.15.37:0/1052605403 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb6080b6590 msgr2=0x7fb6080b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:41.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.686+0000 7fb629800640 1 --2- 172.21.15.37:0/1052605403 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb6080b6590 0x7fb6080b8aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb6140095f0 tx=0x7fb614030340 comp rx=0 tx=0).stop 2024-09-21T05:53:41.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.686+0000 7fb629800640 1 -- 172.21.15.37:0/1052605403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6241092d0 msgr2=0x7fb62419a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:41.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.686+0000 7fb629800640 1 --2- 172.21.15.37:0/1052605403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6241092d0 0x7fb62419a8b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb62406c810 tx=0x7fb61000ee50 comp rx=0 tx=0).stop 2024-09-21T05:53:41.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.686+0000 7fb629800640 1 -- 172.21.15.37:0/1052605403 shutdown_connections 2024-09-21T05:53:41.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.686+0000 7fb629800640 1 --2- 172.21.15.37:0/1052605403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb624109c20 0x7fb62419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.686+0000 7fb629800640 1 --2- 172.21.15.37:0/1052605403 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fb6080b6590 0x7fb6080b8aa0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.686+0000 7fb629800640 1 --2- 172.21.15.37:0/1052605403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6241092d0 0x7fb62419a8b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.686+0000 7fb629800640 1 --2- 172.21.15.37:0/1052605403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb624103990 0x7fb62419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:41.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.686+0000 7fb629800640 1 -- 172.21.15.37:0/1052605403 >> 172.21.15.37:0/1052605403 conn(0x7fb6240ff3e0 msgr2=0x7fb624101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:41.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.687+0000 7fb629800640 1 -- 172.21.15.37:0/1052605403 shutdown_connections 2024-09-21T05:53:41.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:41.687+0000 7fb629800640 1 -- 172.21.15.37:0/1052605403 wait complete. 2024-09-21T05:53:42.099 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:41 smithi037 ceph-mon[30631]: pgmap v407: 129 pgs: 129 active+clean; 646 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T05:53:42.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:41 smithi144 ceph-mon[34351]: pgmap v407: 129 pgs: 129 active+clean; 646 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T05:53:42.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:41 smithi067 ceph-mon[34443]: pgmap v407: 129 pgs: 129 active+clean; 646 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T05:53:42.466 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":407,"stamp":"2024-09-21T05:53:40.273586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661227,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":310,"num_read_kb":252,"num_write":223,"num_write_kb":2258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":675,"ondisk_log_size":675,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384204,"kb_used_data":14156,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557620,"statfs":{"total":1151940427776,"available":1151547002880,"internally_reserved":0,"allocated":14495744,"data_stored":8226516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":311,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003580"},"pg_stats":[{"pgid":"2.1f","version":"79'4","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012748+0000","last_change":"2024-09-21T05:50:50.846365+0000","last_active":"2024-09-21T05:52:48.012748+0000","last_peered":"2024-09-21T05:52:48.012748+0000","last_clean":"2024-09-21T05:52:48.012748+0000","last_became_active":"2024-09-21T05:50:50.845924+0000","last_became_peered":"2024-09-21T05:50:50.845924+0000","last_unstale":"2024-09-21T05:52:48.012748+0000","last_undegraded":"2024-09-21T05:52:48.012748+0000","last_fullsized":"2024-09-21T05:52:48.012748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:39.056271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.628415+0000","last_change":"2024-09-21T05:51:47.377003+0000","last_active":"2024-09-21T05:53:16.628415+0000","last_peered":"2024-09-21T05:53:16.628415+0000","last_clean":"2024-09-21T05:53:16.628415+0000","last_became_active":"2024-09-21T05:51:47.376624+0000","last_became_peered":"2024-09-21T05:51:47.376624+0000","last_unstale":"2024-09-21T05:53:16.628415+0000","last_undegraded":"2024-09-21T05:53:16.628415+0000","last_fullsized":"2024-09-21T05:53:16.628415+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:20.569002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678029+0000","last_change":"2024-09-21T05:51:03.940107+0000","last_active":"2024-09-21T05:52:47.678029+0000","last_peered":"2024-09-21T05:52:47.678029+0000","last_clean":"2024-09-21T05:52:47.678029+0000","last_became_active":"2024-09-21T05:51:03.939723+0000","last_became_peered":"2024-09-21T05:51:03.939723+0000","last_unstale":"2024-09-21T05:52:47.678029+0000","last_undegraded":"2024-09-21T05:52:47.678029+0000","last_fullsized":"2024-09-21T05:52:47.678029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:15.116461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"79'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321731+0000","last_change":"2024-09-21T05:50:51.162120+0000","last_active":"2024-09-21T05:52:48.321731+0000","last_peered":"2024-09-21T05:52:48.321731+0000","last_clean":"2024-09-21T05:52:48.321731+0000","last_became_active":"2024-09-21T05:50:51.161679+0000","last_became_peered":"2024-09-21T05:50:51.161679+0000","last_unstale":"2024-09-21T05:52:48.321731+0000","last_undegraded":"2024-09-21T05:52:48.321731+0000","last_fullsized":"2024-09-21T05:52:48.321731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:10.028536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.647305+0000","last_change":"2024-09-21T05:50:53.907800+0000","last_active":"2024-09-21T05:53:16.647305+0000","last_peered":"2024-09-21T05:53:16.647305+0000","last_clean":"2024-09-21T05:53:16.647305+0000","last_became_active":"2024-09-21T05:50:53.906695+0000","last_became_peered":"2024-09-21T05:50:53.906695+0000","last_unstale":"2024-09-21T05:53:16.647305+0000","last_undegraded":"2024-09-21T05:53:16.647305+0000","last_fullsized":"2024-09-21T05:53:16.647305+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:45.999010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699064+0000","last_change":"2024-09-21T05:51:03.947020+0000","last_active":"2024-09-21T05:52:47.699064+0000","last_peered":"2024-09-21T05:52:47.699064+0000","last_clean":"2024-09-21T05:52:47.699064+0000","last_became_active":"2024-09-21T05:51:03.946387+0000","last_became_peered":"2024-09-21T05:51:03.946387+0000","last_unstale":"2024-09-21T05:52:47.699064+0000","last_undegraded":"2024-09-21T05:52:47.699064+0000","last_fullsized":"2024-09-21T05:52:47.699064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:02.073199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677355+0000","last_change":"2024-09-21T05:50:50.850606+0000","last_active":"2024-09-21T05:52:47.677355+0000","last_peered":"2024-09-21T05:52:47.677355+0000","last_clean":"2024-09-21T05:52:47.677355+0000","last_became_active":"2024-09-21T05:50:50.850244+0000","last_became_peered":"2024-09-21T05:50:50.850244+0000","last_unstale":"2024-09-21T05:52:47.677355+0000","last_undegraded":"2024-09-21T05:52:47.677355+0000","last_fullsized":"2024-09-21T05:52:47.677355+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:39.437099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645012+0000","last_change":"2024-09-21T05:50:53.897805+0000","last_active":"2024-09-21T05:53:16.645012+0000","last_peered":"2024-09-21T05:53:16.645012+0000","last_clean":"2024-09-21T05:53:16.645012+0000","last_became_active":"2024-09-21T05:50:53.896977+0000","last_became_peered":"2024-09-21T05:50:53.896977+0000","last_unstale":"2024-09-21T05:53:16.645012+0000","last_undegraded":"2024-09-21T05:53:16.645012+0000","last_fullsized":"2024-09-21T05:53:16.645012+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:35.538322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698802+0000","last_change":"2024-09-21T05:51:03.939519+0000","last_active":"2024-09-21T05:52:47.698802+0000","last_peered":"2024-09-21T05:52:47.698802+0000","last_clean":"2024-09-21T05:52:47.698802+0000","last_became_active":"2024-09-21T05:51:03.938429+0000","last_became_peered":"2024-09-21T05:51:03.938429+0000","last_unstale":"2024-09-21T05:52:47.698802+0000","last_undegraded":"2024-09-21T05:52:47.698802+0000","last_fullsized":"2024-09-21T05:52:47.698802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:09.236561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677115+0000","last_change":"2024-09-21T05:50:50.847640+0000","last_active":"2024-09-21T05:52:47.677115+0000","last_peered":"2024-09-21T05:52:47.677115+0000","last_clean":"2024-09-21T05:52:47.677115+0000","last_became_active":"2024-09-21T05:50:50.847101+0000","last_became_peered":"2024-09-21T05:50:50.847101+0000","last_unstale":"2024-09-21T05:52:47.677115+0000","last_undegraded":"2024-09-21T05:52:47.677115+0000","last_fullsized":"2024-09-21T05:52:47.677115+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:09.087655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641403+0000","last_change":"2024-09-21T05:50:53.889855+0000","last_active":"2024-09-21T05:53:16.641403+0000","last_peered":"2024-09-21T05:53:16.641403+0000","last_clean":"2024-09-21T05:53:16.641403+0000","last_became_active":"2024-09-21T05:50:53.889444+0000","last_became_peered":"2024-09-21T05:50:53.889444+0000","last_unstale":"2024-09-21T05:53:16.641403+0000","last_undegraded":"2024-09-21T05:53:16.641403+0000","last_fullsized":"2024-09-21T05:53:16.641403+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:47.480986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.698671+0000","last_change":"2024-09-21T05:51:03.946866+0000","last_active":"2024-09-21T05:52:47.698671+0000","last_peered":"2024-09-21T05:52:47.698671+0000","last_clean":"2024-09-21T05:52:47.698671+0000","last_became_active":"2024-09-21T05:51:03.946332+0000","last_became_peered":"2024-09-21T05:51:03.946332+0000","last_unstale":"2024-09-21T05:52:47.698671+0000","last_undegraded":"2024-09-21T05:52:47.698671+0000","last_fullsized":"2024-09-21T05:52:47.698671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:43.527937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645506+0000","last_change":"2024-09-21T05:50:53.900395+0000","last_active":"2024-09-21T05:53:16.645506+0000","last_peered":"2024-09-21T05:53:16.645506+0000","last_clean":"2024-09-21T05:53:16.645506+0000","last_became_active":"2024-09-21T05:50:53.894925+0000","last_became_peered":"2024-09-21T05:50:53.894925+0000","last_unstale":"2024-09-21T05:53:16.645506+0000","last_undegraded":"2024-09-21T05:53:16.645506+0000","last_fullsized":"2024-09-21T05:53:16.645506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.939120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"79'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.676506+0000","last_change":"2024-09-21T05:50:50.851145+0000","last_active":"2024-09-21T05:52:47.676506+0000","last_peered":"2024-09-21T05:52:47.676506+0000","last_clean":"2024-09-21T05:52:47.676506+0000","last_became_active":"2024-09-21T05:50:50.850641+0000","last_became_peered":"2024-09-21T05:50:50.850641+0000","last_unstale":"2024-09-21T05:52:47.676506+0000","last_undegraded":"2024-09-21T05:52:47.676506+0000","last_fullsized":"2024-09-21T05:52:47.676506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:34.560798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699204+0000","last_change":"2024-09-21T05:51:03.991798+0000","last_active":"2024-09-21T05:52:47.699204+0000","last_peered":"2024-09-21T05:52:47.699204+0000","last_clean":"2024-09-21T05:52:47.699204+0000","last_became_active":"2024-09-21T05:51:03.991173+0000","last_became_peered":"2024-09-21T05:51:03.991173+0000","last_unstale":"2024-09-21T05:52:47.699204+0000","last_undegraded":"2024-09-21T05:52:47.699204+0000","last_fullsized":"2024-09-21T05:52:47.699204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:46.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.634436+0000","last_change":"2024-09-21T05:50:53.892293+0000","last_active":"2024-09-21T05:53:16.634436+0000","last_peered":"2024-09-21T05:53:16.634436+0000","last_clean":"2024-09-21T05:53:16.634436+0000","last_became_active":"2024-09-21T05:50:53.891814+0000","last_became_peered":"2024-09-21T05:50:53.891814+0000","last_unstale":"2024-09-21T05:53:16.634436+0000","last_undegraded":"2024-09-21T05:53:16.634436+0000","last_fullsized":"2024-09-21T05:53:16.634436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:14.810409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678731+0000","last_change":"2024-09-21T05:50:50.846360+0000","last_active":"2024-09-21T05:52:47.678731+0000","last_peered":"2024-09-21T05:52:47.678731+0000","last_clean":"2024-09-21T05:52:47.678731+0000","last_became_active":"2024-09-21T05:50:50.845972+0000","last_became_peered":"2024-09-21T05:50:50.845972+0000","last_unstale":"2024-09-21T05:52:47.678731+0000","last_undegraded":"2024-09-21T05:52:47.678731+0000","last_fullsized":"2024-09-21T05:52:47.678731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:03.023239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699296+0000","last_change":"2024-09-21T05:51:03.938903+0000","last_active":"2024-09-21T05:52:47.699296+0000","last_peered":"2024-09-21T05:52:47.699296+0000","last_clean":"2024-09-21T05:52:47.699296+0000","last_became_active":"2024-09-21T05:51:03.938312+0000","last_became_peered":"2024-09-21T05:51:03.938312+0000","last_unstale":"2024-09-21T05:52:47.699296+0000","last_undegraded":"2024-09-21T05:52:47.699296+0000","last_fullsized":"2024-09-21T05:52:47.699296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:01.851758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.635971+0000","last_change":"2024-09-21T05:50:53.907529+0000","last_active":"2024-09-21T05:53:16.635971+0000","last_peered":"2024-09-21T05:53:16.635971+0000","last_clean":"2024-09-21T05:53:16.635971+0000","last_became_active":"2024-09-21T05:50:53.907154+0000","last_became_peered":"2024-09-21T05:50:53.907154+0000","last_unstale":"2024-09-21T05:53:16.635971+0000","last_undegraded":"2024-09-21T05:53:16.635971+0000","last_fullsized":"2024-09-21T05:53:16.635971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:22.586642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.321422+0000","last_change":"2024-09-21T05:50:50.838939+0000","last_active":"2024-09-21T05:52:48.321422+0000","last_peered":"2024-09-21T05:52:48.321422+0000","last_clean":"2024-09-21T05:52:48.321422+0000","last_became_active":"2024-09-21T05:50:50.838457+0000","last_became_peered":"2024-09-21T05:50:50.838457+0000","last_unstale":"2024-09-21T05:52:48.321422+0000","last_undegraded":"2024-09-21T05:52:48.321422+0000","last_fullsized":"2024-09-21T05:52:48.321422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:54.259046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011123+0000","last_change":"2024-09-21T05:51:03.944824+0000","last_active":"2024-09-21T05:52:48.011123+0000","last_peered":"2024-09-21T05:52:48.011123+0000","last_clean":"2024-09-21T05:52:48.011123+0000","last_became_active":"2024-09-21T05:51:03.938856+0000","last_became_peered":"2024-09-21T05:51:03.938856+0000","last_unstale":"2024-09-21T05:52:48.011123+0000","last_undegraded":"2024-09-21T05:52:48.011123+0000","last_fullsized":"2024-09-21T05:52:48.011123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:12.111775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.582040+0000","last_change":"2024-09-21T05:50:53.891676+0000","last_active":"2024-09-21T05:53:16.582040+0000","last_peered":"2024-09-21T05:53:16.582040+0000","last_clean":"2024-09-21T05:53:16.582040+0000","last_became_active":"2024-09-21T05:50:53.891339+0000","last_became_peered":"2024-09-21T05:50:53.891339+0000","last_unstale":"2024-09-21T05:53:16.582040+0000","last_undegraded":"2024-09-21T05:53:16.582040+0000","last_fullsized":"2024-09-21T05:53:16.582040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:41.707680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675446+0000","last_change":"2024-09-21T05:50:51.162492+0000","last_active":"2024-09-21T05:52:47.675446+0000","last_peered":"2024-09-21T05:52:47.675446+0000","last_clean":"2024-09-21T05:52:47.675446+0000","last_became_active":"2024-09-21T05:50:51.162108+0000","last_became_peered":"2024-09-21T05:50:51.162108+0000","last_unstale":"2024-09-21T05:52:47.675446+0000","last_undegraded":"2024-09-21T05:52:47.675446+0000","last_fullsized":"2024-09-21T05:52:47.675446+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.387568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699051+0000","last_change":"2024-09-21T05:51:03.992550+0000","last_active":"2024-09-21T05:52:47.699051+0000","last_peered":"2024-09-21T05:52:47.699051+0000","last_clean":"2024-09-21T05:52:47.699051+0000","last_became_active":"2024-09-21T05:51:03.991865+0000","last_became_peered":"2024-09-21T05:51:03.991865+0000","last_unstale":"2024-09-21T05:52:47.699051+0000","last_undegraded":"2024-09-21T05:52:47.699051+0000","last_fullsized":"2024-09-21T05:52:47.699051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:50.204058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.636651+0000","last_change":"2024-09-21T05:50:53.884376+0000","last_active":"2024-09-21T05:53:16.636651+0000","last_peered":"2024-09-21T05:53:16.636651+0000","last_clean":"2024-09-21T05:53:16.636651+0000","last_became_active":"2024-09-21T05:50:53.884033+0000","last_became_peered":"2024-09-21T05:50:53.884033+0000","last_unstale":"2024-09-21T05:53:16.636651+0000","last_undegraded":"2024-09-21T05:53:16.636651+0000","last_fullsized":"2024-09-21T05:53:16.636651+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.359191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699406+0000","last_change":"2024-09-21T05:50:50.869502+0000","last_active":"2024-09-21T05:52:47.699406+0000","last_peered":"2024-09-21T05:52:47.699406+0000","last_clean":"2024-09-21T05:52:47.699406+0000","last_became_active":"2024-09-21T05:50:50.869071+0000","last_became_peered":"2024-09-21T05:50:50.869071+0000","last_unstale":"2024-09-21T05:52:47.699406+0000","last_undegraded":"2024-09-21T05:52:47.699406+0000","last_fullsized":"2024-09-21T05:52:47.699406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:48.364902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678176+0000","last_change":"2024-09-21T05:51:03.931945+0000","last_active":"2024-09-21T05:52:47.678176+0000","last_peered":"2024-09-21T05:52:47.678176+0000","last_clean":"2024-09-21T05:52:47.678176+0000","last_became_active":"2024-09-21T05:51:03.931411+0000","last_became_peered":"2024-09-21T05:51:03.931411+0000","last_unstale":"2024-09-21T05:52:47.678176+0000","last_undegraded":"2024-09-21T05:52:47.678176+0000","last_fullsized":"2024-09-21T05:52:47.678176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.910547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641081+0000","last_change":"2024-09-21T05:50:53.897995+0000","last_active":"2024-09-21T05:53:16.641081+0000","last_peered":"2024-09-21T05:53:16.641081+0000","last_clean":"2024-09-21T05:53:16.641081+0000","last_became_active":"2024-09-21T05:50:53.895797+0000","last_became_peered":"2024-09-21T05:50:53.895797+0000","last_unstale":"2024-09-21T05:53:16.641081+0000","last_undegraded":"2024-09-21T05:53:16.641081+0000","last_fullsized":"2024-09-21T05:53:16.641081+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:18.484867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.920142+0000","last_change":"2024-09-21T05:50:50.845853+0000","last_active":"2024-09-21T05:53:16.920142+0000","last_peered":"2024-09-21T05:53:16.920142+0000","last_clean":"2024-09-21T05:53:16.920142+0000","last_became_active":"2024-09-21T05:50:50.845495+0000","last_became_peered":"2024-09-21T05:50:50.845495+0000","last_unstale":"2024-09-21T05:53:16.920142+0000","last_undegraded":"2024-09-21T05:53:16.920142+0000","last_fullsized":"2024-09-21T05:53:16.920142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:47.960498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.320673+0000","last_change":"2024-09-21T05:51:03.991380+0000","last_active":"2024-09-21T05:52:48.320673+0000","last_peered":"2024-09-21T05:52:48.320673+0000","last_clean":"2024-09-21T05:52:48.320673+0000","last_became_active":"2024-09-21T05:51:03.990911+0000","last_became_peered":"2024-09-21T05:51:03.990911+0000","last_unstale":"2024-09-21T05:52:48.320673+0000","last_undegraded":"2024-09-21T05:52:48.320673+0000","last_fullsized":"2024-09-21T05:52:48.320673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:01.779692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.625116+0000","last_change":"2024-09-21T05:50:53.910190+0000","last_active":"2024-09-21T05:53:16.625116+0000","last_peered":"2024-09-21T05:53:16.625116+0000","last_clean":"2024-09-21T05:53:16.625116+0000","last_became_active":"2024-09-21T05:50:53.909649+0000","last_became_peered":"2024-09-21T05:50:53.909649+0000","last_unstale":"2024-09-21T05:53:16.625116+0000","last_undegraded":"2024-09-21T05:53:16.625116+0000","last_fullsized":"2024-09-21T05:53:16.625116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:14.582217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677473+0000","last_change":"2024-09-21T05:50:51.163512+0000","last_active":"2024-09-21T05:52:47.677473+0000","last_peered":"2024-09-21T05:52:47.677473+0000","last_clean":"2024-09-21T05:52:47.677473+0000","last_became_active":"2024-09-21T05:50:51.161959+0000","last_became_peered":"2024-09-21T05:50:51.161959+0000","last_unstale":"2024-09-21T05:52:47.677473+0000","last_undegraded":"2024-09-21T05:52:47.677473+0000","last_fullsized":"2024-09-21T05:52:47.677473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:51.701990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682240+0000","last_change":"2024-09-21T05:51:03.936815+0000","last_active":"2024-09-21T05:52:47.682240+0000","last_peered":"2024-09-21T05:52:47.682240+0000","last_clean":"2024-09-21T05:52:47.682240+0000","last_became_active":"2024-09-21T05:51:03.936365+0000","last_became_peered":"2024-09-21T05:51:03.936365+0000","last_unstale":"2024-09-21T05:52:47.682240+0000","last_undegraded":"2024-09-21T05:52:47.682240+0000","last_fullsized":"2024-09-21T05:52:47.682240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:59.820159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.624247+0000","last_change":"2024-09-21T05:50:53.892772+0000","last_active":"2024-09-21T05:53:16.624247+0000","last_peered":"2024-09-21T05:53:16.624247+0000","last_clean":"2024-09-21T05:53:16.624247+0000","last_became_active":"2024-09-21T05:50:53.892378+0000","last_became_peered":"2024-09-21T05:50:53.892378+0000","last_unstale":"2024-09-21T05:53:16.624247+0000","last_undegraded":"2024-09-21T05:53:16.624247+0000","last_fullsized":"2024-09-21T05:53:16.624247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:34.438067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011995+0000","last_change":"2024-09-21T05:51:47.378160+0000","last_active":"2024-09-21T05:52:48.011995+0000","last_peered":"2024-09-21T05:52:48.011995+0000","last_clean":"2024-09-21T05:52:48.011995+0000","last_became_active":"2024-09-21T05:51:47.377779+0000","last_became_peered":"2024-09-21T05:51:47.377779+0000","last_unstale":"2024-09-21T05:52:48.011995+0000","last_undegraded":"2024-09-21T05:52:48.011995+0000","last_fullsized":"2024-09-21T05:52:48.011995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:27.780273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.012450+0000","last_change":"2024-09-21T05:52:48.011820+0000","last_active":"2024-09-21T05:52:48.012450+0000","last_peered":"2024-09-21T05:52:48.012450+0000","last_clean":"2024-09-21T05:52:48.012450+0000","last_became_active":"2024-09-21T05:52:48.011191+0000","last_became_peered":"2024-09-21T05:52:48.011191+0000","last_unstale":"2024-09-21T05:52:48.012450+0000","last_undegraded":"2024-09-21T05:52:48.012450+0000","last_fullsized":"2024-09-21T05:52:48.012450+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:45.598281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.620513+0000","last_change":"2024-09-21T05:50:53.899306+0000","last_active":"2024-09-21T05:53:16.620513+0000","last_peered":"2024-09-21T05:53:16.620513+0000","last_clean":"2024-09-21T05:53:16.620513+0000","last_became_active":"2024-09-21T05:50:53.898921+0000","last_became_peered":"2024-09-21T05:50:53.898921+0000","last_unstale":"2024-09-21T05:53:16.620513+0000","last_undegraded":"2024-09-21T05:53:16.620513+0000","last_fullsized":"2024-09-21T05:53:16.620513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:45.698584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681190+0000","last_change":"2024-09-21T05:50:50.844394+0000","last_active":"2024-09-21T05:52:47.681190+0000","last_peered":"2024-09-21T05:52:47.681190+0000","last_clean":"2024-09-21T05:52:47.681190+0000","last_became_active":"2024-09-21T05:50:50.843771+0000","last_became_peered":"2024-09-21T05:50:50.843771+0000","last_unstale":"2024-09-21T05:52:47.681190+0000","last_undegraded":"2024-09-21T05:52:47.681190+0000","last_fullsized":"2024-09-21T05:52:47.681190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:14.372917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009778+0000","last_change":"2024-09-21T05:51:03.941277+0000","last_active":"2024-09-21T05:52:48.009778+0000","last_peered":"2024-09-21T05:52:48.009778+0000","last_clean":"2024-09-21T05:52:48.009778+0000","last_became_active":"2024-09-21T05:51:03.940659+0000","last_became_peered":"2024-09-21T05:51:03.940659+0000","last_unstale":"2024-09-21T05:52:48.009778+0000","last_undegraded":"2024-09-21T05:52:48.009778+0000","last_fullsized":"2024-09-21T05:52:48.009778+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:40.217023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640245+0000","last_change":"2024-09-21T05:50:53.895399+0000","last_active":"2024-09-21T05:53:16.640245+0000","last_peered":"2024-09-21T05:53:16.640245+0000","last_clean":"2024-09-21T05:53:16.640245+0000","last_became_active":"2024-09-21T05:50:53.895022+0000","last_became_peered":"2024-09-21T05:50:53.895022+0000","last_unstale":"2024-09-21T05:53:16.640245+0000","last_undegraded":"2024-09-21T05:53:16.640245+0000","last_fullsized":"2024-09-21T05:53:16.640245+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:02.056015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010036+0000","last_change":"2024-09-21T05:50:51.162215+0000","last_active":"2024-09-21T05:52:48.010036+0000","last_peered":"2024-09-21T05:52:48.010036+0000","last_clean":"2024-09-21T05:52:48.010036+0000","last_became_active":"2024-09-21T05:50:51.161812+0000","last_became_peered":"2024-09-21T05:50:51.161812+0000","last_unstale":"2024-09-21T05:52:48.010036+0000","last_undegraded":"2024-09-21T05:52:48.010036+0000","last_fullsized":"2024-09-21T05:52:48.010036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:05.237806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009907+0000","last_change":"2024-09-21T05:51:03.991488+0000","last_active":"2024-09-21T05:52:48.009907+0000","last_peered":"2024-09-21T05:52:48.009907+0000","last_clean":"2024-09-21T05:52:48.009907+0000","last_became_active":"2024-09-21T05:51:03.990866+0000","last_became_peered":"2024-09-21T05:51:03.990866+0000","last_unstale":"2024-09-21T05:52:48.009907+0000","last_undegraded":"2024-09-21T05:52:48.009907+0000","last_fullsized":"2024-09-21T05:52:48.009907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:41.061421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.629178+0000","last_change":"2024-09-21T05:50:53.895076+0000","last_active":"2024-09-21T05:53:16.629178+0000","last_peered":"2024-09-21T05:53:16.629178+0000","last_clean":"2024-09-21T05:53:16.629178+0000","last_became_active":"2024-09-21T05:50:53.893888+0000","last_became_peered":"2024-09-21T05:50:53.893888+0000","last_unstale":"2024-09-21T05:53:16.629178+0000","last_undegraded":"2024-09-21T05:53:16.629178+0000","last_fullsized":"2024-09-21T05:53:16.629178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:13.397806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681934+0000","last_change":"2024-09-21T05:51:47.376540+0000","last_active":"2024-09-21T05:52:47.681934+0000","last_peered":"2024-09-21T05:52:47.681934+0000","last_clean":"2024-09-21T05:52:47.681934+0000","last_became_active":"2024-09-21T05:51:47.376163+0000","last_became_peered":"2024-09-21T05:51:47.376163+0000","last_unstale":"2024-09-21T05:52:47.681934+0000","last_undegraded":"2024-09-21T05:52:47.681934+0000","last_fullsized":"2024-09-21T05:52:47.681934+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:51.217674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010533+0000","last_change":"2024-09-21T05:51:03.991711+0000","last_active":"2024-09-21T05:52:48.010533+0000","last_peered":"2024-09-21T05:52:48.010533+0000","last_clean":"2024-09-21T05:52:48.010533+0000","last_became_active":"2024-09-21T05:51:03.991200+0000","last_became_peered":"2024-09-21T05:51:03.991200+0000","last_unstale":"2024-09-21T05:52:48.010533+0000","last_undegraded":"2024-09-21T05:52:48.010533+0000","last_fullsized":"2024-09-21T05:52:48.010533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:40.981303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.635878+0000","last_change":"2024-09-21T05:50:53.887913+0000","last_active":"2024-09-21T05:53:16.635878+0000","last_peered":"2024-09-21T05:53:16.635878+0000","last_clean":"2024-09-21T05:53:16.635878+0000","last_became_active":"2024-09-21T05:50:53.887583+0000","last_became_peered":"2024-09-21T05:50:53.887583+0000","last_unstale":"2024-09-21T05:53:16.635878+0000","last_undegraded":"2024-09-21T05:53:16.635878+0000","last_fullsized":"2024-09-21T05:53:16.635878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:05.941780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699391+0000","last_change":"2024-09-21T05:50:50.846370+0000","last_active":"2024-09-21T05:52:47.699391+0000","last_peered":"2024-09-21T05:52:47.699391+0000","last_clean":"2024-09-21T05:52:47.699391+0000","last_became_active":"2024-09-21T05:50:50.845890+0000","last_became_peered":"2024-09-21T05:50:50.845890+0000","last_unstale":"2024-09-21T05:52:47.699391+0000","last_undegraded":"2024-09-21T05:52:47.699391+0000","last_fullsized":"2024-09-21T05:52:47.699391+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:15.180734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":118,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.680908+0000","last_change":"2024-09-21T05:49:33.762460+0000","last_active":"2024-09-21T05:52:47.680908+0000","last_peered":"2024-09-21T05:52:47.680908+0000","last_clean":"2024-09-21T05:52:47.680908+0000","last_became_active":"2024-09-21T05:49:33.705194+0000","last_became_peered":"2024-09-21T05:49:33.705194+0000","last_unstale":"2024-09-21T05:52:47.680908+0000","last_undegraded":"2024-09-21T05:52:47.680908+0000","last_fullsized":"2024-09-21T05:52:47.680908+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:45:49.237325+0000","last_clean_scrub_stamp":"2024-09-21T05:45:49.237325+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:39.194122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681362+0000","last_change":"2024-09-21T05:51:03.938790+0000","last_active":"2024-09-21T05:52:47.681362+0000","last_peered":"2024-09-21T05:52:47.681362+0000","last_clean":"2024-09-21T05:52:47.681362+0000","last_became_active":"2024-09-21T05:51:03.938214+0000","last_became_peered":"2024-09-21T05:51:03.938214+0000","last_unstale":"2024-09-21T05:52:47.681362+0000","last_undegraded":"2024-09-21T05:52:47.681362+0000","last_fullsized":"2024-09-21T05:52:47.681362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:11.512500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645921+0000","last_change":"2024-09-21T05:50:53.893475+0000","last_active":"2024-09-21T05:53:16.645921+0000","last_peered":"2024-09-21T05:53:16.645921+0000","last_clean":"2024-09-21T05:53:16.645921+0000","last_became_active":"2024-09-21T05:50:53.892946+0000","last_became_peered":"2024-09-21T05:50:53.892946+0000","last_unstale":"2024-09-21T05:53:16.645921+0000","last_undegraded":"2024-09-21T05:53:16.645921+0000","last_fullsized":"2024-09-21T05:53:16.645921+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:23.612285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678724+0000","last_change":"2024-09-21T05:50:51.162170+0000","last_active":"2024-09-21T05:52:47.678724+0000","last_peered":"2024-09-21T05:52:47.678724+0000","last_clean":"2024-09-21T05:52:47.678724+0000","last_became_active":"2024-09-21T05:50:51.161685+0000","last_became_peered":"2024-09-21T05:50:51.161685+0000","last_unstale":"2024-09-21T05:52:47.678724+0000","last_undegraded":"2024-09-21T05:52:47.678724+0000","last_fullsized":"2024-09-21T05:52:47.678724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:14.922423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.675290+0000","last_change":"2024-09-21T05:51:03.937061+0000","last_active":"2024-09-21T05:52:47.675290+0000","last_peered":"2024-09-21T05:52:47.675290+0000","last_clean":"2024-09-21T05:52:47.675290+0000","last_became_active":"2024-09-21T05:51:03.936306+0000","last_became_peered":"2024-09-21T05:51:03.936306+0000","last_unstale":"2024-09-21T05:52:47.675290+0000","last_undegraded":"2024-09-21T05:52:47.675290+0000","last_fullsized":"2024-09-21T05:52:47.675290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:51.057973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640342+0000","last_change":"2024-09-21T05:50:53.893930+0000","last_active":"2024-09-21T05:53:16.640342+0000","last_peered":"2024-09-21T05:53:16.640342+0000","last_clean":"2024-09-21T05:53:16.640342+0000","last_became_active":"2024-09-21T05:50:53.893155+0000","last_became_peered":"2024-09-21T05:50:53.893155+0000","last_unstale":"2024-09-21T05:53:16.640342+0000","last_undegraded":"2024-09-21T05:53:16.640342+0000","last_fullsized":"2024-09-21T05:53:16.640342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:46.097408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011053+0000","last_change":"2024-09-21T05:50:50.847890+0000","last_active":"2024-09-21T05:52:48.011053+0000","last_peered":"2024-09-21T05:52:48.011053+0000","last_clean":"2024-09-21T05:52:48.011053+0000","last_became_active":"2024-09-21T05:50:50.847549+0000","last_became_peered":"2024-09-21T05:50:50.847549+0000","last_unstale":"2024-09-21T05:52:48.011053+0000","last_undegraded":"2024-09-21T05:52:48.011053+0000","last_fullsized":"2024-09-21T05:52:48.011053+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:14.998849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674513+0000","last_change":"2024-09-21T05:51:03.940674+0000","last_active":"2024-09-21T05:52:47.674513+0000","last_peered":"2024-09-21T05:52:47.674513+0000","last_clean":"2024-09-21T05:52:47.674513+0000","last_became_active":"2024-09-21T05:51:03.940222+0000","last_became_peered":"2024-09-21T05:51:03.940222+0000","last_unstale":"2024-09-21T05:52:47.674513+0000","last_undegraded":"2024-09-21T05:52:47.674513+0000","last_fullsized":"2024-09-21T05:52:47.674513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:58.497147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641922+0000","last_change":"2024-09-21T05:50:53.895191+0000","last_active":"2024-09-21T05:53:16.641922+0000","last_peered":"2024-09-21T05:53:16.641922+0000","last_clean":"2024-09-21T05:53:16.641922+0000","last_became_active":"2024-09-21T05:50:53.892894+0000","last_became_peered":"2024-09-21T05:50:53.892894+0000","last_unstale":"2024-09-21T05:53:16.641922+0000","last_undegraded":"2024-09-21T05:53:16.641922+0000","last_fullsized":"2024-09-21T05:53:16.641922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:41.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011748+0000","last_change":"2024-09-21T05:50:50.844301+0000","last_active":"2024-09-21T05:52:48.011748+0000","last_peered":"2024-09-21T05:52:48.011748+0000","last_clean":"2024-09-21T05:52:48.011748+0000","last_became_active":"2024-09-21T05:50:50.843878+0000","last_became_peered":"2024-09-21T05:50:50.843878+0000","last_unstale":"2024-09-21T05:52:48.011748+0000","last_undegraded":"2024-09-21T05:52:48.011748+0000","last_fullsized":"2024-09-21T05:52:48.011748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:53.150300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009615+0000","last_change":"2024-09-21T05:51:03.931684+0000","last_active":"2024-09-21T05:52:48.009615+0000","last_peered":"2024-09-21T05:52:48.009615+0000","last_clean":"2024-09-21T05:52:48.009615+0000","last_became_active":"2024-09-21T05:51:03.931225+0000","last_became_peered":"2024-09-21T05:51:03.931225+0000","last_unstale":"2024-09-21T05:52:48.009615+0000","last_undegraded":"2024-09-21T05:52:48.009615+0000","last_fullsized":"2024-09-21T05:52:48.009615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:51.993481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637668+0000","last_change":"2024-09-21T05:50:53.892740+0000","last_active":"2024-09-21T05:53:16.637668+0000","last_peered":"2024-09-21T05:53:16.637668+0000","last_clean":"2024-09-21T05:53:16.637668+0000","last_became_active":"2024-09-21T05:50:53.892381+0000","last_became_peered":"2024-09-21T05:50:53.892381+0000","last_unstale":"2024-09-21T05:53:16.637668+0000","last_undegraded":"2024-09-21T05:53:16.637668+0000","last_fullsized":"2024-09-21T05:53:16.637668+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:20.038644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677796+0000","last_change":"2024-09-21T05:50:50.850077+0000","last_active":"2024-09-21T05:52:47.677796+0000","last_peered":"2024-09-21T05:52:47.677796+0000","last_clean":"2024-09-21T05:52:47.677796+0000","last_became_active":"2024-09-21T05:50:50.849553+0000","last_became_peered":"2024-09-21T05:50:50.849553+0000","last_unstale":"2024-09-21T05:52:47.677796+0000","last_undegraded":"2024-09-21T05:52:47.677796+0000","last_fullsized":"2024-09-21T05:52:47.677796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:09.764465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009537+0000","last_change":"2024-09-21T05:51:03.930231+0000","last_active":"2024-09-21T05:52:48.009537+0000","last_peered":"2024-09-21T05:52:48.009537+0000","last_clean":"2024-09-21T05:52:48.009537+0000","last_became_active":"2024-09-21T05:51:03.929907+0000","last_became_peered":"2024-09-21T05:51:03.929907+0000","last_unstale":"2024-09-21T05:52:48.009537+0000","last_undegraded":"2024-09-21T05:52:48.009537+0000","last_fullsized":"2024-09-21T05:52:48.009537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:18.829725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640149+0000","last_change":"2024-09-21T05:50:53.888988+0000","last_active":"2024-09-21T05:53:16.640149+0000","last_peered":"2024-09-21T05:53:16.640149+0000","last_clean":"2024-09-21T05:53:16.640149+0000","last_became_active":"2024-09-21T05:50:53.888599+0000","last_became_peered":"2024-09-21T05:50:53.888599+0000","last_unstale":"2024-09-21T05:53:16.640149+0000","last_undegraded":"2024-09-21T05:53:16.640149+0000","last_fullsized":"2024-09-21T05:53:16.640149+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:32.353201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"79'8","reported_seq":68,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.677086+0000","last_change":"2024-09-21T05:51:47.383528+0000","last_active":"2024-09-21T05:52:47.677086+0000","last_peered":"2024-09-21T05:52:47.677086+0000","last_clean":"2024-09-21T05:52:47.677086+0000","last_became_active":"2024-09-21T05:51:47.376325+0000","last_became_peered":"2024-09-21T05:51:47.376325+0000","last_unstale":"2024-09-21T05:52:47.677086+0000","last_undegraded":"2024-09-21T05:52:47.677086+0000","last_fullsized":"2024-09-21T05:52:47.677086+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:47.659961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009829+0000","last_change":"2024-09-21T05:51:03.946581+0000","last_active":"2024-09-21T05:52:48.009829+0000","last_peered":"2024-09-21T05:52:48.009829+0000","last_clean":"2024-09-21T05:52:48.009829+0000","last_became_active":"2024-09-21T05:51:03.946170+0000","last_became_peered":"2024-09-21T05:51:03.946170+0000","last_unstale":"2024-09-21T05:52:48.009829+0000","last_undegraded":"2024-09-21T05:52:48.009829+0000","last_fullsized":"2024-09-21T05:52:48.009829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:59.302647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.622157+0000","last_change":"2024-09-21T05:50:53.890164+0000","last_active":"2024-09-21T05:53:16.622157+0000","last_peered":"2024-09-21T05:53:16.622157+0000","last_clean":"2024-09-21T05:53:16.622157+0000","last_became_active":"2024-09-21T05:50:53.889309+0000","last_became_peered":"2024-09-21T05:50:53.889309+0000","last_unstale":"2024-09-21T05:53:16.622157+0000","last_undegraded":"2024-09-21T05:53:16.622157+0000","last_fullsized":"2024-09-21T05:53:16.622157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:18.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699112+0000","last_change":"2024-09-21T05:50:50.844080+0000","last_active":"2024-09-21T05:52:47.699112+0000","last_peered":"2024-09-21T05:52:47.699112+0000","last_clean":"2024-09-21T05:52:47.699112+0000","last_became_active":"2024-09-21T05:50:50.842929+0000","last_became_peered":"2024-09-21T05:50:50.842929+0000","last_unstale":"2024-09-21T05:52:47.699112+0000","last_undegraded":"2024-09-21T05:52:47.699112+0000","last_fullsized":"2024-09-21T05:52:47.699112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:42:49.623189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010942+0000","last_change":"2024-09-21T05:51:03.939228+0000","last_active":"2024-09-21T05:52:48.010942+0000","last_peered":"2024-09-21T05:52:48.010942+0000","last_clean":"2024-09-21T05:52:48.010942+0000","last_became_active":"2024-09-21T05:51:03.937857+0000","last_became_peered":"2024-09-21T05:51:03.937857+0000","last_unstale":"2024-09-21T05:52:48.010942+0000","last_undegraded":"2024-09-21T05:52:48.010942+0000","last_fullsized":"2024-09-21T05:52:48.010942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:54.147008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.643581+0000","last_change":"2024-09-21T05:50:53.890755+0000","last_active":"2024-09-21T05:53:16.643581+0000","last_peered":"2024-09-21T05:53:16.643581+0000","last_clean":"2024-09-21T05:53:16.643581+0000","last_became_active":"2024-09-21T05:50:53.890286+0000","last_became_peered":"2024-09-21T05:50:53.890286+0000","last_unstale":"2024-09-21T05:53:16.643581+0000","last_undegraded":"2024-09-21T05:53:16.643581+0000","last_fullsized":"2024-09-21T05:53:16.643581+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:50.767355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010406+0000","last_change":"2024-09-21T05:50:50.852722+0000","last_active":"2024-09-21T05:52:48.010406+0000","last_peered":"2024-09-21T05:52:48.010406+0000","last_clean":"2024-09-21T05:52:48.010406+0000","last_became_active":"2024-09-21T05:50:50.852211+0000","last_became_peered":"2024-09-21T05:50:50.852211+0000","last_unstale":"2024-09-21T05:52:48.010406+0000","last_undegraded":"2024-09-21T05:52:48.010406+0000","last_fullsized":"2024-09-21T05:52:48.010406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:44.392153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.014263+0000","last_change":"2024-09-21T05:52:48.013503+0000","last_active":"2024-09-21T05:52:48.014263+0000","last_peered":"2024-09-21T05:52:48.014263+0000","last_clean":"2024-09-21T05:52:48.014263+0000","last_became_active":"2024-09-21T05:52:48.012908+0000","last_became_peered":"2024-09-21T05:52:48.012908+0000","last_unstale":"2024-09-21T05:52:48.014263+0000","last_undegraded":"2024-09-21T05:52:48.014263+0000","last_fullsized":"2024-09-21T05:52:48.014263+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:59.512334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641672+0000","last_change":"2024-09-21T05:50:53.903935+0000","last_active":"2024-09-21T05:53:16.641672+0000","last_peered":"2024-09-21T05:53:16.641672+0000","last_clean":"2024-09-21T05:53:16.641672+0000","last_became_active":"2024-09-21T05:50:53.903604+0000","last_became_peered":"2024-09-21T05:50:53.903604+0000","last_unstale":"2024-09-21T05:53:16.641672+0000","last_undegraded":"2024-09-21T05:53:16.641672+0000","last_fullsized":"2024-09-21T05:53:16.641672+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:49.552901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678699+0000","last_change":"2024-09-21T05:50:50.848254+0000","last_active":"2024-09-21T05:52:47.678699+0000","last_peered":"2024-09-21T05:52:47.678699+0000","last_clean":"2024-09-21T05:52:47.678699+0000","last_became_active":"2024-09-21T05:50:50.847834+0000","last_became_peered":"2024-09-21T05:50:50.847834+0000","last_unstale":"2024-09-21T05:52:47.678699+0000","last_undegraded":"2024-09-21T05:52:47.678699+0000","last_fullsized":"2024-09-21T05:52:47.678699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:36.579763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009610+0000","last_change":"2024-09-21T05:51:03.941732+0000","last_active":"2024-09-21T05:52:48.009610+0000","last_peered":"2024-09-21T05:52:48.009610+0000","last_clean":"2024-09-21T05:52:48.009610+0000","last_became_active":"2024-09-21T05:51:03.941144+0000","last_became_peered":"2024-09-21T05:51:03.941144+0000","last_unstale":"2024-09-21T05:52:48.009610+0000","last_undegraded":"2024-09-21T05:52:48.009610+0000","last_fullsized":"2024-09-21T05:52:48.009610+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:38.117642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.620240+0000","last_change":"2024-09-21T05:50:53.904574+0000","last_active":"2024-09-21T05:53:16.620240+0000","last_peered":"2024-09-21T05:53:16.620240+0000","last_clean":"2024-09-21T05:53:16.620240+0000","last_became_active":"2024-09-21T05:50:53.904215+0000","last_became_peered":"2024-09-21T05:50:53.904215+0000","last_unstale":"2024-09-21T05:53:16.620240+0000","last_undegraded":"2024-09-21T05:53:16.620240+0000","last_fullsized":"2024-09-21T05:53:16.620240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:49.662725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":312,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:35.652285+0000","last_change":"2024-09-21T05:50:50.850929+0000","last_active":"2024-09-21T05:53:35.652285+0000","last_peered":"2024-09-21T05:53:35.652285+0000","last_clean":"2024-09-21T05:53:35.652285+0000","last_became_active":"2024-09-21T05:50:50.850495+0000","last_became_peered":"2024-09-21T05:50:50.850495+0000","last_unstale":"2024-09-21T05:53:35.652285+0000","last_undegraded":"2024-09-21T05:53:35.652285+0000","last_fullsized":"2024-09-21T05:53:35.652285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:45.224063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69827,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":182,"num_write":38,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011525+0000","last_change":"2024-09-21T05:51:03.944010+0000","last_active":"2024-09-21T05:52:48.011525+0000","last_peered":"2024-09-21T05:52:48.011525+0000","last_clean":"2024-09-21T05:52:48.011525+0000","last_became_active":"2024-09-21T05:51:03.942942+0000","last_became_peered":"2024-09-21T05:51:03.942942+0000","last_unstale":"2024-09-21T05:52:48.011525+0000","last_undegraded":"2024-09-21T05:52:48.011525+0000","last_fullsized":"2024-09-21T05:52:48.011525+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:48:38.846493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.639338+0000","last_change":"2024-09-21T05:51:47.376326+0000","last_active":"2024-09-21T05:53:16.639338+0000","last_peered":"2024-09-21T05:53:16.639338+0000","last_clean":"2024-09-21T05:53:16.639338+0000","last_became_active":"2024-09-21T05:51:47.375993+0000","last_became_peered":"2024-09-21T05:51:47.375993+0000","last_unstale":"2024-09-21T05:53:16.639338+0000","last_undegraded":"2024-09-21T05:53:16.639338+0000","last_fullsized":"2024-09-21T05:53:16.639338+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:13.193571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010874+0000","last_change":"2024-09-21T05:50:51.162682+0000","last_active":"2024-09-21T05:52:48.010874+0000","last_peered":"2024-09-21T05:52:48.010874+0000","last_clean":"2024-09-21T05:52:48.010874+0000","last_became_active":"2024-09-21T05:50:51.162244+0000","last_became_peered":"2024-09-21T05:50:51.162244+0000","last_unstale":"2024-09-21T05:52:48.010874+0000","last_undegraded":"2024-09-21T05:52:48.010874+0000","last_fullsized":"2024-09-21T05:52:48.010874+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:03.595096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.699172+0000","last_change":"2024-09-21T05:51:03.939666+0000","last_active":"2024-09-21T05:52:47.699172+0000","last_peered":"2024-09-21T05:52:47.699172+0000","last_clean":"2024-09-21T05:52:47.699172+0000","last_became_active":"2024-09-21T05:51:03.938311+0000","last_became_peered":"2024-09-21T05:51:03.938311+0000","last_unstale":"2024-09-21T05:52:47.699172+0000","last_undegraded":"2024-09-21T05:52:47.699172+0000","last_fullsized":"2024-09-21T05:52:47.699172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:31.407900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640807+0000","last_change":"2024-09-21T05:51:47.588416+0000","last_active":"2024-09-21T05:53:16.640807+0000","last_peered":"2024-09-21T05:53:16.640807+0000","last_clean":"2024-09-21T05:53:16.640807+0000","last_became_active":"2024-09-21T05:51:47.587905+0000","last_became_peered":"2024-09-21T05:51:47.587905+0000","last_unstale":"2024-09-21T05:53:16.640807+0000","last_undegraded":"2024-09-21T05:53:16.640807+0000","last_fullsized":"2024-09-21T05:53:16.640807+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:05.821048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.681491+0000","last_change":"2024-09-21T05:50:50.846164+0000","last_active":"2024-09-21T05:52:47.681491+0000","last_peered":"2024-09-21T05:52:47.681491+0000","last_clean":"2024-09-21T05:52:47.681491+0000","last_became_active":"2024-09-21T05:50:50.845775+0000","last_became_peered":"2024-09-21T05:50:50.845775+0000","last_unstale":"2024-09-21T05:52:47.681491+0000","last_undegraded":"2024-09-21T05:52:47.681491+0000","last_fullsized":"2024-09-21T05:52:47.681491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:45.356626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.701383+0000","last_change":"2024-09-21T05:52:47.700832+0000","last_active":"2024-09-21T05:52:47.701383+0000","last_peered":"2024-09-21T05:52:47.701383+0000","last_clean":"2024-09-21T05:52:47.701383+0000","last_became_active":"2024-09-21T05:52:47.700372+0000","last_became_peered":"2024-09-21T05:52:47.700372+0000","last_unstale":"2024-09-21T05:52:47.701383+0000","last_undegraded":"2024-09-21T05:52:47.701383+0000","last_fullsized":"2024-09-21T05:52:47.701383+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.887433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.644971+0000","last_change":"2024-09-21T05:50:53.903005+0000","last_active":"2024-09-21T05:53:16.644971+0000","last_peered":"2024-09-21T05:53:16.644971+0000","last_clean":"2024-09-21T05:53:16.644971+0000","last_became_active":"2024-09-21T05:50:53.902590+0000","last_became_peered":"2024-09-21T05:50:53.902590+0000","last_unstale":"2024-09-21T05:53:16.644971+0000","last_undegraded":"2024-09-21T05:53:16.644971+0000","last_fullsized":"2024-09-21T05:53:16.644971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:46.602723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.011645+0000","last_change":"2024-09-21T05:50:50.846682+0000","last_active":"2024-09-21T05:52:48.011645+0000","last_peered":"2024-09-21T05:52:48.011645+0000","last_clean":"2024-09-21T05:52:48.011645+0000","last_became_active":"2024-09-21T05:50:50.846305+0000","last_became_peered":"2024-09-21T05:50:50.846305+0000","last_unstale":"2024-09-21T05:52:48.011645+0000","last_undegraded":"2024-09-21T05:52:48.011645+0000","last_fullsized":"2024-09-21T05:52:48.011645+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:30.946247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.320808+0000","last_change":"2024-09-21T05:51:03.931781+0000","last_active":"2024-09-21T05:52:48.320808+0000","last_peered":"2024-09-21T05:52:48.320808+0000","last_clean":"2024-09-21T05:52:48.320808+0000","last_became_active":"2024-09-21T05:51:03.930921+0000","last_became_peered":"2024-09-21T05:51:03.930921+0000","last_unstale":"2024-09-21T05:52:48.320808+0000","last_undegraded":"2024-09-21T05:52:48.320808+0000","last_fullsized":"2024-09-21T05:52:48.320808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:03.284929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.674758+0000","last_change":"2024-09-21T05:51:03.947521+0000","last_active":"2024-09-21T05:52:47.674758+0000","last_peered":"2024-09-21T05:52:47.674758+0000","last_clean":"2024-09-21T05:52:47.674758+0000","last_became_active":"2024-09-21T05:51:03.947074+0000","last_became_peered":"2024-09-21T05:51:03.947074+0000","last_unstale":"2024-09-21T05:52:47.674758+0000","last_undegraded":"2024-09-21T05:52:47.674758+0000","last_fullsized":"2024-09-21T05:52:47.674758+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:51.313988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.640063+0000","last_change":"2024-09-21T05:50:53.911791+0000","last_active":"2024-09-21T05:53:16.640063+0000","last_peered":"2024-09-21T05:53:16.640063+0000","last_clean":"2024-09-21T05:53:16.640063+0000","last_became_active":"2024-09-21T05:50:53.911392+0000","last_became_peered":"2024-09-21T05:50:53.911392+0000","last_unstale":"2024-09-21T05:53:16.640063+0000","last_undegraded":"2024-09-21T05:53:16.640063+0000","last_fullsized":"2024-09-21T05:53:16.640063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:45.688626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010697+0000","last_change":"2024-09-21T05:50:50.853383+0000","last_active":"2024-09-21T05:52:48.010697+0000","last_peered":"2024-09-21T05:52:48.010697+0000","last_clean":"2024-09-21T05:52:48.010697+0000","last_became_active":"2024-09-21T05:50:50.853006+0000","last_became_peered":"2024-09-21T05:50:50.853006+0000","last_unstale":"2024-09-21T05:52:48.010697+0000","last_undegraded":"2024-09-21T05:52:48.010697+0000","last_fullsized":"2024-09-21T05:52:48.010697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:14.838953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.682519+0000","last_change":"2024-09-21T05:51:03.945415+0000","last_active":"2024-09-21T05:52:47.682519+0000","last_peered":"2024-09-21T05:52:47.682519+0000","last_clean":"2024-09-21T05:52:47.682519+0000","last_became_active":"2024-09-21T05:51:03.945019+0000","last_became_peered":"2024-09-21T05:51:03.945019+0000","last_unstale":"2024-09-21T05:52:47.682519+0000","last_undegraded":"2024-09-21T05:52:47.682519+0000","last_fullsized":"2024-09-21T05:52:47.682519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:27.006823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.629274+0000","last_change":"2024-09-21T05:50:53.897515+0000","last_active":"2024-09-21T05:53:16.629274+0000","last_peered":"2024-09-21T05:53:16.629274+0000","last_clean":"2024-09-21T05:53:16.629274+0000","last_became_active":"2024-09-21T05:50:53.897070+0000","last_became_peered":"2024-09-21T05:50:53.897070+0000","last_unstale":"2024-09-21T05:53:16.629274+0000","last_undegraded":"2024-09-21T05:53:16.629274+0000","last_fullsized":"2024-09-21T05:53:16.629274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:16.971379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.009930+0000","last_change":"2024-09-21T05:50:50.844937+0000","last_active":"2024-09-21T05:52:48.009930+0000","last_peered":"2024-09-21T05:52:48.009930+0000","last_clean":"2024-09-21T05:52:48.009930+0000","last_became_active":"2024-09-21T05:50:50.844048+0000","last_became_peered":"2024-09-21T05:50:50.844048+0000","last_unstale":"2024-09-21T05:52:48.009930+0000","last_undegraded":"2024-09-21T05:52:48.009930+0000","last_fullsized":"2024-09-21T05:52:48.009930+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:28.764620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010674+0000","last_change":"2024-09-21T05:51:47.587919+0000","last_active":"2024-09-21T05:52:48.010674+0000","last_peered":"2024-09-21T05:52:48.010674+0000","last_clean":"2024-09-21T05:52:48.010674+0000","last_became_active":"2024-09-21T05:51:47.587418+0000","last_became_peered":"2024-09-21T05:51:47.587418+0000","last_unstale":"2024-09-21T05:52:48.010674+0000","last_undegraded":"2024-09-21T05:52:48.010674+0000","last_fullsized":"2024-09-21T05:52:48.010674+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:29.800848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641399+0000","last_change":"2024-09-21T05:50:53.890761+0000","last_active":"2024-09-21T05:53:16.641399+0000","last_peered":"2024-09-21T05:53:16.641399+0000","last_clean":"2024-09-21T05:53:16.641399+0000","last_became_active":"2024-09-21T05:50:53.890394+0000","last_became_peered":"2024-09-21T05:50:53.890394+0000","last_unstale":"2024-09-21T05:53:16.641399+0000","last_undegraded":"2024-09-21T05:53:16.641399+0000","last_fullsized":"2024-09-21T05:53:16.641399+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:53.176920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.014611+0000","last_change":"2024-09-21T05:52:48.014051+0000","last_active":"2024-09-21T05:52:48.014611+0000","last_peered":"2024-09-21T05:52:48.014611+0000","last_clean":"2024-09-21T05:52:48.014611+0000","last_became_active":"2024-09-21T05:52:48.013422+0000","last_became_peered":"2024-09-21T05:52:48.013422+0000","last_unstale":"2024-09-21T05:52:48.014611+0000","last_undegraded":"2024-09-21T05:52:48.014611+0000","last_fullsized":"2024-09-21T05:52:48.014611+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:18.380310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,10],"acting":[2,6,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:48.010663+0000","last_change":"2024-09-21T05:50:50.852630+0000","last_active":"2024-09-21T05:52:48.010663+0000","last_peered":"2024-09-21T05:52:48.010663+0000","last_clean":"2024-09-21T05:52:48.010663+0000","last_became_active":"2024-09-21T05:50:50.852255+0000","last_became_peered":"2024-09-21T05:50:50.852255+0000","last_unstale":"2024-09-21T05:52:48.010663+0000","last_undegraded":"2024-09-21T05:52:48.010663+0000","last_fullsized":"2024-09-21T05:52:48.010663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:49.826704+0000","last_clean_scrub_stamp":"2024-09-21T05:50:49.826704+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:18.094082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.630538+0000","last_change":"2024-09-21T05:50:53.902303+0000","last_active":"2024-09-21T05:53:16.630538+0000","last_peered":"2024-09-21T05:53:16.630538+0000","last_clean":"2024-09-21T05:53:16.630538+0000","last_became_active":"2024-09-21T05:50:53.901910+0000","last_became_peered":"2024-09-21T05:50:53.901910+0000","last_unstale":"2024-09-21T05:53:16.630538+0000","last_undegraded":"2024-09-21T05:53:16.630538+0000","last_fullsized":"2024-09-21T05:53:16.630538+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:06.651235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:52:47.678995+0000","last_change":"2024-09-21T05:51:03.932268+0000","last_active":"2024-09-21T05:52:47.678995+0000","last_peered":"2024-09-21T05:52:47.678995+0000","last_clean":"2024-09-21T05:52:47.678995+0000","last_became_active":"2024-09-21T05:51:03.931849+0000","last_became_peered":"2024-09-21T05:51:03.931849+0000","last_unstale":"2024-09-21T05:52:47.678995+0000","last_undegraded":"2024-09-21T05:52:47.678995+0000","last_fullsized":"2024-09-21T05:52:47.678995+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:51:02.912298+0000","last_clean_scrub_stamp":"2024-09-21T05:51:02.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:53.622621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.631866+0000","last_change":"2024-09-21T05:50:53.897205+0000","last_active":"2024-09-21T05:53:16.631866+0000","last_peered":"2024-09-21T05:53:16.631866+0000","last_clean":"2024-09-21T05:53:16.631866+0000","last_became_active":"2024-09-21T05:50:53.896811+0000","last_became_peered":"2024-09-21T05:50:53.896811+0000","last_unstale":"2024-09-21T05:53:16.631866+0000","last_undegraded":"2024-09-21T05:53:16.631866+0000","last_fullsized":"2024-09-21T05:53:16.631866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:13.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.625137+0000","last_change":"2024-09-21T05:51:47.376606+0000","last_active":"2024-09-21T05:53:16.625137+0000","last_peered":"2024-09-21T05:53:16.625137+0000","last_clean":"2024-09-21T05:53:16.625137+0000","last_became_active":"2024-09-21T05:51:47.376203+0000","last_became_peered":"2024-09-21T05:51:47.376203+0000","last_unstale":"2024-09-21T05:53:16.625137+0000","last_undegraded":"2024-09-21T05:53:16.625137+0000","last_fullsized":"2024-09-21T05:53:16.625137+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:34.698021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.632441+0000","last_change":"2024-09-21T05:50:53.910991+0000","last_active":"2024-09-21T05:53:16.632441+0000","last_peered":"2024-09-21T05:53:16.632441+0000","last_clean":"2024-09-21T05:53:16.632441+0000","last_became_active":"2024-09-21T05:50:53.910720+0000","last_became_peered":"2024-09-21T05:50:53.910720+0000","last_unstale":"2024-09-21T05:53:16.632441+0000","last_undegraded":"2024-09-21T05:53:16.632441+0000","last_fullsized":"2024-09-21T05:53:16.632441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.653746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.634552+0000","last_change":"2024-09-21T05:50:53.894065+0000","last_active":"2024-09-21T05:53:16.634552+0000","last_peered":"2024-09-21T05:53:16.634552+0000","last_clean":"2024-09-21T05:53:16.634552+0000","last_became_active":"2024-09-21T05:50:53.892630+0000","last_became_peered":"2024-09-21T05:50:53.892630+0000","last_unstale":"2024-09-21T05:53:16.634552+0000","last_undegraded":"2024-09-21T05:53:16.634552+0000","last_fullsized":"2024-09-21T05:53:16.634552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:09.025667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.636013+0000","last_change":"2024-09-21T05:50:53.899586+0000","last_active":"2024-09-21T05:53:16.636013+0000","last_peered":"2024-09-21T05:53:16.636013+0000","last_clean":"2024-09-21T05:53:16.636013+0000","last_became_active":"2024-09-21T05:50:53.899066+0000","last_became_peered":"2024-09-21T05:50:53.899066+0000","last_unstale":"2024-09-21T05:53:16.636013+0000","last_undegraded":"2024-09-21T05:53:16.636013+0000","last_fullsized":"2024-09-21T05:53:16.636013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:07.678164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.622595+0000","last_change":"2024-09-21T05:51:47.375063+0000","last_active":"2024-09-21T05:53:16.622595+0000","last_peered":"2024-09-21T05:53:16.622595+0000","last_clean":"2024-09-21T05:53:16.622595+0000","last_became_active":"2024-09-21T05:51:47.374645+0000","last_became_peered":"2024-09-21T05:51:47.374645+0000","last_unstale":"2024-09-21T05:53:16.622595+0000","last_undegraded":"2024-09-21T05:53:16.622595+0000","last_fullsized":"2024-09-21T05:53:16.622595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:29.572438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.625339+0000","last_change":"2024-09-21T05:50:53.901688+0000","last_active":"2024-09-21T05:53:16.625339+0000","last_peered":"2024-09-21T05:53:16.625339+0000","last_clean":"2024-09-21T05:53:16.625339+0000","last_became_active":"2024-09-21T05:50:53.901245+0000","last_became_peered":"2024-09-21T05:50:53.901245+0000","last_unstale":"2024-09-21T05:53:16.625339+0000","last_undegraded":"2024-09-21T05:53:16.625339+0000","last_fullsized":"2024-09-21T05:53:16.625339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:41.401357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.623074+0000","last_change":"2024-09-21T05:50:53.908954+0000","last_active":"2024-09-21T05:53:16.623074+0000","last_peered":"2024-09-21T05:53:16.623074+0000","last_clean":"2024-09-21T05:53:16.623074+0000","last_became_active":"2024-09-21T05:50:53.897605+0000","last_became_peered":"2024-09-21T05:50:53.897605+0000","last_unstale":"2024-09-21T05:53:16.623074+0000","last_undegraded":"2024-09-21T05:53:16.623074+0000","last_fullsized":"2024-09-21T05:53:16.623074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:15.634597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.636800+0000","last_change":"2024-09-21T05:50:53.900106+0000","last_active":"2024-09-21T05:53:16.636800+0000","last_peered":"2024-09-21T05:53:16.636800+0000","last_clean":"2024-09-21T05:53:16.636800+0000","last_became_active":"2024-09-21T05:50:53.899697+0000","last_became_peered":"2024-09-21T05:50:53.899697+0000","last_unstale":"2024-09-21T05:53:16.636800+0000","last_undegraded":"2024-09-21T05:53:16.636800+0000","last_fullsized":"2024-09-21T05:53:16.636800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:36.599501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.621162+0000","last_change":"2024-09-21T05:50:53.899644+0000","last_active":"2024-09-21T05:53:16.621162+0000","last_peered":"2024-09-21T05:53:16.621162+0000","last_clean":"2024-09-21T05:53:16.621162+0000","last_became_active":"2024-09-21T05:50:53.899246+0000","last_became_peered":"2024-09-21T05:50:53.899246+0000","last_unstale":"2024-09-21T05:53:16.621162+0000","last_undegraded":"2024-09-21T05:53:16.621162+0000","last_fullsized":"2024-09-21T05:53:16.621162+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:34.551489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.643578+0000","last_change":"2024-09-21T05:50:53.904328+0000","last_active":"2024-09-21T05:53:16.643578+0000","last_peered":"2024-09-21T05:53:16.643578+0000","last_clean":"2024-09-21T05:53:16.643578+0000","last_became_active":"2024-09-21T05:50:53.903887+0000","last_became_peered":"2024-09-21T05:50:53.903887+0000","last_unstale":"2024-09-21T05:53:16.643578+0000","last_undegraded":"2024-09-21T05:53:16.643578+0000","last_fullsized":"2024-09-21T05:53:16.643578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:27.659631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641985+0000","last_change":"2024-09-21T05:50:53.905278+0000","last_active":"2024-09-21T05:53:16.641985+0000","last_peered":"2024-09-21T05:53:16.641985+0000","last_clean":"2024-09-21T05:53:16.641985+0000","last_became_active":"2024-09-21T05:50:53.904633+0000","last_became_peered":"2024-09-21T05:50:53.904633+0000","last_unstale":"2024-09-21T05:53:16.641985+0000","last_undegraded":"2024-09-21T05:53:16.641985+0000","last_fullsized":"2024-09-21T05:53:16.641985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:26.802336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.642195+0000","last_change":"2024-09-21T05:50:53.891621+0000","last_active":"2024-09-21T05:53:16.642195+0000","last_peered":"2024-09-21T05:53:16.642195+0000","last_clean":"2024-09-21T05:53:16.642195+0000","last_became_active":"2024-09-21T05:50:53.891246+0000","last_became_peered":"2024-09-21T05:50:53.891246+0000","last_unstale":"2024-09-21T05:53:16.642195+0000","last_undegraded":"2024-09-21T05:53:16.642195+0000","last_fullsized":"2024-09-21T05:53:16.642195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:03:21.419789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.626978+0000","last_change":"2024-09-21T05:50:53.902964+0000","last_active":"2024-09-21T05:53:16.626978+0000","last_peered":"2024-09-21T05:53:16.626978+0000","last_clean":"2024-09-21T05:53:16.626978+0000","last_became_active":"2024-09-21T05:50:53.902574+0000","last_became_peered":"2024-09-21T05:50:53.902574+0000","last_unstale":"2024-09-21T05:53:16.626978+0000","last_undegraded":"2024-09-21T05:53:16.626978+0000","last_fullsized":"2024-09-21T05:53:16.626978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:35.552787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.639981+0000","last_change":"2024-09-21T05:50:53.904717+0000","last_active":"2024-09-21T05:53:16.639981+0000","last_peered":"2024-09-21T05:53:16.639981+0000","last_clean":"2024-09-21T05:53:16.639981+0000","last_became_active":"2024-09-21T05:50:53.903152+0000","last_became_peered":"2024-09-21T05:50:53.903152+0000","last_unstale":"2024-09-21T05:53:16.639981+0000","last_undegraded":"2024-09-21T05:53:16.639981+0000","last_fullsized":"2024-09-21T05:53:16.639981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:56.808689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645213+0000","last_change":"2024-09-21T05:50:53.906336+0000","last_active":"2024-09-21T05:53:16.645213+0000","last_peered":"2024-09-21T05:53:16.645213+0000","last_clean":"2024-09-21T05:53:16.645213+0000","last_became_active":"2024-09-21T05:50:53.905942+0000","last_became_peered":"2024-09-21T05:50:53.905942+0000","last_unstale":"2024-09-21T05:53:16.645213+0000","last_undegraded":"2024-09-21T05:53:16.645213+0000","last_fullsized":"2024-09-21T05:53:16.645213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:26.824967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.646758+0000","last_change":"2024-09-21T05:50:53.910772+0000","last_active":"2024-09-21T05:53:16.646758+0000","last_peered":"2024-09-21T05:53:16.646758+0000","last_clean":"2024-09-21T05:53:16.646758+0000","last_became_active":"2024-09-21T05:50:53.910394+0000","last_became_peered":"2024-09-21T05:50:53.910394+0000","last_unstale":"2024-09-21T05:53:16.646758+0000","last_undegraded":"2024-09-21T05:53:16.646758+0000","last_fullsized":"2024-09-21T05:53:16.646758+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:00.338916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.635467+0000","last_change":"2024-09-21T05:50:53.906454+0000","last_active":"2024-09-21T05:53:16.635467+0000","last_peered":"2024-09-21T05:53:16.635467+0000","last_clean":"2024-09-21T05:53:16.635467+0000","last_became_active":"2024-09-21T05:50:53.905947+0000","last_became_peered":"2024-09-21T05:50:53.905947+0000","last_unstale":"2024-09-21T05:53:16.635467+0000","last_undegraded":"2024-09-21T05:53:16.635467+0000","last_fullsized":"2024-09-21T05:53:16.635467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:57.358615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.632851+0000","last_change":"2024-09-21T05:50:53.903690+0000","last_active":"2024-09-21T05:53:16.632851+0000","last_peered":"2024-09-21T05:53:16.632851+0000","last_clean":"2024-09-21T05:53:16.632851+0000","last_became_active":"2024-09-21T05:50:53.900672+0000","last_became_peered":"2024-09-21T05:50:53.900672+0000","last_unstale":"2024-09-21T05:53:16.632851+0000","last_undegraded":"2024-09-21T05:53:16.632851+0000","last_fullsized":"2024-09-21T05:53:16.632851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:42.005312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637208+0000","last_change":"2024-09-21T05:50:53.888711+0000","last_active":"2024-09-21T05:53:16.637208+0000","last_peered":"2024-09-21T05:53:16.637208+0000","last_clean":"2024-09-21T05:53:16.637208+0000","last_became_active":"2024-09-21T05:50:53.888302+0000","last_became_peered":"2024-09-21T05:50:53.888302+0000","last_unstale":"2024-09-21T05:53:16.637208+0000","last_undegraded":"2024-09-21T05:53:16.637208+0000","last_fullsized":"2024-09-21T05:53:16.637208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:24:25.766696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637942+0000","last_change":"2024-09-21T05:50:53.898848+0000","last_active":"2024-09-21T05:53:16.637942+0000","last_peered":"2024-09-21T05:53:16.637942+0000","last_clean":"2024-09-21T05:53:16.637942+0000","last_became_active":"2024-09-21T05:50:53.897785+0000","last_became_peered":"2024-09-21T05:50:53.897785+0000","last_unstale":"2024-09-21T05:53:16.637942+0000","last_undegraded":"2024-09-21T05:53:16.637942+0000","last_fullsized":"2024-09-21T05:53:16.637942+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:25.099224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.646192+0000","last_change":"2024-09-21T05:50:53.899051+0000","last_active":"2024-09-21T05:53:16.646192+0000","last_peered":"2024-09-21T05:53:16.646192+0000","last_clean":"2024-09-21T05:53:16.646192+0000","last_became_active":"2024-09-21T05:50:53.898381+0000","last_became_peered":"2024-09-21T05:50:53.898381+0000","last_unstale":"2024-09-21T05:53:16.646192+0000","last_undegraded":"2024-09-21T05:53:16.646192+0000","last_fullsized":"2024-09-21T05:53:16.646192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:05.958547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.639314+0000","last_change":"2024-09-21T05:50:53.896079+0000","last_active":"2024-09-21T05:53:16.639314+0000","last_peered":"2024-09-21T05:53:16.639314+0000","last_clean":"2024-09-21T05:53:16.639314+0000","last_became_active":"2024-09-21T05:50:53.895659+0000","last_became_peered":"2024-09-21T05:50:53.895659+0000","last_unstale":"2024-09-21T05:53:16.639314+0000","last_undegraded":"2024-09-21T05:53:16.639314+0000","last_fullsized":"2024-09-21T05:53:16.639314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:50.151899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637936+0000","last_change":"2024-09-21T05:50:53.894899+0000","last_active":"2024-09-21T05:53:16.637936+0000","last_peered":"2024-09-21T05:53:16.637936+0000","last_clean":"2024-09-21T05:53:16.637936+0000","last_became_active":"2024-09-21T05:50:53.894530+0000","last_became_peered":"2024-09-21T05:50:53.894530+0000","last_unstale":"2024-09-21T05:53:16.637936+0000","last_undegraded":"2024-09-21T05:53:16.637936+0000","last_fullsized":"2024-09-21T05:53:16.637936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:15.356149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.637061+0000","last_change":"2024-09-21T05:51:47.376927+0000","last_active":"2024-09-21T05:53:16.637061+0000","last_peered":"2024-09-21T05:53:16.637061+0000","last_clean":"2024-09-21T05:53:16.637061+0000","last_became_active":"2024-09-21T05:51:47.376534+0000","last_became_peered":"2024-09-21T05:51:47.376534+0000","last_unstale":"2024-09-21T05:53:16.637061+0000","last_undegraded":"2024-09-21T05:53:16.637061+0000","last_fullsized":"2024-09-21T05:53:16.637061+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:26.353085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.641137+0000","last_change":"2024-09-21T05:50:53.903196+0000","last_active":"2024-09-21T05:53:16.641137+0000","last_peered":"2024-09-21T05:53:16.641137+0000","last_clean":"2024-09-21T05:53:16.641137+0000","last_became_active":"2024-09-21T05:50:53.902825+0000","last_became_peered":"2024-09-21T05:50:53.902825+0000","last_unstale":"2024-09-21T05:53:16.641137+0000","last_undegraded":"2024-09-21T05:53:16.641137+0000","last_fullsized":"2024-09-21T05:53:16.641137+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:13.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.636471+0000","last_change":"2024-09-21T05:50:53.902249+0000","last_active":"2024-09-21T05:53:16.636471+0000","last_peered":"2024-09-21T05:53:16.636471+0000","last_clean":"2024-09-21T05:53:16.636471+0000","last_became_active":"2024-09-21T05:50:53.901828+0000","last_became_peered":"2024-09-21T05:50:53.901828+0000","last_unstale":"2024-09-21T05:53:16.636471+0000","last_undegraded":"2024-09-21T05:53:16.636471+0000","last_fullsized":"2024-09-21T05:53:16.636471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:51.200179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.626871+0000","last_change":"2024-09-21T05:50:53.897170+0000","last_active":"2024-09-21T05:53:16.626871+0000","last_peered":"2024-09-21T05:53:16.626871+0000","last_clean":"2024-09-21T05:53:16.626871+0000","last_became_active":"2024-09-21T05:50:53.895337+0000","last_became_peered":"2024-09-21T05:50:53.895337+0000","last_unstale":"2024-09-21T05:53:16.626871+0000","last_undegraded":"2024-09-21T05:53:16.626871+0000","last_fullsized":"2024-09-21T05:53:16.626871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:19.869698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.629432+0000","last_change":"2024-09-21T05:50:53.899575+0000","last_active":"2024-09-21T05:53:16.629432+0000","last_peered":"2024-09-21T05:53:16.629432+0000","last_clean":"2024-09-21T05:53:16.629432+0000","last_became_active":"2024-09-21T05:50:53.898274+0000","last_became_peered":"2024-09-21T05:50:53.898274+0000","last_unstale":"2024-09-21T05:53:16.629432+0000","last_undegraded":"2024-09-21T05:53:16.629432+0000","last_fullsized":"2024-09-21T05:53:16.629432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:28.188691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.647411+0000","last_change":"2024-09-21T05:50:53.908381+0000","last_active":"2024-09-21T05:53:16.647411+0000","last_peered":"2024-09-21T05:53:16.647411+0000","last_clean":"2024-09-21T05:53:16.647411+0000","last_became_active":"2024-09-21T05:50:53.906731+0000","last_became_peered":"2024-09-21T05:50:53.906731+0000","last_unstale":"2024-09-21T05:53:16.647411+0000","last_undegraded":"2024-09-21T05:53:16.647411+0000","last_fullsized":"2024-09-21T05:53:16.647411+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:59.254561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.631582+0000","last_change":"2024-09-21T05:50:53.904619+0000","last_active":"2024-09-21T05:53:16.631582+0000","last_peered":"2024-09-21T05:53:16.631582+0000","last_clean":"2024-09-21T05:53:16.631582+0000","last_became_active":"2024-09-21T05:50:53.903901+0000","last_became_peered":"2024-09-21T05:50:53.903901+0000","last_unstale":"2024-09-21T05:53:16.631582+0000","last_undegraded":"2024-09-21T05:53:16.631582+0000","last_fullsized":"2024-09-21T05:53:16.631582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:25.531973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-21T05:53:16.645006+0000","last_change":"2024-09-21T05:50:53.903557+0000","last_active":"2024-09-21T05:53:16.645006+0000","last_peered":"2024-09-21T05:53:16.645006+0000","last_clean":"2024-09-21T05:53:16.645006+0000","last_became_active":"2024-09-21T05:50:53.903195+0000","last_became_peered":"2024-09-21T05:50:53.903195+0000","last_unstale":"2024-09-21T05:53:16.645006+0000","last_undegraded":"2024-09-21T05:53:16.645006+0000","last_fullsized":"2024-09-21T05:53:16.645006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T05:50:52.851961+0000","last_clean_scrub_stamp":"2024-09-21T05:50:52.851961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:32.268063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70625,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":234,"num_read_kb":188,"num_write":98,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":211875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678063,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":521686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874292,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28700,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716452,"statfs":{"total":95995035648,"available":95965646848,"internally_reserved":0,"allocated":1716224,"data_stored":1177668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037819,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":526364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234048,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":522290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430277,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32784,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712368,"statfs":{"total":95995035648,"available":95961464832,"internally_reserved":0,"allocated":1638400,"data_stored":1116732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626506,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":517590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822738,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36948,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708204,"statfs":{"total":95995035648,"available":95957200896,"internally_reserved":0,"allocated":1642496,"data_stored":1112236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018966,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":521708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215194,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1040384,"data_stored":517694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444129,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1114112,"data_stored":587451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1110016,"data_stored":587417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738477,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":517680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:53:42.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:43.053 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:42 smithi037 ceph-mon[30631]: from='client.25280 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:43.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:42 smithi144 ceph-mon[34351]: from='client.25280 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:43.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:42 smithi067 ceph-mon[34443]: from='client.25280 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:53:43.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.506+0000 7f3a2b000640 1 -- 172.21.15.37:0/1691714485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a2410c010 msgr2=0x7f3a24112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.506+0000 7f3a2b000640 1 --2- 172.21.15.37:0/1691714485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a2410c010 0x7f3a24112840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009be0 tx=0x7f3a1c02a6c0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.506+0000 7f3a2b000640 1 -- 172.21.15.37:0/1691714485 shutdown_connections 2024-09-21T05:53:43.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.506+0000 7f3a2b000640 1 --2- 172.21.15.37:0/1691714485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a2410c010 0x7f3a24112840 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.506+0000 7f3a2b000640 1 --2- 172.21.15.37:0/1691714485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a2410b6c0 0x7f3a2410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.506+0000 7f3a2b000640 1 --2- 172.21.15.37:0/1691714485 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a24105d80 0x7f3a24106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.506+0000 7f3a2b000640 1 -- 172.21.15.37:0/1691714485 >> 172.21.15.37:0/1691714485 conn(0x7f3a24101810 msgr2=0x7f3a24103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:43.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.506+0000 7f3a2b000640 1 -- 172.21.15.37:0/1691714485 shutdown_connections 2024-09-21T05:53:43.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.506+0000 7f3a2b000640 1 -- 172.21.15.37:0/1691714485 wait complete. 2024-09-21T05:53:43.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.507+0000 7f3a2b000640 1 Processor -- start 2024-09-21T05:53:43.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.508+0000 7f3a2b000640 1 -- start start 2024-09-21T05:53:43.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.508+0000 7f3a2b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a24105d80 0x7f3a2419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.508+0000 7f3a2b000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a2410b6c0 0x7f3a2419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.508+0000 7f3a2b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a2410c010 0x7f3a241a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.508+0000 7f3a2b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24115cd0 con 0x7f3a24105d80 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.508+0000 7f3a2b000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24115b50 con 0x7f3a2410b6c0 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.508+0000 7f3a2b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24115e50 con 0x7f3a2410c010 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.508+0000 7f3a23400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a2410b6c0 0x7f3a2419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.508+0000 7f3a23400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a2410b6c0 0x7f3a2419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:50354/0 (socket says 172.21.15.37:50354) 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.508+0000 7f3a23400640 1 -- 172.21.15.37:0/2504717284 learned_addr learned my addr 172.21.15.37:0/2504717284 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.508+0000 7f3a23e00640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a24105d80 0x7f3a2419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.509+0000 7f3a29000640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a2410c010 0x7f3a241a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.509+0000 7f3a23400640 1 -- 172.21.15.37:0/2504717284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a2410c010 msgr2=0x7f3a241a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.509+0000 7f3a23400640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a2410c010 0x7f3a241a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.509+0000 7f3a23400640 1 -- 172.21.15.37:0/2504717284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a24105d80 msgr2=0x7f3a2419c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.509+0000 7f3a23400640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a24105d80 0x7f3a2419c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.509+0000 7f3a23400640 1 -- 172.21.15.37:0/2504717284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a241a2670 con 0x7f3a2410b6c0 2024-09-21T05:53:43.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.509+0000 7f3a23e00640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a24105d80 0x7f3a2419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:53:43.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.509+0000 7f3a23400640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a2410b6c0 0x7f3a2419cca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000e9f0 tx=0x7f3a1000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.509+0000 7f3a20c00640 1 -- 172.21.15.37:0/2504717284 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000ccc0 con 0x7f3a2410b6c0 2024-09-21T05:53:43.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.510+0000 7f3a2b000640 1 -- 172.21.15.37:0/2504717284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a241a2960 con 0x7f3a2410b6c0 2024-09-21T05:53:43.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.510+0000 7f3a20c00640 1 -- 172.21.15.37:0/2504717284 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a100108e0 con 0x7f3a2410b6c0 2024-09-21T05:53:43.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.510+0000 7f3a2b000640 1 -- 172.21.15.37:0/2504717284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a241a90c0 con 0x7f3a2410b6c0 2024-09-21T05:53:43.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.510+0000 7f3a20c00640 1 -- 172.21.15.37:0/2504717284 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10018860 con 0x7f3a2410b6c0 2024-09-21T05:53:43.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.511+0000 7f3a2b000640 1 -- 172.21.15.37:0/2504717284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a24106190 con 0x7f3a2410b6c0 2024-09-21T05:53:43.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.513+0000 7f3a20c00640 1 -- 172.21.15.37:0/2504717284 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3a10010430 con 0x7f3a2410b6c0 2024-09-21T05:53:43.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.515+0000 7f3a20c00640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3a080b6590 0x7f3a080b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:43.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.515+0000 7f3a20c00640 1 -- 172.21.15.37:0/2504717284 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f3a100e7e30 con 0x7f3a2410b6c0 2024-09-21T05:53:43.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.515+0000 7f3a23e00640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3a080b6590 0x7f3a080b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:43.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.516+0000 7f3a23e00640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3a080b6590 0x7f3a080b8aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3a14005fd0 tx=0x7f3a14009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:43.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.517+0000 7f3a20c00640 1 -- 172.21.15.37:0/2504717284 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a100ae290 con 0x7f3a2410b6c0 2024-09-21T05:53:43.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.751+0000 7f3a2b000640 1 -- 172.21.15.37:0/2504717284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a2419d830 con 0x7f3a2410b6c0 2024-09-21T05:53:43.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.752+0000 7f3a20c00640 1 -- 172.21.15.37:0/2504717284 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f3a100b2670 con 0x7f3a2410b6c0 2024-09-21T05:53:43.754 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:43.755 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:53:43.755 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:53:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.755+0000 7f3a2b000640 1 -- 172.21.15.37:0/2504717284 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3a080b6590 msgr2=0x7f3a080b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.755+0000 7f3a2b000640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3a080b6590 0x7f3a080b8aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3a14005fd0 tx=0x7f3a14009260 comp rx=0 tx=0).stop 2024-09-21T05:53:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.755+0000 7f3a2b000640 1 -- 172.21.15.37:0/2504717284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a2410b6c0 msgr2=0x7f3a2419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.755+0000 7f3a2b000640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a2410b6c0 0x7f3a2419cca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000e9f0 tx=0x7f3a1000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.755+0000 7f3a2b000640 1 -- 172.21.15.37:0/2504717284 shutdown_connections 2024-09-21T05:53:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.755+0000 7f3a2b000640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a2410c010 0x7f3a241a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.755+0000 7f3a2b000640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f3a080b6590 0x7f3a080b8aa0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.755+0000 7f3a2b000640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a2410b6c0 0x7f3a2419cca0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.755+0000 7f3a2b000640 1 --2- 172.21.15.37:0/2504717284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a24105d80 0x7f3a2419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.755+0000 7f3a2b000640 1 -- 172.21.15.37:0/2504717284 >> 172.21.15.37:0/2504717284 conn(0x7f3a24101810 msgr2=0x7f3a2410ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.755+0000 7f3a2b000640 1 -- 172.21.15.37:0/2504717284 shutdown_connections 2024-09-21T05:53:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:43.755+0000 7f3a2b000640 1 -- 172.21.15.37:0/2504717284 wait complete. 2024-09-21T05:53:44.116 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:43 smithi037 ceph-mon[30631]: pgmap v408: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T05:53:44.116 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:43 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2504717284' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:44.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:43 smithi144 ceph-mon[34351]: pgmap v408: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T05:53:44.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:43 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2504717284' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:44.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:43 smithi067 ceph-mon[34443]: pgmap v408: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T05:53:44.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:43 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2504717284' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:44.616 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:44.996 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.650+0000 7f1aba800640 1 -- 172.21.15.37:0/2176855549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab41092f0 msgr2=0x7f1ab4109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.650+0000 7f1aba800640 1 --2- 172.21.15.37:0/2176855549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab41092f0 0x7f1ab4109700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009900 tx=0x7f1aa002a3f0 comp rx=0 tx=0).stop 2024-09-21T05:53:45.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.651+0000 7f1aba800640 1 -- 172.21.15.37:0/2176855549 shutdown_connections 2024-09-21T05:53:45.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.651+0000 7f1aba800640 1 --2- 172.21.15.37:0/2176855549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ab4109c40 0x7f1ab4110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:45.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.651+0000 7f1aba800640 1 --2- 172.21.15.37:0/2176855549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab41092f0 0x7f1ab4109700 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:45.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.651+0000 7f1aba800640 1 --2- 172.21.15.37:0/2176855549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab41039b0 0x7f1ab4103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:45.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.651+0000 7f1aba800640 1 -- 172.21.15.37:0/2176855549 >> 172.21.15.37:0/2176855549 conn(0x7f1ab40ff400 msgr2=0x7f1ab4101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:45.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.651+0000 7f1aba800640 1 -- 172.21.15.37:0/2176855549 shutdown_connections 2024-09-21T05:53:45.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.651+0000 7f1aba800640 1 -- 172.21.15.37:0/2176855549 wait complete. 2024-09-21T05:53:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.652+0000 7f1aba800640 1 Processor -- start 2024-09-21T05:53:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.652+0000 7f1aba800640 1 -- start start 2024-09-21T05:53:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.652+0000 7f1aba800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ab41039b0 0x7f1ab419c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.652+0000 7f1aba800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab41092f0 0x7f1ab419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.652+0000 7f1aba800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab4109c40 0x7f1ab41a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.652+0000 7f1aba800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4113900 con 0x7f1ab4109c40 2024-09-21T05:53:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.652+0000 7f1aba800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4113780 con 0x7f1ab41092f0 2024-09-21T05:53:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.652+0000 7f1aba800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4113a80 con 0x7f1ab41039b0 2024-09-21T05:53:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.653+0000 7f1ab9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab4109c40 0x7f1ab41a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.653+0000 7f1ab9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab4109c40 0x7f1ab41a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34882/0 (socket says 172.21.15.37:34882) 2024-09-21T05:53:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.653+0000 7f1ab9e00640 1 -- 172.21.15.37:0/445334376 learned_addr learned my addr 172.21.15.37:0/445334376 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.653+0000 7f1ab9400640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ab41039b0 0x7f1ab419c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.653+0000 7f1ab8a00640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab41092f0 0x7f1ab419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.653+0000 7f1ab9400640 1 -- 172.21.15.37:0/445334376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab41092f0 msgr2=0x7f1ab419ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.653+0000 7f1ab9400640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab41092f0 0x7f1ab419ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.653+0000 7f1ab9400640 1 -- 172.21.15.37:0/445334376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab4109c40 msgr2=0x7f1ab41a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.653+0000 7f1ab9400640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab4109c40 0x7f1ab41a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.653+0000 7f1ab9400640 1 -- 172.21.15.37:0/445334376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab41a2440 con 0x7f1ab41039b0 2024-09-21T05:53:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.653+0000 7f1ab9e00640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab4109c40 0x7f1ab41a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.653+0000 7f1ab9400640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ab41039b0 0x7f1ab419c4d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800e9f0 tx=0x7f1aa800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.654+0000 7f1ab2000640 1 -- 172.21.15.37:0/445334376 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa800ccc0 con 0x7f1ab41039b0 2024-09-21T05:53:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.654+0000 7f1aba800640 1 -- 172.21.15.37:0/445334376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab41a2730 con 0x7f1ab41039b0 2024-09-21T05:53:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.654+0000 7f1ab2000640 1 -- 172.21.15.37:0/445334376 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1aa80108e0 con 0x7f1ab41039b0 2024-09-21T05:53:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.654+0000 7f1ab2000640 1 -- 172.21.15.37:0/445334376 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8018880 con 0x7f1ab41039b0 2024-09-21T05:53:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.654+0000 7f1aba800640 1 -- 172.21.15.37:0/445334376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab41a8e90 con 0x7f1ab41039b0 2024-09-21T05:53:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.655+0000 7f1aba800640 1 -- 172.21.15.37:0/445334376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab4103dc0 con 0x7f1ab41039b0 2024-09-21T05:53:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.658+0000 7f1ab2000640 1 -- 172.21.15.37:0/445334376 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1aa8010430 con 0x7f1ab41039b0 2024-09-21T05:53:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.659+0000 7f1ab2000640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1a9c0b6510 0x7f1a9c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:45.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.659+0000 7f1ab2000640 1 -- 172.21.15.37:0/445334376 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f1aa80e7ef0 con 0x7f1ab41039b0 2024-09-21T05:53:45.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.659+0000 7f1ab8a00640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1a9c0b6510 0x7f1a9c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:45.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.660+0000 7f1ab8a00640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1a9c0b6510 0x7f1a9c0b8a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009230 tx=0x7f1aa0031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.661+0000 7f1ab2000640 1 -- 172.21.15.37:0/445334376 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1aa80b2730 con 0x7f1ab41039b0 2024-09-21T05:53:45.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.902+0000 7f1aba800640 1 -- 172.21.15.37:0/445334376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ab41a90c0 con 0x7f1ab41039b0 2024-09-21T05:53:45.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.903+0000 7f1ab2000640 1 -- 172.21.15.37:0/445334376 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f1aa80b7670 con 0x7f1ab41039b0 2024-09-21T05:53:45.906 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:45.906 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:53:45.906 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:53:45.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.906+0000 7f1aba800640 1 -- 172.21.15.37:0/445334376 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1a9c0b6510 msgr2=0x7f1a9c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:45.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.906+0000 7f1aba800640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1a9c0b6510 0x7f1a9c0b8a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009230 tx=0x7f1aa0031400 comp rx=0 tx=0).stop 2024-09-21T05:53:45.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.906+0000 7f1aba800640 1 -- 172.21.15.37:0/445334376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ab41039b0 msgr2=0x7f1ab419c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:45.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.906+0000 7f1aba800640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ab41039b0 0x7f1ab419c4d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800e9f0 tx=0x7f1aa800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:53:45.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.906+0000 7f1aba800640 1 -- 172.21.15.37:0/445334376 shutdown_connections 2024-09-21T05:53:45.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.906+0000 7f1aba800640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab4109c40 0x7f1ab41a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:45.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.906+0000 7f1aba800640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1a9c0b6510 0x7f1a9c0b8a20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:45.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.906+0000 7f1aba800640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ab41092f0 0x7f1ab419ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:45.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.906+0000 7f1aba800640 1 --2- 172.21.15.37:0/445334376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ab41039b0 0x7f1ab419c4d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:45.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.906+0000 7f1aba800640 1 -- 172.21.15.37:0/445334376 >> 172.21.15.37:0/445334376 conn(0x7f1ab40ff400 msgr2=0x7f1ab41089c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:45.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.906+0000 7f1aba800640 1 -- 172.21.15.37:0/445334376 shutdown_connections 2024-09-21T05:53:45.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:45.906+0000 7f1aba800640 1 -- 172.21.15.37:0/445334376 wait complete. 2024-09-21T05:53:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:45 smithi144 ceph-mon[34351]: pgmap v409: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 767 B/s wr, 2 op/s 2024-09-21T05:53:46.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:45 smithi037 ceph-mon[30631]: pgmap v409: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 767 B/s wr, 2 op/s 2024-09-21T05:53:46.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:45 smithi067 ceph-mon[34443]: pgmap v409: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 767 B/s wr, 2 op/s 2024-09-21T05:53:46.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:53:47.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:46 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/445334376' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:47.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:46 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/445334376' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:47.191 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:47.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:46 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/445334376' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:47.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.838+0000 7f7114200640 1 -- 172.21.15.37:0/2226146865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f710c105d80 msgr2=0x7f710c106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:47.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.838+0000 7f7114200640 1 --2- 172.21.15.37:0/2226146865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f710c105d80 0x7f710c106190 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7100009900 tx=0x7f710002a410 comp rx=0 tx=0).stop 2024-09-21T05:53:47.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.838+0000 7f7114200640 1 -- 172.21.15.37:0/2226146865 shutdown_connections 2024-09-21T05:53:47.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.838+0000 7f7114200640 1 --2- 172.21.15.37:0/2226146865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f710c10c010 0x7f710c112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:47.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.838+0000 7f7114200640 1 --2- 172.21.15.37:0/2226146865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c10b6c0 0x7f710c10bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:47.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.838+0000 7f7114200640 1 --2- 172.21.15.37:0/2226146865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f710c105d80 0x7f710c106190 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:47.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.838+0000 7f7114200640 1 -- 172.21.15.37:0/2226146865 >> 172.21.15.37:0/2226146865 conn(0x7f710c1017d0 msgr2=0x7f710c103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:47.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.838+0000 7f7114200640 1 -- 172.21.15.37:0/2226146865 shutdown_connections 2024-09-21T05:53:47.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.838+0000 7f7114200640 1 -- 172.21.15.37:0/2226146865 wait complete. 2024-09-21T05:53:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.839+0000 7f7114200640 1 Processor -- start 2024-09-21T05:53:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.840+0000 7f7114200640 1 -- start start 2024-09-21T05:53:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.840+0000 7f7114200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f710c105d80 0x7f710c19c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.840+0000 7f7114200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c10b6c0 0x7f710c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.840+0000 7f7114200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f710c10c010 0x7f710c1a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.840+0000 7f7114200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f710c115cd0 con 0x7f710c105d80 2024-09-21T05:53:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.840+0000 7f7114200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f710c115b50 con 0x7f710c10c010 2024-09-21T05:53:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.840+0000 7f7114200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f710c115e50 con 0x7f710c10b6c0 2024-09-21T05:53:47.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.840+0000 7f7111800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f710c105d80 0x7f710c19c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.840+0000 7f7111800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f710c105d80 0x7f710c19c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34898/0 (socket says 172.21.15.37:34898) 2024-09-21T05:53:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.840+0000 7f7111800640 1 -- 172.21.15.37:0/4112371429 learned_addr learned my addr 172.21.15.37:0/4112371429 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.840+0000 7f7112200640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f710c10c010 0x7f710c1a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.840+0000 7f7110e00640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c10b6c0 0x7f710c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.841+0000 7f7111800640 1 -- 172.21.15.37:0/4112371429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c10b6c0 msgr2=0x7f710c19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.841+0000 7f7111800640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c10b6c0 0x7f710c19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.841+0000 7f7111800640 1 -- 172.21.15.37:0/4112371429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f710c10c010 msgr2=0x7f710c1a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.841+0000 7f7111800640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f710c10c010 0x7f710c1a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.841+0000 7f7111800640 1 -- 172.21.15.37:0/4112371429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c1a2650 con 0x7f710c105d80 2024-09-21T05:53:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.841+0000 7f7111800640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f710c105d80 0x7f710c19c6e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7100005940 tx=0x7f71000040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.841+0000 7f710a000640 1 -- 172.21.15.37:0/4112371429 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710003f030 con 0x7f710c105d80 2024-09-21T05:53:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.841+0000 7f710a000640 1 -- 172.21.15.37:0/4112371429 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71000044c0 con 0x7f710c105d80 2024-09-21T05:53:47.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.841+0000 7f710a000640 1 -- 172.21.15.37:0/4112371429 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100035070 con 0x7f710c105d80 2024-09-21T05:53:47.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.841+0000 7f7114200640 1 -- 172.21.15.37:0/4112371429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710c1a28e0 con 0x7f710c105d80 2024-09-21T05:53:47.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.842+0000 7f7114200640 1 -- 172.21.15.37:0/4112371429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710c1a90a0 con 0x7f710c105d80 2024-09-21T05:53:47.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.843+0000 7f7114200640 1 -- 172.21.15.37:0/4112371429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710c106190 con 0x7f710c105d80 2024-09-21T05:53:47.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.845+0000 7f710a000640 1 -- 172.21.15.37:0/4112371429 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7100042030 con 0x7f710c105d80 2024-09-21T05:53:47.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.847+0000 7f710a000640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f70f40b6510 0x7f70f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:47.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.847+0000 7f710a000640 1 -- 172.21.15.37:0/4112371429 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7100107cf0 con 0x7f710c105d80 2024-09-21T05:53:47.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.847+0000 7f7110e00640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f70f40b6510 0x7f70f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:47.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.848+0000 7f7110e00640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f70f40b6510 0x7f70f40b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f710c10b1c0 tx=0x7f70f8005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:47.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:47.849+0000 7f710a000640 1 -- 172.21.15.37:0/4112371429 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71000d2530 con 0x7f710c105d80 2024-09-21T05:53:47.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:47 smithi037 ceph-mon[30631]: pgmap v410: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-21T05:53:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.050+0000 7f7114200640 1 -- 172.21.15.37:0/4112371429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f710c19d810 con 0x7f710c105d80 2024-09-21T05:53:48.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.052+0000 7f710a000640 1 -- 172.21.15.37:0/4112371429 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24836 (secure 0 0 0) 0x7f71000d7470 con 0x7f710c105d80 2024-09-21T05:53:48.055 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:48.055 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":90,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:52:47.670174+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:50:49.791290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:50:51.877662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:51:01.928796+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:53:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.054+0000 7f7114200640 1 -- 172.21.15.37:0/4112371429 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f70f40b6510 msgr2=0x7f70f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.054+0000 7f7114200640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f70f40b6510 0x7f70f40b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f710c10b1c0 tx=0x7f70f8005f90 comp rx=0 tx=0).stop 2024-09-21T05:53:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.054+0000 7f7114200640 1 -- 172.21.15.37:0/4112371429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f710c105d80 msgr2=0x7f710c19c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.054+0000 7f7114200640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f710c105d80 0x7f710c19c6e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7100005940 tx=0x7f71000040c0 comp rx=0 tx=0).stop 2024-09-21T05:53:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.055+0000 7f7114200640 1 -- 172.21.15.37:0/4112371429 shutdown_connections 2024-09-21T05:53:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.055+0000 7f7114200640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f70f40b6510 0x7f70f40b8a20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.055+0000 7f7114200640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f710c10c010 0x7f710c1a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.055+0000 7f7114200640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c10b6c0 0x7f710c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.055+0000 7f7114200640 1 --2- 172.21.15.37:0/4112371429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f710c105d80 0x7f710c19c6e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.055+0000 7f7114200640 1 -- 172.21.15.37:0/4112371429 >> 172.21.15.37:0/4112371429 conn(0x7f710c1017d0 msgr2=0x7f710c103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.055+0000 7f7114200640 1 -- 172.21.15.37:0/4112371429 shutdown_connections 2024-09-21T05:53:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:48.055+0000 7f7114200640 1 -- 172.21.15.37:0/4112371429 wait complete. 2024-09-21T05:53:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:47 smithi144 ceph-mon[34351]: pgmap v410: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-21T05:53:48.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:47 smithi067 ceph-mon[34443]: pgmap v410: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-21T05:53:48.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph daemon mon.a --format=json config get run_dir 2024-09-21T05:53:49.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:48 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/4112371429' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:49.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:48 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/4112371429' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:49.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:48 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/4112371429' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T05:53:49.374 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:49 smithi144 ceph-mon[34351]: pgmap v411: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T05:53:50.159 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:49 smithi037 ceph-mon[30631]: pgmap v411: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T05:53:50.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:49 smithi067 ceph-mon[34443]: pgmap v411: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T05:53:50.997 INFO:teuthology.orchestra.run.smithi037.stdout:{"run_dir":"/var/run/ceph"} 2024-09-21T05:53:50.998 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-21T05:53:50.998 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7864 2024-09-21T05:53:50.998 DEBUG:tasks.quiescer:Yielding 2024-09-21T05:53:50.998 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T05:53:51.013 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:53:51.013 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T05:53:51.013 INFO:tasks.workunit:timeout=3h 2024-09-21T05:53:51.013 INFO:tasks.workunit:cleanup=True 2024-09-21T05:53:51.013 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:51.014 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:53:51.050 INFO:teuthology.orchestra.run.smithi037.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:51.050 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T05:53:51.050 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6ch/108d Inode: 1099511628283 Links: 2 2024-09-21T05:53:51.051 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T05:53:51.051 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T05:53:51.051 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-21 05:51:58.692591693 +0000 2024-09-21T05:53:51.051 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-21 05:51:58.692591693 +0000 2024-09-21T05:53:51.051 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-21 05:53:35.721463299 +0000 2024-09-21T05:53:51.051 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-21 05:51:58.692591693 +0000 2024-09-21T05:53:51.051 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T05:53:51.051 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T05:53:51.158 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:53:51.197 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T05:53:51.438 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:51.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:51 smithi037 ceph-mon[30631]: pgmap v412: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T05:53:52.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.034+0000 7f5c9fe00640 1 -- 172.21.15.37:0/2673734023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca01092f0 msgr2=0x7f5ca0109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:52.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.034+0000 7f5c9fe00640 1 --2- 172.21.15.37:0/2673734023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca01092f0 0x7f5ca0109700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5c88009900 tx=0x7f5c8802a410 comp rx=0 tx=0).stop 2024-09-21T05:53:52.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.034+0000 7f5c9fe00640 1 -- 172.21.15.37:0/2673734023 shutdown_connections 2024-09-21T05:53:52.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.034+0000 7f5c9fe00640 1 --2- 172.21.15.37:0/2673734023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ca0109c40 0x7f5ca0110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:52.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.034+0000 7f5c9fe00640 1 --2- 172.21.15.37:0/2673734023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca01092f0 0x7f5ca0109700 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:52.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.034+0000 7f5c9fe00640 1 --2- 172.21.15.37:0/2673734023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ca01039b0 0x7f5ca0103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:52.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.034+0000 7f5c9fe00640 1 -- 172.21.15.37:0/2673734023 >> 172.21.15.37:0/2673734023 conn(0x7f5ca00ff440 msgr2=0x7f5ca0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:52.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.035+0000 7f5c9fe00640 1 -- 172.21.15.37:0/2673734023 shutdown_connections 2024-09-21T05:53:52.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.035+0000 7f5c9fe00640 1 -- 172.21.15.37:0/2673734023 wait complete. 2024-09-21T05:53:52.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.036+0000 7f5c9fe00640 1 Processor -- start 2024-09-21T05:53:52.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.036+0000 7f5c9fe00640 1 -- start start 2024-09-21T05:53:52.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.036+0000 7f5c9fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ca01039b0 0x7f5ca019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:52.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.036+0000 7f5c9fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ca01092f0 0x7f5ca019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:52.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.036+0000 7f5c9fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0109c40 0x7f5ca01a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:52.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.036+0000 7f5c9fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0113950 con 0x7f5ca0109c40 2024-09-21T05:53:52.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.036+0000 7f5c9fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca01137d0 con 0x7f5ca01039b0 2024-09-21T05:53:52.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.036+0000 7f5c9fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0113ad0 con 0x7f5ca01092f0 2024-09-21T05:53:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.037+0000 7f5c9f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0109c40 0x7f5ca01a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.037+0000 7f5c9f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0109c40 0x7f5ca01a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38248/0 (socket says 172.21.15.37:38248) 2024-09-21T05:53:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.037+0000 7f5c9f400640 1 -- 172.21.15.37:0/1387105685 learned_addr learned my addr 172.21.15.37:0/1387105685 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.037+0000 7f5c96000640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ca01092f0 0x7f5ca019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.037+0000 7f5c9ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ca01039b0 0x7f5ca019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.037+0000 7f5c9f400640 1 -- 172.21.15.37:0/1387105685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ca01092f0 msgr2=0x7f5ca019cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.037+0000 7f5c9f400640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ca01092f0 0x7f5ca019cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.037+0000 7f5c9f400640 1 -- 172.21.15.37:0/1387105685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ca01039b0 msgr2=0x7f5ca019c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.037+0000 7f5c9f400640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ca01039b0 0x7f5ca019c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.037+0000 7f5c9f400640 1 -- 172.21.15.37:0/1387105685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca01a24b0 con 0x7f5ca0109c40 2024-09-21T05:53:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.037+0000 7f5c9ea00640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ca01039b0 0x7f5ca019c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.038+0000 7f5c9f400640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0109c40 0x7f5ca01a1d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800e970 tx=0x7f5c9800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.038+0000 7f5c97e00640 1 -- 172.21.15.37:0/1387105685 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800ccc0 con 0x7f5ca0109c40 2024-09-21T05:53:52.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.038+0000 7f5c9fe00640 1 -- 172.21.15.37:0/1387105685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca01a27a0 con 0x7f5ca0109c40 2024-09-21T05:53:52.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.038+0000 7f5c97e00640 1 -- 172.21.15.37:0/1387105685 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c9800ce60 con 0x7f5ca0109c40 2024-09-21T05:53:52.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.038+0000 7f5c97e00640 1 -- 172.21.15.37:0/1387105685 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98010430 con 0x7f5ca0109c40 2024-09-21T05:53:52.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.038+0000 7f5c9fe00640 1 -- 172.21.15.37:0/1387105685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca01a8f00 con 0x7f5ca0109c40 2024-09-21T05:53:52.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.039+0000 7f5c9fe00640 1 -- 172.21.15.37:0/1387105685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca0103dc0 con 0x7f5ca0109c40 2024-09-21T05:53:52.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.042+0000 7f5c97e00640 1 -- 172.21.15.37:0/1387105685 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5c98004fb0 con 0x7f5ca0109c40 2024-09-21T05:53:52.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.044+0000 7f5c97e00640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5c840b6590 0x7f5c840b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:52.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.045+0000 7f5c97e00640 1 -- 172.21.15.37:0/1387105685 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f5c980e7bc0 con 0x7f5ca0109c40 2024-09-21T05:53:52.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.045+0000 7f5c9ea00640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5c840b6590 0x7f5c840b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:52.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.045+0000 7f5c9ea00640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5c840b6590 0x7f5c840b8aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5c90005fd0 tx=0x7f5c90009760 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:52.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.047+0000 7f5c97e00640 1 -- 172.21.15.37:0/1387105685 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5c98056710 con 0x7f5ca0109c40 2024-09-21T05:53:52.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:51 smithi144 ceph-mon[34351]: pgmap v412: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T05:53:52.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:51 smithi067 ceph-mon[34443]: pgmap v412: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-21T05:53:52.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.285+0000 7f5c9fe00640 1 -- 172.21.15.37:0/1387105685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ca019d670 con 0x7f5ca0109c40 2024-09-21T05:53:52.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.286+0000 7f5c97e00640 1 -- 172.21.15.37:0/1387105685 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f5ca019d670 con 0x7f5ca0109c40 2024-09-21T05:53:52.288 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:53:52.289 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:53:52.289 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:53:52.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.288+0000 7f5c9fe00640 1 -- 172.21.15.37:0/1387105685 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5c840b6590 msgr2=0x7f5c840b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:52.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.288+0000 7f5c9fe00640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5c840b6590 0x7f5c840b8aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5c90005fd0 tx=0x7f5c90009760 comp rx=0 tx=0).stop 2024-09-21T05:53:52.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.288+0000 7f5c9fe00640 1 -- 172.21.15.37:0/1387105685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0109c40 msgr2=0x7f5ca01a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:52.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.288+0000 7f5c9fe00640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0109c40 0x7f5ca01a1d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800e970 tx=0x7f5c9800ed70 comp rx=0 tx=0).stop 2024-09-21T05:53:52.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.289+0000 7f5c9fe00640 1 -- 172.21.15.37:0/1387105685 shutdown_connections 2024-09-21T05:53:52.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.289+0000 7f5c9fe00640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0109c40 0x7f5ca01a1d80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:52.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.289+0000 7f5c9fe00640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ca01092f0 0x7f5ca019cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:52.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.289+0000 7f5c9fe00640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5c840b6590 0x7f5c840b8aa0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:52.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.289+0000 7f5c9fe00640 1 --2- 172.21.15.37:0/1387105685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ca01039b0 0x7f5ca019c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:52.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.289+0000 7f5c9fe00640 1 -- 172.21.15.37:0/1387105685 >> 172.21.15.37:0/1387105685 conn(0x7f5ca00ff440 msgr2=0x7f5ca0108990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:52.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.289+0000 7f5c9fe00640 1 -- 172.21.15.37:0/1387105685 shutdown_connections 2024-09-21T05:53:52.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:52.289+0000 7f5c9fe00640 1 -- 172.21.15.37:0/1387105685 wait complete. 2024-09-21T05:53:52.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:52 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1387105685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:53.042 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T05:50:54.973656+0000', 'modified': '2024-09-21T05:51:49.877112+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24731}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24706': {'gid': 24706, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6839/2186109815', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6838', 'nonce': 2186109815}, {'type': 'v1', 'addr': '172.21.15.144:6839', 'nonce': 2186109815}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24731': {'gid': 24731, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.67:6839/2815536303', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6838', 'nonce': 2815536303}, {'type': 'v1', 'addr': '172.21.15.67:6839', 'nonce': 2815536303}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24731, 'qdb_cluster': [24731]} 2024-09-21T05:53:53.043 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T05:53:53.043 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T05:53:53.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:52 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1387105685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:53.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:52 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1387105685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:53:53.462 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:53:53.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:53 smithi037 ceph-mon[30631]: pgmap v413: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T05:53:54.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.119+0000 7f01b3200640 1 -- 172.21.15.37:0/2577188620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b4103990 msgr2=0x7f01b4103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:54.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.119+0000 7f01b3200640 1 --2- 172.21.15.37:0/2577188620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b4103990 0x7f01b4103da0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009900 tx=0x7f01a402a410 comp rx=0 tx=0).stop 2024-09-21T05:53:54.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.119+0000 7f01b3200640 1 -- 172.21.15.37:0/2577188620 shutdown_connections 2024-09-21T05:53:54.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.119+0000 7f01b3200640 1 --2- 172.21.15.37:0/2577188620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01b4109c20 0x7f01b4110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.119+0000 7f01b3200640 1 --2- 172.21.15.37:0/2577188620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01b41092d0 0x7f01b41096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.119+0000 7f01b3200640 1 --2- 172.21.15.37:0/2577188620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b4103990 0x7f01b4103da0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.119+0000 7f01b3200640 1 -- 172.21.15.37:0/2577188620 >> 172.21.15.37:0/2577188620 conn(0x7f01b40ff3e0 msgr2=0x7f01b4101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:54.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.120+0000 7f01b3200640 1 -- 172.21.15.37:0/2577188620 shutdown_connections 2024-09-21T05:53:54.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.120+0000 7f01b3200640 1 -- 172.21.15.37:0/2577188620 wait complete. 2024-09-21T05:53:54.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:53 smithi144 ceph-mon[34351]: pgmap v413: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T05:53:54.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.121+0000 7f01b3200640 1 Processor -- start 2024-09-21T05:53:54.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.121+0000 7f01b3200640 1 -- start start 2024-09-21T05:53:54.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.121+0000 7f01b3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b4103990 0x7f01b419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.121+0000 7f01b3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01b41092d0 0x7f01b419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.121+0000 7f01b3200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01b4109c20 0x7f01b41a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.121+0000 7f01b3200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f01b41138e0 con 0x7f01b4103990 2024-09-21T05:53:54.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.121+0000 7f01b3200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f01b4113760 con 0x7f01b4109c20 2024-09-21T05:53:54.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.121+0000 7f01b3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01b4113a60 con 0x7f01b41092d0 2024-09-21T05:53:54.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.122+0000 7f01b1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b4103990 0x7f01b419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.122+0000 7f01b1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b4103990 0x7f01b419c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38268/0 (socket says 172.21.15.37:38268) 2024-09-21T05:53:54.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.122+0000 7f01b1e00640 1 -- 172.21.15.37:0/1951503091 learned_addr learned my addr 172.21.15.37:0/1951503091 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:54.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.122+0000 7f01b1400640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01b41092d0 0x7f01b419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.122+0000 7f01b2800640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01b4109c20 0x7f01b41a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.122+0000 7f01b1e00640 1 -- 172.21.15.37:0/1951503091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01b41092d0 msgr2=0x7f01b419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:54.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.122+0000 7f01b1e00640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01b41092d0 0x7f01b419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.122+0000 7f01b1e00640 1 -- 172.21.15.37:0/1951503091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01b4109c20 msgr2=0x7f01b41a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:54.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.122+0000 7f01b1e00640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01b4109c20 0x7f01b41a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.122+0000 7f01b1e00640 1 -- 172.21.15.37:0/1951503091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b41a24a0 con 0x7f01b4103990 2024-09-21T05:53:54.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.123+0000 7f01b1e00640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b4103990 0x7f01b419c530 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f01a4005940 tx=0x7f01a40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:54.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.123+0000 7f01aaa00640 1 -- 172.21.15.37:0/1951503091 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a403f030 con 0x7f01b4103990 2024-09-21T05:53:54.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.123+0000 7f01aaa00640 1 -- 172.21.15.37:0/1951503091 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01a40044c0 con 0x7f01b4103990 2024-09-21T05:53:54.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.123+0000 7f01b3200640 1 -- 172.21.15.37:0/1951503091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b41a2730 con 0x7f01b4103990 2024-09-21T05:53:54.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.123+0000 7f01aaa00640 1 -- 172.21.15.37:0/1951503091 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4035070 con 0x7f01b4103990 2024-09-21T05:53:54.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.123+0000 7f01b3200640 1 -- 172.21.15.37:0/1951503091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b41a8ef0 con 0x7f01b4103990 2024-09-21T05:53:54.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.126+0000 7f01bfe70740 1 Processor -- start 2024-09-21T05:53:54.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.126+0000 7f01bfe70740 1 -- start start 2024-09-21T05:53:54.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.127+0000 7f01aaa00640 1 -- 172.21.15.37:0/1951503091 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f01a4042030 con 0x7f01b4103990 2024-09-21T05:53:54.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.127+0000 7f01bfe70740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e3a6f60 0x55690e74d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.127+0000 7f01bfe70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e37e0a0 0x55690e74dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.127+0000 7f01bfe70740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e386280 0x55690e74e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.127+0000 7f01bfe70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55690e6c4d50 con 0x55690e37e0a0 2024-09-21T05:53:54.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.127+0000 7f01bfe70740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55690e6b4180 con 0x55690e386280 2024-09-21T05:53:54.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.127+0000 7f01bfe70740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55690e6b7f90 con 0x55690e3a6f60 2024-09-21T05:53:54.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.127+0000 7f01b1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e37e0a0 0x55690e74dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.127+0000 7f01b1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e37e0a0 0x55690e74dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38270/0 (socket says 172.21.15.37:38270) 2024-09-21T05:53:54.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.127+0000 7f01b1e00640 1 -- 172.21.15.37:0/2243794215 learned_addr learned my addr 172.21.15.37:0/2243794215 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:54.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.127+0000 7f01b1400640 1 --2- 172.21.15.37:0/2243794215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e386280 0x55690e74e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.127+0000 7f01b2800640 1 --2- 172.21.15.37:0/2243794215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e3a6f60 0x55690e74d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.128+0000 7f01b1400640 1 -- 172.21.15.37:0/2243794215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e3a6f60 msgr2=0x55690e74d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.128+0000 7f01b1400640 1 --2- 172.21.15.37:0/2243794215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e3a6f60 0x55690e74d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.128+0000 7f01b1400640 1 -- 172.21.15.37:0/2243794215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e37e0a0 msgr2=0x55690e74dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.128+0000 7f01b1400640 1 --2- 172.21.15.37:0/2243794215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e37e0a0 0x55690e74dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.128+0000 7f01b1400640 1 -- 172.21.15.37:0/2243794215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55690e67ea70 con 0x55690e386280 2024-09-21T05:53:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.128+0000 7f01b2800640 1 --2- 172.21.15.37:0/2243794215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e3a6f60 0x55690e74d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.128+0000 7f01b1400640 1 --2- 172.21.15.37:0/2243794215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e386280 0x55690e74e0f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f01b406c5a0 tx=0x7f01a0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aea144e100f2c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.128+0000 7f019f400640 1 -- 172.21.15.37:0/2243794215 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a0009d70 con 0x55690e386280 2024-09-21T05:53:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.129+0000 7f019f400640 1 -- 172.21.15.37:0/2243794215 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01a0005020 con 0x55690e386280 2024-09-21T05:53:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.129+0000 7f019f400640 1 -- 172.21.15.37:0/2243794215 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a0004a00 con 0x55690e386280 2024-09-21T05:53:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.129+0000 7f01aaa00640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f01980b6510 0x7f01980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.129+0000 7f01aaa00640 1 -- 172.21.15.37:0/1951503091 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f01a4107720 con 0x7f01b4103990 2024-09-21T05:53:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.129+0000 7f01b2800640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f01980b6510 0x7f01980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.130+0000 7f01bfe70740 1 -- 172.21.15.37:0/2243794215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e386280 msgr2=0x55690e74e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.130+0000 7f01bfe70740 1 --2- 172.21.15.37:0/2243794215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e386280 0x55690e74e0f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f01b406c5a0 tx=0x7f01a0011810 comp rx=0 tx=0).stop 2024-09-21T05:53:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.130+0000 7f01bfe70740 1 -- 172.21.15.37:0/2243794215 shutdown_connections 2024-09-21T05:53:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.130+0000 7f01bfe70740 1 --2- 172.21.15.37:0/2243794215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e386280 0x55690e74e0f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.130+0000 7f01bfe70740 1 --2- 172.21.15.37:0/2243794215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e37e0a0 0x55690e74dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.130+0000 7f01bfe70740 1 --2- 172.21.15.37:0/2243794215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e3a6f60 0x55690e74d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.130+0000 7f01bfe70740 1 -- 172.21.15.37:0/2243794215 >> 172.21.15.37:0/2243794215 conn(0x55690e39b350 msgr2=0x55690e74b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.130+0000 7f01b2800640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f01980b6510 0x7f01980b8a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009fd0 tx=0x7f01ac009500 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.130+0000 7f01bfe70740 1 -- 172.21.15.37:0/2243794215 shutdown_connections 2024-09-21T05:53:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.130+0000 7f01bfe70740 1 -- 172.21.15.37:0/2243794215 wait complete. 2024-09-21T05:53:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.131+0000 7f01bfe70740 1 -- start start 2024-09-21T05:53:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.131+0000 7f01bfe70740 1 Processor -- start 2024-09-21T05:53:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.131+0000 7f01bfe70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e37e0a0 0x55690e7592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.131+0000 7f01bfe70740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e386280 0x55690e7597e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.131+0000 7f01bfe70740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e3a6f60 0x55690e765170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01bfe70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55690e5155f0 con 0x55690e37e0a0 2024-09-21T05:53:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01bfe70740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55690e64f460 con 0x55690e3a6f60 2024-09-21T05:53:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01bfe70740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55690e75be50 con 0x55690e386280 2024-09-21T05:53:54.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01bfe70740 10 client.0 _ll_register_callbacks cb 0x55690e65f210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01b1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e37e0a0 0x55690e7592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01b1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e37e0a0 0x55690e7592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38280/0 (socket says 172.21.15.37:38280) 2024-09-21T05:53:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01b1e00640 1 -- 172.21.15.37:0/543777260 learned_addr learned my addr 172.21.15.37:0/543777260 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01b1400640 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e386280 0x55690e7597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01b2800640 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e3a6f60 0x55690e765170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01b1400640 1 -- 172.21.15.37:0/543777260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e3a6f60 msgr2=0x55690e765170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01b1400640 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e3a6f60 0x55690e765170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01b1400640 1 -- 172.21.15.37:0/543777260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e37e0a0 msgr2=0x55690e7592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01b1400640 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e37e0a0 0x55690e7592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01b1400640 1 -- 172.21.15.37:0/543777260 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55690e412540 con 0x55690e386280 2024-09-21T05:53:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.132+0000 7f01b1e00640 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e37e0a0 0x55690e7592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.133+0000 7f01b1400640 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e386280 0x55690e7597e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f01a0000c00 tx=0x7f01a0005510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69f4114c056898e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.133+0000 7f0193e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T05:53:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.133+0000 7f0193e00640 1 -- 172.21.15.37:0/543777260 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a001d050 con 0x55690e386280 2024-09-21T05:53:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.133+0000 7f0193e00640 1 -- 172.21.15.37:0/543777260 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f01a00048d0 con 0x55690e386280 2024-09-21T05:53:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.133+0000 7f01bfe70740 1 -- 172.21.15.37:0/543777260 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55690e651a70 con 0x55690e386280 2024-09-21T05:53:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.133+0000 7f0193e00640 1 -- 172.21.15.37:0/543777260 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f01a0032050 con 0x55690e386280 2024-09-21T05:53:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.134+0000 7f01bfe70740 10 client.25333 fetch_fsmap learned FSMap version 21 2024-09-21T05:53:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.134+0000 7f01bfe70740 1 -- 172.21.15.37:0/543777260 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55690e66c6f0 con 0x55690e386280 2024-09-21T05:53:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.134+0000 7f0193e00640 1 -- 172.21.15.37:0/543777260 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55690e651a70 con 0x55690e386280 2024-09-21T05:53:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.134+0000 7f0193e00640 1 -- 172.21.15.37:0/543777260 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f01a0024ad0 con 0x55690e386280 2024-09-21T05:53:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.134+0000 7f01bfe70740 10 client.25333 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:53:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.134+0000 7f01bfe70740 10 client.25333 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:53:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.134+0000 7f01bfe70740 20 client.25333 populate_metadata read hostname 'smithi037' 2024-09-21T05:53:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.134+0000 7f01bfe70740 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55690e3658e0 0x55690e76b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.134+0000 7f01bfe70740 4 client.25333 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:53:54.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.134+0000 7f01bfe70740 1 -- 172.21.15.37:0/543777260 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55690e6c6ca0 con 0x55690e3658e0 2024-09-21T05:53:54.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.135+0000 7f01b1e00640 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55690e3658e0 0x55690e76b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.135+0000 7f01b1e00640 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55690e3658e0 0x55690e76b4f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d7c1100c2923640 server_cookie=8292f510f1e499bf in_seq=0 out_seq=0 2024-09-21T05:53:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.135+0000 7f0193e00640 10 client.25333 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:53:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.136+0000 7f0193e00640 1 -- 172.21.15.37:0/543777260 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55690e6c6ca0 con 0x55690e3658e0 2024-09-21T05:53:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.136+0000 7f0193e00640 10 client.25333 handle_command_reply: tid=0 2024-09-21T05:53:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.136+0000 7f01bfe70740 1 client.25333 shutdown 2024-09-21T05:53:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.136+0000 7f01bfe70740 1 -- 172.21.15.37:0/543777260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e386280 msgr2=0x55690e7597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.136+0000 7f01bfe70740 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e386280 0x55690e7597e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f01a0000c00 tx=0x7f01a0005510 comp rx=0 tx=0).stop 2024-09-21T05:53:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.136+0000 7f01bfe70740 1 -- 172.21.15.37:0/543777260 shutdown_connections 2024-09-21T05:53:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.136+0000 7f01bfe70740 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55690e3658e0 0x55690e76b4f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.136+0000 7f01bfe70740 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e3a6f60 0x55690e765170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.136+0000 7f01bfe70740 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e386280 0x55690e7597e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.136+0000 7f0193e00640 0 client.25333 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:53:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.136+0000 7f01bfe70740 1 --2- 172.21.15.37:0/543777260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e37e0a0 0x55690e7592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.136+0000 7f01bfe70740 1 -- 172.21.15.37:0/543777260 >> 172.21.15.37:0/543777260 conn(0x55690e39b350 msgr2=0x55690e750800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.137+0000 7f01bfe70740 1 -- 172.21.15.37:0/543777260 shutdown_connections 2024-09-21T05:53:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.137+0000 7f01bfe70740 1 -- 172.21.15.37:0/543777260 wait complete. 2024-09-21T05:53:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.137+0000 7f01bfe70740 20 client.25333 trim_cache size 0 max 16384 2024-09-21T05:53:54.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.156+0000 7f01bfe70740 1 Processor -- start 2024-09-21T05:53:54.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.156+0000 7f01bfe70740 1 -- start start 2024-09-21T05:53:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.156+0000 7f01bfe70740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e37e0a0 0x55690e76a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.156+0000 7f01bfe70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e386280 0x55690e754250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.156+0000 7f01bfe70740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e3a6f60 0x55690e754790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.156+0000 7f01bfe70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55690e769830 con 0x55690e386280 2024-09-21T05:53:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.156+0000 7f01bfe70740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55690e769f00 con 0x55690e37e0a0 2024-09-21T05:53:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.156+0000 7f01bfe70740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55690e76a5d0 con 0x55690e3a6f60 2024-09-21T05:53:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.156+0000 7f01b1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e386280 0x55690e754250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.156+0000 7f01b1e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e37e0a0 0x55690e76a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.156+0000 7f01b1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e386280 0x55690e754250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38282/0 (socket says 172.21.15.37:38282) 2024-09-21T05:53:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.156+0000 7f01b1400640 1 -- 172.21.15.37:0/1812992057 learned_addr learned my addr 172.21.15.37:0/1812992057 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.156+0000 7f01b1e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e37e0a0 0x55690e76a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:53198/0 (socket says 172.21.15.37:53198) 2024-09-21T05:53:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.157+0000 7f01b2800640 1 --2- 172.21.15.37:0/1812992057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e3a6f60 0x55690e754790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.157+0000 7f01b1e00640 1 -- 172.21.15.37:0/1812992057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e3a6f60 msgr2=0x55690e754790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.157+0000 7f01b1e00640 1 --2- 172.21.15.37:0/1812992057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e3a6f60 0x55690e754790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.157+0000 7f01b1e00640 1 -- 172.21.15.37:0/1812992057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e386280 msgr2=0x55690e754250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.157+0000 7f01b1e00640 1 --2- 172.21.15.37:0/1812992057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e386280 0x55690e754250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.157+0000 7f01b1e00640 1 -- 172.21.15.37:0/1812992057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55690e75a140 con 0x55690e37e0a0 2024-09-21T05:53:54.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.157+0000 7f01b1400640 1 --2- 172.21.15.37:0/1812992057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e386280 0x55690e754250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:54.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.157+0000 7f01b1e00640 1 --2- 172.21.15.37:0/1812992057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e37e0a0 0x55690e76a080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f01a41079c0 tx=0x7f01a4109040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=980366252e431ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:54.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.157+0000 7f019ea00640 1 -- 172.21.15.37:0/1812992057 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4049040 con 0x55690e37e0a0 2024-09-21T05:53:54.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.158+0000 7f019ea00640 1 -- 172.21.15.37:0/1812992057 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01a40cd040 con 0x55690e37e0a0 2024-09-21T05:53:54.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.158+0000 7f019ea00640 1 -- 172.21.15.37:0/1812992057 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4003cf0 con 0x55690e37e0a0 2024-09-21T05:53:54.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.158+0000 7f01bfe70740 1 -- 172.21.15.37:0/1812992057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e37e0a0 msgr2=0x55690e76a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.158+0000 7f01bfe70740 1 --2- 172.21.15.37:0/1812992057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e37e0a0 0x55690e76a080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f01a41079c0 tx=0x7f01a4109040 comp rx=0 tx=0).stop 2024-09-21T05:53:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.158+0000 7f01bfe70740 1 -- 172.21.15.37:0/1812992057 shutdown_connections 2024-09-21T05:53:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.158+0000 7f01bfe70740 1 --2- 172.21.15.37:0/1812992057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e3a6f60 0x55690e754790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.158+0000 7f01bfe70740 1 --2- 172.21.15.37:0/1812992057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e386280 0x55690e754250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.158+0000 7f01bfe70740 1 --2- 172.21.15.37:0/1812992057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e37e0a0 0x55690e76a080 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.158+0000 7f01bfe70740 1 -- 172.21.15.37:0/1812992057 >> 172.21.15.37:0/1812992057 conn(0x55690e39b350 msgr2=0x55690e7652f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.158+0000 7f01bfe70740 1 -- 172.21.15.37:0/1812992057 shutdown_connections 2024-09-21T05:53:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.159+0000 7f01bfe70740 1 -- 172.21.15.37:0/1812992057 wait complete. 2024-09-21T05:53:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.159+0000 7f01bfe70740 1 -- start start 2024-09-21T05:53:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.159+0000 7f01bfe70740 1 Processor -- start 2024-09-21T05:53:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01bfe70740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e37e0a0 0x55690e772660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01bfe70740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e386280 0x55690e772ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01bfe70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e3a6f60 0x55690e76cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01bfe70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55690e76b370 con 0x55690e3a6f60 2024-09-21T05:53:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01bfe70740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55690e76aca0 con 0x55690e37e0a0 2024-09-21T05:53:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01bfe70740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55690e76ba40 con 0x55690e386280 2024-09-21T05:53:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01bfe70740 10 client.0 _ll_register_callbacks cb 0x7f01a0009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:53:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01b2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e3a6f60 0x55690e76cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01b2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e3a6f60 0x55690e76cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38286/0 (socket says 172.21.15.37:38286) 2024-09-21T05:53:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01b2800640 1 -- 172.21.15.37:0/709579416 learned_addr learned my addr 172.21.15.37:0/709579416 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:53:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01b1400640 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e386280 0x55690e772ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01b1e00640 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e37e0a0 0x55690e772660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01b2800640 1 -- 172.21.15.37:0/709579416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e386280 msgr2=0x55690e772ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01b2800640 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e386280 0x55690e772ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.160+0000 7f01b2800640 1 -- 172.21.15.37:0/709579416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e37e0a0 msgr2=0x55690e772660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:53:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.161+0000 7f01b2800640 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e37e0a0 0x55690e772660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.161+0000 7f01b2800640 1 -- 172.21.15.37:0/709579416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55690e76d240 con 0x55690e3a6f60 2024-09-21T05:53:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.161+0000 7f01b1400640 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e386280 0x55690e772ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.161+0000 7f01b1e00640 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e37e0a0 0x55690e772660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:53:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.161+0000 7f01b2800640 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e3a6f60 0x55690e76cd00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00f910 tx=0x7f01ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3facc273cf9adaa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:53:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.161+0000 7f0193e00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T05:53:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.161+0000 7f0193e00640 1 -- 172.21.15.37:0/709579416 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac02e060 con 0x55690e3a6f60 2024-09-21T05:53:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.161+0000 7f0193e00640 1 -- 172.21.15.37:0/709579416 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f01ac003b80 con 0x55690e3a6f60 2024-09-21T05:53:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.161+0000 7f01bfe70740 1 -- 172.21.15.37:0/709579416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01a40cd040 con 0x55690e3a6f60 2024-09-21T05:53:54.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.162+0000 7f0193e00640 1 -- 172.21.15.37:0/709579416 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f01ac035050 con 0x55690e3a6f60 2024-09-21T05:53:54.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.162+0000 7f01bfe70740 10 client.15291 fetch_fsmap learned FSMap version 21 2024-09-21T05:53:54.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.162+0000 7f01bfe70740 1 -- 172.21.15.37:0/709579416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55690e773c20 con 0x55690e3a6f60 2024-09-21T05:53:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.162+0000 7f0193e00640 1 -- 172.21.15.37:0/709579416 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01a40cd040 con 0x55690e3a6f60 2024-09-21T05:53:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.162+0000 7f0193e00640 1 -- 172.21.15.37:0/709579416 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f01ac0106a0 con 0x55690e3a6f60 2024-09-21T05:53:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.162+0000 7f01bfe70740 10 client.15291 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:53:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.162+0000 7f01bfe70740 10 client.15291 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T05:53:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.162+0000 7f01bfe70740 20 client.15291 populate_metadata read hostname 'smithi037' 2024-09-21T05:53:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.162+0000 7f01bfe70740 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55690e33ac90 0x55690e7d9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:53:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.162+0000 7f01bfe70740 4 client.15291 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T05:53:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.162+0000 7f01bfe70740 1 -- 172.21.15.37:0/709579416 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "status"}) -- 0x55690e6c2750 con 0x55690e33ac90 2024-09-21T05:53:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.163+0000 7f01b1e00640 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55690e33ac90 0x55690e7d9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:53:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.163+0000 7f01b1e00640 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55690e33ac90 0x55690e7d9a40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9e59c581b62f4e6 server_cookie=ff30c429387dc865 in_seq=0 out_seq=0 2024-09-21T05:53:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.163+0000 7f0193e00640 10 client.15291 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:53:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f0193e00640 1 -- 172.21.15.37:0/709579416 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55690e6c2750 con 0x55690e33ac90 2024-09-21T05:53:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f0193e00640 10 client.15291 handle_command_reply: tid=0 2024-09-21T05:53:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f01bfe70740 1 client.15291 shutdown 2024-09-21T05:53:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f01bfe70740 1 -- 172.21.15.37:0/709579416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e3a6f60 msgr2=0x55690e76cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f01bfe70740 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e3a6f60 0x55690e76cd00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00f910 tx=0x7f01ac004a40 comp rx=0 tx=0).stop 2024-09-21T05:53:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f01bfe70740 1 -- 172.21.15.37:0/709579416 shutdown_connections 2024-09-21T05:53:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f01bfe70740 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55690e33ac90 0x55690e7d9a40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f01bfe70740 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55690e3a6f60 0x55690e76cd00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f01bfe70740 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55690e386280 0x55690e772ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f01bfe70740 1 --2- 172.21.15.37:0/709579416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55690e37e0a0 0x55690e772660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f0193e00640 0 client.15291 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:53:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f01bfe70740 1 -- 172.21.15.37:0/709579416 >> 172.21.15.37:0/709579416 conn(0x55690e39b350 msgr2=0x55690e759280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f01bfe70740 1 -- 172.21.15.37:0/709579416 shutdown_connections 2024-09-21T05:53:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f01bfe70740 1 -- 172.21.15.37:0/709579416 wait complete. 2024-09-21T05:53:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.164+0000 7f01bfe70740 20 client.15291 trim_cache size 0 max 16384 2024-09-21T05:53:54.171 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:53:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "0c10cdda-77dc-11ef-baf5-efdc52797490", 2024-09-21T05:53:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-09-21T05:53:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24731, 2024-09-21T05:53:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T05:53:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T05:53:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T05:53:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 178.271706997, 2024-09-21T05:53:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 21, 2024-09-21T05:53:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 90, 2024-09-21T05:53:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 88, 2024-09-21T05:53:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 193.491381375 2024-09-21T05:53:54.172 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:53:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.165+0000 7f01b3200640 1 -- 172.21.15.37:0/1951503091 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f01980b6510 msgr2=0x7f01980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.165+0000 7f01b3200640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f01980b6510 0x7f01980b8a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009fd0 tx=0x7f01ac009500 comp rx=0 tx=0).stop 2024-09-21T05:53:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.165+0000 7f01b3200640 1 -- 172.21.15.37:0/1951503091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b4103990 msgr2=0x7f01b419c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:53:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.165+0000 7f01b3200640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b4103990 0x7f01b419c530 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f01a4005940 tx=0x7f01a40040c0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.165+0000 7f01b3200640 1 -- 172.21.15.37:0/1951503091 shutdown_connections 2024-09-21T05:53:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.165+0000 7f01b3200640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f01980b6510 0x7f01980b8a20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.165+0000 7f01b3200640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01b4109c20 0x7f01b41a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.165+0000 7f01b3200640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01b41092d0 0x7f01b419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.165+0000 7f01b3200640 1 --2- 172.21.15.37:0/1951503091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b4103990 0x7f01b419c530 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:53:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.165+0000 7f01b3200640 1 -- 172.21.15.37:0/1951503091 >> 172.21.15.37:0/1951503091 conn(0x7f01b40ff3e0 msgr2=0x7f01b410e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:53:54.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.165+0000 7f01b3200640 1 -- 172.21.15.37:0/1951503091 shutdown_connections 2024-09-21T05:53:54.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:53:54.166+0000 7f01b3200640 1 -- 172.21.15.37:0/1951503091 wait complete. 2024-09-21T05:53:54.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:53 smithi067 ceph-mon[34443]: pgmap v413: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T05:53:55.083 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-21T05:53:56.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:55 smithi144 ceph-mon[34351]: pgmap v414: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:53:56.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:53:56.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:56.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:56.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:56.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:55 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:56.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:55 smithi037 ceph-mon[30631]: pgmap v414: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:53:56.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:53:56.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:56.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:56.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:56.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:55 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:55 smithi067 ceph-mon[34443]: pgmap v414: 129 pgs: 129 active+clean; 651 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-21T05:53:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:53:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:55 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:57.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:53:57.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:53:57.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:57.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:53:57.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:53:57.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:57.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:53:57.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:53:57.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:53:58.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:57 smithi144 ceph-mon[34351]: pgmap v415: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:53:58.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:57 smithi037 ceph-mon[30631]: pgmap v415: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:53:58.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:57 smithi067 ceph-mon[34443]: pgmap v415: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:00.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:53:59 smithi144 ceph-mon[34351]: pgmap v416: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:00.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:53:59 smithi037 ceph-mon[30631]: pgmap v416: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:00.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:53:59 smithi067 ceph-mon[34443]: pgmap v416: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:02.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:01 smithi144 ceph-mon[34351]: pgmap v417: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:02.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:01 smithi037 ceph-mon[30631]: pgmap v417: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:02.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:01 smithi067 ceph-mon[34443]: pgmap v417: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:04.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:03 smithi144 ceph-mon[34351]: pgmap v418: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:04.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:03 smithi037 ceph-mon[30631]: pgmap v418: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:03 smithi067 ceph-mon[34443]: pgmap v418: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:06.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:05 smithi144 ceph-mon[34351]: pgmap v419: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:06.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:05 smithi037 ceph-mon[30631]: pgmap v419: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:05 smithi067 ceph-mon[34443]: pgmap v419: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:08.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:07 smithi144 ceph-mon[34351]: pgmap v420: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:08.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:07 smithi037 ceph-mon[30631]: pgmap v420: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:08.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:07 smithi067 ceph-mon[34443]: pgmap v420: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:10.084 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.5 2024-09-21T05:54:10.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:54:10.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:09 smithi144 ceph-mon[34351]: pgmap v421: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:10.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:09 smithi037 ceph-mon[30631]: pgmap v421: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:10.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:09 smithi067 ceph-mon[34443]: pgmap v421: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:10.475 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:11.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.129+0000 7f5756000640 1 -- 172.21.15.37:0/3361394727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575010b6c0 msgr2=0x7f575010bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:11.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.129+0000 7f5756000640 1 --2- 172.21.15.37:0/3361394727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575010b6c0 0x7f575010bad0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5738009900 tx=0x7f573802a410 comp rx=0 tx=0).stop 2024-09-21T05:54:11.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.130+0000 7f5756000640 1 -- 172.21.15.37:0/3361394727 shutdown_connections 2024-09-21T05:54:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.130+0000 7f5756000640 1 --2- 172.21.15.37:0/3361394727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f575010c010 0x7f5750112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.130+0000 7f5756000640 1 --2- 172.21.15.37:0/3361394727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f575010b6c0 0x7f575010bad0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.130+0000 7f5756000640 1 --2- 172.21.15.37:0/3361394727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5750105d80 0x7f5750106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.130+0000 7f5756000640 1 -- 172.21.15.37:0/3361394727 >> 172.21.15.37:0/3361394727 conn(0x7f5750101810 msgr2=0x7f5750103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.130+0000 7f5756000640 1 -- 172.21.15.37:0/3361394727 shutdown_connections 2024-09-21T05:54:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.130+0000 7f5756000640 1 -- 172.21.15.37:0/3361394727 wait complete. 2024-09-21T05:54:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.131+0000 7f5756000640 1 Processor -- start 2024-09-21T05:54:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.131+0000 7f5756000640 1 -- start start 2024-09-21T05:54:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.131+0000 7f5756000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5750105d80 0x7f575019c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.131+0000 7f5756000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575010b6c0 0x7f575019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f5756000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f575010c010 0x7f57501a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f5756000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5750115cd0 con 0x7f5750105d80 2024-09-21T05:54:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f5756000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5750115b50 con 0x7f575010c010 2024-09-21T05:54:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f5756000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5750115e50 con 0x7f575010b6c0 2024-09-21T05:54:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f574f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5750105d80 0x7f575019c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f574f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5750105d80 0x7f575019c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36464/0 (socket says 172.21.15.37:36464) 2024-09-21T05:54:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f574f400640 1 -- 172.21.15.37:0/3071510438 learned_addr learned my addr 172.21.15.37:0/3071510438 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:54:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f5747e00640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575010b6c0 0x7f575019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f574fe00640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f575010c010 0x7f57501a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f574f400640 1 -- 172.21.15.37:0/3071510438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575010b6c0 msgr2=0x7f575019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f574f400640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575010b6c0 0x7f575019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f574f400640 1 -- 172.21.15.37:0/3071510438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f575010c010 msgr2=0x7f57501a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f574f400640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f575010c010 0x7f57501a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f574f400640 1 -- 172.21.15.37:0/3071510438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57501a2690 con 0x7f5750105d80 2024-09-21T05:54:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f5747e00640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575010b6c0 0x7f575019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.132+0000 7f574fe00640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f575010c010 0x7f57501a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:54:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.133+0000 7f574f400640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5750105d80 0x7f575019c720 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f574000e9f0 tx=0x7f574000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.133+0000 7f574cc00640 1 -- 172.21.15.37:0/3071510438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574000cd80 con 0x7f5750105d80 2024-09-21T05:54:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.133+0000 7f574cc00640 1 -- 172.21.15.37:0/3071510438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57400108e0 con 0x7f5750105d80 2024-09-21T05:54:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.133+0000 7f574cc00640 1 -- 172.21.15.37:0/3071510438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740018980 con 0x7f5750105d80 2024-09-21T05:54:11.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.133+0000 7f5756000640 1 -- 172.21.15.37:0/3071510438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57501a2980 con 0x7f5750105d80 2024-09-21T05:54:11.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.133+0000 7f5756000640 1 -- 172.21.15.37:0/3071510438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57501a90e0 con 0x7f5750105d80 2024-09-21T05:54:11.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.134+0000 7f5756000640 1 -- 172.21.15.37:0/3071510438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5750106190 con 0x7f5750105d80 2024-09-21T05:54:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.139+0000 7f574cc00640 1 -- 172.21.15.37:0/3071510438 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5740010430 con 0x7f5750105d80 2024-09-21T05:54:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.141+0000 7f574cc00640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f57340b6590 0x7f57340b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.141+0000 7f574cc00640 1 -- 172.21.15.37:0/3071510438 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f57400e7f50 con 0x7f5750105d80 2024-09-21T05:54:11.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.141+0000 7f5747e00640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f57340b6590 0x7f57340b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:11.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.141+0000 7f574cc00640 1 -- 172.21.15.37:0/3071510438 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57400e8450 con 0x7f5750105d80 2024-09-21T05:54:11.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.142+0000 7f5747e00640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f57340b6590 0x7f57340b8aa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5738009230 tx=0x7f5738000bc0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:11.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.390+0000 7f5756000640 1 -- 172.21.15.37:0/3071510438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f575002e640 con 0x7f5750105d80 2024-09-21T05:54:11.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.391+0000 7f574cc00640 1 -- 172.21.15.37:0/3071510438 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f57400ae410 con 0x7f5750105d80 2024-09-21T05:54:11.394 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:54:11.394 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:54:11.394 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:54:11.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.395+0000 7f5756000640 1 -- 172.21.15.37:0/3071510438 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f57340b6590 msgr2=0x7f57340b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:11.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.395+0000 7f5756000640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f57340b6590 0x7f57340b8aa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5738009230 tx=0x7f5738000bc0 comp rx=0 tx=0).stop 2024-09-21T05:54:11.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.395+0000 7f5756000640 1 -- 172.21.15.37:0/3071510438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5750105d80 msgr2=0x7f575019c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:11.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.395+0000 7f5756000640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5750105d80 0x7f575019c720 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f574000e9f0 tx=0x7f574000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:54:11.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.395+0000 7f5756000640 1 -- 172.21.15.37:0/3071510438 shutdown_connections 2024-09-21T05:54:11.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.395+0000 7f5756000640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f57340b6590 0x7f57340b8aa0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:11.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.395+0000 7f5756000640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f575010c010 0x7f57501a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:11.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.395+0000 7f5756000640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575010b6c0 0x7f575019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:11.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.395+0000 7f5756000640 1 --2- 172.21.15.37:0/3071510438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5750105d80 0x7f575019c720 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:11.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.395+0000 7f5756000640 1 -- 172.21.15.37:0/3071510438 >> 172.21.15.37:0/3071510438 conn(0x7f5750101810 msgr2=0x7f5750103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:11.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.395+0000 7f5756000640 1 -- 172.21.15.37:0/3071510438 shutdown_connections 2024-09-21T05:54:11.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:11.395+0000 7f5756000640 1 -- 172.21.15.37:0/3071510438 wait complete. 2024-09-21T05:54:12.101 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:11 smithi037 ceph-mon[30631]: pgmap v422: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:12.101 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:11 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3071510438' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:11 smithi144 ceph-mon[34351]: pgmap v422: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:11 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3071510438' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:12.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:11 smithi067 ceph-mon[34443]: pgmap v422: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:12.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:11 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3071510438' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:12.311 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0' 2024-09-21T05:54:12.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0 2024-09-21T05:54:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:13.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.480+0000 7fe76a000640 1 -- 172.21.15.37:0/3627160448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe764105d80 msgr2=0x7fe764106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:13.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.480+0000 7fe76a000640 1 --2- 172.21.15.37:0/3627160448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe764105d80 0x7fe764106190 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe754009900 tx=0x7fe75402a410 comp rx=0 tx=0).stop 2024-09-21T05:54:13.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.480+0000 7fe76a000640 1 -- 172.21.15.37:0/3627160448 shutdown_connections 2024-09-21T05:54:13.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.480+0000 7fe76a000640 1 --2- 172.21.15.37:0/3627160448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76410c010 0x7fe764112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.480+0000 7fe76a000640 1 --2- 172.21.15.37:0/3627160448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76410b6c0 0x7fe76410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.480+0000 7fe76a000640 1 --2- 172.21.15.37:0/3627160448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe764105d80 0x7fe764106190 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.480+0000 7fe76a000640 1 -- 172.21.15.37:0/3627160448 >> 172.21.15.37:0/3627160448 conn(0x7fe7641017d0 msgr2=0x7fe764103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:13.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.480+0000 7fe76a000640 1 -- 172.21.15.37:0/3627160448 shutdown_connections 2024-09-21T05:54:13.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.480+0000 7fe76a000640 1 -- 172.21.15.37:0/3627160448 wait complete. 2024-09-21T05:54:13.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.482+0000 7fe76a000640 1 Processor -- start 2024-09-21T05:54:13.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.482+0000 7fe76a000640 1 -- start start 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.482+0000 7fe76a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe764105d80 0x7fe76419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.482+0000 7fe76a000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76410b6c0 0x7fe76419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.482+0000 7fe76a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76410c010 0x7fe7641a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.482+0000 7fe76a000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe764115d20 con 0x7fe76410c010 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.482+0000 7fe76a000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe764115ba0 con 0x7fe76410b6c0 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.482+0000 7fe76a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe764115ea0 con 0x7fe764105d80 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.483+0000 7fe763400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe764105d80 0x7fe76419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.483+0000 7fe763400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe764105d80 0x7fe76419c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:51834/0 (socket says 172.21.15.37:51834) 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.483+0000 7fe763400640 1 -- 172.21.15.37:0/3007716472 learned_addr learned my addr 172.21.15.37:0/3007716472 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.483+0000 7fe763e00640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76410c010 0x7fe7641a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.483+0000 7fe75be00640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76410b6c0 0x7fe76419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.483+0000 7fe763400640 1 -- 172.21.15.37:0/3007716472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76410b6c0 msgr2=0x7fe76419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.483+0000 7fe763400640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76410b6c0 0x7fe76419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.483+0000 7fe763400640 1 -- 172.21.15.37:0/3007716472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76410c010 msgr2=0x7fe7641a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:13.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.483+0000 7fe763400640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76410c010 0x7fe7641a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.483+0000 7fe763400640 1 -- 172.21.15.37:0/3007716472 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7641a2640 con 0x7fe764105d80 2024-09-21T05:54:13.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.483+0000 7fe763400640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe764105d80 0x7fe76419c6d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe754005ab0 tx=0x7fe754003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:13.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.484+0000 7fe760c00640 1 -- 172.21.15.37:0/3007716472 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75403f070 con 0x7fe764105d80 2024-09-21T05:54:13.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.484+0000 7fe760c00640 1 -- 172.21.15.37:0/3007716472 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe754031d60 con 0x7fe764105d80 2024-09-21T05:54:13.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.484+0000 7fe76a000640 1 -- 172.21.15.37:0/3007716472 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7641a28d0 con 0x7fe764105d80 2024-09-21T05:54:13.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.484+0000 7fe760c00640 1 -- 172.21.15.37:0/3007716472 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754035030 con 0x7fe764105d80 2024-09-21T05:54:13.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.484+0000 7fe76a000640 1 -- 172.21.15.37:0/3007716472 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7641a9090 con 0x7fe764105d80 2024-09-21T05:54:13.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.487+0000 7fe770c73740 1 Processor -- start 2024-09-21T05:54:13.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.487+0000 7fe770c73740 1 -- start start 2024-09-21T05:54:13.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.488+0000 7fe770c73740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e8304840 0x5598e86ac350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.488+0000 7fe770c73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82db980 0x5598e86ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.488+0000 7fe770c73740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e82e3b60 0x5598e86acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.488+0000 7fe770c73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5598e8621ca0 con 0x5598e82db980 2024-09-21T05:54:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.488+0000 7fe770c73740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5598e86110d0 con 0x5598e8304840 2024-09-21T05:54:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.488+0000 7fe770c73740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5598e8614ee0 con 0x5598e82e3b60 2024-09-21T05:54:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.488+0000 7fe760c00640 1 -- 172.21.15.37:0/3007716472 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fe754042070 con 0x7fe764105d80 2024-09-21T05:54:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.488+0000 7fe763e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e8304840 0x5598e86ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.488+0000 7fe75be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e82e3b60 0x5598e86acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.488+0000 7fe763e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e8304840 0x5598e86ac350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:55504/0 (socket says 172.21.15.37:55504) 2024-09-21T05:54:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.488+0000 7fe763e00640 1 -- 172.21.15.37:0/664218315 learned_addr learned my addr 172.21.15.37:0/664218315 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:54:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.488+0000 7fe763400640 1 --2- 172.21.15.37:0/664218315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82db980 0x5598e86ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.489+0000 7fe763e00640 1 -- 172.21.15.37:0/664218315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e82e3b60 msgr2=0x5598e86acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.489+0000 7fe763e00640 1 --2- 172.21.15.37:0/664218315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e82e3b60 0x5598e86acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.489+0000 7fe763e00640 1 -- 172.21.15.37:0/664218315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82db980 msgr2=0x5598e86ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:13.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.489+0000 7fe763e00640 1 --2- 172.21.15.37:0/664218315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82db980 0x5598e86ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.489+0000 7fe763e00640 1 -- 172.21.15.37:0/664218315 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e85c3400 con 0x5598e8304840 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.489+0000 7fe75be00640 1 --2- 172.21.15.37:0/664218315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e82e3b60 0x5598e86acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.489+0000 7fe763e00640 1 --2- 172.21.15.37:0/664218315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e8304840 0x5598e86ac350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009f50 tx=0x7fe75c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79468bb3a7e342ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.489+0000 7fe753e00640 1 -- 172.21.15.37:0/664218315 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c004b20 con 0x5598e8304840 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.489+0000 7fe753e00640 1 -- 172.21.15.37:0/664218315 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75c004cc0 con 0x5598e8304840 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.489+0000 7fe753e00640 1 -- 172.21.15.37:0/664218315 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c005020 con 0x5598e8304840 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.490+0000 7fe760c00640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe7480b6510 0x7fe7480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.490+0000 7fe760c00640 1 -- 172.21.15.37:0/3007716472 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fe754107f30 con 0x7fe764105d80 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.491+0000 7fe763400640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe7480b6510 0x7fe7480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.491+0000 7fe770c73740 1 -- 172.21.15.37:0/664218315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e8304840 msgr2=0x5598e86ac350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.491+0000 7fe770c73740 1 --2- 172.21.15.37:0/664218315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e8304840 0x5598e86ac350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009f50 tx=0x7fe75c0118d0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.491+0000 7fe770c73740 1 -- 172.21.15.37:0/664218315 shutdown_connections 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.491+0000 7fe770c73740 1 --2- 172.21.15.37:0/664218315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e82e3b60 0x5598e86acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.491+0000 7fe770c73740 1 --2- 172.21.15.37:0/664218315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82db980 0x5598e86ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.491+0000 7fe770c73740 1 --2- 172.21.15.37:0/664218315 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e8304840 0x5598e86ac350 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.491+0000 7fe770c73740 1 -- 172.21.15.37:0/664218315 >> 172.21.15.37:0/664218315 conn(0x5598e82f8990 msgr2=0x5598e86aa240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:13.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.491+0000 7fe770c73740 1 -- 172.21.15.37:0/664218315 shutdown_connections 2024-09-21T05:54:13.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.491+0000 7fe770c73740 1 -- 172.21.15.37:0/664218315 wait complete. 2024-09-21T05:54:13.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.492+0000 7fe763400640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe7480b6510 0x7fe7480b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe7540ca310 tx=0x7fe754009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:13.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.492+0000 7fe770c73740 1 -- start start 2024-09-21T05:54:13.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.493+0000 7fe770c73740 1 Processor -- start 2024-09-21T05:54:13.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.493+0000 7fe770c73740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e82db980 0x5598e86b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.493+0000 7fe770c73740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82e3b60 0x5598e86b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.493+0000 7fe770c73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e8304840 0x5598e86b8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.493+0000 7fe770c73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5598e84727a0 con 0x5598e8304840 2024-09-21T05:54:13.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.493+0000 7fe770c73740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5598e85b6a10 con 0x5598e82e3b60 2024-09-21T05:54:13.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.493+0000 7fe770c73740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5598e86bab30 con 0x5598e82db980 2024-09-21T05:54:13.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.493+0000 7fe770c73740 10 client.0 _ll_register_callbacks cb 0x5598e85c6be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:13.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.494+0000 7fe763e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e8304840 0x5598e86b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.494+0000 7fe75be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82e3b60 0x5598e86b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.494+0000 7fe763e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e82db980 0x5598e86b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.494+0000 7fe75be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82e3b60 0x5598e86b7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:55518/0 (socket says 172.21.15.37:55518) 2024-09-21T05:54:13.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.494+0000 7fe75be00640 1 -- 172.21.15.37:0/2992397403 learned_addr learned my addr 172.21.15.37:0/2992397403 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:54:13.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.494+0000 7fe75be00640 1 -- 172.21.15.37:0/2992397403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e82db980 msgr2=0x5598e86b79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:13.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.494+0000 7fe75be00640 1 --2- 172.21.15.37:0/2992397403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e82db980 0x5598e86b79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.494+0000 7fe75be00640 1 -- 172.21.15.37:0/2992397403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e8304840 msgr2=0x5598e86b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:13.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.494+0000 7fe75be00640 1 --2- 172.21.15.37:0/2992397403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e8304840 0x5598e86b8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.494+0000 7fe75be00640 1 -- 172.21.15.37:0/2992397403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e837eb90 con 0x5598e82e3b60 2024-09-21T05:54:13.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.495+0000 7fe75be00640 1 --2- 172.21.15.37:0/2992397403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82e3b60 0x5598e86b7f10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00bf50 tx=0x7fe74c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3282db000fe5051c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:13.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.495+0000 7fe750c00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:54:13.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.495+0000 7fe750c00640 1 -- 172.21.15.37:0/2992397403 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c004020 con 0x5598e82e3b60 2024-09-21T05:54:13.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.495+0000 7fe750c00640 1 -- 172.21.15.37:0/2992397403 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fe74c0041c0 con 0x5598e82e3b60 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.495+0000 7fe770c73740 1 -- 172.21.15.37:0/2992397403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe75c004cc0 con 0x5598e82e3b60 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.495+0000 7fe750c00640 1 -- 172.21.15.37:0/2992397403 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe74c024050 con 0x5598e82e3b60 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.495+0000 7fe770c73740 10 client.25337 fetch_fsmap learned FSMap version 21 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.495+0000 7fe770c73740 1 -- 172.21.15.37:0/2992397403 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5598e86c67b0 con 0x5598e82e3b60 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.496+0000 7fe750c00640 1 -- 172.21.15.37:0/2992397403 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75c004cc0 con 0x5598e82e3b60 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.496+0000 7fe750c00640 1 -- 172.21.15.37:0/2992397403 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe74c0037b0 con 0x5598e82e3b60 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.496+0000 7fe770c73740 10 client.25337 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.496+0000 7fe770c73740 10 client.25337 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.496+0000 7fe770c73740 20 client.25337 populate_metadata read hostname 'smithi037' 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.496+0000 7fe770c73740 1 --2- 172.21.15.37:0/2992397403 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5598e82c31c0 0x5598e86c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.496+0000 7fe770c73740 4 client.25337 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.496+0000 7fe770c73740 1 -- 172.21.15.37:0/2992397403 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598e8623bf0 con 0x5598e82c31c0 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.497+0000 7fe763e00640 1 --2- 172.21.15.37:0/2992397403 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5598e82c31c0 0x5598e86c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.498+0000 7fe750c00640 10 client.25337 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:54:13.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.498+0000 7fe763e00640 1 --2- 172.21.15.37:0/2992397403 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5598e82c31c0 0x5598e86c9d50 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f7a5754740e4056 server_cookie=b291a34924aa5275 in_seq=0 out_seq=0 2024-09-21T05:54:13.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.498+0000 7fe750c00640 1 -- 172.21.15.37:0/2992397403 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5598e8623bf0 con 0x5598e82c31c0 2024-09-21T05:54:13.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.498+0000 7fe750c00640 10 client.25337 handle_command_reply: tid=0 2024-09-21T05:54:13.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.499+0000 7fe770c73740 1 client.25337 shutdown 2024-09-21T05:54:13.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.499+0000 7fe770c73740 1 -- 172.21.15.37:0/2992397403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82e3b60 msgr2=0x5598e86b7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:13.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.499+0000 7fe770c73740 1 --2- 172.21.15.37:0/2992397403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82e3b60 0x5598e86b7f10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00bf50 tx=0x7fe74c0118d0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.499+0000 7fe770c73740 1 -- 172.21.15.37:0/2992397403 shutdown_connections 2024-09-21T05:54:13.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.499+0000 7fe770c73740 1 --2- 172.21.15.37:0/2992397403 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5598e82c31c0 0x5598e86c9d50 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.499+0000 7fe770c73740 1 --2- 172.21.15.37:0/2992397403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e8304840 0x5598e86b8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.499+0000 7fe770c73740 1 --2- 172.21.15.37:0/2992397403 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82e3b60 0x5598e86b7f10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.499+0000 7fe770c73740 1 --2- 172.21.15.37:0/2992397403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e82db980 0x5598e86b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.499+0000 7fe770c73740 1 -- 172.21.15.37:0/2992397403 >> 172.21.15.37:0/2992397403 conn(0x5598e82f8990 msgr2=0x5598e86a89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:13.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.499+0000 7fe750c00640 0 client.25337 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:54:13.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.499+0000 7fe770c73740 1 -- 172.21.15.37:0/2992397403 shutdown_connections 2024-09-21T05:54:13.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.499+0000 7fe770c73740 1 -- 172.21.15.37:0/2992397403 wait complete. 2024-09-21T05:54:13.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.500+0000 7fe770c73740 20 client.25337 trim_cache size 0 max 16384 2024-09-21T05:54:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.526+0000 7fe770c73740 1 Processor -- start 2024-09-21T05:54:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.526+0000 7fe770c73740 1 -- start start 2024-09-21T05:54:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.526+0000 7fe770c73740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 0x5598e86b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.526+0000 7fe770c73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82e3b60 0x5598e86b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.526+0000 7fe770c73740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e8304840 0x5598e86cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.526+0000 7fe770c73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641b0e00 con 0x5598e82e3b60 2024-09-21T05:54:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.526+0000 7fe770c73740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641b3680 con 0x5598e82db980 2024-09-21T05:54:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.526+0000 7fe770c73740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641b1470 con 0x5598e8304840 2024-09-21T05:54:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.527+0000 7fe75be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82e3b60 0x5598e86b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.527+0000 7fe763e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 0x5598e86b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.527+0000 7fe763e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 0x5598e86b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:55522/0 (socket says 172.21.15.37:55522) 2024-09-21T05:54:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.527+0000 7fe763e00640 1 -- 172.21.15.37:0/1208130763 learned_addr learned my addr 172.21.15.37:0/1208130763 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:54:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.527+0000 7fe763e00640 1 --2- 172.21.15.37:0/1208130763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e8304840 0x5598e86cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.527+0000 7fe763e00640 1 -- 172.21.15.37:0/1208130763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e8304840 msgr2=0x5598e86cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.527+0000 7fe763e00640 1 --2- 172.21.15.37:0/1208130763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e8304840 0x5598e86cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.527+0000 7fe763e00640 1 -- 172.21.15.37:0/1208130763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82e3b60 msgr2=0x5598e86b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.527+0000 7fe763e00640 1 --2- 172.21.15.37:0/1208130763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82e3b60 0x5598e86b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.527+0000 7fe763e00640 1 -- 172.21.15.37:0/1208130763 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e86a5c50 con 0x5598e82db980 2024-09-21T05:54:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.527+0000 7fe763e00640 1 --2- 172.21.15.37:0/1208130763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 0x5598e86b4bc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009560 tx=0x7fe75c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbafa8e04434d22b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.528+0000 7fe753400640 1 -- 172.21.15.37:0/1208130763 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c004810 con 0x5598e82db980 2024-09-21T05:54:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.528+0000 7fe753400640 1 -- 172.21.15.37:0/1208130763 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75c003ee0 con 0x5598e82db980 2024-09-21T05:54:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.528+0000 7fe753400640 1 -- 172.21.15.37:0/1208130763 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c028880 con 0x5598e82db980 2024-09-21T05:54:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.529+0000 7fe770c73740 1 -- 172.21.15.37:0/1208130763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 msgr2=0x5598e86b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.529+0000 7fe770c73740 1 --2- 172.21.15.37:0/1208130763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 0x5598e86b4bc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009560 tx=0x7fe75c005fd0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.529+0000 7fe770c73740 1 -- 172.21.15.37:0/1208130763 shutdown_connections 2024-09-21T05:54:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.529+0000 7fe770c73740 1 --2- 172.21.15.37:0/1208130763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e8304840 0x5598e86cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.529+0000 7fe770c73740 1 --2- 172.21.15.37:0/1208130763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82e3b60 0x5598e86b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.529+0000 7fe770c73740 1 --2- 172.21.15.37:0/1208130763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 0x5598e86b4bc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.529+0000 7fe770c73740 1 -- 172.21.15.37:0/1208130763 >> 172.21.15.37:0/1208130763 conn(0x5598e82f8990 msgr2=0x5598e86b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.529+0000 7fe770c73740 1 -- 172.21.15.37:0/1208130763 shutdown_connections 2024-09-21T05:54:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.529+0000 7fe770c73740 1 -- 172.21.15.37:0/1208130763 wait complete. 2024-09-21T05:54:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.529+0000 7fe770c73740 1 -- start start 2024-09-21T05:54:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.529+0000 7fe770c73740 1 Processor -- start 2024-09-21T05:54:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.530+0000 7fe770c73740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 0x5598e872d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.530+0000 7fe770c73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82e3b60 0x5598e872dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.530+0000 7fe770c73740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e8304840 0x5598e86bc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.530+0000 7fe770c73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641b1b40 con 0x5598e82e3b60 2024-09-21T05:54:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.530+0000 7fe770c73740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641b2fb0 con 0x5598e82db980 2024-09-21T05:54:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.530+0000 7fe770c73740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641b2210 con 0x5598e8304840 2024-09-21T05:54:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.530+0000 7fe770c73740 10 client.0 _ll_register_callbacks cb 0x7fe74c00bb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.530+0000 7fe75be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82e3b60 0x5598e872dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.530+0000 7fe763e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 0x5598e872d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.530+0000 7fe763e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 0x5598e872d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:55528/0 (socket says 172.21.15.37:55528) 2024-09-21T05:54:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.530+0000 7fe75be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82e3b60 0x5598e872dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36514/0 (socket says 172.21.15.37:36514) 2024-09-21T05:54:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.530+0000 7fe763e00640 1 -- 172.21.15.37:0/4025013805 learned_addr learned my addr 172.21.15.37:0/4025013805 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:54:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.531+0000 7fe763e00640 1 --2- 172.21.15.37:0/4025013805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e8304840 0x5598e86bc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.531+0000 7fe75be00640 1 -- 172.21.15.37:0/4025013805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e8304840 msgr2=0x5598e86bc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.531+0000 7fe75be00640 1 --2- 172.21.15.37:0/4025013805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e8304840 0x5598e86bc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.531+0000 7fe75be00640 1 -- 172.21.15.37:0/4025013805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 msgr2=0x5598e872d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.531+0000 7fe75be00640 1 --2- 172.21.15.37:0/4025013805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 0x5598e872d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.531+0000 7fe75be00640 1 -- 172.21.15.37:0/4025013805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e86bcbc0 con 0x5598e82e3b60 2024-09-21T05:54:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.531+0000 7fe763e00640 1 --2- 172.21.15.37:0/4025013805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 0x5598e872d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.532+0000 7fe75be00640 1 --2- 172.21.15.37:0/4025013805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82e3b60 0x5598e872dfa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe74c003bd0 tx=0x7fe74c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62fa31d2a405929 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.532+0000 7fe750c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T05:54:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.532+0000 7fe750c00640 1 -- 172.21.15.37:0/4025013805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00b480 con 0x5598e82e3b60 2024-09-21T05:54:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.532+0000 7fe750c00640 1 -- 172.21.15.37:0/4025013805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fe74c005250 con 0x5598e82e3b60 2024-09-21T05:54:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.532+0000 7fe770c73740 1 -- 172.21.15.37:0/4025013805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe75c003ee0 con 0x5598e82e3b60 2024-09-21T05:54:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.533+0000 7fe750c00640 1 -- 172.21.15.37:0/4025013805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe74c03a050 con 0x5598e82e3b60 2024-09-21T05:54:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.533+0000 7fe770c73740 10 client.15315 fetch_fsmap learned FSMap version 21 2024-09-21T05:54:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.533+0000 7fe770c73740 1 -- 172.21.15.37:0/4025013805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5598e87350e0 con 0x5598e82e3b60 2024-09-21T05:54:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.533+0000 7fe750c00640 1 -- 172.21.15.37:0/4025013805 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75c003ee0 con 0x5598e82e3b60 2024-09-21T05:54:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.533+0000 7fe750c00640 1 -- 172.21.15.37:0/4025013805 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe74c010700 con 0x5598e82e3b60 2024-09-21T05:54:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.533+0000 7fe770c73740 10 client.15315 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:54:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.533+0000 7fe770c73740 10 client.15315 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:54:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.533+0000 7fe770c73740 20 client.15315 populate_metadata read hostname 'smithi037' 2024-09-21T05:54:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.533+0000 7fe770c73740 1 --2- 172.21.15.37:0/4025013805 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5598e8298570 0x5598e8737900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.533+0000 7fe770c73740 4 client.15315 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}] 2024-09-21T05:54:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.533+0000 7fe770c73740 1 -- 172.21.15.37:0/4025013805 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}) -- 0x5598e861f6a0 con 0x5598e8298570 2024-09-21T05:54:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.534+0000 7fe763e00640 1 --2- 172.21.15.37:0/4025013805 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5598e8298570 0x5598e8737900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.534+0000 7fe763e00640 1 --2- 172.21.15.37:0/4025013805 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5598e8298570 0x5598e8737900 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58b73f16ea42633f server_cookie=1a23a018c9396eb1 in_seq=0 out_seq=0 2024-09-21T05:54:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.534+0000 7fe750c00640 10 client.15315 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:54:13.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe750c00640 1 -- 172.21.15.37:0/4025013805 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5598e861f6a0 con 0x5598e8298570 2024-09-21T05:54:13.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe750c00640 10 client.15315 handle_command_reply: tid=0 2024-09-21T05:54:13.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe770c73740 1 client.15315 shutdown 2024-09-21T05:54:13.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe770c73740 1 -- 172.21.15.37:0/4025013805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82e3b60 msgr2=0x5598e872dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:13.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe770c73740 1 --2- 172.21.15.37:0/4025013805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82e3b60 0x5598e872dfa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe74c003bd0 tx=0x7fe74c0038a0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe770c73740 1 -- 172.21.15.37:0/4025013805 shutdown_connections 2024-09-21T05:54:13.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe770c73740 1 --2- 172.21.15.37:0/4025013805 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5598e8298570 0x5598e8737900 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe770c73740 1 --2- 172.21.15.37:0/4025013805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5598e8304840 0x5598e86bc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe770c73740 1 --2- 172.21.15.37:0/4025013805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e82e3b60 0x5598e872dfa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe770c73740 1 --2- 172.21.15.37:0/4025013805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598e82db980 0x5598e872d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe770c73740 1 -- 172.21.15.37:0/4025013805 >> 172.21.15.37:0/4025013805 conn(0x5598e82f8990 msgr2=0x5598e86ad380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:13.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe750c00640 0 client.15315 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:54:13.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe770c73740 1 -- 172.21.15.37:0/4025013805 shutdown_connections 2024-09-21T05:54:13.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.543+0000 7fe770c73740 1 -- 172.21.15.37:0/4025013805 wait complete. 2024-09-21T05:54:13.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.544+0000 7fe770c73740 20 client.15315 trim_cache size 0 max 16384 2024-09-21T05:54:13.547 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:54:13.547 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:54:13.547 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:54:13.547 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 2, 2024-09-21T05:54:13.547 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:54:13.547 INFO:teuthology.orchestra.run.smithi037.stdout: "5b381d20": { 2024-09-21T05:54:13.547 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 2, 2024-09-21T05:54:13.547 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 134.5, 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:54:13.548 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:54:13.549 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:54:13.549 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:54:13.549 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:54:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.544+0000 7fe76a000640 1 -- 172.21.15.37:0/3007716472 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe7480b6510 msgr2=0x7fe7480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.544+0000 7fe76a000640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe7480b6510 0x7fe7480b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe7540ca310 tx=0x7fe754009260 comp rx=0 tx=0).stop 2024-09-21T05:54:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.544+0000 7fe76a000640 1 -- 172.21.15.37:0/3007716472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe764105d80 msgr2=0x7fe76419c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.544+0000 7fe76a000640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe764105d80 0x7fe76419c6d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe754005ab0 tx=0x7fe754003c80 comp rx=0 tx=0).stop 2024-09-21T05:54:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.544+0000 7fe76a000640 1 -- 172.21.15.37:0/3007716472 shutdown_connections 2024-09-21T05:54:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.544+0000 7fe76a000640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76410c010 0x7fe7641a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.544+0000 7fe76a000640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe7480b6510 0x7fe7480b8a20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.544+0000 7fe76a000640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76410b6c0 0x7fe76419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.544+0000 7fe76a000640 1 --2- 172.21.15.37:0/3007716472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe764105d80 0x7fe76419c6d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.544+0000 7fe76a000640 1 -- 172.21.15.37:0/3007716472 >> 172.21.15.37:0/3007716472 conn(0x7fe7641017d0 msgr2=0x7fe764103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.545+0000 7fe76a000640 1 -- 172.21.15.37:0/3007716472 shutdown_connections 2024-09-21T05:54:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:13.545+0000 7fe76a000640 1 -- 172.21.15.37:0/3007716472 wait complete. 2024-09-21T05:54:14.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:13 smithi144 ceph-mon[34351]: pgmap v423: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:14.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:13 smithi037 ceph-mon[30631]: pgmap v423: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:14.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:13 smithi067 ceph-mon[34443]: pgmap v423: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:14.336 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5b381d20', quiesce took 4.3 seconds. Will release after: 10.2 2024-09-21T05:54:16.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:15 smithi144 ceph-mon[34351]: pgmap v424: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:16.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:15 smithi037 ceph-mon[30631]: pgmap v424: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:16.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:15 smithi067 ceph-mon[34443]: pgmap v424: 129 pgs: 129 active+clean; 657 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:18.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:17 smithi144 ceph-mon[34351]: pgmap v425: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T05:54:18.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:17 smithi037 ceph-mon[30631]: pgmap v425: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T05:54:18.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:17 smithi067 ceph-mon[34443]: pgmap v425: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T05:54:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:19 smithi144 ceph-mon[34351]: pgmap v426: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T05:54:20.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:19 smithi037 ceph-mon[30631]: pgmap v426: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T05:54:20.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:19 smithi067 ceph-mon[34443]: pgmap v426: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T05:54:22.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:21 smithi144 ceph-mon[34351]: pgmap v427: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T05:54:22.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:21 smithi037 ceph-mon[30631]: pgmap v427: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T05:54:22.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:21 smithi067 ceph-mon[34443]: pgmap v427: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T05:54:24.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:23 smithi144 ceph-mon[34351]: pgmap v428: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:24.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:23 smithi037 ceph-mon[30631]: pgmap v428: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:24.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:23 smithi067 ceph-mon[34443]: pgmap v428: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:24.537 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:54:25.039 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.745+0000 7f97ab200640 1 -- 172.21.15.37:0/894612518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a41047c0 msgr2=0x7f97a4104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.745+0000 7f97ab200640 1 --2- 172.21.15.37:0/894612518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a41047c0 0x7f97a4104bd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9798009860 tx=0x7f979802a360 comp rx=0 tx=0).stop 2024-09-21T05:54:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.745+0000 7f97ab200640 1 -- 172.21.15.37:0/894612518 shutdown_connections 2024-09-21T05:54:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.745+0000 7f97ab200640 1 --2- 172.21.15.37:0/894612518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a410dc20 0x7f97a4110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.745+0000 7f97ab200640 1 --2- 172.21.15.37:0/894612518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a4105110 0x7f97a410d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.745+0000 7f97ab200640 1 --2- 172.21.15.37:0/894612518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a41047c0 0x7f97a4104bd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.745+0000 7f97ab200640 1 -- 172.21.15.37:0/894612518 >> 172.21.15.37:0/894612518 conn(0x7f97a40fe2c0 msgr2=0x7f97a4100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.745+0000 7f97ab200640 1 -- 172.21.15.37:0/894612518 shutdown_connections 2024-09-21T05:54:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.747+0000 7f97ab200640 1 -- 172.21.15.37:0/894612518 wait complete. 2024-09-21T05:54:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.748+0000 7f97ab200640 1 Processor -- start 2024-09-21T05:54:25.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.748+0000 7f97ab200640 1 -- start start 2024-09-21T05:54:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.749+0000 7f97ab200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a41047c0 0x7f97a4102500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.749+0000 7f97ab200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4105110 0x7f97a4102a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.749+0000 7f97ab200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a410dc20 0x7f97a4102f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.749+0000 7f97ab200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4113880 con 0x7f97a4105110 2024-09-21T05:54:25.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.749+0000 7f97ab200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4113700 con 0x7f97a41047c0 2024-09-21T05:54:25.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.749+0000 7f97ab200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4113a00 con 0x7f97a410dc20 2024-09-21T05:54:25.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.750+0000 7f97a9e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a41047c0 0x7f97a4102500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.750+0000 7f97a9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4105110 0x7f97a4102a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.750+0000 7f97a9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4105110 0x7f97a4102a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51810/0 (socket says 172.21.15.37:51810) 2024-09-21T05:54:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.750+0000 7f97a9400640 1 -- 172.21.15.37:0/3513893138 learned_addr learned my addr 172.21.15.37:0/3513893138 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:54:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.750+0000 7f97a9e00640 1 -- 172.21.15.37:0/3513893138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a410dc20 msgr2=0x7f97a4102f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.750+0000 7f97a9e00640 1 --2- 172.21.15.37:0/3513893138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a410dc20 0x7f97a4102f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.750+0000 7f97a9e00640 1 -- 172.21.15.37:0/3513893138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4105110 msgr2=0x7f97a4102a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.750+0000 7f97a9e00640 1 --2- 172.21.15.37:0/3513893138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4105110 0x7f97a4102a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.750+0000 7f97a9e00640 1 -- 172.21.15.37:0/3513893138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a41a8590 con 0x7f97a41047c0 2024-09-21T05:54:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.751+0000 7f97a9400640 1 --2- 172.21.15.37:0/3513893138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4105110 0x7f97a4102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:54:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.751+0000 7f97a9e00640 1 --2- 172.21.15.37:0/3513893138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a41047c0 0x7f97a4102500 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9798035040 tx=0x7f9798032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.752+0000 7f979ea00640 1 -- 172.21.15.37:0/3513893138 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798040020 con 0x7f97a41047c0 2024-09-21T05:54:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.752+0000 7f979ea00640 1 -- 172.21.15.37:0/3513893138 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9798038040 con 0x7f97a41047c0 2024-09-21T05:54:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.752+0000 7f97ab200640 1 -- 172.21.15.37:0/3513893138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a41a8820 con 0x7f97a41047c0 2024-09-21T05:54:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.752+0000 7f979ea00640 1 -- 172.21.15.37:0/3513893138 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798037070 con 0x7f97a41047c0 2024-09-21T05:54:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.752+0000 7f97ab200640 1 -- 172.21.15.37:0/3513893138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a41a8d00 con 0x7f97a41047c0 2024-09-21T05:54:25.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.753+0000 7f97ab200640 1 -- 172.21.15.37:0/3513893138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a4104bd0 con 0x7f97a41047c0 2024-09-21T05:54:25.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.756+0000 7f979ea00640 1 -- 172.21.15.37:0/3513893138 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9798043020 con 0x7f97a41047c0 2024-09-21T05:54:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.759+0000 7f979ea00640 1 --2- 172.21.15.37:0/3513893138 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f978c0b6660 0x7f978c0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.759+0000 7f979ea00640 1 -- 172.21.15.37:0/3513893138 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f97981079d0 con 0x7f97a41047c0 2024-09-21T05:54:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.759+0000 7f97a9400640 1 --2- 172.21.15.37:0/3513893138 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f978c0b6660 0x7f978c0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.760+0000 7f979ea00640 1 -- 172.21.15.37:0/3513893138 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f97980cdf30 con 0x7f97a41047c0 2024-09-21T05:54:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:25.760+0000 7f97a9400640 1 --2- 172.21.15.37:0/3513893138 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f978c0b6660 0x7f978c0b8b70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f97a4110280 tx=0x7f979400b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:25.876 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:25 smithi037 ceph-mon[30631]: pgmap v429: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:26.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.140+0000 7f97ab200640 1 -- 172.21.15.37:0/3513893138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97a41a9120 con 0x7f97a41047c0 2024-09-21T05:54:26.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.141+0000 7f979ea00640 1 -- 172.21.15.37:0/3513893138 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f97980d2310 con 0x7f97a41047c0 2024-09-21T05:54:26.143 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:54:26.144 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:54:26.144 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:54:26.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.144+0000 7f97ab200640 1 -- 172.21.15.37:0/3513893138 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f978c0b6660 msgr2=0x7f978c0b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:26.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.144+0000 7f97ab200640 1 --2- 172.21.15.37:0/3513893138 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f978c0b6660 0x7f978c0b8b70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f97a4110280 tx=0x7f979400b410 comp rx=0 tx=0).stop 2024-09-21T05:54:26.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.144+0000 7f97ab200640 1 -- 172.21.15.37:0/3513893138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a41047c0 msgr2=0x7f97a4102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:26.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.144+0000 7f97ab200640 1 --2- 172.21.15.37:0/3513893138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a41047c0 0x7f97a4102500 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9798035040 tx=0x7f9798032d50 comp rx=0 tx=0).stop 2024-09-21T05:54:26.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.144+0000 7f97ab200640 1 -- 172.21.15.37:0/3513893138 shutdown_connections 2024-09-21T05:54:26.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.144+0000 7f97ab200640 1 --2- 172.21.15.37:0/3513893138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a410dc20 0x7f97a4102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:26.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.144+0000 7f97ab200640 1 --2- 172.21.15.37:0/3513893138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4105110 0x7f97a4102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:26.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.144+0000 7f97ab200640 1 --2- 172.21.15.37:0/3513893138 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f978c0b6660 0x7f978c0b8b70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:26.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.144+0000 7f97ab200640 1 --2- 172.21.15.37:0/3513893138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97a41047c0 0x7f97a4102500 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:26.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.144+0000 7f97ab200640 1 -- 172.21.15.37:0/3513893138 >> 172.21.15.37:0/3513893138 conn(0x7f97a40fe2c0 msgr2=0x7f97a41077a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:26.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.144+0000 7f97ab200640 1 -- 172.21.15.37:0/3513893138 shutdown_connections 2024-09-21T05:54:26.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:26.144+0000 7f97ab200640 1 -- 172.21.15.37:0/3513893138 wait complete. 2024-09-21T05:54:26.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:25 smithi067 ceph-mon[34443]: pgmap v429: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:26.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:25 smithi144 ceph-mon[34351]: pgmap v429: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:26.881 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:26 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3513893138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:26.928 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db --set-id 5b381d20 --release --await' 2024-09-21T05:54:26.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db --set-id 5b381d20 --release --await 2024-09-21T05:54:27.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:26 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3513893138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:27.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:26 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3513893138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.113+0000 7f2fd6800640 1 -- 172.21.15.37:0/1050621899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0102d30 msgr2=0x7f2fd010fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.113+0000 7f2fd6800640 1 --2- 172.21.15.37:0/1050621899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0102d30 0x7f2fd010fa50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009900 tx=0x7f2fbc02a480 comp rx=0 tx=0).stop 2024-09-21T05:54:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.113+0000 7f2fd6800640 1 -- 172.21.15.37:0/1050621899 shutdown_connections 2024-09-21T05:54:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.113+0000 7f2fd6800640 1 --2- 172.21.15.37:0/1050621899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fd010ff90 0x7f2fd01123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.113+0000 7f2fd6800640 1 --2- 172.21.15.37:0/1050621899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0102d30 0x7f2fd010fa50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.113+0000 7f2fd6800640 1 --2- 172.21.15.37:0/1050621899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fd01023e0 0x7f2fd01027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.113+0000 7f2fd6800640 1 -- 172.21.15.37:0/1050621899 >> 172.21.15.37:0/1050621899 conn(0x7f2fd00fe2c0 msgr2=0x7f2fd0100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.113+0000 7f2fd6800640 1 -- 172.21.15.37:0/1050621899 shutdown_connections 2024-09-21T05:54:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.113+0000 7f2fd6800640 1 -- 172.21.15.37:0/1050621899 wait complete. 2024-09-21T05:54:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.114+0000 7f2fd6800640 1 Processor -- start 2024-09-21T05:54:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.115+0000 7f2fd6800640 1 -- start start 2024-09-21T05:54:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.115+0000 7f2fd6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fd01023e0 0x7f2fd019c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.115+0000 7f2fd6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0102d30 0x7f2fd019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.115+0000 7f2fd6800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fd010ff90 0x7f2fd01a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.115+0000 7f2fd6800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd0115ad0 con 0x7f2fd0102d30 2024-09-21T05:54:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.115+0000 7f2fd6800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd0115950 con 0x7f2fd010ff90 2024-09-21T05:54:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.115+0000 7f2fd6800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd0115c50 con 0x7f2fd01023e0 2024-09-21T05:54:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.115+0000 7f2fd4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0102d30 0x7f2fd019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.116+0000 7f2fd5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fd010ff90 0x7f2fd01a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.116+0000 7f2fd4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0102d30 0x7f2fd019ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51824/0 (socket says 172.21.15.37:51824) 2024-09-21T05:54:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.116+0000 7f2fd4a00640 1 -- 172.21.15.37:0/3744024646 learned_addr learned my addr 172.21.15.37:0/3744024646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:54:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.116+0000 7f2fd5400640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fd01023e0 0x7f2fd019c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.116+0000 7f2fd5400640 1 -- 172.21.15.37:0/3744024646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fd010ff90 msgr2=0x7f2fd01a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.116+0000 7f2fd5400640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fd010ff90 0x7f2fd01a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.116+0000 7f2fd5400640 1 -- 172.21.15.37:0/3744024646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0102d30 msgr2=0x7f2fd019ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.116+0000 7f2fd5400640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0102d30 0x7f2fd019ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.116+0000 7f2fd5400640 1 -- 172.21.15.37:0/3744024646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd01a2410 con 0x7f2fd01023e0 2024-09-21T05:54:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.116+0000 7f2fd5e00640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fd010ff90 0x7f2fd01a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.117+0000 7f2fd5400640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fd01023e0 0x7f2fd019c4a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400e9f0 tx=0x7f2fc400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.117+0000 7f2fce000640 1 -- 172.21.15.37:0/3744024646 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc400cd80 con 0x7f2fd01023e0 2024-09-21T05:54:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.117+0000 7f2fd6800640 1 -- 172.21.15.37:0/3744024646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd01a2700 con 0x7f2fd01023e0 2024-09-21T05:54:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.118+0000 7f2fd6800640 1 -- 172.21.15.37:0/3744024646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd01a8e60 con 0x7f2fd01023e0 2024-09-21T05:54:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.118+0000 7f2fce000640 1 -- 172.21.15.37:0/3744024646 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fc40035f0 con 0x7f2fd01023e0 2024-09-21T05:54:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.118+0000 7f2fce000640 1 -- 172.21.15.37:0/3744024646 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4010690 con 0x7f2fd01023e0 2024-09-21T05:54:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.122+0000 7f2fdea3c740 1 Processor -- start 2024-09-21T05:54:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.122+0000 7f2fdea3c740 1 -- start start 2024-09-21T05:54:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.122+0000 7f2fdea3c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556801500520 0x5568018a7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.122+0000 7f2fdea3c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5568014d7660 0x5568018a7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.122+0000 7f2fdea3c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014df840 0x5568018a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.122+0000 7f2fdea3c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55680181e290 con 0x556801500520 2024-09-21T05:54:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.122+0000 7f2fdea3c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55680180d6c0 con 0x5568014d7660 2024-09-21T05:54:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.122+0000 7f2fdea3c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5568018114d0 con 0x5568014df840 2024-09-21T05:54:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.123+0000 7f2fd5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556801500520 0x5568018a7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.123+0000 7f2fd5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556801500520 0x5568018a7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51832/0 (socket says 172.21.15.37:51832) 2024-09-21T05:54:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.123+0000 7f2fd5e00640 1 -- 172.21.15.37:0/3424488309 learned_addr learned my addr 172.21.15.37:0/3424488309 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:54:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.123+0000 7f2fd4a00640 1 --2- 172.21.15.37:0/3424488309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014df840 0x5568018a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.124+0000 7f2fce000640 1 -- 172.21.15.37:0/3744024646 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f2fc40037a0 con 0x7f2fd01023e0 2024-09-21T05:54:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.124+0000 7f2fd4a00640 1 -- 172.21.15.37:0/3424488309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5568014d7660 msgr2=0x5568018a7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.124+0000 7f2fd4a00640 1 --2- 172.21.15.37:0/3424488309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5568014d7660 0x5568018a7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.124+0000 7f2fd4a00640 1 -- 172.21.15.37:0/3424488309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556801500520 msgr2=0x5568018a7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.124+0000 7f2fd4a00640 1 --2- 172.21.15.37:0/3424488309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556801500520 0x5568018a7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.124+0000 7f2fd4a00640 1 -- 172.21.15.37:0/3424488309 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55680179a460 con 0x5568014df840 2024-09-21T05:54:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.125+0000 7f2fd4a00640 1 --2- 172.21.15.37:0/3424488309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014df840 0x5568018a7dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc000c00 tx=0x7f2fbc004100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ecc33e585962424 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:28.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.125+0000 7f2fc2600640 1 -- 172.21.15.37:0/3424488309 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc040070 con 0x5568014df840 2024-09-21T05:54:28.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.126+0000 7f2fc2600640 1 -- 172.21.15.37:0/3424488309 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fbc0054d0 con 0x5568014df840 2024-09-21T05:54:28.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.126+0000 7f2fc2600640 1 -- 172.21.15.37:0/3424488309 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc035040 con 0x5568014df840 2024-09-21T05:54:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.126+0000 7f2fce000640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2fb80b6590 0x7f2fb80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.127+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3424488309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014df840 msgr2=0x5568018a7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.127+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3424488309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014df840 0x5568018a7dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc000c00 tx=0x7f2fbc004100 comp rx=0 tx=0).stop 2024-09-21T05:54:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.127+0000 7f2fce000640 1 -- 172.21.15.37:0/3744024646 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f2fc40e79c0 con 0x7f2fd01023e0 2024-09-21T05:54:28.130 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:27 smithi037 ceph-mon[30631]: pgmap v430: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.127+0000 7f2fd5e00640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2fb80b6590 0x7f2fb80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.128+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3424488309 shutdown_connections 2024-09-21T05:54:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.128+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3424488309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014df840 0x5568018a7dc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.128+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3424488309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5568014d7660 0x5568018a7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.128+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3424488309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556801500520 0x5568018a7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.128+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3424488309 >> 172.21.15.37:0/3424488309 conn(0x5568014f4910 msgr2=0x5568018a5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.128+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3424488309 shutdown_connections 2024-09-21T05:54:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.129+0000 7f2fd5e00640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2fb80b6590 0x7f2fb80b8aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8009fd0 tx=0x7f2fc8009500 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.129+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3424488309 wait complete. 2024-09-21T05:54:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.129+0000 7f2fdea3c740 1 -- start start 2024-09-21T05:54:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.130+0000 7f2fdea3c740 1 Processor -- start 2024-09-21T05:54:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.131+0000 7f2fdea3c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.131+0000 7f2fdea3c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568014df840 0x5568018b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.131+0000 7f2fdea3c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556801500520 0x5568018bedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.131+0000 7f2fdea3c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55680166ebb0 con 0x5568014df840 2024-09-21T05:54:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.131+0000 7f2fdea3c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5568017a86c0 con 0x556801500520 2024-09-21T05:54:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.131+0000 7f2fdea3c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5568018b5ac0 con 0x5568014d7660 2024-09-21T05:54:28.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.131+0000 7f2fdea3c740 10 client.0 _ll_register_callbacks cb 0x5568017c3490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.131+0000 7f2fd5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556801500520 0x5568018bedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.131+0000 7f2fd5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.131+0000 7f2fd5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556801500520 0x5568018bedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:56990/0 (socket says 172.21.15.37:56990) 2024-09-21T05:54:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.131+0000 7f2fd5e00640 1 -- 172.21.15.37:0/3454288742 learned_addr learned my addr 172.21.15.37:0/3454288742 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:54:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.132+0000 7f2fd5e00640 1 -- 172.21.15.37:0/3454288742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 msgr2=0x5568018b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.132+0000 7f2fd5e00640 1 --2- 172.21.15.37:0/3454288742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.132+0000 7f2fd5e00640 1 -- 172.21.15.37:0/3454288742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568014df840 msgr2=0x5568018b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.133+0000 7f2fd4a00640 1 --2- 172.21.15.37:0/3454288742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568014df840 0x5568018b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.133+0000 7f2fd5e00640 1 --2- 172.21.15.37:0/3454288742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568014df840 0x5568018b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.133+0000 7f2fd5e00640 1 -- 172.21.15.37:0/3454288742 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55680156bb00 con 0x556801500520 2024-09-21T05:54:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.133+0000 7f2fd4a00640 1 --2- 172.21.15.37:0/3454288742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568014df840 0x5568018b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:54:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.133+0000 7f2fd5e00640 1 --2- 172.21.15.37:0/3454288742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556801500520 0x5568018bedb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8011b90 tx=0x7f2fc8004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6552f9ccbffe29a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.133+0000 7f2fb6a00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:54:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.134+0000 7f2fb6a00640 1 -- 172.21.15.37:0/3454288742 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc802d060 con 0x556801500520 2024-09-21T05:54:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.134+0000 7f2fb6a00640 1 -- 172.21.15.37:0/3454288742 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f2fc8017030 con 0x556801500520 2024-09-21T05:54:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.134+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3454288742 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fbc0054d0 con 0x556801500520 2024-09-21T05:54:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.134+0000 7f2fb6a00640 1 -- 172.21.15.37:0/3454288742 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2fc8034050 con 0x556801500520 2024-09-21T05:54:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.134+0000 7f2fdea3c740 10 client.25358 fetch_fsmap learned FSMap version 21 2024-09-21T05:54:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.134+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3454288742 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5568015e2960 con 0x556801500520 2024-09-21T05:54:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.135+0000 7f2fb6a00640 1 -- 172.21.15.37:0/3454288742 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fbc0054d0 con 0x556801500520 2024-09-21T05:54:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.135+0000 7f2fb6a00640 1 -- 172.21.15.37:0/3454288742 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2fc8028860 con 0x556801500520 2024-09-21T05:54:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.136+0000 7f2fdea3c740 10 client.25358 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:54:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.136+0000 7f2fdea3c740 10 client.25358 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:54:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.136+0000 7f2fdea3c740 20 client.25358 populate_metadata read hostname 'smithi037' 2024-09-21T05:54:28.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.136+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3454288742 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5568014beea0 0x5568018c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.136+0000 7f2fdea3c740 4 client.25358 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:54:28.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.136+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3454288742 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568018201e0 con 0x5568014beea0 2024-09-21T05:54:28.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.137+0000 7f2fd5400640 1 --2- 172.21.15.37:0/3454288742 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5568014beea0 0x5568018c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.138+0000 7f2fd5400640 1 --2- 172.21.15.37:0/3454288742 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5568014beea0 0x5568018c4f20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9655e240679ccde5 server_cookie=adbe91e6bdc1df89 in_seq=0 out_seq=0 2024-09-21T05:54:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.138+0000 7f2fb6a00640 10 client.25358 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:54:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.138+0000 7f2fb6a00640 1 -- 172.21.15.37:0/3454288742 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5568018201e0 con 0x5568014beea0 2024-09-21T05:54:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.138+0000 7f2fb6a00640 10 client.25358 handle_command_reply: tid=0 2024-09-21T05:54:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.139+0000 7f2fdea3c740 1 client.25358 shutdown 2024-09-21T05:54:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.139+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3454288742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556801500520 msgr2=0x5568018bedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.139+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3454288742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556801500520 0x5568018bedb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8011b90 tx=0x7f2fc8004ab0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.140+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3454288742 shutdown_connections 2024-09-21T05:54:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.140+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3454288742 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5568014beea0 0x5568018c4f20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.140+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3454288742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556801500520 0x5568018bedb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.140+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3454288742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568014df840 0x5568018b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.140+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3454288742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.140+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3454288742 >> 172.21.15.37:0/3454288742 conn(0x5568014f4910 msgr2=0x5568018aa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.140+0000 7f2fb6a00640 0 client.25358 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:54:28.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.141+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3454288742 shutdown_connections 2024-09-21T05:54:28.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.141+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3454288742 wait complete. 2024-09-21T05:54:28.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.141+0000 7f2fdea3c740 20 client.25358 trim_cache size 0 max 16384 2024-09-21T05:54:28.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.176+0000 7f2fdea3c740 1 Processor -- start 2024-09-21T05:54:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.176+0000 7f2fdea3c740 1 -- start start 2024-09-21T05:54:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.177+0000 7f2fdea3c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018becb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.177+0000 7f2fdea3c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568014df840 0x5568018bf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.177+0000 7f2fdea3c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556801500520 0x5568018aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.177+0000 7f2fdea3c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd01b0c50 con 0x5568014df840 2024-09-21T05:54:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.177+0000 7f2fdea3c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd01b34d0 con 0x556801500520 2024-09-21T05:54:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.177+0000 7f2fdea3c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd01b12c0 con 0x5568014d7660 2024-09-21T05:54:28.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.177+0000 7f2fd5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018becb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.177+0000 7f2fd4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568014df840 0x5568018bf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.177+0000 7f2fd5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018becb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:44842/0 (socket says 172.21.15.37:44842) 2024-09-21T05:54:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.177+0000 7f2fd5400640 1 -- 172.21.15.37:0/3263114658 learned_addr learned my addr 172.21.15.37:0/3263114658 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:54:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.178+0000 7f2fd5e00640 1 --2- 172.21.15.37:0/3263114658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556801500520 0x5568018aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.178+0000 7f2fd5400640 1 -- 172.21.15.37:0/3263114658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556801500520 msgr2=0x5568018aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.178+0000 7f2fd5400640 1 --2- 172.21.15.37:0/3263114658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556801500520 0x5568018aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.178+0000 7f2fd5400640 1 -- 172.21.15.37:0/3263114658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568014df840 msgr2=0x5568018bf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.178+0000 7f2fd5400640 1 --2- 172.21.15.37:0/3263114658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568014df840 0x5568018bf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.178+0000 7f2fd5400640 1 -- 172.21.15.37:0/3263114658 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568018ae5b0 con 0x5568014d7660 2024-09-21T05:54:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.178+0000 7f2fd5e00640 1 --2- 172.21.15.37:0/3263114658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556801500520 0x5568018aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.178+0000 7f2fd4a00640 1 --2- 172.21.15.37:0/3263114658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568014df840 0x5568018bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:54:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.179+0000 7f2fd5400640 1 --2- 172.21.15.37:0/3263114658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018becb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40a9ee0 tx=0x7f2fc4005bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=130d98e0f729a93c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.179+0000 7f2fc1c00640 1 -- 172.21.15.37:0/3263114658 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc40ade20 con 0x5568014d7660 2024-09-21T05:54:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.179+0000 7f2fc1c00640 1 -- 172.21.15.37:0/3263114658 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fc40b2200 con 0x5568014d7660 2024-09-21T05:54:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.179+0000 7f2fc1c00640 1 -- 172.21.15.37:0/3263114658 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc40ac3f0 con 0x5568014d7660 2024-09-21T05:54:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.180+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3263114658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 msgr2=0x5568018becb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.180+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3263114658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018becb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40a9ee0 tx=0x7f2fc4005bb0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.180+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3263114658 shutdown_connections 2024-09-21T05:54:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.180+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3263114658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556801500520 0x5568018aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.180+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3263114658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568014df840 0x5568018bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.180+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/3263114658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018becb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.180+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3263114658 >> 172.21.15.37:0/3263114658 conn(0x5568014f4910 msgr2=0x5568018aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.181+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3263114658 shutdown_connections 2024-09-21T05:54:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.181+0000 7f2fdea3c740 1 -- 172.21.15.37:0/3263114658 wait complete. 2024-09-21T05:54:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.181+0000 7f2fdea3c740 1 -- start start 2024-09-21T05:54:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.181+0000 7f2fdea3c740 1 Processor -- start 2024-09-21T05:54:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.182+0000 7f2fdea3c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.182+0000 7f2fdea3c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5568014df840 0x5568018b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.182+0000 7f2fdea3c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556801500520 0x5568018b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.182+0000 7f2fdea3c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd01b1990 con 0x556801500520 2024-09-21T05:54:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.182+0000 7f2fdea3c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd01b2e00 con 0x5568014df840 2024-09-21T05:54:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.182+0000 7f2fdea3c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd01b2060 con 0x5568014d7660 2024-09-21T05:54:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.182+0000 7f2fdea3c740 10 client.0 _ll_register_callbacks cb 0x7f2fc8003bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:54:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.183+0000 7f2fd4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5568014df840 0x5568018b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.183+0000 7f2fd4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5568014df840 0x5568018b7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:57008/0 (socket says 172.21.15.37:57008) 2024-09-21T05:54:28.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.183+0000 7f2fd5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.183+0000 7f2fd4a00640 1 -- 172.21.15.37:0/13346646 learned_addr learned my addr 172.21.15.37:0/13346646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:54:28.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.183+0000 7f2fd5e00640 1 --2- 172.21.15.37:0/13346646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556801500520 0x5568018b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.183+0000 7f2fd4a00640 1 -- 172.21.15.37:0/13346646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 msgr2=0x5568018bb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:28.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.183+0000 7f2fd4a00640 1 --2- 172.21.15.37:0/13346646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018bb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.183+0000 7f2fd4a00640 1 -- 172.21.15.37:0/13346646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556801500520 msgr2=0x5568018b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:54:28.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.183+0000 7f2fd4a00640 1 --2- 172.21.15.37:0/13346646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556801500520 0x5568018b7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.183+0000 7f2fd4a00640 1 -- 172.21.15.37:0/13346646 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568018b85e0 con 0x5568014df840 2024-09-21T05:54:28.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.184+0000 7f2fd4a00640 1 --2- 172.21.15.37:0/13346646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5568014df840 0x5568018b7960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc000c00 tx=0x7f2fbc0045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e511b99e49381eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:28.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.184+0000 7f2fb6a00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:54:28.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.184+0000 7f2fb6a00640 1 -- 172.21.15.37:0/13346646 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc040040 con 0x5568014df840 2024-09-21T05:54:28.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.184+0000 7f2fdea3c740 1 -- 172.21.15.37:0/13346646 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fc40b2200 con 0x5568014df840 2024-09-21T05:54:28.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.184+0000 7f2fb6a00640 1 -- 172.21.15.37:0/13346646 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f2fbc003ac0 con 0x5568014df840 2024-09-21T05:54:28.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.185+0000 7f2fb6a00640 1 -- 172.21.15.37:0/13346646 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2fbc05c050 con 0x5568014df840 2024-09-21T05:54:28.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.185+0000 7f2fdea3c740 10 client.25364 fetch_fsmap learned FSMap version 21 2024-09-21T05:54:28.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.185+0000 7f2fdea3c740 1 -- 172.21.15.37:0/13346646 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556801930860 con 0x5568014df840 2024-09-21T05:54:28.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.186+0000 7f2fb6a00640 1 -- 172.21.15.37:0/13346646 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fc40b2200 con 0x5568014df840 2024-09-21T05:54:28.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.186+0000 7f2fb6a00640 1 -- 172.21.15.37:0/13346646 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2fbc057030 con 0x5568014df840 2024-09-21T05:54:28.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.186+0000 7f2fdea3c740 10 client.25364 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:54:28.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.186+0000 7f2fdea3c740 10 client.25364 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:54:28.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.186+0000 7f2fdea3c740 20 client.25364 populate_metadata read hostname 'smithi037' 2024-09-21T05:54:28.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.186+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/13346646 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x556801494250 0x556801932b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:28.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.186+0000 7f2fdea3c740 4 client.25364 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5b381d20", "release": true, "await": true}] 2024-09-21T05:54:28.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.186+0000 7f2fdea3c740 1 -- 172.21.15.37:0/13346646 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5b381d20", "release": true, "await": true}) -- 0x55680181bc90 con 0x556801494250 2024-09-21T05:54:28.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.187+0000 7f2fd5400640 1 --2- 172.21.15.37:0/13346646 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x556801494250 0x556801932b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:28.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.187+0000 7f2fb6a00640 10 client.25364 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:54:28.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.187+0000 7f2fd5400640 1 --2- 172.21.15.37:0/13346646 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x556801494250 0x556801932b70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a4475cde0143d35 server_cookie=987f424d33b8b7a in_seq=0 out_seq=0 2024-09-21T05:54:28.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.189+0000 7f2fb6a00640 1 -- 172.21.15.37:0/13346646 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55680181bc90 con 0x556801494250 2024-09-21T05:54:28.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.189+0000 7f2fb6a00640 10 client.25364 handle_command_reply: tid=0 2024-09-21T05:54:28.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.189+0000 7f2fdea3c740 1 client.25364 shutdown 2024-09-21T05:54:28.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.189+0000 7f2fdea3c740 1 -- 172.21.15.37:0/13346646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5568014df840 msgr2=0x5568018b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:28.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.189+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/13346646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5568014df840 0x5568018b7960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc000c00 tx=0x7f2fbc0045e0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.189+0000 7f2fdea3c740 1 -- 172.21.15.37:0/13346646 shutdown_connections 2024-09-21T05:54:28.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.189+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/13346646 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x556801494250 0x556801932b70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.189+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/13346646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556801500520 0x5568018b7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.189+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/13346646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5568014df840 0x5568018b7960 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.189+0000 7f2fdea3c740 1 --2- 172.21.15.37:0/13346646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568014d7660 0x5568018bb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.189+0000 7f2fdea3c740 1 -- 172.21.15.37:0/13346646 >> 172.21.15.37:0/13346646 conn(0x5568014f4910 msgr2=0x5568018aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:28.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.189+0000 7f2fb6a00640 0 client.25364 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:54:28.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.189+0000 7f2fdea3c740 1 -- 172.21.15.37:0/13346646 shutdown_connections 2024-09-21T05:54:28.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.190+0000 7f2fdea3c740 1 -- 172.21.15.37:0/13346646 wait complete. 2024-09-21T05:54:28.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.190+0000 7f2fdea3c740 20 client.25364 trim_cache size 0 max 16384 2024-09-21T05:54:28.193 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:54:28.193 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:54:28.193 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:54:28.193 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 4, 2024-09-21T05:54:28.193 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:54:28.193 INFO:teuthology.orchestra.run.smithi037.stdout: "5b381d20": { 2024-09-21T05:54:28.193 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 4, 2024-09-21T05:54:28.193 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 134.5, 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:54:28.194 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:54:28.195 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:54:28.195 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:54:28.195 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:54:28.195 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:54:28.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.191+0000 7f2fd6800640 1 -- 172.21.15.37:0/3744024646 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2fb80b6590 msgr2=0x7f2fb80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:28.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.191+0000 7f2fd6800640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2fb80b6590 0x7f2fb80b8aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8009fd0 tx=0x7f2fc8009500 comp rx=0 tx=0).stop 2024-09-21T05:54:28.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.191+0000 7f2fd6800640 1 -- 172.21.15.37:0/3744024646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fd01023e0 msgr2=0x7f2fd019c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:28.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.191+0000 7f2fd6800640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fd01023e0 0x7f2fd019c4a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400e9f0 tx=0x7f2fc400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.191+0000 7f2fd6800640 1 -- 172.21.15.37:0/3744024646 shutdown_connections 2024-09-21T05:54:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.191+0000 7f2fd6800640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f2fb80b6590 0x7f2fb80b8aa0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.191+0000 7f2fd6800640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2fd010ff90 0x7f2fd01a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.191+0000 7f2fd6800640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fd0102d30 0x7f2fd019ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.191+0000 7f2fd6800640 1 --2- 172.21.15.37:0/3744024646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fd01023e0 0x7f2fd019c4a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.191+0000 7f2fd6800640 1 -- 172.21.15.37:0/3744024646 >> 172.21.15.37:0/3744024646 conn(0x7f2fd00fe2c0 msgr2=0x7f2fd0112100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.191+0000 7f2fd6800640 1 -- 172.21.15.37:0/3744024646 shutdown_connections 2024-09-21T05:54:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:28.191+0000 7f2fd6800640 1 -- 172.21.15.37:0/3744024646 wait complete. 2024-09-21T05:54:28.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:27 smithi067 ceph-mon[34443]: pgmap v430: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:28.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:27 smithi144 ceph-mon[34351]: pgmap v430: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T05:54:29.011 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5b381d20', total seconds elapsed: 18.9 2024-09-21T05:54:30.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:29 smithi037 ceph-mon[30631]: pgmap v431: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:54:30.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:29 smithi067 ceph-mon[34443]: pgmap v431: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:54:30.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:29 smithi144 ceph-mon[34351]: pgmap v431: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:54:32.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:31 smithi037 ceph-mon[30631]: pgmap v432: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:54:32.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:31 smithi067 ceph-mon[34443]: pgmap v432: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:54:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:31 smithi144 ceph-mon[34351]: pgmap v432: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:54:34.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:33 smithi037 ceph-mon[30631]: pgmap v433: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T05:54:34.175 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:33 smithi144 ceph-mon[34351]: pgmap v433: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T05:54:34.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:33 smithi067 ceph-mon[34443]: pgmap v433: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T05:54:36.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:35 smithi037 ceph-mon[30631]: pgmap v434: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:36.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:35 smithi067 ceph-mon[34443]: pgmap v434: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:36.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:35 smithi144 ceph-mon[34351]: pgmap v434: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:38.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:37 smithi037 ceph-mon[30631]: pgmap v435: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:38.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:37 smithi067 ceph-mon[34443]: pgmap v435: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:38.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:37 smithi144 ceph-mon[34351]: pgmap v435: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:40.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:39 smithi037 ceph-mon[30631]: pgmap v436: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:40.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:39 smithi067 ceph-mon[34443]: pgmap v436: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:40.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:39 smithi144 ceph-mon[34351]: pgmap v436: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:42.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:41 smithi037 ceph-mon[30631]: pgmap v437: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:42.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:41 smithi067 ceph-mon[34443]: pgmap v437: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:42.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:41 smithi144 ceph-mon[34351]: pgmap v437: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:44.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:43 smithi037 ceph-mon[30631]: pgmap v438: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:44.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:43 smithi067 ceph-mon[34443]: pgmap v438: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:44.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:43 smithi144 ceph-mon[34351]: pgmap v438: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:46.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:45 smithi067 ceph-mon[34443]: pgmap v439: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:46.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:45 smithi144 ceph-mon[34351]: pgmap v439: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:46.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:45 smithi037 ceph-mon[30631]: pgmap v439: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:48.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:47 smithi067 ceph-mon[34443]: pgmap v440: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:48.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:47 smithi144 ceph-mon[34351]: pgmap v440: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:48.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:47 smithi037 ceph-mon[30631]: pgmap v440: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:50.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:49 smithi067 ceph-mon[34443]: pgmap v441: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:50.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:49 smithi144 ceph-mon[34351]: pgmap v441: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:50.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:49 smithi037 ceph-mon[30631]: pgmap v441: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:52.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:51 smithi067 ceph-mon[34443]: pgmap v442: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:52.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:51 smithi144 ceph-mon[34351]: pgmap v442: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:52.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:51 smithi037 ceph-mon[30631]: pgmap v442: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:54.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:53 smithi067 ceph-mon[34443]: pgmap v443: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:54.272 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:53 smithi037 ceph-mon[30631]: pgmap v443: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:54.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:53 smithi144 ceph-mon[34351]: pgmap v443: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:55.940 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.0 2024-09-21T05:54:55.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:54:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:55 smithi067 ceph-mon[34443]: pgmap v444: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:56.349 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:54:56.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:55 smithi144 ceph-mon[34351]: pgmap v444: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:56.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:55 smithi037 ceph-mon[30631]: pgmap v444: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:54:57.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:56 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:54:57.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:56 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:54:57.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:56 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:54:58.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:57 smithi067 ceph-mon[34443]: pgmap v445: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:58.248 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:57 smithi037 ceph-mon[30631]: pgmap v445: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:58.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:57 smithi144 ceph-mon[34351]: pgmap v445: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:54:58.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.430+0000 7f5d0e000640 1 -- 172.21.15.37:0/2946026029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08077940 msgr2=0x7f5d08077d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.430+0000 7f5d0e000640 1 --2- 172.21.15.37:0/2946026029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08077940 0x7f5d08077d50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009900 tx=0x7f5cf802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.430+0000 7f5d0e000640 1 -- 172.21.15.37:0/2946026029 shutdown_connections 2024-09-21T05:54:58.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.430+0000 7f5d0e000640 1 --2- 172.21.15.37:0/2946026029 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d08114750 0x7f5d08116b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.430+0000 7f5d0e000640 1 --2- 172.21.15.37:0/2946026029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d08078290 0x7f5d08114210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.430+0000 7f5d0e000640 1 --2- 172.21.15.37:0/2946026029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08077940 0x7f5d08077d50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.430+0000 7f5d0e000640 1 -- 172.21.15.37:0/2946026029 >> 172.21.15.37:0/2946026029 conn(0x7f5d08101860 msgr2=0x7f5d08103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:58.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.430+0000 7f5d0e000640 1 -- 172.21.15.37:0/2946026029 shutdown_connections 2024-09-21T05:54:58.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.430+0000 7f5d0e000640 1 -- 172.21.15.37:0/2946026029 wait complete. 2024-09-21T05:54:58.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.431+0000 7f5d0e000640 1 Processor -- start 2024-09-21T05:54:58.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.431+0000 7f5d0e000640 1 -- start start 2024-09-21T05:54:58.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.432+0000 7f5d0e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d08077940 0x7f5d081a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.432+0000 7f5d0e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08078290 0x7f5d081a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.432+0000 7f5d0e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d08114750 0x7f5d081a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.432+0000 7f5d0e000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0811a130 con 0x7f5d08078290 2024-09-21T05:54:58.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.432+0000 7f5d0e000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08119fb0 con 0x7f5d08114750 2024-09-21T05:54:58.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.432+0000 7f5d0e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0811a2b0 con 0x7f5d08077940 2024-09-21T05:54:58.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.432+0000 7f5d07400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d08077940 0x7f5d081a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.432+0000 7f5d06a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08078290 0x7f5d081a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.432+0000 7f5d07400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d08077940 0x7f5d081a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:48228/0 (socket says 172.21.15.37:48228) 2024-09-21T05:54:58.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.432+0000 7f5d07400640 1 -- 172.21.15.37:0/623623517 learned_addr learned my addr 172.21.15.37:0/623623517 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:54:58.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.432+0000 7f5d07e00640 1 --2- 172.21.15.37:0/623623517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d08114750 0x7f5d081a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.433+0000 7f5d07400640 1 -- 172.21.15.37:0/623623517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d08114750 msgr2=0x7f5d081a6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.433+0000 7f5d07400640 1 --2- 172.21.15.37:0/623623517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d08114750 0x7f5d081a6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.433+0000 7f5d07400640 1 -- 172.21.15.37:0/623623517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08078290 msgr2=0x7f5d081a1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.433+0000 7f5d07400640 1 --2- 172.21.15.37:0/623623517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08078290 0x7f5d081a1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.433+0000 7f5d07400640 1 -- 172.21.15.37:0/623623517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d081a6a30 con 0x7f5d08077940 2024-09-21T05:54:58.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.433+0000 7f5d07400640 1 --2- 172.21.15.37:0/623623517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d08077940 0x7f5d081a0ac0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8005ab0 tx=0x7f5cf8003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:58.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.433+0000 7f5cffe00640 1 -- 172.21.15.37:0/623623517 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf803f070 con 0x7f5d08077940 2024-09-21T05:54:58.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.434+0000 7f5d0e000640 1 -- 172.21.15.37:0/623623517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d081a6cc0 con 0x7f5d08077940 2024-09-21T05:54:58.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.434+0000 7f5cffe00640 1 -- 172.21.15.37:0/623623517 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cf8031d60 con 0x7f5d08077940 2024-09-21T05:54:58.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.434+0000 7f5cffe00640 1 -- 172.21.15.37:0/623623517 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8035030 con 0x7f5d08077940 2024-09-21T05:54:58.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.434+0000 7f5d0e000640 1 -- 172.21.15.37:0/623623517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d081ad480 con 0x7f5d08077940 2024-09-21T05:54:58.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.435+0000 7f5d0e000640 1 -- 172.21.15.37:0/623623517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d08077d50 con 0x7f5d08077940 2024-09-21T05:54:58.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.437+0000 7f5cffe00640 1 -- 172.21.15.37:0/623623517 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5cf8042070 con 0x7f5d08077940 2024-09-21T05:54:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.439+0000 7f5cffe00640 1 --2- 172.21.15.37:0/623623517 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5cec0b6510 0x7f5cec0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:54:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.439+0000 7f5cffe00640 1 -- 172.21.15.37:0/623623517 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f5cf8108500 con 0x7f5d08077940 2024-09-21T05:54:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.439+0000 7f5d06a00640 1 --2- 172.21.15.37:0/623623517 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5cec0b6510 0x7f5cec0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:54:58.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.440+0000 7f5d06a00640 1 --2- 172.21.15.37:0/623623517 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5cec0b6510 0x7f5cec0b8a20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5d0807a1e0 tx=0x7f5cf4005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:54:58.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.441+0000 7f5cffe00640 1 -- 172.21.15.37:0/623623517 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5cf80d2d40 con 0x7f5d08077940 2024-09-21T05:54:58.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.678+0000 7f5d0e000640 1 -- 172.21.15.37:0/623623517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d081a1bf0 con 0x7f5d08077940 2024-09-21T05:54:58.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.679+0000 7f5cffe00640 1 -- 172.21.15.37:0/623623517 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f5cf80d7c80 con 0x7f5d08077940 2024-09-21T05:54:58.682 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:54:58.682 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:54:58.683 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:54:58.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.682+0000 7f5d0e000640 1 -- 172.21.15.37:0/623623517 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5cec0b6510 msgr2=0x7f5cec0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.682+0000 7f5d0e000640 1 --2- 172.21.15.37:0/623623517 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5cec0b6510 0x7f5cec0b8a20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5d0807a1e0 tx=0x7f5cf4005f90 comp rx=0 tx=0).stop 2024-09-21T05:54:58.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.682+0000 7f5d0e000640 1 -- 172.21.15.37:0/623623517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d08077940 msgr2=0x7f5d081a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:54:58.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.682+0000 7f5d0e000640 1 --2- 172.21.15.37:0/623623517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d08077940 0x7f5d081a0ac0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8005ab0 tx=0x7f5cf8003c80 comp rx=0 tx=0).stop 2024-09-21T05:54:58.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.682+0000 7f5d0e000640 1 -- 172.21.15.37:0/623623517 shutdown_connections 2024-09-21T05:54:58.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.682+0000 7f5d0e000640 1 --2- 172.21.15.37:0/623623517 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5cec0b6510 0x7f5cec0b8a20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.682+0000 7f5d0e000640 1 --2- 172.21.15.37:0/623623517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d08114750 0x7f5d081a6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.682+0000 7f5d0e000640 1 --2- 172.21.15.37:0/623623517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d08078290 0x7f5d081a1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.682+0000 7f5d0e000640 1 --2- 172.21.15.37:0/623623517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d08077940 0x7f5d081a0ac0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:54:58.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.682+0000 7f5d0e000640 1 -- 172.21.15.37:0/623623517 >> 172.21.15.37:0/623623517 conn(0x7f5d08101860 msgr2=0x7f5d08116760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:54:58.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.682+0000 7f5d0e000640 1 -- 172.21.15.37:0/623623517 shutdown_connections 2024-09-21T05:54:58.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:54:58.682+0000 7f5d0e000640 1 -- 172.21.15.37:0/623623517 wait complete. 2024-09-21T05:54:59.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:58 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:54:59.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:58 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:54:59.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:58 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:54:59.250 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:58 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/623623517' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:59.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:58 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:54:59.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:58 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:54:59.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:58 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:54:59.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:58 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/623623517' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:59.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:58 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:54:59.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:58 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:54:59.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:58 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:54:59.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:58 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/623623517' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:54:59.623 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0' 2024-09-21T05:54:59.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0 2024-09-21T05:55:00.011 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:00.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:54:59 smithi037 ceph-mon[30631]: pgmap v446: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:55:00.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:54:59 smithi067 ceph-mon[34443]: pgmap v446: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:55:00.325 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 57% (7330/12697) Updating files: 58% (7365/12697) Updating files: 59% (7492/12697) Updating files: 60% (7619/12697) Updating files: 61% (7746/12697) Updating files: 62% (7873/12697) Updating files: 63% (8000/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 94% (11957/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T05:55:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:54:59 smithi144 ceph-mon[34351]: pgmap v446: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:55:00.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.731+0000 7fa9bec00640 1 -- 172.21.15.37:0/3281008834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9b8077380 msgr2=0x7fa9b80757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.731+0000 7fa9bec00640 1 --2- 172.21.15.37:0/3281008834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9b8077380 0x7fa9b80757b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009900 tx=0x7fa9a802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.731+0000 7fa9bec00640 1 -- 172.21.15.37:0/3281008834 shutdown_connections 2024-09-21T05:55:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.731+0000 7fa9bec00640 1 --2- 172.21.15.37:0/3281008834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8114450 0x7fa9b8116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.731+0000 7fa9bec00640 1 --2- 172.21.15.37:0/3281008834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9b8075dd0 0x7fa9b80761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.731+0000 7fa9bec00640 1 --2- 172.21.15.37:0/3281008834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9b8077380 0x7fa9b80757b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.731+0000 7fa9bec00640 1 -- 172.21.15.37:0/3281008834 >> 172.21.15.37:0/3281008834 conn(0x7fa9b80ff5d0 msgr2=0x7fa9b8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.732+0000 7fa9bec00640 1 -- 172.21.15.37:0/3281008834 shutdown_connections 2024-09-21T05:55:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.732+0000 7fa9bec00640 1 -- 172.21.15.37:0/3281008834 wait complete. 2024-09-21T05:55:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.733+0000 7fa9bec00640 1 Processor -- start 2024-09-21T05:55:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.733+0000 7fa9bec00640 1 -- start start 2024-09-21T05:55:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.733+0000 7fa9bec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8075dd0 0x7fa9b81a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.733+0000 7fa9bec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9b8077380 0x7fa9b81a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.733+0000 7fa9bec00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9b8114450 0x7fa9b81a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.733+0000 7fa9bec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b811a0a0 con 0x7fa9b8077380 2024-09-21T05:55:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.733+0000 7fa9bec00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b8119f20 con 0x7fa9b8114450 2024-09-21T05:55:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.733+0000 7fa9bec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b811a220 con 0x7fa9b8075dd0 2024-09-21T05:55:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.734+0000 7fa9b7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8075dd0 0x7fa9b81a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.734+0000 7fa9b7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9b8077380 0x7fa9b81a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.734+0000 7fa9b7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8075dd0 0x7fa9b81a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:48248/0 (socket says 172.21.15.37:48248) 2024-09-21T05:55:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.734+0000 7fa9b7e00640 1 -- 172.21.15.37:0/1825539421 learned_addr learned my addr 172.21.15.37:0/1825539421 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.734+0000 7fa9bcc00640 1 --2- 172.21.15.37:0/1825539421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9b8114450 0x7fa9b81a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.734+0000 7fa9b7e00640 1 -- 172.21.15.37:0/1825539421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9b8114450 msgr2=0x7fa9b81a6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.734+0000 7fa9b7e00640 1 --2- 172.21.15.37:0/1825539421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9b8114450 0x7fa9b81a6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.734+0000 7fa9b7e00640 1 -- 172.21.15.37:0/1825539421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9b8077380 msgr2=0x7fa9b81a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.734+0000 7fa9b7e00640 1 --2- 172.21.15.37:0/1825539421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9b8077380 0x7fa9b81a10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.734+0000 7fa9b7e00640 1 -- 172.21.15.37:0/1825539421 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b81a6ac0 con 0x7fa9b8075dd0 2024-09-21T05:55:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.735+0000 7fa9b7e00640 1 --2- 172.21.15.37:0/1825539421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8075dd0 0x7fa9b81a0b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8005940 tx=0x7fa9a80040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.735+0000 7fa9b4c00640 1 -- 172.21.15.37:0/1825539421 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a803f030 con 0x7fa9b8075dd0 2024-09-21T05:55:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.735+0000 7fa9bec00640 1 -- 172.21.15.37:0/1825539421 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b81a6d50 con 0x7fa9b8075dd0 2024-09-21T05:55:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.735+0000 7fa9b4c00640 1 -- 172.21.15.37:0/1825539421 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9a80044c0 con 0x7fa9b8075dd0 2024-09-21T05:55:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.735+0000 7fa9b4c00640 1 -- 172.21.15.37:0/1825539421 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8035070 con 0x7fa9b8075dd0 2024-09-21T05:55:00.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.735+0000 7fa9bec00640 1 -- 172.21.15.37:0/1825539421 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b81ad510 con 0x7fa9b8075dd0 2024-09-21T05:55:00.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.739+0000 7fa9b4c00640 1 -- 172.21.15.37:0/1825539421 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa9a8042030 con 0x7fa9b8075dd0 2024-09-21T05:55:00.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.740+0000 7fa9c57bc740 1 Processor -- start 2024-09-21T05:55:00.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.740+0000 7fa9c57bc740 1 -- start start 2024-09-21T05:55:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.741+0000 7fa9c57bc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8006840 0x5594a83ae350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.741+0000 7fa9c57bc740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fdd980 0x5594a83ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.741+0000 7fa9c57bc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fe5b60 0x5594a83aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.741+0000 7fa9c57bc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5594a8323ca0 con 0x5594a8006840 2024-09-21T05:55:00.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.741+0000 7fa9c57bc740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5594a83130d0 con 0x5594a7fdd980 2024-09-21T05:55:00.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.741+0000 7fa9c57bc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5594a8316ee0 con 0x5594a7fe5b60 2024-09-21T05:55:00.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.741+0000 7fa9bcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8006840 0x5594a83ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.741+0000 7fa9bcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8006840 0x5594a83ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52060/0 (socket says 172.21.15.37:52060) 2024-09-21T05:55:00.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.741+0000 7fa9bcc00640 1 -- 172.21.15.37:0/3210889642 learned_addr learned my addr 172.21.15.37:0/3210889642 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:00.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.741+0000 7fa9b7400640 1 --2- 172.21.15.37:0/3210889642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fe5b60 0x5594a83aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.741+0000 7fa9b4c00640 1 --2- 172.21.15.37:0/1825539421 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa99c0b6510 0x7fa99c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.742+0000 7fa9b4c00640 1 -- 172.21.15.37:0/1825539421 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fa9a8107800 con 0x7fa9b8075dd0 2024-09-21T05:55:00.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.742+0000 7fa9bcc00640 1 --2- 172.21.15.37:0/1825539421 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa99c0b6510 0x7fa99c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.742+0000 7fa9b7400640 1 -- 172.21.15.37:0/3210889642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fdd980 msgr2=0x5594a83ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:00.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.742+0000 7fa9b7400640 1 --2- 172.21.15.37:0/3210889642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fdd980 0x5594a83ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.742+0000 7fa9b7400640 1 -- 172.21.15.37:0/3210889642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8006840 msgr2=0x5594a83ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:00.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.742+0000 7fa9b7400640 1 --2- 172.21.15.37:0/3210889642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8006840 0x5594a83ae350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.742+0000 7fa9b7400640 1 -- 172.21.15.37:0/3210889642 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594a82c5400 con 0x5594a7fe5b60 2024-09-21T05:55:00.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.742+0000 7fa9b7400640 1 --2- 172.21.15.37:0/3210889642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fe5b60 0x5594a83aedd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa9b806baa0 tx=0x7fa9a4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5ccb3e2ad3ca4d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:00.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.743+0000 7fa9bcc00640 1 --2- 172.21.15.37:0/1825539421 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa99c0b6510 0x7fa99c0b8a20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009fd0 tx=0x7fa9b0004ab0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:00.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.743+0000 7fa9ad200640 1 -- 172.21.15.37:0/3210889642 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4004050 con 0x5594a7fe5b60 2024-09-21T05:55:00.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.743+0000 7fa9ad200640 1 -- 172.21.15.37:0/3210889642 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9a40054d0 con 0x5594a7fe5b60 2024-09-21T05:55:00.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.743+0000 7fa9ad200640 1 -- 172.21.15.37:0/3210889642 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4004c80 con 0x5594a7fe5b60 2024-09-21T05:55:00.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.744+0000 7fa9c57bc740 1 -- 172.21.15.37:0/3210889642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fe5b60 msgr2=0x5594a83aedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.744+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/3210889642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fe5b60 0x5594a83aedd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa9b806baa0 tx=0x7fa9a4011810 comp rx=0 tx=0).stop 2024-09-21T05:55:00.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.744+0000 7fa9c57bc740 1 -- 172.21.15.37:0/3210889642 shutdown_connections 2024-09-21T05:55:00.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.744+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/3210889642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fe5b60 0x5594a83aedd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.744+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/3210889642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fdd980 0x5594a83ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.744+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/3210889642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8006840 0x5594a83ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.744+0000 7fa9c57bc740 1 -- 172.21.15.37:0/3210889642 >> 172.21.15.37:0/3210889642 conn(0x5594a7ffa990 msgr2=0x5594a83ac240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:00.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.744+0000 7fa9c57bc740 1 -- 172.21.15.37:0/3210889642 shutdown_connections 2024-09-21T05:55:00.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.744+0000 7fa9c57bc740 1 -- 172.21.15.37:0/3210889642 wait complete. 2024-09-21T05:55:00.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.745+0000 7fa9c57bc740 1 -- start start 2024-09-21T05:55:00.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.745+0000 7fa9c57bc740 1 Processor -- start 2024-09-21T05:55:00.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.746+0000 7fa9c57bc740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fdd980 0x5594a83b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.746+0000 7fa9c57bc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a7fe5b60 0x5594a83ba060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.746+0000 7fa9c57bc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a8006840 0x5594a83c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.746+0000 7fa9c57bc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5594a81747a0 con 0x5594a7fe5b60 2024-09-21T05:55:00.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.746+0000 7fa9c57bc740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5594a82b8a10 con 0x5594a7fdd980 2024-09-21T05:55:00.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.746+0000 7fa9c57bc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5594a83bcb30 con 0x5594a8006840 2024-09-21T05:55:00.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.746+0000 7fa9c57bc740 10 client.0 _ll_register_callbacks cb 0x5594a82c8be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:00.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.746+0000 7fa9b7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fdd980 0x5594a83b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.746+0000 7fa9b7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fdd980 0x5594a83b9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:34542/0 (socket says 172.21.15.37:34542) 2024-09-21T05:55:00.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.746+0000 7fa9b7e00640 1 -- 172.21.15.37:0/2596928196 learned_addr learned my addr 172.21.15.37:0/2596928196 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:00.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.746+0000 7fa9bcc00640 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a8006840 0x5594a83c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.747+0000 7fa9b7400640 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a7fe5b60 0x5594a83ba060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.747+0000 7fa9b7e00640 1 -- 172.21.15.37:0/2596928196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a8006840 msgr2=0x5594a83c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:00.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.747+0000 7fa9b7e00640 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a8006840 0x5594a83c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.747+0000 7fa9b7e00640 1 -- 172.21.15.37:0/2596928196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a7fe5b60 msgr2=0x5594a83ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:00.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.747+0000 7fa9b7e00640 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a7fe5b60 0x5594a83ba060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.747+0000 7fa9b7e00640 1 -- 172.21.15.37:0/2596928196 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594a8080b90 con 0x5594a7fdd980 2024-09-21T05:55:00.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.747+0000 7fa9bcc00640 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a8006840 0x5594a83c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:00.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.747+0000 7fa9b7400640 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a7fe5b60 0x5594a83ba060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:55:00.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.748+0000 7fa9b7e00640 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fdd980 0x5594a83b9b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80ca7d0 tx=0x7fa9a80cd3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a02e64040aa4ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:00.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.748+0000 7fa9a1600640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:55:00.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.748+0000 7fa9a1600640 1 -- 172.21.15.37:0/2596928196 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8049040 con 0x5594a7fdd980 2024-09-21T05:55:00.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.748+0000 7fa9a1600640 1 -- 172.21.15.37:0/2596928196 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fa9a80cc9c0 con 0x5594a7fdd980 2024-09-21T05:55:00.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.748+0000 7fa9c57bc740 1 -- 172.21.15.37:0/2596928196 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9a40054d0 con 0x5594a7fdd980 2024-09-21T05:55:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.749+0000 7fa9a1600640 1 -- 172.21.15.37:0/2596928196 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa9a80cd070 con 0x5594a7fdd980 2024-09-21T05:55:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.749+0000 7fa9c57bc740 10 client.25379 fetch_fsmap learned FSMap version 21 2024-09-21T05:55:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.749+0000 7fa9c57bc740 1 -- 172.21.15.37:0/2596928196 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5594a83c8930 con 0x5594a7fdd980 2024-09-21T05:55:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.749+0000 7fa9a1600640 1 -- 172.21.15.37:0/2596928196 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9a40054d0 con 0x5594a7fdd980 2024-09-21T05:55:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.749+0000 7fa9a1600640 1 -- 172.21.15.37:0/2596928196 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa9a804c060 con 0x5594a7fdd980 2024-09-21T05:55:00.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.750+0000 7fa9c57bc740 10 client.25379 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:55:00.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.750+0000 7fa9c57bc740 10 client.25379 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:55:00.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.750+0000 7fa9c57bc740 20 client.25379 populate_metadata read hostname 'smithi037' 2024-09-21T05:55:00.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.750+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5594a7fc51c0 0x5594a83cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.750+0000 7fa9c57bc740 4 client.25379 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:00.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.750+0000 7fa9c57bc740 1 -- 172.21.15.37:0/2596928196 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594a8325bf0 con 0x5594a7fc51c0 2024-09-21T05:55:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.750+0000 7fa9b7400640 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5594a7fc51c0 0x5594a83cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.751+0000 7fa9b7400640 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5594a7fc51c0 0x5594a83cbd50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeda0e9ba0848bfe server_cookie=d9ed73b000d9f0e7 in_seq=0 out_seq=0 2024-09-21T05:55:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.751+0000 7fa9a1600640 10 client.25379 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:55:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.752+0000 7fa9a1600640 1 -- 172.21.15.37:0/2596928196 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5594a8325bf0 con 0x5594a7fc51c0 2024-09-21T05:55:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.752+0000 7fa9a1600640 10 client.25379 handle_command_reply: tid=0 2024-09-21T05:55:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.752+0000 7fa9c57bc740 1 client.25379 shutdown 2024-09-21T05:55:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.752+0000 7fa9c57bc740 1 -- 172.21.15.37:0/2596928196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fdd980 msgr2=0x5594a83b9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.752+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fdd980 0x5594a83b9b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80ca7d0 tx=0x7fa9a80cd3f0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.752+0000 7fa9c57bc740 1 -- 172.21.15.37:0/2596928196 shutdown_connections 2024-09-21T05:55:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.752+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5594a7fc51c0 0x5594a83cbd50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.752+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a8006840 0x5594a83c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.752+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a7fe5b60 0x5594a83ba060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.752+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/2596928196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fdd980 0x5594a83b9b20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.752+0000 7fa9c57bc740 1 -- 172.21.15.37:0/2596928196 >> 172.21.15.37:0/2596928196 conn(0x5594a7ffa990 msgr2=0x5594a83aa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.752+0000 7fa9a1600640 0 client.25379 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:55:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.752+0000 7fa9c57bc740 1 -- 172.21.15.37:0/2596928196 shutdown_connections 2024-09-21T05:55:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.753+0000 7fa9c57bc740 1 -- 172.21.15.37:0/2596928196 wait complete. 2024-09-21T05:55:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.753+0000 7fa9c57bc740 20 client.25379 trim_cache size 0 max 16384 2024-09-21T05:55:00.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.771+0000 7fa9c57bc740 1 Processor -- start 2024-09-21T05:55:00.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.771+0000 7fa9c57bc740 1 -- start start 2024-09-21T05:55:00.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.772+0000 7fa9c57bc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fdd980 0x5594a83c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.772+0000 7fa9c57bc740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fe5b60 0x5594a83af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.772+0000 7fa9c57bc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8006840 0x5594a83afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.772+0000 7fa9c57bc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b81b52d0 con 0x5594a8006840 2024-09-21T05:55:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.772+0000 7fa9c57bc740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b81b7b50 con 0x5594a7fe5b60 2024-09-21T05:55:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.772+0000 7fa9c57bc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b81b5940 con 0x5594a7fdd980 2024-09-21T05:55:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.772+0000 7fa9bcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8006840 0x5594a83afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.772+0000 7fa9bcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8006840 0x5594a83afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52080/0 (socket says 172.21.15.37:52080) 2024-09-21T05:55:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.772+0000 7fa9bcc00640 1 -- 172.21.15.37:0/1599307859 learned_addr learned my addr 172.21.15.37:0/1599307859 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.772+0000 7fa9b7400640 1 --2- 172.21.15.37:0/1599307859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fe5b60 0x5594a83af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.772+0000 7fa9b7e00640 1 --2- 172.21.15.37:0/1599307859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fdd980 0x5594a83c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.773+0000 7fa9bcc00640 1 -- 172.21.15.37:0/1599307859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fdd980 msgr2=0x5594a83c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.773+0000 7fa9bcc00640 1 --2- 172.21.15.37:0/1599307859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fdd980 0x5594a83c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.773+0000 7fa9bcc00640 1 -- 172.21.15.37:0/1599307859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fe5b60 msgr2=0x5594a83af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.773+0000 7fa9bcc00640 1 --2- 172.21.15.37:0/1599307859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fe5b60 0x5594a83af9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.773+0000 7fa9bcc00640 1 -- 172.21.15.37:0/1599307859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594a83a7c50 con 0x5594a8006840 2024-09-21T05:55:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.773+0000 7fa9b7400640 1 --2- 172.21.15.37:0/1599307859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fe5b60 0x5594a83af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.773+0000 7fa9bcc00640 1 --2- 172.21.15.37:0/1599307859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8006840 0x5594a83afef0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0014490 tx=0x7fa9b0009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac3977e13110a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.773+0000 7fa9a3e00640 1 -- 172.21.15.37:0/1599307859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0027070 con 0x5594a8006840 2024-09-21T05:55:00.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.774+0000 7fa9a3e00640 1 -- 172.21.15.37:0/1599307859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9b001b040 con 0x5594a8006840 2024-09-21T05:55:00.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.774+0000 7fa9a3e00640 1 -- 172.21.15.37:0/1599307859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b001a070 con 0x5594a8006840 2024-09-21T05:55:00.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.774+0000 7fa9c57bc740 1 -- 172.21.15.37:0/1599307859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8006840 msgr2=0x5594a83afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.774+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/1599307859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8006840 0x5594a83afef0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0014490 tx=0x7fa9b0009c40 comp rx=0 tx=0).stop 2024-09-21T05:55:00.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.775+0000 7fa9c57bc740 1 -- 172.21.15.37:0/1599307859 shutdown_connections 2024-09-21T05:55:00.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.775+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/1599307859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a8006840 0x5594a83afef0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.775+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/1599307859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a7fe5b60 0x5594a83af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.775+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/1599307859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fdd980 0x5594a83c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.775+0000 7fa9c57bc740 1 -- 172.21.15.37:0/1599307859 >> 172.21.15.37:0/1599307859 conn(0x5594a7ffa990 msgr2=0x5594a83af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:00.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.775+0000 7fa9c57bc740 1 -- 172.21.15.37:0/1599307859 shutdown_connections 2024-09-21T05:55:00.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.775+0000 7fa9c57bc740 1 -- 172.21.15.37:0/1599307859 wait complete. 2024-09-21T05:55:00.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.775+0000 7fa9c57bc740 1 -- start start 2024-09-21T05:55:00.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.776+0000 7fa9c57bc740 1 Processor -- start 2024-09-21T05:55:00.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.776+0000 7fa9c57bc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fdd980 0x5594a83be860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.776+0000 7fa9c57bc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a7fe5b60 0x5594a83bee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.776+0000 7fa9c57bc740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a8006840 0x5594a842f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.776+0000 7fa9c57bc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b81b6010 con 0x5594a7fe5b60 2024-09-21T05:55:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.776+0000 7fa9c57bc740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b81b7480 con 0x5594a8006840 2024-09-21T05:55:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.776+0000 7fa9c57bc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b81b66e0 con 0x5594a7fdd980 2024-09-21T05:55:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.776+0000 7fa9c57bc740 10 client.0 _ll_register_callbacks cb 0x7fa9a8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:00.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.777+0000 7fa9bcc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a8006840 0x5594a842f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.777+0000 7fa9b7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fdd980 0x5594a83be860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.777+0000 7fa9bcc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a8006840 0x5594a842f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:34566/0 (socket says 172.21.15.37:34566) 2024-09-21T05:55:00.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.777+0000 7fa9bcc00640 1 -- 172.21.15.37:0/667260033 learned_addr learned my addr 172.21.15.37:0/667260033 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:00.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.777+0000 7fa9b7400640 1 --2- 172.21.15.37:0/667260033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a7fe5b60 0x5594a83bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.777+0000 7fa9bcc00640 1 -- 172.21.15.37:0/667260033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fdd980 msgr2=0x5594a83be860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:00.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.777+0000 7fa9bcc00640 1 --2- 172.21.15.37:0/667260033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fdd980 0x5594a83be860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.777+0000 7fa9bcc00640 1 -- 172.21.15.37:0/667260033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a7fe5b60 msgr2=0x5594a83bee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:00.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.777+0000 7fa9bcc00640 1 --2- 172.21.15.37:0/667260033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a7fe5b60 0x5594a83bee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.777+0000 7fa9bcc00640 1 -- 172.21.15.37:0/667260033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594a83acfd0 con 0x5594a8006840 2024-09-21T05:55:00.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.777+0000 7fa9b7400640 1 --2- 172.21.15.37:0/667260033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a7fe5b60 0x5594a83bee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:00.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.777+0000 7fa9bcc00640 1 --2- 172.21.15.37:0/667260033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a8006840 0x5594a842f840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00049d0 tx=0x7fa9b0010eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2db62586ebdba036 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:00.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.777+0000 7fa9a1600640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:55:00.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.778+0000 7fa9a1600640 1 -- 172.21.15.37:0/667260033 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0027070 con 0x5594a8006840 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.778+0000 7fa9c57bc740 1 -- 172.21.15.37:0/667260033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9b001b040 con 0x5594a8006840 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.778+0000 7fa9a1600640 1 -- 172.21.15.37:0/667260033 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fa9b00119d0 con 0x5594a8006840 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.778+0000 7fa9a1600640 1 -- 172.21.15.37:0/667260033 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa9b003c050 con 0x5594a8006840 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.778+0000 7fa9c57bc740 10 client.25385 fetch_fsmap learned FSMap version 21 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.778+0000 7fa9c57bc740 1 -- 172.21.15.37:0/667260033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5594a84370c0 con 0x5594a8006840 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.779+0000 7fa9a1600640 1 -- 172.21.15.37:0/667260033 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9b001b040 con 0x5594a8006840 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.779+0000 7fa9a1600640 1 -- 172.21.15.37:0/667260033 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa9b002ca20 con 0x5594a8006840 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.779+0000 7fa9c57bc740 10 client.25385 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.779+0000 7fa9c57bc740 10 client.25385 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.779+0000 7fa9c57bc740 20 client.25385 populate_metadata read hostname 'smithi037' 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.779+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/667260033 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5594a7f9a570 0x5594a8439850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.779+0000 7fa9c57bc740 4 client.25385 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}] 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.779+0000 7fa9c57bc740 1 -- 172.21.15.37:0/667260033 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}) -- 0x5594a83216a0 con 0x5594a7f9a570 2024-09-21T05:55:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.779+0000 7fa9b7e00640 1 --2- 172.21.15.37:0/667260033 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5594a7f9a570 0x5594a8439850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:00.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.780+0000 7fa9b7e00640 1 --2- 172.21.15.37:0/667260033 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5594a7f9a570 0x5594a8439850 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a69467cf9807e88a server_cookie=bf127ef43252a15c in_seq=0 out_seq=0 2024-09-21T05:55:00.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.780+0000 7fa9a1600640 10 client.25385 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:55:00.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.784+0000 7fa9a1600640 1 -- 172.21.15.37:0/667260033 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5594a83216a0 con 0x5594a7f9a570 2024-09-21T05:55:00.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.784+0000 7fa9a1600640 10 client.25385 handle_command_reply: tid=0 2024-09-21T05:55:00.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.784+0000 7fa9c57bc740 1 client.25385 shutdown 2024-09-21T05:55:00.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.784+0000 7fa9c57bc740 1 -- 172.21.15.37:0/667260033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a8006840 msgr2=0x5594a842f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.784+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/667260033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a8006840 0x5594a842f840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00049d0 tx=0x7fa9b0010eb0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.785+0000 7fa9c57bc740 1 -- 172.21.15.37:0/667260033 shutdown_connections 2024-09-21T05:55:00.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.785+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/667260033 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5594a7f9a570 0x5594a8439850 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.785+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/667260033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5594a8006840 0x5594a842f840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.785+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/667260033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594a7fe5b60 0x5594a83bee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.785+0000 7fa9c57bc740 1 --2- 172.21.15.37:0/667260033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5594a7fdd980 0x5594a83be860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.785+0000 7fa9a1600640 0 client.25385 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:55:00.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.785+0000 7fa9c57bc740 1 -- 172.21.15.37:0/667260033 >> 172.21.15.37:0/667260033 conn(0x5594a7ffa990 msgr2=0x5594a83afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:00.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.785+0000 7fa9c57bc740 1 -- 172.21.15.37:0/667260033 shutdown_connections 2024-09-21T05:55:00.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.785+0000 7fa9c57bc740 1 -- 172.21.15.37:0/667260033 wait complete. 2024-09-21T05:55:00.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.785+0000 7fa9c57bc740 20 client.25385 trim_cache size 0 max 16384 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 6, 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "f36ae4e1": { 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 6, 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:55:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 137.0, 2024-09-21T05:55:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:55:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:55:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:55:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:55:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:55:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:55:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:00.790 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:55:00.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.786+0000 7fa9bec00640 1 -- 172.21.15.37:0/1825539421 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa99c0b6510 msgr2=0x7fa99c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.786+0000 7fa9bec00640 1 --2- 172.21.15.37:0/1825539421 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa99c0b6510 0x7fa99c0b8a20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009fd0 tx=0x7fa9b0004ab0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.786+0000 7fa9bec00640 1 -- 172.21.15.37:0/1825539421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8075dd0 msgr2=0x7fa9b81a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:00.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.786+0000 7fa9bec00640 1 --2- 172.21.15.37:0/1825539421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8075dd0 0x7fa9b81a0b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8005940 tx=0x7fa9a80040c0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.787+0000 7fa9bec00640 1 -- 172.21.15.37:0/1825539421 shutdown_connections 2024-09-21T05:55:00.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.787+0000 7fa9bec00640 1 --2- 172.21.15.37:0/1825539421 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa99c0b6510 0x7fa99c0b8a20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.787+0000 7fa9bec00640 1 --2- 172.21.15.37:0/1825539421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9b8114450 0x7fa9b81a6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.787+0000 7fa9bec00640 1 --2- 172.21.15.37:0/1825539421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9b8077380 0x7fa9b81a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.787+0000 7fa9bec00640 1 --2- 172.21.15.37:0/1825539421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8075dd0 0x7fa9b81a0b50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:00.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.787+0000 7fa9bec00640 1 -- 172.21.15.37:0/1825539421 >> 172.21.15.37:0/1825539421 conn(0x7fa9b80ff5d0 msgr2=0x7fa9b8110350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:00.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.787+0000 7fa9bec00640 1 -- 172.21.15.37:0/1825539421 shutdown_connections 2024-09-21T05:55:00.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:00.787+0000 7fa9bec00640 1 -- 172.21.15.37:0/1825539421 wait complete. 2024-09-21T05:55:01.118 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T05:55:01.118 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:01.119 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T05:55:01.119 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T05:55:01.119 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T05:55:01.119 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:01.119 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T05:55:01.119 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T05:55:01.119 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:01.119 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-09-21T05:55:01.119 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:01.119 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-09-21T05:55:01.119 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:01.119 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-09-21T05:55:01.119 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:01.120 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T05:55:01.120 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:01.120 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:55:01.134 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T05:55:01.275 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T05:55:01.280 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T05:55:01.280 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T05:55:01.768 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f36ae4e1', quiesce took 5.8 seconds. Will release after: 11.2 2024-09-21T05:55:02.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:01 smithi037 ceph-mon[30631]: pgmap v447: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:55:02.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:01 smithi067 ceph-mon[34443]: pgmap v447: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:55:02.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:01 smithi144 ceph-mon[34351]: pgmap v447: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:55:02.399 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T05:55:02.497 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T05:55:02.563 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T05:55:02.567 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T05:55:02.568 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T05:55:02.633 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T05:55:02.640 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T05:55:02.641 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T05:55:02.676 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-09-21T05:55:02.677 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-09-21T05:55:02.677 DEBUG:teuthology.orchestra.run.smithi037:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-09-21T05:55:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:03 smithi067 ceph-mon[34443]: pgmap v448: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:55:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:03 smithi144 ceph-mon[34351]: pgmap v448: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:55:04.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:03 smithi037 ceph-mon[30631]: pgmap v448: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T05:55:06.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:05 smithi067 ceph-mon[34443]: pgmap v449: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:55:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:05 smithi144 ceph-mon[34351]: pgmap v449: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:55:06.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:05 smithi037 ceph-mon[30631]: pgmap v449: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:55:08.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:07 smithi067 ceph-mon[34443]: pgmap v450: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T05:55:08.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:07 smithi144 ceph-mon[34351]: pgmap v450: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T05:55:08.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:07 smithi037 ceph-mon[30631]: pgmap v450: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T05:55:10.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:09 smithi067 ceph-mon[34443]: pgmap v451: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:55:10.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:09 smithi144 ceph-mon[34351]: pgmap v451: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:55:10.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:09 smithi037 ceph-mon[30631]: pgmap v451: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:55:12.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:11 smithi067 ceph-mon[34443]: pgmap v452: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:55:12.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:11 smithi144 ceph-mon[34351]: pgmap v452: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:55:12.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:11 smithi037 ceph-mon[30631]: pgmap v452: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:55:12.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:55:13.352 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:13.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.995+0000 7fdcbc600640 1 -- 172.21.15.37:0/4261642709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb4114740 msgr2=0x7fdcb4116b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:13.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.995+0000 7fdcbc600640 1 --2- 172.21.15.37:0/4261642709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb4114740 0x7fdcb4116b60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009ca0 tx=0x7fdcac02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:55:13.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.995+0000 7fdcbc600640 1 -- 172.21.15.37:0/4261642709 shutdown_connections 2024-09-21T05:55:13.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.995+0000 7fdcbc600640 1 --2- 172.21.15.37:0/4261642709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb4114740 0x7fdcb4116b60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.995+0000 7fdcbc600640 1 --2- 172.21.15.37:0/4261642709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcb4078290 0x7fdcb4114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.995+0000 7fdcbc600640 1 --2- 172.21.15.37:0/4261642709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4077940 0x7fdcb4077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.995+0000 7fdcbc600640 1 -- 172.21.15.37:0/4261642709 >> 172.21.15.37:0/4261642709 conn(0x7fdcb4101810 msgr2=0x7fdcb4103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.995+0000 7fdcbc600640 1 -- 172.21.15.37:0/4261642709 shutdown_connections 2024-09-21T05:55:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.995+0000 7fdcbc600640 1 -- 172.21.15.37:0/4261642709 wait complete. 2024-09-21T05:55:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.996+0000 7fdcbc600640 1 Processor -- start 2024-09-21T05:55:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.997+0000 7fdcbc600640 1 -- start start 2024-09-21T05:55:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.997+0000 7fdcbc600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4077940 0x7fdcb41a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.997+0000 7fdcbc600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcb4078290 0x7fdcb41a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.997+0000 7fdcbc600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb4114740 0x7fdcb41a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.997+0000 7fdcbc600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb411a0d0 con 0x7fdcb4114740 2024-09-21T05:55:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.997+0000 7fdcbc600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb4119f50 con 0x7fdcb4077940 2024-09-21T05:55:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.997+0000 7fdcbc600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb411a250 con 0x7fdcb4078290 2024-09-21T05:55:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.997+0000 7fdcb9c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4077940 0x7fdcb41a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.997+0000 7fdcba600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb4114740 0x7fdcb41a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.997+0000 7fdcb9c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4077940 0x7fdcb41a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:49656/0 (socket says 172.21.15.37:49656) 2024-09-21T05:55:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.997+0000 7fdcb9c00640 1 -- 172.21.15.37:0/4037225024 learned_addr learned my addr 172.21.15.37:0/4037225024 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.997+0000 7fdcb9200640 1 --2- 172.21.15.37:0/4037225024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcb4078290 0x7fdcb41a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.998+0000 7fdcb9c00640 1 -- 172.21.15.37:0/4037225024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcb4078290 msgr2=0x7fdcb41a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.998+0000 7fdcb9c00640 1 --2- 172.21.15.37:0/4037225024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcb4078290 0x7fdcb41a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.998+0000 7fdcb9c00640 1 -- 172.21.15.37:0/4037225024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb4114740 msgr2=0x7fdcb41a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.998+0000 7fdcb9c00640 1 --2- 172.21.15.37:0/4037225024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb4114740 0x7fdcb41a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.998+0000 7fdcb9c00640 1 -- 172.21.15.37:0/4037225024 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb41a6a70 con 0x7fdcb4077940 2024-09-21T05:55:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.998+0000 7fdcb9c00640 1 --2- 172.21.15.37:0/4037225024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4077940 0x7fdcb41a0b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdca800e9f0 tx=0x7fdca800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:14.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.998+0000 7fdcb2000640 1 -- 172.21.15.37:0/4037225024 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca800cd80 con 0x7fdcb4077940 2024-09-21T05:55:14.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.998+0000 7fdcbc600640 1 -- 172.21.15.37:0/4037225024 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb41a6d60 con 0x7fdcb4077940 2024-09-21T05:55:14.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.999+0000 7fdcb2000640 1 -- 172.21.15.37:0/4037225024 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdca80108e0 con 0x7fdcb4077940 2024-09-21T05:55:14.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.999+0000 7fdcb2000640 1 -- 172.21.15.37:0/4037225024 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8018980 con 0x7fdcb4077940 2024-09-21T05:55:14.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:13.999+0000 7fdcbc600640 1 -- 172.21.15.37:0/4037225024 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb41ad4c0 con 0x7fdcb4077940 2024-09-21T05:55:14.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.000+0000 7fdcbc600640 1 -- 172.21.15.37:0/4037225024 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb4077d50 con 0x7fdcb4077940 2024-09-21T05:55:14.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.002+0000 7fdcb2000640 1 -- 172.21.15.37:0/4037225024 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdca8010430 con 0x7fdcb4077940 2024-09-21T05:55:14.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.003+0000 7fdcb2000640 1 --2- 172.21.15.37:0/4037225024 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdc9c0b6590 0x7fdc9c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:14.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.004+0000 7fdcb2000640 1 -- 172.21.15.37:0/4037225024 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fdca80e7dd0 con 0x7fdcb4077940 2024-09-21T05:55:14.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.004+0000 7fdcb9200640 1 --2- 172.21.15.37:0/4037225024 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdc9c0b6590 0x7fdc9c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:14.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.004+0000 7fdcb9200640 1 --2- 172.21.15.37:0/4037225024 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdc9c0b6590 0x7fdc9c0b8aa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdcb407b2a0 tx=0x7fdca0005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:14.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.005+0000 7fdcb2000640 1 -- 172.21.15.37:0/4037225024 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdca80b2610 con 0x7fdcb4077940 2024-09-21T05:55:14.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:13 smithi037 ceph-mon[30631]: pgmap v453: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T05:55:14.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:13 smithi067 ceph-mon[34443]: pgmap v453: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T05:55:14.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.247+0000 7fdcbc600640 1 -- 172.21.15.37:0/4037225024 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcb41a1c30 con 0x7fdcb4077940 2024-09-21T05:55:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.248+0000 7fdcb2000640 1 -- 172.21.15.37:0/4037225024 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7fdca80b7550 con 0x7fdcb4077940 2024-09-21T05:55:14.250 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:55:14.251 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:55:14.251 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:55:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.251+0000 7fdcbc600640 1 -- 172.21.15.37:0/4037225024 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdc9c0b6590 msgr2=0x7fdc9c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.251+0000 7fdcbc600640 1 --2- 172.21.15.37:0/4037225024 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdc9c0b6590 0x7fdc9c0b8aa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdcb407b2a0 tx=0x7fdca0005f90 comp rx=0 tx=0).stop 2024-09-21T05:55:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.251+0000 7fdcbc600640 1 -- 172.21.15.37:0/4037225024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4077940 msgr2=0x7fdcb41a0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.251+0000 7fdcbc600640 1 --2- 172.21.15.37:0/4037225024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4077940 0x7fdcb41a0b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdca800e9f0 tx=0x7fdca800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:55:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.251+0000 7fdcbc600640 1 -- 172.21.15.37:0/4037225024 shutdown_connections 2024-09-21T05:55:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.251+0000 7fdcbc600640 1 --2- 172.21.15.37:0/4037225024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb4114740 0x7fdcb41a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.251+0000 7fdcbc600640 1 --2- 172.21.15.37:0/4037225024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcb4078290 0x7fdcb41a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.251+0000 7fdcbc600640 1 --2- 172.21.15.37:0/4037225024 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdc9c0b6590 0x7fdc9c0b8aa0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:14.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.251+0000 7fdcbc600640 1 --2- 172.21.15.37:0/4037225024 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4077940 0x7fdcb41a0b00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:14.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.251+0000 7fdcbc600640 1 -- 172.21.15.37:0/4037225024 >> 172.21.15.37:0/4037225024 conn(0x7fdcb4101810 msgr2=0x7fdcb4116760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:14.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.251+0000 7fdcbc600640 1 -- 172.21.15.37:0/4037225024 shutdown_connections 2024-09-21T05:55:14.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:14.251+0000 7fdcbc600640 1 -- 172.21.15.37:0/4037225024 wait complete. 2024-09-21T05:55:14.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:13 smithi144 ceph-mon[34351]: pgmap v453: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T05:55:15.112 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db --set-id f36ae4e1 --release --await' 2024-09-21T05:55:15.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db --set-id f36ae4e1 --release --await 2024-09-21T05:55:15.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:14 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/4037225024' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:55:15.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:14 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/4037225024' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:55:15.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:14 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/4037225024' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:55:15.496 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:16.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.139+0000 7f52a3200640 1 -- 172.21.15.37:0/1650366365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a410be40 msgr2=0x7f52a4112670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.139+0000 7f52a3200640 1 --2- 172.21.15.37:0/1650366365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a410be40 0x7f52a4112670 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f529c009ca0 tx=0x7f529c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.139+0000 7f52a3200640 1 -- 172.21.15.37:0/1650366365 shutdown_connections 2024-09-21T05:55:16.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.139+0000 7f52a3200640 1 --2- 172.21.15.37:0/1650366365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a410be40 0x7f52a4112670 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.139+0000 7f52a3200640 1 --2- 172.21.15.37:0/1650366365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52a410b4f0 0x7f52a410b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.139+0000 7f52a3200640 1 --2- 172.21.15.37:0/1650366365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52a4105bb0 0x7f52a4105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.139+0000 7f52a3200640 1 -- 172.21.15.37:0/1650366365 >> 172.21.15.37:0/1650366365 conn(0x7f52a4101680 msgr2=0x7f52a4103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:16.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.139+0000 7f52a3200640 1 -- 172.21.15.37:0/1650366365 shutdown_connections 2024-09-21T05:55:16.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.139+0000 7f52a3200640 1 -- 172.21.15.37:0/1650366365 wait complete. 2024-09-21T05:55:16.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.140+0000 7f52a3200640 1 Processor -- start 2024-09-21T05:55:16.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.141+0000 7f52a3200640 1 -- start start 2024-09-21T05:55:16.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.141+0000 7f52a3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a4105bb0 0x7f52a419c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.141+0000 7f52a3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52a410b4f0 0x7f52a419ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.141+0000 7f52a3200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52a410be40 0x7f52a41a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.141+0000 7f52a3200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52a4115b00 con 0x7f52a4105bb0 2024-09-21T05:55:16.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.141+0000 7f52a3200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f52a4115980 con 0x7f52a410be40 2024-09-21T05:55:16.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.141+0000 7f52a3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f52a4115c80 con 0x7f52a410b4f0 2024-09-21T05:55:16.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.141+0000 7f52a1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a4105bb0 0x7f52a419c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.141+0000 7f52a1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a4105bb0 0x7f52a419c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48434/0 (socket says 172.21.15.37:48434) 2024-09-21T05:55:16.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.141+0000 7f52a1e00640 1 -- 172.21.15.37:0/2492438877 learned_addr learned my addr 172.21.15.37:0/2492438877 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:16.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.141+0000 7f52a2800640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52a410be40 0x7f52a41a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.142+0000 7f52a1400640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52a410b4f0 0x7f52a419ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.142+0000 7f52a1e00640 1 -- 172.21.15.37:0/2492438877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52a410b4f0 msgr2=0x7f52a419ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.142+0000 7f52a1e00640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52a410b4f0 0x7f52a419ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.142+0000 7f52a1e00640 1 -- 172.21.15.37:0/2492438877 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52a410be40 msgr2=0x7f52a41a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.142+0000 7f52a1e00640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52a410be40 0x7f52a41a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.142+0000 7f52a1e00640 1 -- 172.21.15.37:0/2492438877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a41a2400 con 0x7f52a4105bb0 2024-09-21T05:55:16.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.142+0000 7f52a2800640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52a410be40 0x7f52a41a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:16.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.142+0000 7f52a1e00640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a4105bb0 0x7f52a419c490 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f529400ea60 tx=0x7f529400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:16.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.143+0000 7f529aa00640 1 -- 172.21.15.37:0/2492438877 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529400cde0 con 0x7f52a4105bb0 2024-09-21T05:55:16.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.143+0000 7f529aa00640 1 -- 172.21.15.37:0/2492438877 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52940035f0 con 0x7f52a4105bb0 2024-09-21T05:55:16.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.143+0000 7f529aa00640 1 -- 172.21.15.37:0/2492438877 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5294010690 con 0x7f52a4105bb0 2024-09-21T05:55:16.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.143+0000 7f52a3200640 1 -- 172.21.15.37:0/2492438877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a41a26f0 con 0x7f52a4105bb0 2024-09-21T05:55:16.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.143+0000 7f52a3200640 1 -- 172.21.15.37:0/2492438877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a41a8e50 con 0x7f52a4105bb0 2024-09-21T05:55:16.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.146+0000 7f52afe6a740 1 Processor -- start 2024-09-21T05:55:16.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.146+0000 7f52afe6a740 1 -- start start 2024-09-21T05:55:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.146+0000 7f52afe6a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e03340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.146+0000 7f52afe6a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 0x55d877e03880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52afe6a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e03dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52afe6a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d877d7a290 con 0x55d877a5c520 2024-09-21T05:55:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52afe6a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d877d696c0 con 0x55d877a3b840 2024-09-21T05:55:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52afe6a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d877d6d4d0 con 0x55d877a33660 2024-09-21T05:55:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f529aa00640 1 -- 172.21.15.37:0/2492438877 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f52940037a0 con 0x7f52a4105bb0 2024-09-21T05:55:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52a2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e03340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52a2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e03340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48438/0 (socket says 172.21.15.37:48438) 2024-09-21T05:55:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52a2800640 1 -- 172.21.15.37:0/444948857 learned_addr learned my addr 172.21.15.37:0/444948857 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52a1400640 1 --2- 172.21.15.37:0/444948857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e03dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52a1e00640 1 --2- 172.21.15.37:0/444948857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 0x55d877e03880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52a2800640 1 -- 172.21.15.37:0/444948857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 msgr2=0x55d877e03880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52a2800640 1 --2- 172.21.15.37:0/444948857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 0x55d877e03880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52a2800640 1 -- 172.21.15.37:0/444948857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 msgr2=0x55d877e03dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52a2800640 1 --2- 172.21.15.37:0/444948857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e03dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.147+0000 7f52a2800640 1 -- 172.21.15.37:0/444948857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d877cf6460 con 0x55d877a5c520 2024-09-21T05:55:16.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.148+0000 7f52a2800640 1 --2- 172.21.15.37:0/444948857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e03340 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f529c033040 tx=0x7f529c02f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c6f6835dac059e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:16.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.148+0000 7f528f400640 1 -- 172.21.15.37:0/444948857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c031650 con 0x55d877a5c520 2024-09-21T05:55:16.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.148+0000 7f528f400640 1 -- 172.21.15.37:0/444948857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f529c036040 con 0x55d877a5c520 2024-09-21T05:55:16.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.148+0000 7f528f400640 1 -- 172.21.15.37:0/444948857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c004460 con 0x55d877a5c520 2024-09-21T05:55:16.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.149+0000 7f529aa00640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f52880b6590 0x7f52880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.149+0000 7f529aa00640 1 -- 172.21.15.37:0/2492438877 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f52940e7950 con 0x7f52a4105bb0 2024-09-21T05:55:16.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.149+0000 7f52a1e00640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f52880b6590 0x7f52880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.149+0000 7f52afe6a740 1 -- 172.21.15.37:0/444948857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 msgr2=0x55d877e03340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.149+0000 7f52afe6a740 1 --2- 172.21.15.37:0/444948857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e03340 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f529c033040 tx=0x7f529c02f310 comp rx=0 tx=0).stop 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.149+0000 7f52afe6a740 1 -- 172.21.15.37:0/444948857 shutdown_connections 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.149+0000 7f52afe6a740 1 --2- 172.21.15.37:0/444948857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e03dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.149+0000 7f52afe6a740 1 --2- 172.21.15.37:0/444948857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 0x55d877e03880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.149+0000 7f52afe6a740 1 --2- 172.21.15.37:0/444948857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e03340 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.149+0000 7f52afe6a740 1 -- 172.21.15.37:0/444948857 >> 172.21.15.37:0/444948857 conn(0x55d877a50910 msgr2=0x55d877e01230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.150+0000 7f52afe6a740 1 -- 172.21.15.37:0/444948857 shutdown_connections 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.150+0000 7f52afe6a740 1 -- 172.21.15.37:0/444948857 wait complete. 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.150+0000 7f52a1e00640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f52880b6590 0x7f52880b8aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f52940a9c80 tx=0x7f52940ed530 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.150+0000 7f52afe6a740 1 -- start start 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.150+0000 7f52afe6a740 1 Processor -- start 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.151+0000 7f52afe6a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a33660 0x55d877e0ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.151+0000 7f52afe6a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e0f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.151+0000 7f52afe6a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a5c520 0x55d877e1ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.151+0000 7f52afe6a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d877bcabb0 con 0x55d877a33660 2024-09-21T05:55:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.151+0000 7f52afe6a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d877d046c0 con 0x55d877a3b840 2024-09-21T05:55:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.151+0000 7f52afe6a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d877e11940 con 0x55d877a5c520 2024-09-21T05:55:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.151+0000 7f52afe6a740 10 client.0 _ll_register_callbacks cb 0x55d877d1f490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.151+0000 7f52a2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a33660 0x55d877e0ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.151+0000 7f52a1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e0f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.151+0000 7f52a2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a33660 0x55d877e0ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48450/0 (socket says 172.21.15.37:48450) 2024-09-21T05:55:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.151+0000 7f52a2800640 1 -- 172.21.15.37:0/1976038945 learned_addr learned my addr 172.21.15.37:0/1976038945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:16.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.152+0000 7f52a2800640 1 --2- 172.21.15.37:0/1976038945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a5c520 0x55d877e1ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.152+0000 7f52a1400640 1 -- 172.21.15.37:0/1976038945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a5c520 msgr2=0x55d877e1ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.152+0000 7f52a1400640 1 --2- 172.21.15.37:0/1976038945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a5c520 0x55d877e1ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.152+0000 7f52a1400640 1 -- 172.21.15.37:0/1976038945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a33660 msgr2=0x55d877e0ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.152+0000 7f52a1400640 1 --2- 172.21.15.37:0/1976038945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a33660 0x55d877e0ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.152+0000 7f52a1400640 1 -- 172.21.15.37:0/1976038945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d877ac7b00 con 0x55d877a3b840 2024-09-21T05:55:16.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.152+0000 7f52a1400640 1 --2- 172.21.15.37:0/1976038945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e0f450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f52a406c630 tx=0x7f5290012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c07f0fbca9cb57ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:16.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.152+0000 7f5283e00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:55:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.152+0000 7f5283e00640 1 -- 172.21.15.37:0/1976038945 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529000f890 con 0x55d877a3b840 2024-09-21T05:55:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.152+0000 7f52afe6a740 1 -- 172.21.15.37:0/1976038945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f529c036040 con 0x55d877a3b840 2024-09-21T05:55:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.153+0000 7f5283e00640 1 -- 172.21.15.37:0/1976038945 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f529000fa30 con 0x55d877a3b840 2024-09-21T05:55:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.153+0000 7f5283e00640 1 -- 172.21.15.37:0/1976038945 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f529000fc30 con 0x55d877a3b840 2024-09-21T05:55:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.153+0000 7f52afe6a740 10 client.25403 fetch_fsmap learned FSMap version 21 2024-09-21T05:55:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.153+0000 7f52afe6a740 1 -- 172.21.15.37:0/1976038945 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d877b3e960 con 0x55d877a3b840 2024-09-21T05:55:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.153+0000 7f5283e00640 1 -- 172.21.15.37:0/1976038945 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f529c036040 con 0x55d877a3b840 2024-09-21T05:55:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.154+0000 7f5283e00640 1 -- 172.21.15.37:0/1976038945 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f529001c420 con 0x55d877a3b840 2024-09-21T05:55:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.154+0000 7f52afe6a740 10 client.25403 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:55:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.154+0000 7f52afe6a740 10 client.25403 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:55:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.154+0000 7f52afe6a740 20 client.25403 populate_metadata read hostname 'smithi037' 2024-09-21T05:55:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.154+0000 7f52afe6a740 1 --2- 172.21.15.37:0/1976038945 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55d877a1aea0 0x55d877e20cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.154+0000 7f52afe6a740 4 client.25403 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:16.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.154+0000 7f52afe6a740 1 -- 172.21.15.37:0/1976038945 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d877d7c1e0 con 0x55d877a1aea0 2024-09-21T05:55:16.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.154+0000 7f52a2800640 1 --2- 172.21.15.37:0/1976038945 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55d877a1aea0 0x55d877e20cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.155+0000 7f52a2800640 1 --2- 172.21.15.37:0/1976038945 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55d877a1aea0 0x55d877e20cc0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=403b828084fcc321 server_cookie=6800245322a2abea in_seq=0 out_seq=0 2024-09-21T05:55:16.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.155+0000 7f5283e00640 10 client.25403 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:55:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.155+0000 7f5283e00640 1 -- 172.21.15.37:0/1976038945 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d877d7c1e0 con 0x55d877a1aea0 2024-09-21T05:55:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f5283e00640 10 client.25403 handle_command_reply: tid=0 2024-09-21T05:55:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f52afe6a740 1 client.25403 shutdown 2024-09-21T05:55:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f52afe6a740 1 -- 172.21.15.37:0/1976038945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 msgr2=0x55d877e0f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f52afe6a740 1 --2- 172.21.15.37:0/1976038945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e0f450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f52a406c630 tx=0x7f5290012b60 comp rx=0 tx=0).stop 2024-09-21T05:55:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f52afe6a740 1 -- 172.21.15.37:0/1976038945 shutdown_connections 2024-09-21T05:55:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f52afe6a740 1 --2- 172.21.15.37:0/1976038945 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55d877a1aea0 0x55d877e20cc0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f52afe6a740 1 --2- 172.21.15.37:0/1976038945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a5c520 0x55d877e1ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f52afe6a740 1 --2- 172.21.15.37:0/1976038945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e0f450 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f5283e00640 0 client.25403 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:55:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f52afe6a740 1 --2- 172.21.15.37:0/1976038945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a33660 0x55d877e0ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f52afe6a740 1 -- 172.21.15.37:0/1976038945 >> 172.21.15.37:0/1976038945 conn(0x55d877a50910 msgr2=0x55d877e06520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:16.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f52afe6a740 1 -- 172.21.15.37:0/1976038945 shutdown_connections 2024-09-21T05:55:16.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f52afe6a740 1 -- 172.21.15.37:0/1976038945 wait complete. 2024-09-21T05:55:16.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.156+0000 7f52afe6a740 20 client.25403 trim_cache size 0 max 16384 2024-09-21T05:55:16.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.174+0000 7f52afe6a740 1 Processor -- start 2024-09-21T05:55:16.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.174+0000 7f52afe6a740 1 -- start start 2024-09-21T05:55:16.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52afe6a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 0x55d877e04d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52afe6a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e1ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52afe6a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e1b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52afe6a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52a41b0c60 con 0x55d877a5c520 2024-09-21T05:55:16.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52afe6a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f52a41b34e0 con 0x55d877a3b840 2024-09-21T05:55:16.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52afe6a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f52a41b12d0 con 0x55d877a33660 2024-09-21T05:55:16.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52a2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e1b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52a1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e1ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52a2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e1b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48456/0 (socket says 172.21.15.37:48456) 2024-09-21T05:55:16.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52a2800640 1 -- 172.21.15.37:0/3768831312 learned_addr learned my addr 172.21.15.37:0/3768831312 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:16.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52a2800640 1 --2- 172.21.15.37:0/3768831312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 0x55d877e04d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52a2800640 1 -- 172.21.15.37:0/3768831312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 msgr2=0x55d877e04d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52a2800640 1 --2- 172.21.15.37:0/3768831312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 0x55d877e04d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52a2800640 1 -- 172.21.15.37:0/3768831312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 msgr2=0x55d877e1ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52a2800640 1 --2- 172.21.15.37:0/3768831312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e1ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.175+0000 7f52a2800640 1 -- 172.21.15.37:0/3768831312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d877e0fc60 con 0x55d877a5c520 2024-09-21T05:55:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.176+0000 7f52a2800640 1 --2- 172.21.15.37:0/3768831312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e1b0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f529c02f400 tx=0x7f529c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c183efb27841e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.176+0000 7f528ea00640 1 -- 172.21.15.37:0/3768831312 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c031580 con 0x55d877a5c520 2024-09-21T05:55:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.176+0000 7f528ea00640 1 -- 172.21.15.37:0/3768831312 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f529c036070 con 0x55d877a5c520 2024-09-21T05:55:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.176+0000 7f528ea00640 1 -- 172.21.15.37:0/3768831312 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c0045b0 con 0x55d877a5c520 2024-09-21T05:55:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.177+0000 7f52afe6a740 1 -- 172.21.15.37:0/3768831312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 msgr2=0x55d877e1b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.177+0000 7f52afe6a740 1 --2- 172.21.15.37:0/3768831312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e1b0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f529c02f400 tx=0x7f529c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.177+0000 7f52afe6a740 1 -- 172.21.15.37:0/3768831312 shutdown_connections 2024-09-21T05:55:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.177+0000 7f52afe6a740 1 --2- 172.21.15.37:0/3768831312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e1b0a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.177+0000 7f52afe6a740 1 --2- 172.21.15.37:0/3768831312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e1ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.177+0000 7f52afe6a740 1 --2- 172.21.15.37:0/3768831312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 0x55d877e04d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.177+0000 7f52afe6a740 1 -- 172.21.15.37:0/3768831312 >> 172.21.15.37:0/3768831312 conn(0x55d877a50910 msgr2=0x55d877e011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.177+0000 7f52afe6a740 1 -- 172.21.15.37:0/3768831312 shutdown_connections 2024-09-21T05:55:16.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.177+0000 7f52afe6a740 1 -- 172.21.15.37:0/3768831312 wait complete. 2024-09-21T05:55:16.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.178+0000 7f52afe6a740 1 -- start start 2024-09-21T05:55:16.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.178+0000 7f52afe6a740 1 Processor -- start 2024-09-21T05:55:16.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.178+0000 7f52afe6a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 0x55d877e17160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.178+0000 7f52afe6a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e14bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.178+0000 7f52afe6a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e15130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.178+0000 7f52afe6a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52a41b19a0 con 0x55d877a5c520 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.178+0000 7f52afe6a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f52a41b2e10 con 0x55d877a3b840 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.178+0000 7f52afe6a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f52a41b2070 con 0x55d877a33660 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.178+0000 7f52afe6a740 10 client.0 _ll_register_callbacks cb 0x7f5290009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.179+0000 7f52a2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 0x55d877e17160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.179+0000 7f52a1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e14bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.179+0000 7f52a2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e15130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.179+0000 7f52a1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e14bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:49694/0 (socket says 172.21.15.37:49694) 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.179+0000 7f52a1400640 1 -- 172.21.15.37:0/1578885671 learned_addr learned my addr 172.21.15.37:0/1578885671 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.179+0000 7f52a2800640 1 -- 172.21.15.37:0/1578885671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 msgr2=0x55d877e17160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.179+0000 7f52a2800640 1 --2- 172.21.15.37:0/1578885671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 0x55d877e17160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.179+0000 7f52a2800640 1 -- 172.21.15.37:0/1578885671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 msgr2=0x55d877e14bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.179+0000 7f52a2800640 1 --2- 172.21.15.37:0/1578885671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e14bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.179+0000 7f52a2800640 1 -- 172.21.15.37:0/1578885671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d877e15670 con 0x55d877a5c520 2024-09-21T05:55:16.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.179+0000 7f52a2800640 1 --2- 172.21.15.37:0/1578885671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e15130 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f529c009a60 tx=0x7f529c02f550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32860c4cb30b6abc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.179+0000 7f5283e00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T05:55:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.180+0000 7f5283e00640 1 -- 172.21.15.37:0/1578885671 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c04b040 con 0x55d877a5c520 2024-09-21T05:55:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.180+0000 7f52afe6a740 1 -- 172.21.15.37:0/1578885671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f529c036070 con 0x55d877a5c520 2024-09-21T05:55:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.180+0000 7f5283e00640 1 -- 172.21.15.37:0/1578885671 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f529c004740 con 0x55d877a5c520 2024-09-21T05:55:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.180+0000 7f5283e00640 1 -- 172.21.15.37:0/1578885671 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f529c003970 con 0x55d877a5c520 2024-09-21T05:55:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.180+0000 7f52afe6a740 10 client.15381 fetch_fsmap learned FSMap version 21 2024-09-21T05:55:16.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.180+0000 7f52afe6a740 1 -- 172.21.15.37:0/1578885671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d877e8c390 con 0x55d877a5c520 2024-09-21T05:55:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.180+0000 7f5283e00640 1 -- 172.21.15.37:0/1578885671 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f529c036070 con 0x55d877a5c520 2024-09-21T05:55:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.181+0000 7f5283e00640 1 -- 172.21.15.37:0/1578885671 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f529c044070 con 0x55d877a5c520 2024-09-21T05:55:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.181+0000 7f52afe6a740 10 client.15381 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:55:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.181+0000 7f52afe6a740 10 client.15381 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:55:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.181+0000 7f52afe6a740 20 client.15381 populate_metadata read hostname 'smithi037' 2024-09-21T05:55:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.181+0000 7f52afe6a740 1 --2- 172.21.15.37:0/1578885671 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55d8779f0250 0x55d877e8e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.181+0000 7f52afe6a740 4 client.15381 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f36ae4e1", "release": true, "await": true}] 2024-09-21T05:55:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.181+0000 7f52afe6a740 1 -- 172.21.15.37:0/1578885671 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f36ae4e1", "release": true, "await": true}) -- 0x55d877d77c90 con 0x55d8779f0250 2024-09-21T05:55:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.181+0000 7f52a1400640 1 --2- 172.21.15.37:0/1578885671 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55d8779f0250 0x55d877e8e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.182+0000 7f52a1400640 1 --2- 172.21.15.37:0/1578885671 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55d8779f0250 0x55d877e8e6e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d953d038b5e2629 server_cookie=4bd18a5e24616d8a in_seq=0 out_seq=0 2024-09-21T05:55:16.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.182+0000 7f5283e00640 10 client.15381 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:55:16.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.184+0000 7f5283e00640 1 -- 172.21.15.37:0/1578885671 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55d877d77c90 con 0x55d8779f0250 2024-09-21T05:55:16.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.184+0000 7f5283e00640 10 client.15381 handle_command_reply: tid=0 2024-09-21T05:55:16.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.184+0000 7f52afe6a740 1 client.15381 shutdown 2024-09-21T05:55:16.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.185+0000 7f52afe6a740 1 -- 172.21.15.37:0/1578885671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 msgr2=0x55d877e15130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.185+0000 7f52afe6a740 1 --2- 172.21.15.37:0/1578885671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e15130 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f529c009a60 tx=0x7f529c02f550 comp rx=0 tx=0).stop 2024-09-21T05:55:16.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.185+0000 7f52afe6a740 1 -- 172.21.15.37:0/1578885671 shutdown_connections 2024-09-21T05:55:16.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.185+0000 7f52afe6a740 1 --2- 172.21.15.37:0/1578885671 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55d8779f0250 0x55d877e8e6e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.185+0000 7f52afe6a740 1 --2- 172.21.15.37:0/1578885671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d877a5c520 0x55d877e15130 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.185+0000 7f52afe6a740 1 --2- 172.21.15.37:0/1578885671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d877a3b840 0x55d877e14bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.185+0000 7f52afe6a740 1 --2- 172.21.15.37:0/1578885671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d877a33660 0x55d877e17160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.185+0000 7f5283e00640 0 client.15381 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:55:16.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.185+0000 7f52afe6a740 1 -- 172.21.15.37:0/1578885671 >> 172.21.15.37:0/1578885671 conn(0x55d877a50910 msgr2=0x55d877e011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:16.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.185+0000 7f52afe6a740 1 -- 172.21.15.37:0/1578885671 shutdown_connections 2024-09-21T05:55:16.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.185+0000 7f52afe6a740 1 -- 172.21.15.37:0/1578885671 wait complete. 2024-09-21T05:55:16.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.185+0000 7f52afe6a740 20 client.15381 trim_cache size 0 max 16384 2024-09-21T05:55:16.188 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:55:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:55:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:55:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 8, 2024-09-21T05:55:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:55:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: "f36ae4e1": { 2024-09-21T05:55:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 8, 2024-09-21T05:55:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:55:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:55:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:55:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:55:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:55:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:55:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 137.0, 2024-09-21T05:55:16.190 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:55:16.190 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:55:16.190 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:55:16.190 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:55:16.190 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:55:16.190 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:55:16.190 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:16.190 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:16.190 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:16.190 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:16.190 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:16.190 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:55:16.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.186+0000 7f52a3200640 1 -- 172.21.15.37:0/2492438877 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f52880b6590 msgr2=0x7f52880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.186+0000 7f52a3200640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f52880b6590 0x7f52880b8aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f52940a9c80 tx=0x7f52940ed530 comp rx=0 tx=0).stop 2024-09-21T05:55:16.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.186+0000 7f52a3200640 1 -- 172.21.15.37:0/2492438877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a4105bb0 msgr2=0x7f52a419c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:16.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.186+0000 7f52a3200640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a4105bb0 0x7f52a419c490 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f529400ea60 tx=0x7f529400ef20 comp rx=0 tx=0).stop 2024-09-21T05:55:16.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.186+0000 7f52a3200640 1 -- 172.21.15.37:0/2492438877 shutdown_connections 2024-09-21T05:55:16.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.186+0000 7f52a3200640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f52880b6590 0x7f52880b8aa0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.186+0000 7f52a3200640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52a410be40 0x7f52a41a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.186+0000 7f52a3200640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52a410b4f0 0x7f52a419ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.186+0000 7f52a3200640 1 --2- 172.21.15.37:0/2492438877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a4105bb0 0x7f52a419c490 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:16.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.186+0000 7f52a3200640 1 -- 172.21.15.37:0/2492438877 >> 172.21.15.37:0/2492438877 conn(0x7f52a4101680 msgr2=0x7f52a410ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:16.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.186+0000 7f52a3200640 1 -- 172.21.15.37:0/2492438877 shutdown_connections 2024-09-21T05:55:16.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:16.186+0000 7f52a3200640 1 -- 172.21.15.37:0/2492438877 wait complete. 2024-09-21T05:55:16.198 INFO:tasks.workunit.client.0.smithi037.stderr:+ set -e 2024-09-21T05:55:16.199 INFO:tasks.workunit.client.0.smithi037.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-09-21T05:55:16.203 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into 'xfstests-dev'... 2024-09-21T05:55:16.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:15 smithi037 ceph-mon[30631]: pgmap v454: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:55:16.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:15 smithi067 ceph-mon[34443]: pgmap v454: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:55:16.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:15 smithi144 ceph-mon[34351]: pgmap v454: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T05:55:17.037 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f36ae4e1', total seconds elapsed: 21.1 2024-09-21T05:55:18.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:17 smithi067 ceph-mon[34443]: pgmap v455: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T05:55:18.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:17 smithi144 ceph-mon[34351]: pgmap v455: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T05:55:18.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:17 smithi037 ceph-mon[30631]: pgmap v455: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T05:55:20.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:19 smithi067 ceph-mon[34443]: pgmap v456: 129 pgs: 129 active+clean; 662 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:55:20.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:19 smithi144 ceph-mon[34351]: pgmap v456: 129 pgs: 129 active+clean; 662 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:55:20.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:19 smithi037 ceph-mon[30631]: pgmap v456: 129 pgs: 129 active+clean; 662 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T05:55:22.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:21 smithi067 ceph-mon[34443]: pgmap v457: 129 pgs: 129 active+clean; 2.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 132 KiB/s wr, 2 op/s 2024-09-21T05:55:22.298 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:21 smithi037 ceph-mon[30631]: pgmap v457: 129 pgs: 129 active+clean; 2.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 132 KiB/s wr, 2 op/s 2024-09-21T05:55:22.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:21 smithi144 ceph-mon[34351]: pgmap v457: 129 pgs: 129 active+clean; 2.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 132 KiB/s wr, 2 op/s 2024-09-21T05:55:24.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:23 smithi067 ceph-mon[34443]: pgmap v458: 129 pgs: 129 active+clean; 11 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 911 KiB/s wr, 6 op/s 2024-09-21T05:55:24.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:23 smithi144 ceph-mon[34351]: pgmap v458: 129 pgs: 129 active+clean; 11 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 911 KiB/s wr, 6 op/s 2024-09-21T05:55:24.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:23 smithi037 ceph-mon[30631]: pgmap v458: 129 pgs: 129 active+clean; 11 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 911 KiB/s wr, 6 op/s 2024-09-21T05:55:26.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:25 smithi067 ceph-mon[34443]: pgmap v459: 129 pgs: 129 active+clean; 15 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 1.2 MiB/s wr, 6 op/s 2024-09-21T05:55:26.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:25 smithi144 ceph-mon[34351]: pgmap v459: 129 pgs: 129 active+clean; 15 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 1.2 MiB/s wr, 6 op/s 2024-09-21T05:55:26.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:25 smithi037 ceph-mon[30631]: pgmap v459: 129 pgs: 129 active+clean; 15 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 1.2 MiB/s wr, 6 op/s 2024-09-21T05:55:28.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:27 smithi144 ceph-mon[34351]: pgmap v460: 129 pgs: 129 active+clean; 16 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-21T05:55:28.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:27 smithi037 ceph-mon[30631]: pgmap v460: 129 pgs: 129 active+clean; 16 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-21T05:55:28.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:27 smithi067 ceph-mon[34443]: pgmap v460: 129 pgs: 129 active+clean; 16 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-21T05:55:30.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:30 smithi144 ceph-mon[34351]: pgmap v461: 129 pgs: 129 active+clean; 16 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-21T05:55:30.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:30 smithi037 ceph-mon[30631]: pgmap v461: 129 pgs: 129 active+clean; 16 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-21T05:55:30.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:30 smithi067 ceph-mon[34443]: pgmap v461: 129 pgs: 129 active+clean; 16 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-21T05:55:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:32 smithi144 ceph-mon[34351]: pgmap v462: 129 pgs: 129 active+clean; 16 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-21T05:55:32.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:32 smithi037 ceph-mon[30631]: pgmap v462: 129 pgs: 129 active+clean; 16 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-21T05:55:32.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:32 smithi067 ceph-mon[34443]: pgmap v462: 129 pgs: 129 active+clean; 16 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-21T05:55:34.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:34 smithi144 ceph-mon[34351]: pgmap v463: 129 pgs: 129 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-21T05:55:34.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:34 smithi037 ceph-mon[30631]: pgmap v463: 129 pgs: 129 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-21T05:55:34.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:34 smithi067 ceph-mon[34443]: pgmap v463: 129 pgs: 129 active+clean; 17 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-09-21T05:55:36.299 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:36 smithi067 ceph-mon[34443]: pgmap v464: 129 pgs: 129 active+clean; 17 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 544 KiB/s wr, 9 op/s 2024-09-21T05:55:36.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:36 smithi144 ceph-mon[34351]: pgmap v464: 129 pgs: 129 active+clean; 17 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 544 KiB/s wr, 9 op/s 2024-09-21T05:55:36.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:36 smithi037 ceph-mon[30631]: pgmap v464: 129 pgs: 129 active+clean; 17 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 544 KiB/s wr, 9 op/s 2024-09-21T05:55:37.290 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:37 smithi037 ceph-mon[30631]: pgmap v465: 129 pgs: 129 active+clean; 20 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 502 KiB/s wr, 23 op/s 2024-09-21T05:55:37.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:37 smithi144 ceph-mon[34351]: pgmap v465: 129 pgs: 129 active+clean; 20 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 502 KiB/s wr, 23 op/s 2024-09-21T05:55:37.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:37 smithi067 ceph-mon[34443]: pgmap v465: 129 pgs: 129 active+clean; 20 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 502 KiB/s wr, 23 op/s 2024-09-21T05:55:39.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:39 smithi144 ceph-mon[34351]: pgmap v466: 129 pgs: 129 active+clean; 21 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 626 KiB/s wr, 61 op/s 2024-09-21T05:55:39.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:39 smithi037 ceph-mon[30631]: pgmap v466: 129 pgs: 129 active+clean; 21 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 626 KiB/s wr, 61 op/s 2024-09-21T05:55:39.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:39 smithi067 ceph-mon[34443]: pgmap v466: 129 pgs: 129 active+clean; 21 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 626 KiB/s wr, 61 op/s 2024-09-21T05:55:40.027 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 7% (322/4351) Updating files: 8% (349/4351) Updating files: 9% (392/4351) Updating files: 10% (436/4351) Updating files: 11% (479/4351) Updating files: 11% (493/4351) Updating files: 12% (523/4351) Updating files: 13% (566/4351) Updating files: 14% (610/4351) Updating files: 15% (653/4351) Updating files: 16% (697/4351) Updating files: 17% (740/4351) Updating files: 18% (784/4351) Updating files: 19% (827/4351) Updating files: 20% (871/4351) Updating files: 21% (914/4351) Updating files: 22% (958/4351) Updating files: 23% (1001/4351) Updating files: 24% (1045/4351) Updating files: 25% (1088/4351) Updating files: 26% (1132/4351) Updating files: 27% (1175/4351) Updating files: 28% (1219/4351) Updating files: 28% (1251/4351) Updating files: 29% (1262/4351) Updating files: 29% (1303/4351) Updating files: 30% (1306/4351) Updating files: 31% (1349/4351) Updating files: 32% (1393/4351) Updating files: 33% (1436/4351) Updating files: 34% (1480/4351) Updating files: 35% (1523/4351) Updating files: 36% (1567/4351) Updating files: 37% (1610/4351) Updating files: 38% (1654/4351) Updating files: 39% (1697/4351) Updating files: 40% (1741/4351) Updating files: 41% (1784/4351) Updating files: 42% (1828/4351) Updating files: 43% (1871/4351) Updating files: 43% (1882/4351) Updating files: 44% (1915/4351) Updating files: 45% (1958/4351) Updating files: 46% (2002/4351) Updating files: 47% (2045/4351) Updating files: 48% (2089/4351) Updating files: 49% (2132/4351) Updating files: 50% (2176/4351) Updating files: 51% (2220/4351) Updating files: 52% (2263/4351) Updating files: 53% (2307/4351) Updating files: 54% (2350/4351) Updating files: 55% (2394/4351) Updating files: 56% (2437/4351) Updating files: 56% (2456/4351) Updating files: 57% (2481/4351) Updating files: 58% (2524/4351) Updating files: 59% (2568/4351) Updating files: 60% (2611/4351) Updating files: 61% (2655/4351) Updating files: 62% (2698/4351) Updating files: 63% (2742/4351) Updating files: 64% (2785/4351) Updating files: 64% (2809/4351) Updating files: 65% (2829/4351) Updating files: 66% (2872/4351) Updating files: 67% (2916/4351) Updating files: 68% (2959/4351) Updating files: 69% (3003/4351) Updating files: 69% (3040/4351) Updating files: 70% (3046/4351) Updating files: 71% (3090/4351) Updating files: 72% (3133/4351) Updating files: 73% (3177/4351) Updating files: 74% (3220/4351) Updating files: 75% (3264/4351) Updating files: 76% (3307/4351) Updating files: 77% (3351/4351) Updating files: 78% (3394/4351) Updating files: 79% (3438/4351) Updating files: 80% (3481/4351) Updating files: 81% (3525/4351) Updating files: 82% (3568/4351) Updating files: 83% (3612/4351) Updating files: 84% (3655/4351) Updating files: 85% (3699/4351) Updating files: 86% (3742/4351) Updating files: 86% (3744/4351) Updating files: 87% (3786/4351) Updating files: 88% (3829/4351) Updating files: 89% (3873/4351) Updating files: 90% (3916/4351) Updating files: 91% (3960/4351) Updating files: 92% (4003/4351) Updating files: 93% (4047/4351) Updating files: 94% (4090/4351) Updating files: 95% (4134/4351) Updating files: 96% (4177/4351) Updating files: 96% (4184/4351) Updating files: 97% (4221/4351) Updating files: 98% (4264/4351) Updating files: 99% (4308/4351) Updating files: 100% (4351/4351) Updating files: 100% (4351/4351), done. 2024-09-21T05:55:40.036 INFO:tasks.workunit.client.0.smithi037.stderr:+ cd xfstests-dev 2024-09-21T05:55:40.036 INFO:tasks.workunit.client.0.smithi037.stderr:+ git checkout 0e5c12dfd008efc2848c98108c9237487e91ef35 2024-09-21T05:55:41.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:41 smithi144 ceph-mon[34351]: pgmap v467: 129 pgs: 129 active+clean; 26 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.0 MiB/s wr, 123 op/s 2024-09-21T05:55:41.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:41 smithi037 ceph-mon[30631]: pgmap v467: 129 pgs: 129 active+clean; 26 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.0 MiB/s wr, 123 op/s 2024-09-21T05:55:41.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:41 smithi067 ceph-mon[34443]: pgmap v467: 129 pgs: 129 active+clean; 26 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.0 MiB/s wr, 123 op/s 2024-09-21T05:55:43.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:43 smithi037 ceph-mon[30631]: pgmap v468: 129 pgs: 129 active+clean; 33 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1.7 MiB/s wr, 189 op/s 2024-09-21T05:55:43.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:43 smithi067 ceph-mon[34443]: pgmap v468: 129 pgs: 129 active+clean; 33 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1.7 MiB/s wr, 189 op/s 2024-09-21T05:55:43.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:43 smithi144 ceph-mon[34351]: pgmap v468: 129 pgs: 129 active+clean; 33 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1.7 MiB/s wr, 189 op/s 2024-09-21T05:55:45.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:45 smithi037 ceph-mon[30631]: pgmap v469: 129 pgs: 129 active+clean; 33 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 1.6 MiB/s wr, 211 op/s 2024-09-21T05:55:45.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:45 smithi067 ceph-mon[34443]: pgmap v469: 129 pgs: 129 active+clean; 33 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 1.6 MiB/s wr, 211 op/s 2024-09-21T05:55:45.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:45 smithi144 ceph-mon[34351]: pgmap v469: 129 pgs: 129 active+clean; 33 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 1.6 MiB/s wr, 211 op/s 2024-09-21T05:55:47.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:47 smithi037 ceph-mon[30631]: pgmap v470: 129 pgs: 129 active+clean; 41 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 320 op/s 2024-09-21T05:55:47.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:47 smithi067 ceph-mon[34443]: pgmap v470: 129 pgs: 129 active+clean; 41 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 320 op/s 2024-09-21T05:55:47.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:47 smithi144 ceph-mon[34351]: pgmap v470: 129 pgs: 129 active+clean; 41 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 320 op/s 2024-09-21T05:55:48.609 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T05:55:48.609 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T05:55:48.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:55:49.021 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:49.167 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to '0e5c12dfd008efc2848c98108c9237487e91ef35'. 2024-09-21T05:55:49.167 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:49.167 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T05:55:49.167 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T05:55:49.167 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T05:55:49.167 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:49.167 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T05:55:49.167 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T05:55:49.167 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:49.167 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-09-21T05:55:49.167 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:49.168 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-09-21T05:55:49.168 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:49.168 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-09-21T05:55:49.168 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:49.168 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T05:55:49.168 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T05:55:49.168 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at 0e5c12df xfs/522: use reflink instead of crc as test feature 2024-09-21T05:55:49.170 INFO:tasks.workunit.client.0.smithi037.stderr:+ make -j4 2024-09-21T05:55:49.186 INFO:tasks.workunit.client.0.smithi037.stdout:libtoolize -cfi 2024-09-21T05:55:49.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:49 smithi037 ceph-mon[30631]: pgmap v471: 129 pgs: 129 active+clean; 44 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 352 op/s 2024-09-21T05:55:49.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:49 smithi067 ceph-mon[34443]: pgmap v471: 129 pgs: 129 active+clean; 44 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 352 op/s 2024-09-21T05:55:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.747+0000 7f1ee0a00640 1 -- 172.21.15.37:0/4137755205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc076100 msgr2=0x7f1edc10f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.747+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/4137755205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc076100 0x7f1edc10f9d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009900 tx=0x7f1ec802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:55:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.747+0000 7f1ee0a00640 1 -- 172.21.15.37:0/4137755205 shutdown_connections 2024-09-21T05:55:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.747+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/4137755205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1edc10ff10 0x7f1edc112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.747+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/4137755205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc076100 0x7f1edc10f9d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.747+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/4137755205 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1edc0757b0 0x7f1edc075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.747+0000 7f1ee0a00640 1 -- 172.21.15.37:0/4137755205 >> 172.21.15.37:0/4137755205 conn(0x7f1edc0ff440 msgr2=0x7f1edc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:49.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.747+0000 7f1ee0a00640 1 -- 172.21.15.37:0/4137755205 shutdown_connections 2024-09-21T05:55:49.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.747+0000 7f1ee0a00640 1 -- 172.21.15.37:0/4137755205 wait complete. 2024-09-21T05:55:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.749+0000 7f1ee0a00640 1 Processor -- start 2024-09-21T05:55:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.749+0000 7f1ee0a00640 1 -- start start 2024-09-21T05:55:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.749+0000 7f1ee0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1edc0757b0 0x7f1edc19c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.749+0000 7f1ee0a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1edc076100 0x7f1edc19caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.749+0000 7f1ee0a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10ff10 0x7f1edc1a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.749+0000 7f1ee0a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc115b10 con 0x7f1edc10ff10 2024-09-21T05:55:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.749+0000 7f1ee0a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc115990 con 0x7f1edc076100 2024-09-21T05:55:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.749+0000 7f1ee0a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc115c90 con 0x7f1edc0757b0 2024-09-21T05:55:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.750+0000 7f1edbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10ff10 0x7f1edc1a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.750+0000 7f1edb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1edc0757b0 0x7f1edc19c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.750+0000 7f1edb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1edc0757b0 0x7f1edc19c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:46974/0 (socket says 172.21.15.37:46974) 2024-09-21T05:55:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.750+0000 7f1edb400640 1 -- 172.21.15.37:0/1082591455 learned_addr learned my addr 172.21.15.37:0/1082591455 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.750+0000 7f1edaa00640 1 --2- 172.21.15.37:0/1082591455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1edc076100 0x7f1edc19caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.750+0000 7f1edbe00640 1 -- 172.21.15.37:0/1082591455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1edc0757b0 msgr2=0x7f1edc19c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.750+0000 7f1edbe00640 1 --2- 172.21.15.37:0/1082591455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1edc0757b0 0x7f1edc19c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.750+0000 7f1edbe00640 1 -- 172.21.15.37:0/1082591455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1edc076100 msgr2=0x7f1edc19caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.750+0000 7f1edbe00640 1 --2- 172.21.15.37:0/1082591455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1edc076100 0x7f1edc19caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.750+0000 7f1edbe00640 1 -- 172.21.15.37:0/1082591455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1edc1a2470 con 0x7f1edc10ff10 2024-09-21T05:55:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.750+0000 7f1edbe00640 1 --2- 172.21.15.37:0/1082591455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10ff10 0x7f1edc1a1d40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009fd0 tx=0x7f1ed400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.751+0000 7f1ed3e00640 1 -- 172.21.15.37:0/1082591455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed400ce20 con 0x7f1edc10ff10 2024-09-21T05:55:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.751+0000 7f1ee0a00640 1 -- 172.21.15.37:0/1082591455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1edc1a2760 con 0x7f1edc10ff10 2024-09-21T05:55:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.751+0000 7f1ed3e00640 1 -- 172.21.15.37:0/1082591455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ed4005020 con 0x7f1edc10ff10 2024-09-21T05:55:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.751+0000 7f1ed3e00640 1 -- 172.21.15.37:0/1082591455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4010690 con 0x7f1edc10ff10 2024-09-21T05:55:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.751+0000 7f1ee0a00640 1 -- 172.21.15.37:0/1082591455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1edc1a8ec0 con 0x7f1edc10ff10 2024-09-21T05:55:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.752+0000 7f1ee0a00640 1 -- 172.21.15.37:0/1082591455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1edc075bc0 con 0x7f1edc10ff10 2024-09-21T05:55:49.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.756+0000 7f1ed3e00640 1 -- 172.21.15.37:0/1082591455 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1ed40054d0 con 0x7f1edc10ff10 2024-09-21T05:55:49.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.758+0000 7f1ed3e00640 1 --2- 172.21.15.37:0/1082591455 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1ec00b6510 0x7f1ec00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:49.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.758+0000 7f1ed3e00640 1 -- 172.21.15.37:0/1082591455 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f1ed40e7d80 con 0x7f1edc10ff10 2024-09-21T05:55:49.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.758+0000 7f1edb400640 1 --2- 172.21.15.37:0/1082591455 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1ec00b6510 0x7f1ec00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:49.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.759+0000 7f1edb400640 1 --2- 172.21.15.37:0/1082591455 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1ec00b6510 0x7f1ec00b8a20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0095f0 tx=0x7f1ecc005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:49.760+0000 7f1ed3e00640 1 -- 172.21.15.37:0/1082591455 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ed40ae1e0 con 0x7f1edc10ff10 2024-09-21T05:55:49.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:49 smithi144 ceph-mon[34351]: pgmap v471: 129 pgs: 129 active+clean; 44 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 352 op/s 2024-09-21T05:55:50.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.004+0000 7f1ee0a00640 1 -- 172.21.15.37:0/1082591455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1edc19d630 con 0x7f1edc10ff10 2024-09-21T05:55:50.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.005+0000 7f1ed3e00640 1 -- 172.21.15.37:0/1082591455 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f1ed40b25c0 con 0x7f1edc10ff10 2024-09-21T05:55:50.008 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:55:50.008 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:55:50.008 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:55:50.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.008+0000 7f1ee0a00640 1 -- 172.21.15.37:0/1082591455 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1ec00b6510 msgr2=0x7f1ec00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:50.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.008+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/1082591455 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1ec00b6510 0x7f1ec00b8a20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0095f0 tx=0x7f1ecc005f90 comp rx=0 tx=0).stop 2024-09-21T05:55:50.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.008+0000 7f1ee0a00640 1 -- 172.21.15.37:0/1082591455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10ff10 msgr2=0x7f1edc1a1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:50.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.008+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/1082591455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10ff10 0x7f1edc1a1d40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009fd0 tx=0x7f1ed400ef10 comp rx=0 tx=0).stop 2024-09-21T05:55:50.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.008+0000 7f1ee0a00640 1 -- 172.21.15.37:0/1082591455 shutdown_connections 2024-09-21T05:55:50.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.008+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/1082591455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10ff10 0x7f1edc1a1d40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.008+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/1082591455 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1ec00b6510 0x7f1ec00b8a20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.008+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/1082591455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1edc076100 0x7f1edc19caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.008+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/1082591455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1edc0757b0 0x7f1edc19c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:50.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.008+0000 7f1ee0a00640 1 -- 172.21.15.37:0/1082591455 >> 172.21.15.37:0/1082591455 conn(0x7f1edc0ff440 msgr2=0x7f1edc109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:50.011 INFO:tasks.workunit.client.0.smithi037.stdout:libtoolize: putting auxiliary files in '.'. 2024-09-21T05:55:50.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.008+0000 7f1ee0a00640 1 -- 172.21.15.37:0/1082591455 shutdown_connections 2024-09-21T05:55:50.011 INFO:tasks.workunit.client.0.smithi037.stdout:libtoolize: copying file './config.guess' 2024-09-21T05:55:50.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:50.008+0000 7f1ee0a00640 1 -- 172.21.15.37:0/1082591455 wait complete. 2024-09-21T05:55:50.023 INFO:tasks.workunit.client.0.smithi037.stdout:libtoolize: copying file './config.sub' 2024-09-21T05:55:50.035 INFO:tasks.workunit.client.0.smithi037.stdout:libtoolize: copying file './install-sh' 2024-09-21T05:55:50.048 INFO:tasks.workunit.client.0.smithi037.stdout:libtoolize: copying file './ltmain.sh' 2024-09-21T05:55:50.111 INFO:tasks.workunit.client.0.smithi037.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-09-21T05:55:50.112 INFO:tasks.workunit.client.0.smithi037.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-09-21T05:55:50.126 INFO:tasks.workunit.client.0.smithi037.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-09-21T05:55:50.139 INFO:tasks.workunit.client.0.smithi037.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-09-21T05:55:50.154 INFO:tasks.workunit.client.0.smithi037.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-09-21T05:55:50.168 INFO:tasks.workunit.client.0.smithi037.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-09-21T05:55:50.184 INFO:tasks.workunit.client.0.smithi037.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-09-21T05:55:50.187 INFO:tasks.workunit.client.0.smithi037.stdout:cp include/install-sh . 2024-09-21T05:55:50.205 INFO:tasks.workunit.client.0.smithi037.stdout:aclocal -I m4 2024-09-21T05:55:50.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:50 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1082591455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:55:50.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:50 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1082591455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:55:50.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:50 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1082591455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:55:50.927 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T05:55:50.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T05:55:51.320 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:55:51.627 INFO:tasks.workunit.client.0.smithi037.stdout:autoheader 2024-09-21T05:55:51.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:51 smithi037 ceph-mon[30631]: pgmap v472: 129 pgs: 129 active+clean; 43 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 342 op/s 2024-09-21T05:55:51.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:51 smithi067 ceph-mon[34443]: pgmap v472: 129 pgs: 129 active+clean; 43 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 342 op/s 2024-09-21T05:55:51.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:51 smithi144 ceph-mon[34351]: pgmap v472: 129 pgs: 129 active+clean; 43 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 342 op/s 2024-09-21T05:55:52.043 INFO:tasks.workunit.client.0.smithi037.stdout:autoconf 2024-09-21T05:55:52.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.124+0000 7f1038600640 1 -- 172.21.15.37:0/3531050245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1030103b80 msgr2=0x7f1030103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.124+0000 7f1038600640 1 --2- 172.21.15.37:0/3531050245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1030103b80 0x7f1030103f90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1024009900 tx=0x7f102402a400 comp rx=0 tx=0).stop 2024-09-21T05:55:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.124+0000 7f1038600640 1 -- 172.21.15.37:0/3531050245 shutdown_connections 2024-09-21T05:55:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.124+0000 7f1038600640 1 --2- 172.21.15.37:0/3531050245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1030109e10 0x7f1030110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.124+0000 7f1038600640 1 --2- 172.21.15.37:0/3531050245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10301094c0 0x7f10301098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.124+0000 7f1038600640 1 --2- 172.21.15.37:0/3531050245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1030103b80 0x7f1030103f90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.124+0000 7f1038600640 1 -- 172.21.15.37:0/3531050245 >> 172.21.15.37:0/3531050245 conn(0x7f10300ff5b0 msgr2=0x7f1030101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.124+0000 7f1038600640 1 -- 172.21.15.37:0/3531050245 shutdown_connections 2024-09-21T05:55:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.124+0000 7f1038600640 1 -- 172.21.15.37:0/3531050245 wait complete. 2024-09-21T05:55:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.126+0000 7f1038600640 1 Processor -- start 2024-09-21T05:55:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.126+0000 7f1038600640 1 -- start start 2024-09-21T05:55:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.126+0000 7f1038600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1030103b80 0x7f103019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.126+0000 7f1038600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10301094c0 0x7f103019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.126+0000 7f1038600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1030109e10 0x7f103019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.126+0000 7f1038600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1030113ad0 con 0x7f10301094c0 2024-09-21T05:55:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.126+0000 7f1038600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1030113950 con 0x7f1030109e10 2024-09-21T05:55:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.126+0000 7f1038600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1030113c50 con 0x7f1030103b80 2024-09-21T05:55:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.127+0000 7f1035200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10301094c0 0x7f103019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.127+0000 7f1035200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10301094c0 0x7f103019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56584/0 (socket says 172.21.15.37:56584) 2024-09-21T05:55:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.127+0000 7f1035200640 1 -- 172.21.15.37:0/3802847292 learned_addr learned my addr 172.21.15.37:0/3802847292 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.127+0000 7f1035c00640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1030103b80 0x7f103019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.127+0000 7f1036600640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1030109e10 0x7f103019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.127+0000 7f1035c00640 1 -- 172.21.15.37:0/3802847292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1030109e10 msgr2=0x7f103019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.127+0000 7f1035c00640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1030109e10 0x7f103019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.127+0000 7f1035c00640 1 -- 172.21.15.37:0/3802847292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10301094c0 msgr2=0x7f103019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.127+0000 7f1035c00640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10301094c0 0x7f103019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.127+0000 7f1035c00640 1 -- 172.21.15.37:0/3802847292 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10301a0450 con 0x7f1030103b80 2024-09-21T05:55:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.127+0000 7f1035200640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10301094c0 0x7f103019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.128+0000 7f1035c00640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1030103b80 0x7f103019a4e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f102402a920 tx=0x7f1024031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:52.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.128+0000 7f102e000640 1 -- 172.21.15.37:0/3802847292 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102403f030 con 0x7f1030103b80 2024-09-21T05:55:52.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.128+0000 7f102e000640 1 -- 172.21.15.37:0/3802847292 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10240043d0 con 0x7f1030103b80 2024-09-21T05:55:52.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.128+0000 7f102e000640 1 -- 172.21.15.37:0/3802847292 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1024035070 con 0x7f1030103b80 2024-09-21T05:55:52.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.128+0000 7f1038600640 1 -- 172.21.15.37:0/3802847292 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10301a06e0 con 0x7f1030103b80 2024-09-21T05:55:52.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.128+0000 7f1038600640 1 -- 172.21.15.37:0/3802847292 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10300755f0 con 0x7f1030103b80 2024-09-21T05:55:52.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.131+0000 7f103f422740 1 Processor -- start 2024-09-21T05:55:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.132+0000 7f103f422740 1 -- start start 2024-09-21T05:55:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.132+0000 7f103f422740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f54224840 0x564f545cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.132+0000 7f103f422740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f541fb980 0x564f545cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.132+0000 7f103f422740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54203b60 0x564f545ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.132+0000 7f103f422740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564f54541ca0 con 0x564f54203b60 2024-09-21T05:55:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.132+0000 7f103f422740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564f545310d0 con 0x564f541fb980 2024-09-21T05:55:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.132+0000 7f103f422740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564f54534ee0 con 0x564f54224840 2024-09-21T05:55:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.133+0000 7f1036600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f54224840 0x564f545cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.133+0000 7f1036600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f54224840 0x564f545cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:38540/0 (socket says 172.21.15.37:38540) 2024-09-21T05:55:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.133+0000 7f1036600640 1 -- 172.21.15.37:0/664198916 learned_addr learned my addr 172.21.15.37:0/664198916 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.133+0000 7f1035200640 1 --2- 172.21.15.37:0/664198916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54203b60 0x564f545ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.133+0000 7f102e000640 1 -- 172.21.15.37:0/3802847292 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1024042030 con 0x7f1030103b80 2024-09-21T05:55:52.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.133+0000 7f1036600640 1 -- 172.21.15.37:0/664198916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f541fb980 msgr2=0x564f545cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:52.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.133+0000 7f1036600640 1 --2- 172.21.15.37:0/664198916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f541fb980 0x564f545cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.133+0000 7f1036600640 1 -- 172.21.15.37:0/664198916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54203b60 msgr2=0x564f545ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:52.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.133+0000 7f1036600640 1 --2- 172.21.15.37:0/664198916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54203b60 0x564f545ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.133+0000 7f1036600640 1 -- 172.21.15.37:0/664198916 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f544e3400 con 0x564f54224840 2024-09-21T05:55:52.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.133+0000 7f1035200640 1 --2- 172.21.15.37:0/664198916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54203b60 0x564f545ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:55:52.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.134+0000 7f1036600640 1 --2- 172.21.15.37:0/664198916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f54224840 0x564f545cc350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1028011440 tx=0x7f1028011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d875d5fb5e92fbb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:52.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.134+0000 7f1022a00640 1 -- 172.21.15.37:0/664198916 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028003c30 con 0x564f54224840 2024-09-21T05:55:52.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.134+0000 7f1022a00640 1 -- 172.21.15.37:0/664198916 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1028003dd0 con 0x564f54224840 2024-09-21T05:55:52.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.134+0000 7f1022a00640 1 -- 172.21.15.37:0/664198916 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102800fa20 con 0x564f54224840 2024-09-21T05:55:52.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.135+0000 7f102e000640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f10180b6590 0x7f10180b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.135+0000 7f103f422740 1 -- 172.21.15.37:0/664198916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f54224840 msgr2=0x564f545cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:52.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.135+0000 7f103f422740 1 --2- 172.21.15.37:0/664198916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f54224840 0x564f545cc350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1028011440 tx=0x7f1028011900 comp rx=0 tx=0).stop 2024-09-21T05:55:52.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.135+0000 7f102e000640 1 -- 172.21.15.37:0/3802847292 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f1024107610 con 0x7f1030103b80 2024-09-21T05:55:52.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.135+0000 7f103f422740 1 -- 172.21.15.37:0/664198916 shutdown_connections 2024-09-21T05:55:52.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.135+0000 7f103f422740 1 --2- 172.21.15.37:0/664198916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54203b60 0x564f545ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.135+0000 7f103f422740 1 --2- 172.21.15.37:0/664198916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f541fb980 0x564f545cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.135+0000 7f103f422740 1 --2- 172.21.15.37:0/664198916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f54224840 0x564f545cc350 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.135+0000 7f103f422740 1 -- 172.21.15.37:0/664198916 >> 172.21.15.37:0/664198916 conn(0x564f54218990 msgr2=0x564f545ca240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:52.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.135+0000 7f1035c00640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f10180b6590 0x7f10180b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.136+0000 7f103f422740 1 -- 172.21.15.37:0/664198916 shutdown_connections 2024-09-21T05:55:52.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.136+0000 7f103f422740 1 -- 172.21.15.37:0/664198916 wait complete. 2024-09-21T05:55:52.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.136+0000 7f1035c00640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f10180b6590 0x7f10180b8aa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f10240c9940 tx=0x7f1024000bc0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:52.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.136+0000 7f103f422740 1 -- start start 2024-09-21T05:55:52.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.137+0000 7f103f422740 1 Processor -- start 2024-09-21T05:55:52.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.137+0000 7f103f422740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f541fb980 0x564f545d79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.137+0000 7f103f422740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54203b60 0x564f545d7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.137+0000 7f103f422740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54224840 0x564f545e3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.137+0000 7f103f422740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564f543927a0 con 0x564f54224840 2024-09-21T05:55:52.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.137+0000 7f103f422740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564f544d6a10 con 0x564f54203b60 2024-09-21T05:55:52.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.137+0000 7f103f422740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564f545dab30 con 0x564f541fb980 2024-09-21T05:55:52.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.137+0000 7f103f422740 10 client.0 _ll_register_callbacks cb 0x564f544e6be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:52.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.138+0000 7f1035200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54203b60 0x564f545d7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.138+0000 7f1035200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54203b60 0x564f545d7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:48476/0 (socket says 172.21.15.37:48476) 2024-09-21T05:55:52.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.138+0000 7f1035200640 1 -- 172.21.15.37:0/317280404 learned_addr learned my addr 172.21.15.37:0/317280404 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:52.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.138+0000 7f1036600640 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54224840 0x564f545e3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.138+0000 7f1036600640 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f541fb980 0x564f545d79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.138+0000 7f1035200640 1 -- 172.21.15.37:0/317280404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f541fb980 msgr2=0x564f545d79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:52.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.138+0000 7f1035200640 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f541fb980 0x564f545d79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.138+0000 7f1035200640 1 -- 172.21.15.37:0/317280404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54224840 msgr2=0x564f545e3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:52.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.138+0000 7f1035200640 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54224840 0x564f545e3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.138+0000 7f1035200640 1 -- 172.21.15.37:0/317280404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f5429eb90 con 0x564f54203b60 2024-09-21T05:55:52.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.138+0000 7f1036600640 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f541fb980 0x564f545d79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:52.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.139+0000 7f1035200640 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54203b60 0x564f545d7f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f101c011c60 tx=0x7f101c00b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8866a6df7512f290 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:52.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.139+0000 7f1017400640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:55:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.139+0000 7f1017400640 1 -- 172.21.15.37:0/317280404 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c01b5f0 con 0x564f54203b60 2024-09-21T05:55:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.139+0000 7f103f422740 1 -- 172.21.15.37:0/317280404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1028003dd0 con 0x564f54203b60 2024-09-21T05:55:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.139+0000 7f1017400640 1 -- 172.21.15.37:0/317280404 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f101c01b790 con 0x564f54203b60 2024-09-21T05:55:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.140+0000 7f1017400640 1 -- 172.21.15.37:0/317280404 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f101c029050 con 0x564f54203b60 2024-09-21T05:55:52.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.140+0000 7f103f422740 10 client.25424 fetch_fsmap learned FSMap version 21 2024-09-21T05:55:52.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.140+0000 7f103f422740 1 -- 172.21.15.37:0/317280404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564f545e6920 con 0x564f54203b60 2024-09-21T05:55:52.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.140+0000 7f1017400640 1 -- 172.21.15.37:0/317280404 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1028003dd0 con 0x564f54203b60 2024-09-21T05:55:52.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.141+0000 7f1017400640 1 -- 172.21.15.37:0/317280404 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f101c0249d0 con 0x564f54203b60 2024-09-21T05:55:52.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.141+0000 7f103f422740 10 client.25424 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:55:52.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.141+0000 7f103f422740 10 client.25424 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:55:52.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.141+0000 7f103f422740 20 client.25424 populate_metadata read hostname 'smithi037' 2024-09-21T05:55:52.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.141+0000 7f103f422740 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x564f541e31c0 0x564f545e9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.141+0000 7f103f422740 4 client.25424 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:55:52.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.141+0000 7f103f422740 1 -- 172.21.15.37:0/317280404 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f54543bf0 con 0x564f541e31c0 2024-09-21T05:55:52.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.141+0000 7f1036600640 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x564f541e31c0 0x564f545e9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.142+0000 7f1036600640 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x564f541e31c0 0x564f545e9e60 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b774cc77cc6a5fe server_cookie=7180bf1b3103cb79 in_seq=0 out_seq=0 2024-09-21T05:55:52.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.142+0000 7f1017400640 10 client.25424 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:55:52.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.143+0000 7f1017400640 1 -- 172.21.15.37:0/317280404 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f54543bf0 con 0x564f541e31c0 2024-09-21T05:55:52.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.143+0000 7f1017400640 10 client.25424 handle_command_reply: tid=0 2024-09-21T05:55:52.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.143+0000 7f103f422740 1 client.25424 shutdown 2024-09-21T05:55:52.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.143+0000 7f103f422740 1 -- 172.21.15.37:0/317280404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54203b60 msgr2=0x564f545d7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:52.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.143+0000 7f103f422740 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54203b60 0x564f545d7f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f101c011c60 tx=0x7f101c00b690 comp rx=0 tx=0).stop 2024-09-21T05:55:52.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.143+0000 7f103f422740 1 -- 172.21.15.37:0/317280404 shutdown_connections 2024-09-21T05:55:52.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.143+0000 7f103f422740 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x564f541e31c0 0x564f545e9e60 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.143+0000 7f103f422740 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54224840 0x564f545e3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.143+0000 7f103f422740 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54203b60 0x564f545d7f20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.143+0000 7f103f422740 1 --2- 172.21.15.37:0/317280404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f541fb980 0x564f545d79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.143+0000 7f1017400640 0 client.25424 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:55:52.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.143+0000 7f103f422740 1 -- 172.21.15.37:0/317280404 >> 172.21.15.37:0/317280404 conn(0x564f54218990 msgr2=0x564f545cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:52.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.143+0000 7f103f422740 1 -- 172.21.15.37:0/317280404 shutdown_connections 2024-09-21T05:55:52.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.144+0000 7f103f422740 1 -- 172.21.15.37:0/317280404 wait complete. 2024-09-21T05:55:52.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.144+0000 7f103f422740 20 client.25424 trim_cache size 0 max 16384 2024-09-21T05:55:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.162+0000 7f103f422740 1 Processor -- start 2024-09-21T05:55:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.163+0000 7f103f422740 1 -- start start 2024-09-21T05:55:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.163+0000 7f103f422740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f541fb980 0x564f545d4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.163+0000 7f103f422740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54203b60 0x564f545d5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.163+0000 7f103f422740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54224840 0x564f545ef620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.163+0000 7f103f422740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10301aca60 con 0x564f54203b60 2024-09-21T05:55:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.163+0000 7f103f422740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f10301af2e0 con 0x564f54224840 2024-09-21T05:55:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.163+0000 7f103f422740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10301ad0d0 con 0x564f541fb980 2024-09-21T05:55:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.163+0000 7f1036600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54224840 0x564f545ef620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.163+0000 7f1035200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54203b60 0x564f545d5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.163+0000 7f1036600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54224840 0x564f545ef620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:48492/0 (socket says 172.21.15.37:48492) 2024-09-21T05:55:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.163+0000 7f1035200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54203b60 0x564f545d5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56614/0 (socket says 172.21.15.37:56614) 2024-09-21T05:55:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.163+0000 7f1036600640 1 -- 172.21.15.37:0/3565382880 learned_addr learned my addr 172.21.15.37:0/3565382880 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.163+0000 7f1036600640 1 --2- 172.21.15.37:0/3565382880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f541fb980 0x564f545d4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.164+0000 7f1036600640 1 -- 172.21.15.37:0/3565382880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f541fb980 msgr2=0x564f545d4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.164+0000 7f1036600640 1 --2- 172.21.15.37:0/3565382880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f541fb980 0x564f545d4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.164+0000 7f1036600640 1 -- 172.21.15.37:0/3565382880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54203b60 msgr2=0x564f545d5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.164+0000 7f1036600640 1 --2- 172.21.15.37:0/3565382880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54203b60 0x564f545d5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.164+0000 7f1036600640 1 -- 172.21.15.37:0/3565382880 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f545c5c50 con 0x564f54224840 2024-09-21T05:55:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.164+0000 7f1035200640 1 --2- 172.21.15.37:0/3565382880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54203b60 0x564f545d5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:55:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.164+0000 7f1036600640 1 --2- 172.21.15.37:0/3565382880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54224840 0x564f545ef620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f102800f650 tx=0x7f102800f5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbd22688d47a0c73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.165+0000 7f1022000640 1 -- 172.21.15.37:0/3565382880 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102800fa80 con 0x564f54224840 2024-09-21T05:55:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.165+0000 7f1022000640 1 -- 172.21.15.37:0/3565382880 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f102800fc20 con 0x564f54224840 2024-09-21T05:55:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.165+0000 7f1022000640 1 -- 172.21.15.37:0/3565382880 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028028dc0 con 0x564f54224840 2024-09-21T05:55:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.166+0000 7f103f422740 1 -- 172.21.15.37:0/3565382880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54224840 msgr2=0x564f545ef620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.166+0000 7f103f422740 1 --2- 172.21.15.37:0/3565382880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54224840 0x564f545ef620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f102800f650 tx=0x7f102800f5e0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.166+0000 7f103f422740 1 -- 172.21.15.37:0/3565382880 shutdown_connections 2024-09-21T05:55:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.166+0000 7f103f422740 1 --2- 172.21.15.37:0/3565382880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54224840 0x564f545ef620 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.166+0000 7f103f422740 1 --2- 172.21.15.37:0/3565382880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f54203b60 0x564f545d5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.166+0000 7f103f422740 1 --2- 172.21.15.37:0/3565382880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f541fb980 0x564f545d4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.166+0000 7f103f422740 1 -- 172.21.15.37:0/3565382880 >> 172.21.15.37:0/3565382880 conn(0x564f54218990 msgr2=0x564f545d8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.166+0000 7f103f422740 1 -- 172.21.15.37:0/3565382880 shutdown_connections 2024-09-21T05:55:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.166+0000 7f103f422740 1 -- 172.21.15.37:0/3565382880 wait complete. 2024-09-21T05:55:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.166+0000 7f103f422740 1 -- start start 2024-09-21T05:55:52.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.167+0000 7f103f422740 1 Processor -- start 2024-09-21T05:55:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.167+0000 7f103f422740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f541fb980 0x564f545dc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.167+0000 7f103f422740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f54203b60 0x564f545dcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.167+0000 7f103f422740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54224840 0x564f54653820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.167+0000 7f103f422740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10301ad7a0 con 0x564f541fb980 2024-09-21T05:55:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.167+0000 7f103f422740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f10301aec10 con 0x564f54224840 2024-09-21T05:55:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.167+0000 7f103f422740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10301ade70 con 0x564f54203b60 2024-09-21T05:55:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.167+0000 7f103f422740 10 client.0 _ll_register_callbacks cb 0x7f101c009470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:55:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.167+0000 7f1036600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f541fb980 0x564f545dc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.167+0000 7f1036600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f541fb980 0x564f545dc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56628/0 (socket says 172.21.15.37:56628) 2024-09-21T05:55:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.167+0000 7f1036600640 1 -- 172.21.15.37:0/2652147184 learned_addr learned my addr 172.21.15.37:0/2652147184 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:55:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.168+0000 7f1035200640 1 --2- 172.21.15.37:0/2652147184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f54203b60 0x564f545dcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.168+0000 7f1036600640 1 --2- 172.21.15.37:0/2652147184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54224840 0x564f54653820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.168+0000 7f1035200640 1 -- 172.21.15.37:0/2652147184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54224840 msgr2=0x564f54653820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.168+0000 7f1035200640 1 --2- 172.21.15.37:0/2652147184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54224840 0x564f54653820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.168+0000 7f1035200640 1 -- 172.21.15.37:0/2652147184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f541fb980 msgr2=0x564f545dc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:55:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.168+0000 7f1035200640 1 --2- 172.21.15.37:0/2652147184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f541fb980 0x564f545dc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.168+0000 7f1035200640 1 -- 172.21.15.37:0/2652147184 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f54653e90 con 0x564f54203b60 2024-09-21T05:55:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.168+0000 7f1035200640 1 --2- 172.21.15.37:0/2652147184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f54203b60 0x564f545dcbd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f101c024dc0 tx=0x7f101c0235a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53a277c550420bfa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:55:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.168+0000 7f1017400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T05:55:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.169+0000 7f1017400640 1 -- 172.21.15.37:0/2652147184 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c005450 con 0x564f54203b60 2024-09-21T05:55:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.169+0000 7f103f422740 1 -- 172.21.15.37:0/2652147184 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f102800fc20 con 0x564f54203b60 2024-09-21T05:55:52.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.169+0000 7f1017400640 1 -- 172.21.15.37:0/2652147184 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f101c0055f0 con 0x564f54203b60 2024-09-21T05:55:52.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.169+0000 7f1017400640 1 -- 172.21.15.37:0/2652147184 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f101c00bb90 con 0x564f54203b60 2024-09-21T05:55:52.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.169+0000 7f103f422740 10 client.25453 fetch_fsmap learned FSMap version 21 2024-09-21T05:55:52.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.169+0000 7f103f422740 1 -- 172.21.15.37:0/2652147184 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564f546550d0 con 0x564f54203b60 2024-09-21T05:55:52.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.170+0000 7f1017400640 1 -- 172.21.15.37:0/2652147184 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f102800fc20 con 0x564f54203b60 2024-09-21T05:55:52.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.170+0000 7f1017400640 1 -- 172.21.15.37:0/2652147184 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f101c023a50 con 0x564f54203b60 2024-09-21T05:55:52.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.170+0000 7f103f422740 10 client.25453 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:55:52.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.170+0000 7f103f422740 10 client.25453 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:55:52.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.170+0000 7f103f422740 20 client.25453 populate_metadata read hostname 'smithi037' 2024-09-21T05:55:52.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.170+0000 7f103f422740 1 --2- 172.21.15.37:0/2652147184 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x564f541b8570 0x564f546578a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:55:52.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.170+0000 7f103f422740 4 client.25453 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T05:55:52.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.170+0000 7f103f422740 1 -- 172.21.15.37:0/2652147184 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x564f5453f6a0 con 0x564f541b8570 2024-09-21T05:55:52.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.170+0000 7f1036600640 1 --2- 172.21.15.37:0/2652147184 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x564f541b8570 0x564f546578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:55:52.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.171+0000 7f1036600640 1 --2- 172.21.15.37:0/2652147184 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x564f541b8570 0x564f546578a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7281021a1d5fa736 server_cookie=fa63c0a76c6f39e4 in_seq=0 out_seq=0 2024-09-21T05:55:52.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:52.171+0000 7f1017400640 10 client.25453 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:55:53.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:53 smithi037 ceph-mon[30631]: pgmap v473: 129 pgs: 129 active+clean; 48 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 306 op/s 2024-09-21T05:55:53.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:53 smithi067 ceph-mon[34443]: pgmap v473: 129 pgs: 129 active+clean; 48 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 306 op/s 2024-09-21T05:55:53.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:53 smithi144 ceph-mon[34351]: pgmap v473: 129 pgs: 129 active+clean; 48 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 306 op/s 2024-09-21T05:55:55.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:55 smithi037 ceph-mon[30631]: pgmap v474: 129 pgs: 129 active+clean; 48 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 240 op/s 2024-09-21T05:55:55.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:55 smithi067 ceph-mon[34443]: pgmap v474: 129 pgs: 129 active+clean; 48 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 240 op/s 2024-09-21T05:55:55.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:55 smithi144 ceph-mon[34351]: pgmap v474: 129 pgs: 129 active+clean; 48 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 240 op/s 2024-09-21T05:55:57.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:57 smithi037 ceph-mon[30631]: pgmap v475: 129 pgs: 129 active+clean; 51 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 347 op/s 2024-09-21T05:55:57.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:57 smithi067 ceph-mon[34443]: pgmap v475: 129 pgs: 129 active+clean; 51 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 347 op/s 2024-09-21T05:55:57.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:57 smithi144 ceph-mon[34351]: pgmap v475: 129 pgs: 129 active+clean; 51 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 347 op/s 2024-09-21T05:55:58.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.489+0000 7f1017400640 1 -- 172.21.15.37:0/2652147184 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564f5453f6a0 con 0x564f541b8570 2024-09-21T05:55:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.489+0000 7f1017400640 10 client.25453 handle_command_reply: tid=0 2024-09-21T05:55:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.489+0000 7f103f422740 1 client.25453 shutdown 2024-09-21T05:55:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.490+0000 7f103f422740 1 -- 172.21.15.37:0/2652147184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f54203b60 msgr2=0x564f545dcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.490+0000 7f103f422740 1 --2- 172.21.15.37:0/2652147184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f54203b60 0x564f545dcbd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f101c024dc0 tx=0x7f101c0235a0 comp rx=0 tx=0).stop 2024-09-21T05:55:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.490+0000 7f103f422740 1 -- 172.21.15.37:0/2652147184 shutdown_connections 2024-09-21T05:55:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.490+0000 7f103f422740 1 --2- 172.21.15.37:0/2652147184 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x564f541b8570 0x564f546578a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.490+0000 7f103f422740 1 --2- 172.21.15.37:0/2652147184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564f54224840 0x564f54653820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.490+0000 7f103f422740 1 --2- 172.21.15.37:0/2652147184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f54203b60 0x564f545dcbd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.490+0000 7f1017400640 0 client.25453 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:55:58.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.490+0000 7f103f422740 1 --2- 172.21.15.37:0/2652147184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f541fb980 0x564f545dc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:58.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.490+0000 7f103f422740 1 -- 172.21.15.37:0/2652147184 >> 172.21.15.37:0/2652147184 conn(0x564f54218990 msgr2=0x564f545c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:58.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.490+0000 7f103f422740 1 -- 172.21.15.37:0/2652147184 shutdown_connections 2024-09-21T05:55:58.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.490+0000 7f103f422740 1 -- 172.21.15.37:0/2652147184 wait complete. 2024-09-21T05:55:58.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.490+0000 7f103f422740 20 client.25453 trim_cache size 0 max 16384 2024-09-21T05:55:58.494 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:55:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:55:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:55:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 10, 2024-09-21T05:55:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:55:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "ea0aa72d": { 2024-09-21T05:55:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 10, 2024-09-21T05:55:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:55:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:55:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:55:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:55:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:55:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:55:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 147.8, 2024-09-21T05:55:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:55:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:55:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:55:58.495 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:55:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:55:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:55:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:55:58.496 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:55:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.491+0000 7f1038600640 1 -- 172.21.15.37:0/3802847292 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f10180b6590 msgr2=0x7f10180b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.491+0000 7f1038600640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f10180b6590 0x7f10180b8aa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f10240c9940 tx=0x7f1024000bc0 comp rx=0 tx=0).stop 2024-09-21T05:55:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.491+0000 7f1038600640 1 -- 172.21.15.37:0/3802847292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1030103b80 msgr2=0x7f103019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:55:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.491+0000 7f1038600640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1030103b80 0x7f103019a4e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f102402a920 tx=0x7f1024031a20 comp rx=0 tx=0).stop 2024-09-21T05:55:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.491+0000 7f1038600640 1 -- 172.21.15.37:0/3802847292 shutdown_connections 2024-09-21T05:55:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.491+0000 7f1038600640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f10180b6590 0x7f10180b8aa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.491+0000 7f1038600640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1030109e10 0x7f103019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.491+0000 7f1038600640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10301094c0 0x7f103019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.491+0000 7f1038600640 1 --2- 172.21.15.37:0/3802847292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1030103b80 0x7f103019a4e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:55:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.491+0000 7f1038600640 1 -- 172.21.15.37:0/3802847292 >> 172.21.15.37:0/3802847292 conn(0x7f10300ff5b0 msgr2=0x7f1030108ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:55:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.492+0000 7f1038600640 1 -- 172.21.15.37:0/3802847292 shutdown_connections 2024-09-21T05:55:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:55:58.492+0000 7f1038600640 1 -- 172.21.15.37:0/3802847292 wait complete. 2024-09-21T05:55:58.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:58 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:55:58.859 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:58 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:55:58.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:58 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:55:59.349 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ea0aa72d', quiesce took 10.7 seconds. Will release after: 17.1 2024-09-21T05:55:59.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:59 smithi037 ceph-mon[30631]: pgmap v476: 129 pgs: 129 active+clean; 57 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 468 op/s 2024-09-21T05:55:59.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:59 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:55:59.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:59 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:55:59.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:55:59 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:55:59.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:59 smithi067 ceph-mon[34443]: pgmap v476: 129 pgs: 129 active+clean; 57 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 468 op/s 2024-09-21T05:55:59.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:59 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:55:59.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:59 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:55:59.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:55:59 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:55:59.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:59 smithi144 ceph-mon[34351]: pgmap v476: 129 pgs: 129 active+clean; 57 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 468 op/s 2024-09-21T05:55:59.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:59 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:55:59.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:59 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:55:59.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:55:59 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:56:01.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:01 smithi067 ceph-mon[34443]: pgmap v477: 129 pgs: 129 active+clean; 60 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.7 MiB/s wr, 463 op/s 2024-09-21T05:56:01.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:01 smithi144 ceph-mon[34351]: pgmap v477: 129 pgs: 129 active+clean; 60 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.7 MiB/s wr, 463 op/s 2024-09-21T05:56:01.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:01 smithi037 ceph-mon[30631]: pgmap v477: 129 pgs: 129 active+clean; 60 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.7 MiB/s wr, 463 op/s 2024-09-21T05:56:03.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:03 smithi067 ceph-mon[34443]: pgmap v478: 129 pgs: 129 active+clean; 64 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 455 op/s 2024-09-21T05:56:03.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:03 smithi144 ceph-mon[34351]: pgmap v478: 129 pgs: 129 active+clean; 64 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 455 op/s 2024-09-21T05:56:03.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:03 smithi037 ceph-mon[30631]: pgmap v478: 129 pgs: 129 active+clean; 64 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 455 op/s 2024-09-21T05:56:05.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:05 smithi067 ceph-mon[34443]: pgmap v479: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.7 MiB/s wr, 428 op/s 2024-09-21T05:56:05.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:05 smithi144 ceph-mon[34351]: pgmap v479: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.7 MiB/s wr, 428 op/s 2024-09-21T05:56:05.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:05 smithi037 ceph-mon[30631]: pgmap v479: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.7 MiB/s wr, 428 op/s 2024-09-21T05:56:07.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:07 smithi067 ceph-mon[34443]: pgmap v480: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1.7 MiB/s wr, 430 op/s 2024-09-21T05:56:07.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:07 smithi144 ceph-mon[34351]: pgmap v480: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1.7 MiB/s wr, 430 op/s 2024-09-21T05:56:07.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:07 smithi037 ceph-mon[30631]: pgmap v480: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1.7 MiB/s wr, 430 op/s 2024-09-21T05:56:09.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:09 smithi067 ceph-mon[34443]: pgmap v481: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 1.3 MiB/s wr, 299 op/s 2024-09-21T05:56:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:09 smithi144 ceph-mon[34351]: pgmap v481: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 1.3 MiB/s wr, 299 op/s 2024-09-21T05:56:09.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:09 smithi037 ceph-mon[30631]: pgmap v481: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 1.3 MiB/s wr, 299 op/s 2024-09-21T05:56:11.716 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:11 smithi037 ceph-mon[30631]: pgmap v482: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 675 KiB/s wr, 70 op/s 2024-09-21T05:56:11.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:11 smithi067 ceph-mon[34443]: pgmap v482: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 675 KiB/s wr, 70 op/s 2024-09-21T05:56:11.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:11 smithi144 ceph-mon[34351]: pgmap v482: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 675 KiB/s wr, 70 op/s 2024-09-21T05:56:13.466 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:13 smithi037 ceph-mon[30631]: pgmap v483: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 417 KiB/s wr, 29 op/s 2024-09-21T05:56:13.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:13 smithi067 ceph-mon[34443]: pgmap v483: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 417 KiB/s wr, 29 op/s 2024-09-21T05:56:13.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:13 smithi144 ceph-mon[34351]: pgmap v483: 129 pgs: 129 active+clean; 64 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 417 KiB/s wr, 29 op/s 2024-09-21T05:56:15.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:15 smithi067 ceph-mon[34443]: pgmap v484: 129 pgs: 129 active+clean; 65 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-09-21T05:56:15.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:15 smithi144 ceph-mon[34351]: pgmap v484: 129 pgs: 129 active+clean; 65 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-09-21T05:56:15.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:15 smithi037 ceph-mon[30631]: pgmap v484: 129 pgs: 129 active+clean; 65 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-09-21T05:56:16.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:56:16.832 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:56:17.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.493+0000 7f17bb200640 1 -- 172.21.15.37:0/10680190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b4103b60 msgr2=0x7f17b4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:17.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.493+0000 7f17bb200640 1 --2- 172.21.15.37:0/10680190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b4103b60 0x7f17b4103f70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009900 tx=0x7f17a402a3f0 comp rx=0 tx=0).stop 2024-09-21T05:56:17.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.493+0000 7f17bb200640 1 -- 172.21.15.37:0/10680190 shutdown_connections 2024-09-21T05:56:17.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.493+0000 7f17bb200640 1 --2- 172.21.15.37:0/10680190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b4109df0 0x7f17b4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:17.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.493+0000 7f17bb200640 1 --2- 172.21.15.37:0/10680190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17b41094a0 0x7f17b41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:17.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.493+0000 7f17bb200640 1 --2- 172.21.15.37:0/10680190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b4103b60 0x7f17b4103f70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:17.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.493+0000 7f17bb200640 1 -- 172.21.15.37:0/10680190 >> 172.21.15.37:0/10680190 conn(0x7f17b407b850 msgr2=0x7f17b407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:17.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.493+0000 7f17bb200640 1 -- 172.21.15.37:0/10680190 shutdown_connections 2024-09-21T05:56:17.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.493+0000 7f17bb200640 1 -- 172.21.15.37:0/10680190 wait complete. 2024-09-21T05:56:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.494+0000 7f17bb200640 1 Processor -- start 2024-09-21T05:56:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.495+0000 7f17bb200640 1 -- start start 2024-09-21T05:56:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.495+0000 7f17bb200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b4103b60 0x7f17b419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.495+0000 7f17bb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17b41094a0 0x7f17b419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.495+0000 7f17bb200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b4109df0 0x7f17b419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.495+0000 7f17bb200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f17b4113b00 con 0x7f17b4109df0 2024-09-21T05:56:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.495+0000 7f17bb200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f17b4113980 con 0x7f17b4103b60 2024-09-21T05:56:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.495+0000 7f17bb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f17b4113c80 con 0x7f17b41094a0 2024-09-21T05:56:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.495+0000 7f17b9200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b4109df0 0x7f17b419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.495+0000 7f17b3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b4103b60 0x7f17b419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.495+0000 7f17b9200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b4109df0 0x7f17b419fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38882/0 (socket says 172.21.15.37:38882) 2024-09-21T05:56:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.495+0000 7f17b9200640 1 -- 172.21.15.37:0/1300529581 learned_addr learned my addr 172.21.15.37:0/1300529581 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.495+0000 7f17ab400640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17b41094a0 0x7f17b419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.496+0000 7f17b3e00640 1 -- 172.21.15.37:0/1300529581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17b41094a0 msgr2=0x7f17b419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.496+0000 7f17b3e00640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17b41094a0 0x7f17b419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.496+0000 7f17b3e00640 1 -- 172.21.15.37:0/1300529581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b4109df0 msgr2=0x7f17b419fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.496+0000 7f17b3e00640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b4109df0 0x7f17b419fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.496+0000 7f17b3e00640 1 -- 172.21.15.37:0/1300529581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b41a04e0 con 0x7f17b4103b60 2024-09-21T05:56:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.496+0000 7f17ab400640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17b41094a0 0x7f17b419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:17.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.496+0000 7f17b9200640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b4109df0 0x7f17b419fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:17.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.496+0000 7f17b3e00640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b4103b60 0x7f17b419a570 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f17a402a9e0 tx=0x7f17a4003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:17.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.497+0000 7f17b1600640 1 -- 172.21.15.37:0/1300529581 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a403f070 con 0x7f17b4103b60 2024-09-21T05:56:17.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.497+0000 7f17bb200640 1 -- 172.21.15.37:0/1300529581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b41a0770 con 0x7f17b4103b60 2024-09-21T05:56:17.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.497+0000 7f17b1600640 1 -- 172.21.15.37:0/1300529581 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17a4031b50 con 0x7f17b4103b60 2024-09-21T05:56:17.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.497+0000 7f17b1600640 1 -- 172.21.15.37:0/1300529581 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4035030 con 0x7f17b4103b60 2024-09-21T05:56:17.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.497+0000 7f17bb200640 1 -- 172.21.15.37:0/1300529581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b41a6f30 con 0x7f17b4103b60 2024-09-21T05:56:17.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.498+0000 7f17bb200640 1 -- 172.21.15.37:0/1300529581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b4103f70 con 0x7f17b4103b60 2024-09-21T05:56:17.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.500+0000 7f17b1600640 1 -- 172.21.15.37:0/1300529581 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f17a4042070 con 0x7f17b4103b60 2024-09-21T05:56:17.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.502+0000 7f17b1600640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f17980b6510 0x7f17980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:17.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.502+0000 7f17b1600640 1 -- 172.21.15.37:0/1300529581 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f17a4107bc0 con 0x7f17b4103b60 2024-09-21T05:56:17.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.502+0000 7f17ab400640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f17980b6510 0x7f17980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:17.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.503+0000 7f17ab400640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f17980b6510 0x7f17980b8a20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f17b41091c0 tx=0x7f179c005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:17.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.504+0000 7f17b1600640 1 -- 172.21.15.37:0/1300529581 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f17a4031d00 con 0x7f17b4103b60 2024-09-21T05:56:17.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:17 smithi037 ceph-mon[30631]: pgmap v485: 129 pgs: 129 active+clean; 66 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 216 KiB/s wr, 67 op/s 2024-09-21T05:56:17.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:17 smithi067 ceph-mon[34443]: pgmap v485: 129 pgs: 129 active+clean; 66 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 216 KiB/s wr, 67 op/s 2024-09-21T05:56:17.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.750+0000 7f17bb200640 1 -- 172.21.15.37:0/1300529581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17b410bbc0 con 0x7f17b4103b60 2024-09-21T05:56:17.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.751+0000 7f17b1600640 1 -- 172.21.15.37:0/1300529581 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f17a40d2400 con 0x7f17b4103b60 2024-09-21T05:56:17.754 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:56:17.754 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:56:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:56:17.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.754+0000 7f17bb200640 1 -- 172.21.15.37:0/1300529581 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f17980b6510 msgr2=0x7f17980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:17.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.754+0000 7f17bb200640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f17980b6510 0x7f17980b8a20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f17b41091c0 tx=0x7f179c005f90 comp rx=0 tx=0).stop 2024-09-21T05:56:17.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.754+0000 7f17bb200640 1 -- 172.21.15.37:0/1300529581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b4103b60 msgr2=0x7f17b419a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:17.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.754+0000 7f17bb200640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b4103b60 0x7f17b419a570 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f17a402a9e0 tx=0x7f17a4003b90 comp rx=0 tx=0).stop 2024-09-21T05:56:17.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.754+0000 7f17bb200640 1 -- 172.21.15.37:0/1300529581 shutdown_connections 2024-09-21T05:56:17.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.754+0000 7f17bb200640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b4109df0 0x7f17b419fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:17.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.754+0000 7f17bb200640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17b41094a0 0x7f17b419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:17.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.754+0000 7f17bb200640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f17980b6510 0x7f17980b8a20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:17.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.754+0000 7f17bb200640 1 --2- 172.21.15.37:0/1300529581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b4103b60 0x7f17b419a570 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:17.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.754+0000 7f17bb200640 1 -- 172.21.15.37:0/1300529581 >> 172.21.15.37:0/1300529581 conn(0x7f17b407b850 msgr2=0x7f17b41075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:17.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.754+0000 7f17bb200640 1 -- 172.21.15.37:0/1300529581 shutdown_connections 2024-09-21T05:56:17.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:17.754+0000 7f17bb200640 1 -- 172.21.15.37:0/1300529581 wait complete. 2024-09-21T05:56:17.875 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:17 smithi144 ceph-mon[34351]: pgmap v485: 129 pgs: 129 active+clean; 66 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 216 KiB/s wr, 67 op/s 2024-09-21T05:56:18.608 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db --set-id ea0aa72d --release --await' 2024-09-21T05:56:18.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db --set-id ea0aa72d --release --await 2024-09-21T05:56:18.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:18 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1300529581' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:56:18.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:18 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1300529581' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:56:18.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:18 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1300529581' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:56:18.989 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:56:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.593+0000 7fa615600640 1 -- 172.21.15.37:0/531523351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6100760a0 msgr2=0x7fa61010fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.593+0000 7fa615600640 1 --2- 172.21.15.37:0/531523351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6100760a0 0x7fa61010fa10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009900 tx=0x7fa5fc02a410 comp rx=0 tx=0).stop 2024-09-21T05:56:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.593+0000 7fa615600640 1 -- 172.21.15.37:0/531523351 shutdown_connections 2024-09-21T05:56:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.593+0000 7fa615600640 1 --2- 172.21.15.37:0/531523351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa61010ff50 0x7fa610112370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.593+0000 7fa615600640 1 --2- 172.21.15.37:0/531523351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6100760a0 0x7fa61010fa10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.593+0000 7fa615600640 1 --2- 172.21.15.37:0/531523351 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa610075750 0x7fa610075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.593+0000 7fa615600640 1 -- 172.21.15.37:0/531523351 >> 172.21.15.37:0/531523351 conn(0x7fa6100ff3e0 msgr2=0x7fa610101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:19.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.593+0000 7fa615600640 1 -- 172.21.15.37:0/531523351 shutdown_connections 2024-09-21T05:56:19.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.593+0000 7fa615600640 1 -- 172.21.15.37:0/531523351 wait complete. 2024-09-21T05:56:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.594+0000 7fa615600640 1 Processor -- start 2024-09-21T05:56:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.595+0000 7fa615600640 1 -- start start 2024-09-21T05:56:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.595+0000 7fa615600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa610075750 0x7fa61019c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.595+0000 7fa615600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6100760a0 0x7fa61019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.595+0000 7fa615600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa61010ff50 0x7fa6101a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.595+0000 7fa615600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa610115ac0 con 0x7fa610075750 2024-09-21T05:56:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.595+0000 7fa615600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa610115940 con 0x7fa61010ff50 2024-09-21T05:56:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.595+0000 7fa615600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa610115c40 con 0x7fa6100760a0 2024-09-21T05:56:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.595+0000 7fa60fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa610075750 0x7fa61019c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.595+0000 7fa60fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa610075750 0x7fa61019c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38910/0 (socket says 172.21.15.37:38910) 2024-09-21T05:56:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.595+0000 7fa60fe00640 1 -- 172.21.15.37:0/872640011 learned_addr learned my addr 172.21.15.37:0/872640011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.595+0000 7fa60f400640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6100760a0 0x7fa61019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.595+0000 7fa614c00640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa61010ff50 0x7fa6101a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.596+0000 7fa60fe00640 1 -- 172.21.15.37:0/872640011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6100760a0 msgr2=0x7fa61019ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.596+0000 7fa60fe00640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6100760a0 0x7fa61019ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.596+0000 7fa60fe00640 1 -- 172.21.15.37:0/872640011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa61010ff50 msgr2=0x7fa6101a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.596+0000 7fa60fe00640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa61010ff50 0x7fa6101a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.596+0000 7fa60fe00640 1 -- 172.21.15.37:0/872640011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6101a2460 con 0x7fa610075750 2024-09-21T05:56:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.596+0000 7fa614c00640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa61010ff50 0x7fa6101a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.596+0000 7fa60fe00640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa610075750 0x7fa61019c4f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa60000e9f0 tx=0x7fa60000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.597+0000 7fa60cc00640 1 -- 172.21.15.37:0/872640011 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60000cd80 con 0x7fa610075750 2024-09-21T05:56:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.597+0000 7fa615600640 1 -- 172.21.15.37:0/872640011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6101a2750 con 0x7fa610075750 2024-09-21T05:56:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.597+0000 7fa60cc00640 1 -- 172.21.15.37:0/872640011 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6000108e0 con 0x7fa610075750 2024-09-21T05:56:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.597+0000 7fa60cc00640 1 -- 172.21.15.37:0/872640011 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600018980 con 0x7fa610075750 2024-09-21T05:56:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.597+0000 7fa615600640 1 -- 172.21.15.37:0/872640011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6101a8eb0 con 0x7fa610075750 2024-09-21T05:56:19.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.600+0000 7fa61d8a1740 1 Processor -- start 2024-09-21T05:56:19.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.600+0000 7fa61d8a1740 1 -- start start 2024-09-21T05:56:19.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.600+0000 7fa61d8a1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7737b520 0x561b77722340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa60cc00640 1 -- 172.21.15.37:0/872640011 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa600018b20 con 0x7fa610075750 2024-09-21T05:56:19.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa61d8a1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b77352660 0x561b77722880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa61d8a1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7735a840 0x561b77722dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa61d8a1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561b77699290 con 0x561b7737b520 2024-09-21T05:56:19.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa61d8a1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561b776886c0 con 0x561b7735a840 2024-09-21T05:56:19.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa61d8a1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561b7768c4d0 con 0x561b77352660 2024-09-21T05:56:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa614c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7737b520 0x561b77722340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa60fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b77352660 0x561b77722880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa60f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7735a840 0x561b77722dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa614c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7737b520 0x561b77722340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38916/0 (socket says 172.21.15.37:38916) 2024-09-21T05:56:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa614c00640 1 -- 172.21.15.37:0/2404750630 learned_addr learned my addr 172.21.15.37:0/2404750630 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa614c00640 1 -- 172.21.15.37:0/2404750630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b77352660 msgr2=0x561b77722880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa614c00640 1 --2- 172.21.15.37:0/2404750630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b77352660 0x561b77722880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa614c00640 1 -- 172.21.15.37:0/2404750630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7735a840 msgr2=0x561b77722dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:19.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.601+0000 7fa614c00640 1 --2- 172.21.15.37:0/2404750630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7735a840 0x561b77722dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.602+0000 7fa614c00640 1 -- 172.21.15.37:0/2404750630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b77615460 con 0x561b7737b520 2024-09-21T05:56:19.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.602+0000 7fa614c00640 1 --2- 172.21.15.37:0/2404750630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7737b520 0x561b77722340 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa6080117e0 tx=0x7fa608011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8983d3f935960993 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.602+0000 7fa605200640 1 -- 172.21.15.37:0/2404750630 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa608011310 con 0x561b7737b520 2024-09-21T05:56:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.602+0000 7fa605200640 1 -- 172.21.15.37:0/2404750630 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa608003e20 con 0x561b7737b520 2024-09-21T05:56:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.602+0000 7fa605200640 1 -- 172.21.15.37:0/2404750630 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6080044f0 con 0x561b7737b520 2024-09-21T05:56:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.602+0000 7fa60cc00640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa5f40b6510 0x7fa5f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.603+0000 7fa60cc00640 1 -- 172.21.15.37:0/872640011 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fa6000e7920 con 0x7fa610075750 2024-09-21T05:56:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.603+0000 7fa60fe00640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa5f40b6510 0x7fa5f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.603+0000 7fa61d8a1740 1 -- 172.21.15.37:0/2404750630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7737b520 msgr2=0x561b77722340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.603+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/2404750630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7737b520 0x561b77722340 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa6080117e0 tx=0x7fa608011ca0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.603+0000 7fa61d8a1740 1 -- 172.21.15.37:0/2404750630 shutdown_connections 2024-09-21T05:56:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.603+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/2404750630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7735a840 0x561b77722dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.603+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/2404750630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b77352660 0x561b77722880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.603+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/2404750630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7737b520 0x561b77722340 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.603+0000 7fa61d8a1740 1 -- 172.21.15.37:0/2404750630 >> 172.21.15.37:0/2404750630 conn(0x561b7736f910 msgr2=0x561b77720230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.604+0000 7fa60fe00640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa5f40b6510 0x7fa5f40b8a20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa6000aa9a0 tx=0x7fa6000ed530 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.604+0000 7fa61d8a1740 1 -- 172.21.15.37:0/2404750630 shutdown_connections 2024-09-21T05:56:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.604+0000 7fa61d8a1740 1 -- 172.21.15.37:0/2404750630 wait complete. 2024-09-21T05:56:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.605+0000 7fa61d8a1740 1 -- start start 2024-09-21T05:56:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.605+0000 7fa61d8a1740 1 Processor -- start 2024-09-21T05:56:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.605+0000 7fa61d8a1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b77352660 0x561b7772deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.605+0000 7fa61d8a1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7735a840 0x561b7772e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.605+0000 7fa61d8a1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7737b520 0x561b77739ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.605+0000 7fa61d8a1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561b774e9bb0 con 0x561b7735a840 2024-09-21T05:56:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.605+0000 7fa61d8a1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561b776236c0 con 0x561b7737b520 2024-09-21T05:56:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.605+0000 7fa61d8a1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561b77730b20 con 0x561b77352660 2024-09-21T05:56:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.605+0000 7fa61d8a1740 10 client.0 _ll_register_callbacks cb 0x561b7763e490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.606+0000 7fa60f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7735a840 0x561b7772e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.606+0000 7fa60f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7735a840 0x561b7772e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38928/0 (socket says 172.21.15.37:38928) 2024-09-21T05:56:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.606+0000 7fa60f400640 1 -- 172.21.15.37:0/99272172 learned_addr learned my addr 172.21.15.37:0/99272172 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.606+0000 7fa614c00640 1 --2- 172.21.15.37:0/99272172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7737b520 0x561b77739ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.606+0000 7fa614c00640 1 --2- 172.21.15.37:0/99272172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b77352660 0x561b7772deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.606+0000 7fa60f400640 1 -- 172.21.15.37:0/99272172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b77352660 msgr2=0x561b7772deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:19.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.606+0000 7fa60f400640 1 --2- 172.21.15.37:0/99272172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b77352660 0x561b7772deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.606+0000 7fa60f400640 1 -- 172.21.15.37:0/99272172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7737b520 msgr2=0x561b77739ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:19.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.606+0000 7fa60f400640 1 --2- 172.21.15.37:0/99272172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7737b520 0x561b77739ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.606+0000 7fa60f400640 1 -- 172.21.15.37:0/99272172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b773e6b00 con 0x561b7735a840 2024-09-21T05:56:19.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.607+0000 7fa60f400640 1 --2- 172.21.15.37:0/99272172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7735a840 0x561b7772e3f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009900 tx=0x7fa5fc032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969be774d0842cda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:19.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.607+0000 7fa5f9600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T05:56:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.607+0000 7fa5f9600640 1 -- 172.21.15.37:0/99272172 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc035040 con 0x561b7735a840 2024-09-21T05:56:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.607+0000 7fa5f9600640 1 -- 172.21.15.37:0/99272172 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fa5fc031760 con 0x561b7735a840 2024-09-21T05:56:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.607+0000 7fa61d8a1740 1 -- 172.21.15.37:0/99272172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa608003e20 con 0x561b7735a840 2024-09-21T05:56:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.607+0000 7fa5f9600640 1 -- 172.21.15.37:0/99272172 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa5fc04f050 con 0x561b7735a840 2024-09-21T05:56:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.607+0000 7fa61d8a1740 10 client.15423 fetch_fsmap learned FSMap version 21 2024-09-21T05:56:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.607+0000 7fa61d8a1740 1 -- 172.21.15.37:0/99272172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561b7745d960 con 0x561b7735a840 2024-09-21T05:56:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.607+0000 7fa5f9600640 1 -- 172.21.15.37:0/99272172 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa608003e20 con 0x561b7735a840 2024-09-21T05:56:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.608+0000 7fa5f9600640 1 -- 172.21.15.37:0/99272172 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa5fc004750 con 0x561b7735a840 2024-09-21T05:56:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.608+0000 7fa61d8a1740 10 client.15423 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:56:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.608+0000 7fa61d8a1740 10 client.15423 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:56:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.608+0000 7fa61d8a1740 20 client.15423 populate_metadata read hostname 'smithi037' 2024-09-21T05:56:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.608+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/99272172 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x561b77339ea0 0x561b7773ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.608+0000 7fa61d8a1740 4 client.15423 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:56:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.608+0000 7fa61d8a1740 1 -- 172.21.15.37:0/99272172 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b7769b1e0 con 0x561b77339ea0 2024-09-21T05:56:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.608+0000 7fa614c00640 1 --2- 172.21.15.37:0/99272172 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x561b77339ea0 0x561b7773ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.609+0000 7fa614c00640 1 --2- 172.21.15.37:0/99272172 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x561b77339ea0 0x561b7773ff60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a832c09c97642ed server_cookie=5cdfabe14d9d798c in_seq=0 out_seq=0 2024-09-21T05:56:19.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.609+0000 7fa5f9600640 10 client.15423 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:56:19.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa5f9600640 1 -- 172.21.15.37:0/99272172 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b7769b1e0 con 0x561b77339ea0 2024-09-21T05:56:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa5f9600640 10 client.15423 handle_command_reply: tid=0 2024-09-21T05:56:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa61d8a1740 1 client.15423 shutdown 2024-09-21T05:56:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa61d8a1740 1 -- 172.21.15.37:0/99272172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7735a840 msgr2=0x561b7772e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/99272172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7735a840 0x561b7772e3f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009900 tx=0x7fa5fc032e90 comp rx=0 tx=0).stop 2024-09-21T05:56:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa61d8a1740 1 -- 172.21.15.37:0/99272172 shutdown_connections 2024-09-21T05:56:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/99272172 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x561b77339ea0 0x561b7773ff60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/99272172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7737b520 0x561b77739ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/99272172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7735a840 0x561b7772e3f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/99272172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b77352660 0x561b7772deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa5f9600640 0 client.15423 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:56:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa61d8a1740 1 -- 172.21.15.37:0/99272172 >> 172.21.15.37:0/99272172 conn(0x561b7736f910 msgr2=0x561b777254d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa61d8a1740 1 -- 172.21.15.37:0/99272172 shutdown_connections 2024-09-21T05:56:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa61d8a1740 1 -- 172.21.15.37:0/99272172 wait complete. 2024-09-21T05:56:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.610+0000 7fa61d8a1740 20 client.15423 trim_cache size 0 max 16384 2024-09-21T05:56:19.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.629+0000 7fa61d8a1740 1 Processor -- start 2024-09-21T05:56:19.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.629+0000 7fa61d8a1740 1 -- start start 2024-09-21T05:56:19.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.629+0000 7fa61d8a1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b77352660 0x561b77739da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.629+0000 7fa61d8a1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b7735a840 0x561b7773a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.629+0000 7fa61d8a1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7737b520 0x561b777275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.629+0000 7fa61d8a1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f000dc80 con 0x561b77352660 2024-09-21T05:56:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.629+0000 7fa61d8a1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f0010500 con 0x561b7737b520 2024-09-21T05:56:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.629+0000 7fa61d8a1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f000e2f0 con 0x561b7735a840 2024-09-21T05:56:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.630+0000 7fa614c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b77352660 0x561b77739da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.630+0000 7fa614c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b77352660 0x561b77739da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38930/0 (socket says 172.21.15.37:38930) 2024-09-21T05:56:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.630+0000 7fa614c00640 1 -- 172.21.15.37:0/3222671437 learned_addr learned my addr 172.21.15.37:0/3222671437 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.630+0000 7fa60f400640 1 --2- 172.21.15.37:0/3222671437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b7735a840 0x561b7773a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.630+0000 7fa614c00640 1 --2- 172.21.15.37:0/3222671437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7737b520 0x561b777275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.630+0000 7fa60f400640 1 -- 172.21.15.37:0/3222671437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7737b520 msgr2=0x561b777275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.630+0000 7fa60f400640 1 --2- 172.21.15.37:0/3222671437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7737b520 0x561b777275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.630+0000 7fa60f400640 1 -- 172.21.15.37:0/3222671437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b77352660 msgr2=0x561b77739da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.630+0000 7fa60f400640 1 --2- 172.21.15.37:0/3222671437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b77352660 0x561b77739da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.630+0000 7fa60f400640 1 -- 172.21.15.37:0/3222671437 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7772cc10 con 0x561b7735a840 2024-09-21T05:56:19.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.630+0000 7fa614c00640 1 --2- 172.21.15.37:0/3222671437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b77352660 0x561b77739da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.630+0000 7fa60f400640 1 --2- 172.21.15.37:0/3222671437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b7735a840 0x561b7773a2e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc005f70 tx=0x7fa5fc001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95fa6f3d0152c404 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.631+0000 7fa5fbe00640 1 -- 172.21.15.37:0/3222671437 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc035030 con 0x561b7735a840 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.631+0000 7fa5fbe00640 1 -- 172.21.15.37:0/3222671437 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5fc031d10 con 0x561b7735a840 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.631+0000 7fa5fbe00640 1 -- 172.21.15.37:0/3222671437 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc004440 con 0x561b7735a840 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.632+0000 7fa61d8a1740 1 -- 172.21.15.37:0/3222671437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b7735a840 msgr2=0x561b7773a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.632+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/3222671437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b7735a840 0x561b7773a2e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc005f70 tx=0x7fa5fc001e70 comp rx=0 tx=0).stop 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.632+0000 7fa61d8a1740 1 -- 172.21.15.37:0/3222671437 shutdown_connections 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.632+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/3222671437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b7737b520 0x561b777275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.632+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/3222671437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b7735a840 0x561b7773a2e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.632+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/3222671437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b77352660 0x561b77739da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.632+0000 7fa61d8a1740 1 -- 172.21.15.37:0/3222671437 >> 172.21.15.37:0/3222671437 conn(0x561b7736f910 msgr2=0x561b77728ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.632+0000 7fa61d8a1740 1 -- 172.21.15.37:0/3222671437 shutdown_connections 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.632+0000 7fa61d8a1740 1 -- 172.21.15.37:0/3222671437 wait complete. 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.632+0000 7fa61d8a1740 1 -- start start 2024-09-21T05:56:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.633+0000 7fa61d8a1740 1 Processor -- start 2024-09-21T05:56:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.633+0000 7fa61d8a1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b77352660 0x561b777360a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.633+0000 7fa61d8a1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7735a840 0x561b77736660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.633+0000 7fa61d8a1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b7737b520 0x561b77730dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.633+0000 7fa61d8a1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f000e9c0 con 0x561b7735a840 2024-09-21T05:56:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.633+0000 7fa61d8a1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f000fe30 con 0x561b77352660 2024-09-21T05:56:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.633+0000 7fa61d8a1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f000f090 con 0x561b7737b520 2024-09-21T05:56:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.633+0000 7fa61d8a1740 10 client.0 _ll_register_callbacks cb 0x7fa5fc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.633+0000 7fa614c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b77352660 0x561b777360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.633+0000 7fa60f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7735a840 0x561b77736660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.633+0000 7fa614c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b77352660 0x561b777360a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:55446/0 (socket says 172.21.15.37:55446) 2024-09-21T05:56:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.633+0000 7fa614c00640 1 -- 172.21.15.37:0/2467535801 learned_addr learned my addr 172.21.15.37:0/2467535801 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.633+0000 7fa614c00640 1 --2- 172.21.15.37:0/2467535801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b7737b520 0x561b77730dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.634+0000 7fa614c00640 1 -- 172.21.15.37:0/2467535801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b7737b520 msgr2=0x561b77730dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.634+0000 7fa614c00640 1 --2- 172.21.15.37:0/2467535801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b7737b520 0x561b77730dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.634+0000 7fa614c00640 1 -- 172.21.15.37:0/2467535801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7735a840 msgr2=0x561b77736660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.634+0000 7fa614c00640 1 --2- 172.21.15.37:0/2467535801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7735a840 0x561b77736660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.634+0000 7fa614c00640 1 -- 172.21.15.37:0/2467535801 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b77731550 con 0x561b77352660 2024-09-21T05:56:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.634+0000 7fa614c00640 1 --2- 172.21.15.37:0/2467535801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b77352660 0x561b777360a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa6080117b0 tx=0x7fa6080040d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f85f1e247808d9d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.634+0000 7fa5f9600640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:56:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.634+0000 7fa5f9600640 1 -- 172.21.15.37:0/2467535801 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa608005050 con 0x561b77352660 2024-09-21T05:56:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.634+0000 7fa5f9600640 1 -- 172.21.15.37:0/2467535801 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fa608011350 con 0x561b77352660 2024-09-21T05:56:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.634+0000 7fa61d8a1740 1 -- 172.21.15.37:0/2467535801 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5fc031d10 con 0x561b77352660 2024-09-21T05:56:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.635+0000 7fa5f9600640 1 -- 172.21.15.37:0/2467535801 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa608043050 con 0x561b77352660 2024-09-21T05:56:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.635+0000 7fa61d8a1740 10 client.25454 fetch_fsmap learned FSMap version 21 2024-09-21T05:56:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.635+0000 7fa61d8a1740 1 -- 172.21.15.37:0/2467535801 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561b777ab340 con 0x561b77352660 2024-09-21T05:56:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.635+0000 7fa5f9600640 1 -- 172.21.15.37:0/2467535801 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5fc031d10 con 0x561b77352660 2024-09-21T05:56:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.635+0000 7fa5f9600640 1 -- 172.21.15.37:0/2467535801 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa608028040 con 0x561b77352660 2024-09-21T05:56:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.635+0000 7fa61d8a1740 10 client.25454 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:56:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.635+0000 7fa61d8a1740 10 client.25454 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:56:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.636+0000 7fa61d8a1740 20 client.25454 populate_metadata read hostname 'smithi037' 2024-09-21T05:56:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.636+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/2467535801 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x561b7730f250 0x561b777ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.636+0000 7fa61d8a1740 4 client.25454 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ea0aa72d", "release": true, "await": true}] 2024-09-21T05:56:19.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.636+0000 7fa61d8a1740 1 -- 172.21.15.37:0/2467535801 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ea0aa72d", "release": true, "await": true}) -- 0x561b77696c90 con 0x561b7730f250 2024-09-21T05:56:19.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.636+0000 7fa60f400640 1 --2- 172.21.15.37:0/2467535801 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x561b7730f250 0x561b777ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:19.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.636+0000 7fa60f400640 1 --2- 172.21.15.37:0/2467535801 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x561b7730f250 0x561b777ad8f0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8bda7c8f3b22c62 server_cookie=76e313f110d9d8db in_seq=0 out_seq=0 2024-09-21T05:56:19.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.636+0000 7fa5f9600640 10 client.25454 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:56:19.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:19 smithi037 ceph-mon[30631]: pgmap v486: 129 pgs: 129 active+clean; 66 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 258 KiB/s wr, 107 op/s 2024-09-21T05:56:19.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:19 smithi067 ceph-mon[34443]: pgmap v486: 129 pgs: 129 active+clean; 66 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 258 KiB/s wr, 107 op/s 2024-09-21T05:56:19.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.849+0000 7fa5f9600640 1 -- 172.21.15.37:0/2467535801 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561b77696c90 con 0x561b7730f250 2024-09-21T05:56:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.849+0000 7fa5f9600640 10 client.25454 handle_command_reply: tid=0 2024-09-21T05:56:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.849+0000 7fa61d8a1740 1 client.25454 shutdown 2024-09-21T05:56:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.850+0000 7fa61d8a1740 1 -- 172.21.15.37:0/2467535801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b77352660 msgr2=0x561b777360a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.850+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/2467535801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b77352660 0x561b777360a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa6080117b0 tx=0x7fa6080040d0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.850+0000 7fa61d8a1740 1 -- 172.21.15.37:0/2467535801 shutdown_connections 2024-09-21T05:56:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.850+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/2467535801 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x561b7730f250 0x561b777ad8f0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.850+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/2467535801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b7737b520 0x561b77730dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.850+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/2467535801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b7735a840 0x561b77736660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.850+0000 7fa5f9600640 0 client.25454 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:56:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.850+0000 7fa61d8a1740 1 --2- 172.21.15.37:0/2467535801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561b77352660 0x561b777360a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.850+0000 7fa61d8a1740 1 -- 172.21.15.37:0/2467535801 >> 172.21.15.37:0/2467535801 conn(0x561b7736f910 msgr2=0x561b77728ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.850+0000 7fa61d8a1740 1 -- 172.21.15.37:0/2467535801 shutdown_connections 2024-09-21T05:56:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.850+0000 7fa61d8a1740 1 -- 172.21.15.37:0/2467535801 wait complete. 2024-09-21T05:56:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.850+0000 7fa61d8a1740 20 client.25454 trim_cache size 0 max 16384 2024-09-21T05:56:19.854 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:56:19.854 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:56:19.854 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:56:19.854 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 12, 2024-09-21T05:56:19.854 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:56:19.854 INFO:teuthology.orchestra.run.smithi037.stdout: "ea0aa72d": { 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 12, 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 147.8, 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:56:19.855 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:56:19.856 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:19.856 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:19.856 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:19.856 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:19.856 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:19.856 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:56:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.851+0000 7fa615600640 1 -- 172.21.15.37:0/872640011 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa5f40b6510 msgr2=0x7fa5f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.851+0000 7fa615600640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa5f40b6510 0x7fa5f40b8a20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa6000aa9a0 tx=0x7fa6000ed530 comp rx=0 tx=0).stop 2024-09-21T05:56:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.851+0000 7fa615600640 1 -- 172.21.15.37:0/872640011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa610075750 msgr2=0x7fa61019c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.851+0000 7fa615600640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa610075750 0x7fa61019c4f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa60000e9f0 tx=0x7fa60000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.851+0000 7fa615600640 1 -- 172.21.15.37:0/872640011 shutdown_connections 2024-09-21T05:56:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.851+0000 7fa615600640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa5f40b6510 0x7fa5f40b8a20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.851+0000 7fa615600640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa61010ff50 0x7fa6101a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.851+0000 7fa615600640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6100760a0 0x7fa61019ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.851+0000 7fa615600640 1 --2- 172.21.15.37:0/872640011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa610075750 0x7fa61019c4f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.851+0000 7fa615600640 1 -- 172.21.15.37:0/872640011 >> 172.21.15.37:0/872640011 conn(0x7fa6100ff3e0 msgr2=0x7fa610109b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.851+0000 7fa615600640 1 -- 172.21.15.37:0/872640011 shutdown_connections 2024-09-21T05:56:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:19.851+0000 7fa615600640 1 -- 172.21.15.37:0/872640011 wait complete. 2024-09-21T05:56:19.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:19 smithi144 ceph-mon[34351]: pgmap v486: 129 pgs: 129 active+clean; 66 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 258 KiB/s wr, 107 op/s 2024-09-21T05:56:20.003 INFO:tasks.workunit.client.0.smithi037.stdout:./configure \ 2024-09-21T05:56:20.003 INFO:tasks.workunit.client.0.smithi037.stdout: --libexecdir=/usr/lib \ 2024-09-21T05:56:20.003 INFO:tasks.workunit.client.0.smithi037.stdout: --exec_prefix=/var/lib 2024-09-21T05:56:20.311 INFO:tasks.workunit.client.0.smithi037.stdout:checking build system type... x86_64-pc-linux-gnu 2024-09-21T05:56:20.311 INFO:tasks.workunit.client.0.smithi037.stdout:checking host system type... x86_64-pc-linux-gnu 2024-09-21T05:56:20.314 INFO:tasks.workunit.client.0.smithi037.stdout:checking how to print strings... printf 2024-09-21T05:56:20.315 INFO:tasks.workunit.client.0.smithi037.stdout:checking for gcc... gcc 2024-09-21T05:56:20.440 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether the C compiler works... yes 2024-09-21T05:56:20.440 INFO:tasks.workunit.client.0.smithi037.stdout:checking for C compiler default output file name... a.out 2024-09-21T05:56:20.501 INFO:tasks.workunit.client.0.smithi037.stdout:checking for suffix of executables... 2024-09-21T05:56:20.565 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether we are cross compiling... no 2024-09-21T05:56:20.622 INFO:tasks.workunit.client.0.smithi037.stdout:checking for suffix of object files... o 2024-09-21T05:56:20.676 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether we are using the GNU C compiler... yes 2024-09-21T05:56:20.716 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether gcc accepts -g... yes 2024-09-21T05:56:20.822 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ea0aa72d', total seconds elapsed: 32.2 2024-09-21T05:56:20.822 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T05:56:20.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:56:20.848 INFO:tasks.workunit.client.0.smithi037.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-21T05:56:20.855 INFO:tasks.workunit.client.0.smithi037.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-09-21T05:56:20.863 INFO:tasks.workunit.client.0.smithi037.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-21T05:56:20.866 INFO:tasks.workunit.client.0.smithi037.stdout:checking for egrep... /usr/bin/grep -E 2024-09-21T05:56:20.869 INFO:tasks.workunit.client.0.smithi037.stdout:checking for fgrep... /usr/bin/grep -F 2024-09-21T05:56:20.878 INFO:tasks.workunit.client.0.smithi037.stdout:checking for ld used by gcc... /usr/bin/ld 2024-09-21T05:56:20.882 INFO:tasks.workunit.client.0.smithi037.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-09-21T05:56:20.897 INFO:tasks.workunit.client.0.smithi037.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-09-21T05:56:21.210 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:56:21.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:21 smithi037 ceph-mon[30631]: pgmap v487: 129 pgs: 129 active+clean; 66 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 325 KiB/s wr, 119 op/s 2024-09-21T05:56:21.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:21 smithi067 ceph-mon[34443]: pgmap v487: 129 pgs: 129 active+clean; 66 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 325 KiB/s wr, 119 op/s 2024-09-21T05:56:21.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:21 smithi144 ceph-mon[34351]: pgmap v487: 129 pgs: 129 active+clean; 66 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 325 KiB/s wr, 119 op/s 2024-09-21T05:56:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.069+0000 7f524de00640 1 -- 172.21.15.37:0/2014603697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f524810c010 msgr2=0x7f5248112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.069+0000 7f524de00640 1 --2- 172.21.15.37:0/2014603697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f524810c010 0x7f5248112840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5240009ca0 tx=0x7f524002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:56:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.069+0000 7f524de00640 1 -- 172.21.15.37:0/2014603697 shutdown_connections 2024-09-21T05:56:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.069+0000 7f524de00640 1 --2- 172.21.15.37:0/2014603697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f524810c010 0x7f5248112840 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.069+0000 7f524de00640 1 --2- 172.21.15.37:0/2014603697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f524810b6c0 0x7f524810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.069+0000 7f524de00640 1 --2- 172.21.15.37:0/2014603697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5248105d80 0x7f5248106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.069+0000 7f524de00640 1 -- 172.21.15.37:0/2014603697 >> 172.21.15.37:0/2014603697 conn(0x7f52481017d0 msgr2=0x7f5248103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.069+0000 7f524de00640 1 -- 172.21.15.37:0/2014603697 shutdown_connections 2024-09-21T05:56:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.069+0000 7f524de00640 1 -- 172.21.15.37:0/2014603697 wait complete. 2024-09-21T05:56:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.070+0000 7f524de00640 1 Processor -- start 2024-09-21T05:56:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.070+0000 7f524de00640 1 -- start start 2024-09-21T05:56:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.070+0000 7f524de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5248105d80 0x7f524819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f524de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f524810b6c0 0x7f524819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f524de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f524810c010 0x7f52481a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f524de00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5248115cd0 con 0x7f5248105d80 2024-09-21T05:56:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f524de00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5248115b50 con 0x7f524810b6c0 2024-09-21T05:56:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f524de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5248115e50 con 0x7f524810c010 2024-09-21T05:56:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f5246a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5248105d80 0x7f524819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f5246a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5248105d80 0x7f524819c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60646/0 (socket says 172.21.15.37:60646) 2024-09-21T05:56:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f5246a00640 1 -- 172.21.15.37:0/2170970404 learned_addr learned my addr 172.21.15.37:0/2170970404 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f5247400640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f524810c010 0x7f52481a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f523fe00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f524810b6c0 0x7f524819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f5246a00640 1 -- 172.21.15.37:0/2170970404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f524810c010 msgr2=0x7f52481a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f5246a00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f524810c010 0x7f52481a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f5246a00640 1 -- 172.21.15.37:0/2170970404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f524810b6c0 msgr2=0x7f524819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f5246a00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f524810b6c0 0x7f524819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f5246a00640 1 -- 172.21.15.37:0/2170970404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52481a25d0 con 0x7f5248105d80 2024-09-21T05:56:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f523fe00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f524810b6c0 0x7f524819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:56:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.071+0000 7f5247400640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f524810c010 0x7f52481a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:56:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.072+0000 7f5246a00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5248105d80 0x7f524819c660 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f523800e9f0 tx=0x7f523800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.072+0000 7f524ca00640 1 -- 172.21.15.37:0/2170970404 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523800cd80 con 0x7f5248105d80 2024-09-21T05:56:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.072+0000 7f524de00640 1 -- 172.21.15.37:0/2170970404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52481a28c0 con 0x7f5248105d80 2024-09-21T05:56:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.072+0000 7f524ca00640 1 -- 172.21.15.37:0/2170970404 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52380108e0 con 0x7f5248105d80 2024-09-21T05:56:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.072+0000 7f524de00640 1 -- 172.21.15.37:0/2170970404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52481a9020 con 0x7f5248105d80 2024-09-21T05:56:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.072+0000 7f524ca00640 1 -- 172.21.15.37:0/2170970404 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238018920 con 0x7f5248105d80 2024-09-21T05:56:22.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.073+0000 7f524de00640 1 -- 172.21.15.37:0/2170970404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5248106190 con 0x7f5248105d80 2024-09-21T05:56:22.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.076+0000 7f524ca00640 1 -- 172.21.15.37:0/2170970404 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5238010430 con 0x7f5248105d80 2024-09-21T05:56:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.077+0000 7f524ca00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f522c0b6510 0x7f522c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.077+0000 7f524ca00640 1 -- 172.21.15.37:0/2170970404 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f52380e7d60 con 0x7f5248105d80 2024-09-21T05:56:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.078+0000 7f523fe00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f522c0b6510 0x7f522c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.078+0000 7f523fe00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f522c0b6510 0x7f522c0b8a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5248109110 tx=0x7f523000b5f0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:22.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.080+0000 7f524ca00640 1 -- 172.21.15.37:0/2170970404 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f52380ae1c0 con 0x7f5248105d80 2024-09-21T05:56:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.330+0000 7f524de00640 1 -- 172.21.15.37:0/2170970404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f524819d790 con 0x7f5248105d80 2024-09-21T05:56:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.331+0000 7f524ca00640 1 -- 172.21.15.37:0/2170970404 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f52380b25a0 con 0x7f5248105d80 2024-09-21T05:56:22.334 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:56:22.334 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:56:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:56:22.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.333+0000 7f524de00640 1 -- 172.21.15.37:0/2170970404 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f522c0b6510 msgr2=0x7f522c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:22.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.333+0000 7f524de00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f522c0b6510 0x7f522c0b8a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5248109110 tx=0x7f523000b5f0 comp rx=0 tx=0).stop 2024-09-21T05:56:22.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.333+0000 7f524de00640 1 -- 172.21.15.37:0/2170970404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5248105d80 msgr2=0x7f524819c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:22.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.333+0000 7f524de00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5248105d80 0x7f524819c660 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f523800e9f0 tx=0x7f523800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:56:22.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.333+0000 7f524de00640 1 -- 172.21.15.37:0/2170970404 shutdown_connections 2024-09-21T05:56:22.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.334+0000 7f524de00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f524810c010 0x7f52481a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:22.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.334+0000 7f524de00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f522c0b6510 0x7f522c0b8a20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:22.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.334+0000 7f524de00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f524810b6c0 0x7f524819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:22.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.334+0000 7f524de00640 1 --2- 172.21.15.37:0/2170970404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5248105d80 0x7f524819c660 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:22.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.334+0000 7f524de00640 1 -- 172.21.15.37:0/2170970404 >> 172.21.15.37:0/2170970404 conn(0x7f52481017d0 msgr2=0x7f5248103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:22.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.334+0000 7f524de00640 1 -- 172.21.15.37:0/2170970404 shutdown_connections 2024-09-21T05:56:22.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:22.334+0000 7f524de00640 1 -- 172.21.15.37:0/2170970404 wait complete. 2024-09-21T05:56:22.368 INFO:tasks.workunit.client.0.smithi037.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-09-21T05:56:22.368 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether ln -s works... yes 2024-09-21T05:56:22.410 INFO:tasks.workunit.client.0.smithi037.stdout:checking the maximum length of command line arguments... 1572864 2024-09-21T05:56:22.417 INFO:tasks.workunit.client.0.smithi037.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-09-21T05:56:22.417 INFO:tasks.workunit.client.0.smithi037.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-09-21T05:56:22.417 INFO:tasks.workunit.client.0.smithi037.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-09-21T05:56:22.417 INFO:tasks.workunit.client.0.smithi037.stdout:checking for objdump... objdump 2024-09-21T05:56:22.417 INFO:tasks.workunit.client.0.smithi037.stdout:checking how to recognize dependent libraries... pass_all 2024-09-21T05:56:22.418 INFO:tasks.workunit.client.0.smithi037.stdout:checking for dlltool... no 2024-09-21T05:56:22.418 INFO:tasks.workunit.client.0.smithi037.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-09-21T05:56:22.418 INFO:tasks.workunit.client.0.smithi037.stdout:checking for ar... ar 2024-09-21T05:56:22.585 INFO:tasks.workunit.client.0.smithi037.stdout:checking for archiver @FILE support... @ 2024-09-21T05:56:22.585 INFO:tasks.workunit.client.0.smithi037.stdout:checking for strip... strip 2024-09-21T05:56:22.585 INFO:tasks.workunit.client.0.smithi037.stdout:checking for ranlib... ranlib 2024-09-21T05:56:22.586 INFO:tasks.workunit.client.0.smithi037.stdout:checking for gawk... gawk 2024-09-21T05:56:22.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:22 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2170970404' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:56:22.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:22 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2170970404' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:56:22.756 INFO:tasks.workunit.client.0.smithi037.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-09-21T05:56:22.759 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sysroot... no 2024-09-21T05:56:22.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:22 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2170970404' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:56:22.926 INFO:tasks.workunit.client.0.smithi037.stdout:checking for a working dd... /usr/bin/dd 2024-09-21T05:56:23.042 INFO:tasks.workunit.client.0.smithi037.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-09-21T05:56:23.092 INFO:tasks.workunit.client.0.smithi037.stdout:checking for mt... no 2024-09-21T05:56:23.110 INFO:tasks.workunit.client.0.smithi037.stdout:checking if : is a manifest tool... no 2024-09-21T05:56:23.302 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T05:56:23.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T05:56:23.321 INFO:tasks.workunit.client.0.smithi037.stdout:checking how to run the C preprocessor... gcc -E 2024-09-21T05:56:23.553 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:23 smithi037 ceph-mon[30631]: pgmap v488: 129 pgs: 129 active+clean; 66 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 323 KiB/s wr, 121 op/s 2024-09-21T05:56:23.628 INFO:tasks.workunit.client.0.smithi037.stdout:checking for ANSI C header files... yes 2024-09-21T05:56:23.688 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/types.h... yes 2024-09-21T05:56:23.720 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:56:23.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:23 smithi067 ceph-mon[34443]: pgmap v488: 129 pgs: 129 active+clean; 66 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 323 KiB/s wr, 121 op/s 2024-09-21T05:56:23.761 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/stat.h... yes 2024-09-21T05:56:23.828 INFO:tasks.workunit.client.0.smithi037.stdout:checking for stdlib.h... yes 2024-09-21T05:56:23.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:23 smithi144 ceph-mon[34351]: pgmap v488: 129 pgs: 129 active+clean; 66 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 323 KiB/s wr, 121 op/s 2024-09-21T05:56:23.895 INFO:tasks.workunit.client.0.smithi037.stdout:checking for string.h... yes 2024-09-21T05:56:23.972 INFO:tasks.workunit.client.0.smithi037.stdout:checking for memory.h... yes 2024-09-21T05:56:24.044 INFO:tasks.workunit.client.0.smithi037.stdout:checking for strings.h... yes 2024-09-21T05:56:24.117 INFO:tasks.workunit.client.0.smithi037.stdout:checking for inttypes.h... yes 2024-09-21T05:56:24.196 INFO:tasks.workunit.client.0.smithi037.stdout:checking for stdint.h... yes 2024-09-21T05:56:24.269 INFO:tasks.workunit.client.0.smithi037.stdout:checking for unistd.h... yes 2024-09-21T05:56:24.362 INFO:tasks.workunit.client.0.smithi037.stdout:checking for dlfcn.h... yes 2024-09-21T05:56:24.373 INFO:tasks.workunit.client.0.smithi037.stdout:checking for objdir... .libs 2024-09-21T05:56:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.417+0000 7fa846600640 1 -- 172.21.15.37:0/815418032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840075730 msgr2=0x7fa840075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.417+0000 7fa846600640 1 --2- 172.21.15.37:0/815418032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840075730 0x7fa840075b40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa838009ca0 tx=0x7fa83802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.417+0000 7fa846600640 1 -- 172.21.15.37:0/815418032 shutdown_connections 2024-09-21T05:56:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.417+0000 7fa846600640 1 --2- 172.21.15.37:0/815418032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa840110150 0x7fa840112570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.417+0000 7fa846600640 1 --2- 172.21.15.37:0/815418032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa840076080 0x7fa84010fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.417+0000 7fa846600640 1 --2- 172.21.15.37:0/815418032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840075730 0x7fa840075b40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.417+0000 7fa846600640 1 -- 172.21.15.37:0/815418032 >> 172.21.15.37:0/815418032 conn(0x7fa8400ff5a0 msgr2=0x7fa8401019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.418+0000 7fa846600640 1 -- 172.21.15.37:0/815418032 shutdown_connections 2024-09-21T05:56:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.418+0000 7fa846600640 1 -- 172.21.15.37:0/815418032 wait complete. 2024-09-21T05:56:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.419+0000 7fa846600640 1 Processor -- start 2024-09-21T05:56:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.419+0000 7fa846600640 1 -- start start 2024-09-21T05:56:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.419+0000 7fa846600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa840075730 0x7fa84019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.419+0000 7fa846600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa840076080 0x7fa84019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.419+0000 7fa846600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840110150 0x7fa8401a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.419+0000 7fa846600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa840115d00 con 0x7fa840110150 2024-09-21T05:56:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.419+0000 7fa846600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa840115b80 con 0x7fa840075730 2024-09-21T05:56:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.419+0000 7fa846600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa840115e80 con 0x7fa840076080 2024-09-21T05:56:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.420+0000 7fa83f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa840075730 0x7fa84019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.420+0000 7fa83f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa840075730 0x7fa84019c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:35592/0 (socket says 172.21.15.37:35592) 2024-09-21T05:56:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.420+0000 7fa83ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa840076080 0x7fa84019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.420+0000 7fa83f400640 1 -- 172.21.15.37:0/1969318588 learned_addr learned my addr 172.21.15.37:0/1969318588 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.420+0000 7fa83fe00640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840110150 0x7fa8401a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.420+0000 7fa83ea00640 1 -- 172.21.15.37:0/1969318588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa840075730 msgr2=0x7fa84019c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.420+0000 7fa83ea00640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa840075730 0x7fa84019c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.420+0000 7fa83ea00640 1 -- 172.21.15.37:0/1969318588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840110150 msgr2=0x7fa8401a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.420+0000 7fa83ea00640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840110150 0x7fa8401a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.420+0000 7fa83ea00640 1 -- 172.21.15.37:0/1969318588 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8401a25e0 con 0x7fa840076080 2024-09-21T05:56:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.420+0000 7fa83fe00640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840110150 0x7fa8401a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:56:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.421+0000 7fa83ea00640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa840076080 0x7fa84019cc10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa84006c970 tx=0x7fa82c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.421+0000 7fa837e00640 1 -- 172.21.15.37:0/1969318588 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00cd00 con 0x7fa840076080 2024-09-21T05:56:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.421+0000 7fa837e00640 1 -- 172.21.15.37:0/1969318588 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa82c0035f0 con 0x7fa840076080 2024-09-21T05:56:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.421+0000 7fa837e00640 1 -- 172.21.15.37:0/1969318588 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c010690 con 0x7fa840076080 2024-09-21T05:56:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.421+0000 7fa846600640 1 -- 172.21.15.37:0/1969318588 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8401a28d0 con 0x7fa840076080 2024-09-21T05:56:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.421+0000 7fa846600640 1 -- 172.21.15.37:0/1969318588 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8401a9030 con 0x7fa840076080 2024-09-21T05:56:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.425+0000 7fa84d282740 1 Processor -- start 2024-09-21T05:56:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.426+0000 7fa84d282740 1 -- start start 2024-09-21T05:56:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.426+0000 7fa84d282740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0231840 0x55e0d05d9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.426+0000 7fa84d282740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05d9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.426+0000 7fa84d282740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0210b60 0x55e0d05d9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.426+0000 7fa84d282740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e0d054eca0 con 0x55e0d0208980 2024-09-21T05:56:24.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.426+0000 7fa84d282740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e0d053e0d0 con 0x55e0d0231840 2024-09-21T05:56:24.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.426+0000 7fa84d282740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e0d0541ee0 con 0x55e0d0210b60 2024-09-21T05:56:24.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.427+0000 7fa83fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0231840 0x55e0d05d9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.427+0000 7fa83fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0231840 0x55e0d05d9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:35600/0 (socket says 172.21.15.37:35600) 2024-09-21T05:56:24.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.427+0000 7fa83fe00640 1 -- 172.21.15.37:0/1895625441 learned_addr learned my addr 172.21.15.37:0/1895625441 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:24.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.427+0000 7fa83f400640 1 --2- 172.21.15.37:0/1895625441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05d9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.427+0000 7fa837e00640 1 -- 172.21.15.37:0/1969318588 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fa82c0037a0 con 0x7fa840076080 2024-09-21T05:56:24.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.427+0000 7fa83fe00640 1 -- 172.21.15.37:0/1895625441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0210b60 msgr2=0x55e0d05d9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:24.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.427+0000 7fa83fe00640 1 --2- 172.21.15.37:0/1895625441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0210b60 0x55e0d05d9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.427+0000 7fa83fe00640 1 -- 172.21.15.37:0/1895625441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 msgr2=0x55e0d05d9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:24.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.427+0000 7fa83fe00640 1 --2- 172.21.15.37:0/1895625441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05d9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.427+0000 7fa83fe00640 1 -- 172.21.15.37:0/1895625441 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d04f0400 con 0x55e0d0231840 2024-09-21T05:56:24.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.428+0000 7fa83fe00640 1 --2- 172.21.15.37:0/1895625441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0231840 0x55e0d05d9350 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa830009cc0 tx=0x7fa8300117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=363edaf8d83971eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:24.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.428+0000 7fa834c00640 1 -- 172.21.15.37:0/1895625441 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830012450 con 0x55e0d0231840 2024-09-21T05:56:24.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.428+0000 7fa834c00640 1 -- 172.21.15.37:0/1895625441 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa830012aa0 con 0x55e0d0231840 2024-09-21T05:56:24.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.428+0000 7fa834c00640 1 -- 172.21.15.37:0/1895625441 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83000fb70 con 0x55e0d0231840 2024-09-21T05:56:24.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.429+0000 7fa84d282740 1 -- 172.21.15.37:0/1895625441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0231840 msgr2=0x55e0d05d9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:24.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.429+0000 7fa84d282740 1 --2- 172.21.15.37:0/1895625441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0231840 0x55e0d05d9350 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa830009cc0 tx=0x7fa8300117b0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.429+0000 7fa84d282740 1 -- 172.21.15.37:0/1895625441 shutdown_connections 2024-09-21T05:56:24.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.429+0000 7fa84d282740 1 --2- 172.21.15.37:0/1895625441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0210b60 0x55e0d05d9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.429+0000 7fa84d282740 1 --2- 172.21.15.37:0/1895625441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05d9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.429+0000 7fa84d282740 1 --2- 172.21.15.37:0/1895625441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0231840 0x55e0d05d9350 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.429+0000 7fa84d282740 1 -- 172.21.15.37:0/1895625441 >> 172.21.15.37:0/1895625441 conn(0x55e0d0225990 msgr2=0x55e0d05d7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:24.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.429+0000 7fa84d282740 1 -- 172.21.15.37:0/1895625441 shutdown_connections 2024-09-21T05:56:24.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.429+0000 7fa84d282740 1 -- 172.21.15.37:0/1895625441 wait complete. 2024-09-21T05:56:24.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.429+0000 7fa837e00640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa8240b64a0 0x7fa8240b89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.429+0000 7fa837e00640 1 -- 172.21.15.37:0/1969318588 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fa82c0e7940 con 0x7fa840076080 2024-09-21T05:56:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.429+0000 7fa83f400640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa8240b64a0 0x7fa8240b89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.430+0000 7fa84d282740 1 -- start start 2024-09-21T05:56:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.430+0000 7fa84d282740 1 Processor -- start 2024-09-21T05:56:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.430+0000 7fa83f400640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa8240b64a0 0x7fa8240b89b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55e0d05d7fd0 tx=0x7fa838005d80 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.431+0000 7fa84d282740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.431+0000 7fa84d282740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0210b60 0x55e0d05e5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.431+0000 7fa84d282740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0231840 0x55e0d05f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.431+0000 7fa84d282740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e0d039f7a0 con 0x55e0d0208980 2024-09-21T05:56:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.431+0000 7fa84d282740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e0d04e3a10 con 0x55e0d0231840 2024-09-21T05:56:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.431+0000 7fa84d282740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e0d05e7b30 con 0x55e0d0210b60 2024-09-21T05:56:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.431+0000 7fa84d282740 10 client.0 _ll_register_callbacks cb 0x55e0d04f3be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.431+0000 7fa83ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0210b60 0x55e0d05e5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.431+0000 7fa83ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0210b60 0x55e0d05e5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45120/0 (socket says 172.21.15.37:45120) 2024-09-21T05:56:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.431+0000 7fa83ea00640 1 -- 172.21.15.37:0/1281395572 learned_addr learned my addr 172.21.15.37:0/1281395572 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.431+0000 7fa83f400640 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.431+0000 7fa83fe00640 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0231840 0x55e0d05f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.432+0000 7fa83ea00640 1 -- 172.21.15.37:0/1281395572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0231840 msgr2=0x55e0d05f0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.432+0000 7fa83ea00640 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0231840 0x55e0d05f0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.432+0000 7fa83ea00640 1 -- 172.21.15.37:0/1281395572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 msgr2=0x55e0d05e4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.432+0000 7fa83ea00640 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.432+0000 7fa83ea00640 1 -- 172.21.15.37:0/1281395572 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d02abb90 con 0x55e0d0210b60 2024-09-21T05:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.432+0000 7fa83fe00640 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0231840 0x55e0d05f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.432+0000 7fa83ea00640 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0210b60 0x55e0d05e5020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0ad400 tx=0x7fa82c003cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c62d65bb8431b678 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.432+0000 7fa829600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T05:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.432+0000 7fa829600640 1 -- 172.21.15.37:0/1281395572 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0d4060 con 0x55e0d0210b60 2024-09-21T05:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.432+0000 7fa84d282740 1 -- 172.21.15.37:0/1281395572 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa830012aa0 con 0x55e0d0210b60 2024-09-21T05:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.432+0000 7fa829600640 1 -- 172.21.15.37:0/1281395572 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fa82c0a9050 con 0x55e0d0210b60 2024-09-21T05:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.433+0000 7fa829600640 1 -- 172.21.15.37:0/1281395572 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa82c0ad210 con 0x55e0d0210b60 2024-09-21T05:56:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.433+0000 7fa84d282740 10 client.25492 fetch_fsmap learned FSMap version 21 2024-09-21T05:56:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.433+0000 7fa84d282740 1 -- 172.21.15.37:0/1281395572 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e0d05f38f0 con 0x55e0d0210b60 2024-09-21T05:56:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.434+0000 7fa829600640 1 -- 172.21.15.37:0/1281395572 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa830012aa0 con 0x55e0d0210b60 2024-09-21T05:56:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.434+0000 7fa829600640 1 -- 172.21.15.37:0/1281395572 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa82c0b3370 con 0x55e0d0210b60 2024-09-21T05:56:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.434+0000 7fa84d282740 10 client.25492 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:56:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.434+0000 7fa84d282740 10 client.25492 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:56:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.434+0000 7fa84d282740 20 client.25492 populate_metadata read hostname 'smithi037' 2024-09-21T05:56:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.434+0000 7fa84d282740 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e0d01f01c0 0x55e0d05f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.434+0000 7fa84d282740 4 client.25492 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:56:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.434+0000 7fa84d282740 1 -- 172.21.15.37:0/1281395572 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0d0550bf0 con 0x55e0d01f01c0 2024-09-21T05:56:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.434+0000 7fa83f400640 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e0d01f01c0 0x55e0d05f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.435+0000 7fa83f400640 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e0d01f01c0 0x55e0d05f6d10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a281407c1d5ecbb9 server_cookie=44c8eb8db29ecc8e in_seq=0 out_seq=0 2024-09-21T05:56:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.435+0000 7fa829600640 10 client.25492 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.435+0000 7fa829600640 1 -- 172.21.15.37:0/1281395572 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e0d0550bf0 con 0x55e0d01f01c0 2024-09-21T05:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.436+0000 7fa829600640 10 client.25492 handle_command_reply: tid=0 2024-09-21T05:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.436+0000 7fa84d282740 1 client.25492 shutdown 2024-09-21T05:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.436+0000 7fa84d282740 1 -- 172.21.15.37:0/1281395572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0210b60 msgr2=0x55e0d05e5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.436+0000 7fa84d282740 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0210b60 0x55e0d05e5020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0ad400 tx=0x7fa82c003cf0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.436+0000 7fa84d282740 1 -- 172.21.15.37:0/1281395572 shutdown_connections 2024-09-21T05:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.436+0000 7fa84d282740 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e0d01f01c0 0x55e0d05f6d10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.436+0000 7fa84d282740 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0231840 0x55e0d05f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.436+0000 7fa84d282740 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0210b60 0x55e0d05e5020 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.436+0000 7fa84d282740 1 --2- 172.21.15.37:0/1281395572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.436+0000 7fa84d282740 1 -- 172.21.15.37:0/1281395572 >> 172.21.15.37:0/1281395572 conn(0x55e0d0225990 msgr2=0x55e0d05d59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.436+0000 7fa829600640 0 client.25492 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.436+0000 7fa84d282740 1 -- 172.21.15.37:0/1281395572 shutdown_connections 2024-09-21T05:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.436+0000 7fa84d282740 1 -- 172.21.15.37:0/1281395572 wait complete. 2024-09-21T05:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.437+0000 7fa84d282740 20 client.25492 trim_cache size 0 max 16384 2024-09-21T05:56:24.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.455+0000 7fa84d282740 1 Processor -- start 2024-09-21T05:56:24.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.455+0000 7fa84d282740 1 -- start start 2024-09-21T05:56:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.455+0000 7fa84d282740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.455+0000 7fa84d282740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0210b60 0x55e0d05f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.455+0000 7fa84d282740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0231840 0x55e0d05e1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.455+0000 7fa84d282740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401b0d60 con 0x55e0d0208980 2024-09-21T05:56:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.455+0000 7fa84d282740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401b35e0 con 0x55e0d0210b60 2024-09-21T05:56:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.455+0000 7fa84d282740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401b13d0 con 0x55e0d0231840 2024-09-21T05:56:24.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.456+0000 7fa83f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.456+0000 7fa83f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60678/0 (socket says 172.21.15.37:60678) 2024-09-21T05:56:24.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.456+0000 7fa83f400640 1 -- 172.21.15.37:0/1516701282 learned_addr learned my addr 172.21.15.37:0/1516701282 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:24.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.456+0000 7fa83ea00640 1 --2- 172.21.15.37:0/1516701282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0210b60 0x55e0d05f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.456+0000 7fa83fe00640 1 --2- 172.21.15.37:0/1516701282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0231840 0x55e0d05e1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.456+0000 7fa83ea00640 1 -- 172.21.15.37:0/1516701282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0231840 msgr2=0x55e0d05e1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.456+0000 7fa83ea00640 1 --2- 172.21.15.37:0/1516701282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0231840 0x55e0d05e1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.456+0000 7fa83ea00640 1 -- 172.21.15.37:0/1516701282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 msgr2=0x55e0d05e69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.456+0000 7fa83ea00640 1 --2- 172.21.15.37:0/1516701282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.456+0000 7fa83ea00640 1 -- 172.21.15.37:0/1516701282 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d05d2a40 con 0x55e0d0210b60 2024-09-21T05:56:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.456+0000 7fa83f400640 1 --2- 172.21.15.37:0/1516701282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.457+0000 7fa83ea00640 1 --2- 172.21.15.37:0/1516701282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0210b60 0x55e0d05f0d20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa82c003e40 tx=0x7fa82c0ad4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9804f67d7b93e041 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.457+0000 7fa82be00640 1 -- 172.21.15.37:0/1516701282 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0cc020 con 0x55e0d0210b60 2024-09-21T05:56:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.457+0000 7fa82be00640 1 -- 172.21.15.37:0/1516701282 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa82c0ade00 con 0x55e0d0210b60 2024-09-21T05:56:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.457+0000 7fa82be00640 1 -- 172.21.15.37:0/1516701282 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0a9050 con 0x55e0d0210b60 2024-09-21T05:56:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.458+0000 7fa84d282740 1 -- 172.21.15.37:0/1516701282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0210b60 msgr2=0x55e0d05f0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.458+0000 7fa84d282740 1 --2- 172.21.15.37:0/1516701282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0210b60 0x55e0d05f0d20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa82c003e40 tx=0x7fa82c0ad4d0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.458+0000 7fa84d282740 1 -- 172.21.15.37:0/1516701282 shutdown_connections 2024-09-21T05:56:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.458+0000 7fa84d282740 1 --2- 172.21.15.37:0/1516701282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0231840 0x55e0d05e1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.458+0000 7fa84d282740 1 --2- 172.21.15.37:0/1516701282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0210b60 0x55e0d05f0d20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.458+0000 7fa84d282740 1 --2- 172.21.15.37:0/1516701282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.458+0000 7fa84d282740 1 -- 172.21.15.37:0/1516701282 >> 172.21.15.37:0/1516701282 conn(0x55e0d0225990 msgr2=0x55e0d05da380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.458+0000 7fa84d282740 1 -- 172.21.15.37:0/1516701282 shutdown_connections 2024-09-21T05:56:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.458+0000 7fa84d282740 1 -- 172.21.15.37:0/1516701282 wait complete. 2024-09-21T05:56:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.459+0000 7fa84d282740 1 -- start start 2024-09-21T05:56:24.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.459+0000 7fa84d282740 1 Processor -- start 2024-09-21T05:56:24.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.459+0000 7fa84d282740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.459+0000 7fa84d282740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0210b60 0x55e0d05e97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.459+0000 7fa84d282740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0231840 0x55e0d0660660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.459+0000 7fa84d282740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401b1aa0 con 0x55e0d0208980 2024-09-21T05:56:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.459+0000 7fa84d282740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401b2f10 con 0x55e0d0210b60 2024-09-21T05:56:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.459+0000 7fa84d282740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401b2170 con 0x55e0d0231840 2024-09-21T05:56:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.459+0000 7fa84d282740 10 client.0 _ll_register_callbacks cb 0x7fa82c003d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.460+0000 7fa83f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.460+0000 7fa83f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60692/0 (socket says 172.21.15.37:60692) 2024-09-21T05:56:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.460+0000 7fa83f400640 1 -- 172.21.15.37:0/3275234949 learned_addr learned my addr 172.21.15.37:0/3275234949 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.460+0000 7fa83fe00640 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0231840 0x55e0d0660660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.460+0000 7fa83ea00640 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0210b60 0x55e0d05e97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.461+0000 7fa83fe00640 1 -- 172.21.15.37:0/3275234949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0210b60 msgr2=0x55e0d05e97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.461+0000 7fa83fe00640 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0210b60 0x55e0d05e97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.461+0000 7fa83fe00640 1 -- 172.21.15.37:0/3275234949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 msgr2=0x55e0d05e91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.461+0000 7fa83fe00640 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:24.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.461+0000 7fa83fe00640 1 -- 172.21.15.37:0/3275234949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d0660ba0 con 0x55e0d0231840 2024-09-21T05:56:24.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.461+0000 7fa83f400640 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:24.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.461+0000 7fa83fe00640 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0231840 0x55e0d0660660 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa830009c90 tx=0x7fa830011de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f765c5fa97c35ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:24.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.461+0000 7fa829600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T05:56:24.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.461+0000 7fa829600640 1 -- 172.21.15.37:0/3275234949 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830005040 con 0x55e0d0231840 2024-09-21T05:56:24.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.461+0000 7fa829600640 1 -- 172.21.15.37:0/3275234949 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fa8300051e0 con 0x55e0d0231840 2024-09-21T05:56:24.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.461+0000 7fa84d282740 1 -- 172.21.15.37:0/3275234949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa82c0ade00 con 0x55e0d0231840 2024-09-21T05:56:24.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.462+0000 7fa829600640 1 -- 172.21.15.37:0/3275234949 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa830037050 con 0x55e0d0231840 2024-09-21T05:56:24.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.462+0000 7fa84d282740 10 client.25498 fetch_fsmap learned FSMap version 21 2024-09-21T05:56:24.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.462+0000 7fa84d282740 1 -- 172.21.15.37:0/3275234949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e0d0661d30 con 0x55e0d0231840 2024-09-21T05:56:24.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.462+0000 7fa829600640 1 -- 172.21.15.37:0/3275234949 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa82c0ade00 con 0x55e0d0231840 2024-09-21T05:56:24.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.462+0000 7fa829600640 1 -- 172.21.15.37:0/3275234949 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa830004660 con 0x55e0d0231840 2024-09-21T05:56:24.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.462+0000 7fa84d282740 10 client.25498 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:56:24.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.462+0000 7fa84d282740 10 client.25498 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:56:24.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.462+0000 7fa84d282740 20 client.25498 populate_metadata read hostname 'smithi037' 2024-09-21T05:56:24.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.462+0000 7fa84d282740 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e0d01c5570 0x55e0d0664250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:24.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.462+0000 7fa84d282740 4 client.25498 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T05:56:24.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.462+0000 7fa84d282740 1 -- 172.21.15.37:0/3275234949 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x55e0d054c6a0 con 0x55e0d01c5570 2024-09-21T05:56:24.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.463+0000 7fa83f400640 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e0d01c5570 0x55e0d0664250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:24.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.463+0000 7fa83f400640 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e0d01c5570 0x55e0d0664250 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea8ef6307551be41 server_cookie=f421fb6b757e7c21 in_seq=0 out_seq=0 2024-09-21T05:56:24.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:24.463+0000 7fa829600640 10 client.25498 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:56:25.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa829600640 1 -- 172.21.15.37:0/3275234949 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e0d054c6a0 con 0x55e0d01c5570 2024-09-21T05:56:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa829600640 10 client.25498 handle_command_reply: tid=0 2024-09-21T05:56:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa84d282740 1 client.25498 shutdown 2024-09-21T05:56:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa84d282740 1 -- 172.21.15.37:0/3275234949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0231840 msgr2=0x55e0d0660660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa84d282740 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0231840 0x55e0d0660660 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa830009c90 tx=0x7fa830011de0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa84d282740 1 -- 172.21.15.37:0/3275234949 shutdown_connections 2024-09-21T05:56:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa84d282740 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55e0d01c5570 0x55e0d0664250 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa84d282740 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0d0231840 0x55e0d0660660 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa84d282740 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e0d0210b60 0x55e0d05e97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa84d282740 1 --2- 172.21.15.37:0/3275234949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0d0208980 0x55e0d05e91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa829600640 0 client.25498 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:56:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa84d282740 1 -- 172.21.15.37:0/3275234949 >> 172.21.15.37:0/3275234949 conn(0x55e0d0225990 msgr2=0x55e0d05e5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa84d282740 1 -- 172.21.15.37:0/3275234949 shutdown_connections 2024-09-21T05:56:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa84d282740 1 -- 172.21.15.37:0/3275234949 wait complete. 2024-09-21T05:56:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.396+0000 7fa84d282740 20 client.25498 trim_cache size 0 max 16384 2024-09-21T05:56:25.400 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:56:25.400 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:56:25.400 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:56:25.400 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 14, 2024-09-21T05:56:25.400 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:56:25.400 INFO:teuthology.orchestra.run.smithi037.stdout: "76d845ce": { 2024-09-21T05:56:25.400 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 14, 2024-09-21T05:56:25.400 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:56:25.400 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:56:25.400 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:56:25.400 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:56:25.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 147.8, 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:25.401 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:56:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.397+0000 7fa846600640 1 -- 172.21.15.37:0/1969318588 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa8240b64a0 msgr2=0x7fa8240b89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.397+0000 7fa846600640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa8240b64a0 0x7fa8240b89b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55e0d05d7fd0 tx=0x7fa838005d80 comp rx=0 tx=0).stop 2024-09-21T05:56:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.397+0000 7fa846600640 1 -- 172.21.15.37:0/1969318588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa840076080 msgr2=0x7fa84019cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.397+0000 7fa846600640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa840076080 0x7fa84019cc10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa84006c970 tx=0x7fa82c00ee50 comp rx=0 tx=0).stop 2024-09-21T05:56:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.397+0000 7fa846600640 1 -- 172.21.15.37:0/1969318588 shutdown_connections 2024-09-21T05:56:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.397+0000 7fa846600640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840110150 0x7fa8401a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.397+0000 7fa846600640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa840076080 0x7fa84019cc10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.397+0000 7fa846600640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fa8240b64a0 0x7fa8240b89b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.397+0000 7fa846600640 1 --2- 172.21.15.37:0/1969318588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa840075730 0x7fa84019c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.397+0000 7fa846600640 1 -- 172.21.15.37:0/1969318588 >> 172.21.15.37:0/1969318588 conn(0x7fa8400ff5a0 msgr2=0x7fa840109c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.397+0000 7fa846600640 1 -- 172.21.15.37:0/1969318588 shutdown_connections 2024-09-21T05:56:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:25.397+0000 7fa846600640 1 -- 172.21.15.37:0/1969318588 wait complete. 2024-09-21T05:56:25.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:25 smithi037 ceph-mon[30631]: pgmap v489: 129 pgs: 129 active+clean; 67 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 388 KiB/s wr, 123 op/s 2024-09-21T05:56:25.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:25 smithi067 ceph-mon[34443]: pgmap v489: 129 pgs: 129 active+clean; 67 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 388 KiB/s wr, 123 op/s 2024-09-21T05:56:25.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:25 smithi144 ceph-mon[34351]: pgmap v489: 129 pgs: 129 active+clean; 67 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 388 KiB/s wr, 123 op/s 2024-09-21T05:56:26.299 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '76d845ce', quiesce took 5.5 seconds. Will release after: 22.3 2024-09-21T05:56:27.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:27 smithi067 ceph-mon[34443]: pgmap v490: 129 pgs: 129 active+clean; 69 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 584 KiB/s wr, 142 op/s 2024-09-21T05:56:27.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:27 smithi144 ceph-mon[34351]: pgmap v490: 129 pgs: 129 active+clean; 69 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 584 KiB/s wr, 142 op/s 2024-09-21T05:56:27.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:27 smithi037 ceph-mon[30631]: pgmap v490: 129 pgs: 129 active+clean; 69 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 584 KiB/s wr, 142 op/s 2024-09-21T05:56:29.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:29 smithi067 ceph-mon[34443]: pgmap v491: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 595 KiB/s wr, 104 op/s 2024-09-21T05:56:29.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:29 smithi144 ceph-mon[34351]: pgmap v491: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 595 KiB/s wr, 104 op/s 2024-09-21T05:56:29.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:29 smithi037 ceph-mon[30631]: pgmap v491: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 595 KiB/s wr, 104 op/s 2024-09-21T05:56:31.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:31 smithi067 ceph-mon[34443]: pgmap v492: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 552 KiB/s wr, 62 op/s 2024-09-21T05:56:31.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:31 smithi144 ceph-mon[34351]: pgmap v492: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 552 KiB/s wr, 62 op/s 2024-09-21T05:56:31.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:31 smithi037 ceph-mon[30631]: pgmap v492: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 552 KiB/s wr, 62 op/s 2024-09-21T05:56:33.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:33 smithi067 ceph-mon[34443]: pgmap v493: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 486 KiB/s wr, 51 op/s 2024-09-21T05:56:33.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:33 smithi144 ceph-mon[34351]: pgmap v493: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 486 KiB/s wr, 51 op/s 2024-09-21T05:56:33.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:33 smithi037 ceph-mon[30631]: pgmap v493: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 486 KiB/s wr, 51 op/s 2024-09-21T05:56:35.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:35 smithi067 ceph-mon[34443]: pgmap v494: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 485 KiB/s wr, 47 op/s 2024-09-21T05:56:35.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:35 smithi144 ceph-mon[34351]: pgmap v494: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 485 KiB/s wr, 47 op/s 2024-09-21T05:56:35.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:35 smithi037 ceph-mon[30631]: pgmap v494: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 485 KiB/s wr, 47 op/s 2024-09-21T05:56:37.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:37 smithi144 ceph-mon[34351]: pgmap v495: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 420 KiB/s wr, 46 op/s 2024-09-21T05:56:37.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:37 smithi037 ceph-mon[30631]: pgmap v495: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 420 KiB/s wr, 46 op/s 2024-09-21T05:56:37.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:37 smithi067 ceph-mon[34443]: pgmap v495: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 420 KiB/s wr, 46 op/s 2024-09-21T05:56:39.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:39 smithi144 ceph-mon[34351]: pgmap v496: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 179 KiB/s wr, 21 op/s 2024-09-21T05:56:39.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:39 smithi037 ceph-mon[30631]: pgmap v496: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 179 KiB/s wr, 21 op/s 2024-09-21T05:56:39.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:39 smithi067 ceph-mon[34443]: pgmap v496: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 179 KiB/s wr, 21 op/s 2024-09-21T05:56:41.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:41 smithi144 ceph-mon[34351]: pgmap v497: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9.6 KiB/s wr, 5 op/s 2024-09-21T05:56:41.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:41 smithi037 ceph-mon[30631]: pgmap v497: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9.6 KiB/s wr, 5 op/s 2024-09-21T05:56:41.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:41 smithi067 ceph-mon[34443]: pgmap v497: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9.6 KiB/s wr, 5 op/s 2024-09-21T05:56:43.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:43 smithi037 ceph-mon[30631]: pgmap v498: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-09-21T05:56:43.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:43 smithi144 ceph-mon[34351]: pgmap v498: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-09-21T05:56:43.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:43 smithi067 ceph-mon[34443]: pgmap v498: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-09-21T05:56:45.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:45 smithi144 ceph-mon[34351]: pgmap v499: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-21T05:56:45.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:45 smithi037 ceph-mon[30631]: pgmap v499: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-21T05:56:45.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:45 smithi067 ceph-mon[34443]: pgmap v499: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-21T05:56:47.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:47 smithi144 ceph-mon[34351]: pgmap v500: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T05:56:47.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:47 smithi037 ceph-mon[30631]: pgmap v500: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T05:56:47.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:47 smithi067 ceph-mon[34443]: pgmap v500: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T05:56:48.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:56:48.997 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:56:49.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.649+0000 7f410d400640 1 -- 172.21.15.37:0/4039388268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4108105d90 msgr2=0x7f41081061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:49.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.649+0000 7f410d400640 1 --2- 172.21.15.37:0/4039388268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4108105d90 0x7f41081061a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009900 tx=0x7f40f802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:56:49.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.649+0000 7f410d400640 1 -- 172.21.15.37:0/4039388268 shutdown_connections 2024-09-21T05:56:49.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.649+0000 7f410d400640 1 --2- 172.21.15.37:0/4039388268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f410810c020 0x7f4108112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:49.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.649+0000 7f410d400640 1 --2- 172.21.15.37:0/4039388268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f410810b6d0 0x7f410810bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:49.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.649+0000 7f410d400640 1 --2- 172.21.15.37:0/4039388268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4108105d90 0x7f41081061a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:49.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.649+0000 7f410d400640 1 -- 172.21.15.37:0/4039388268 >> 172.21.15.37:0/4039388268 conn(0x7f4108101860 msgr2=0x7f4108103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.649+0000 7f410d400640 1 -- 172.21.15.37:0/4039388268 shutdown_connections 2024-09-21T05:56:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.649+0000 7f410d400640 1 -- 172.21.15.37:0/4039388268 wait complete. 2024-09-21T05:56:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.650+0000 7f410d400640 1 Processor -- start 2024-09-21T05:56:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.651+0000 7f410d400640 1 -- start start 2024-09-21T05:56:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.651+0000 7f410d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4108105d90 0x7f410819c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.651+0000 7f410d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f410810b6d0 0x7f410819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.651+0000 7f410d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f410810c020 0x7f41081a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.651+0000 7f410d400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4108115d30 con 0x7f4108105d90 2024-09-21T05:56:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.651+0000 7f410d400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4108115bb0 con 0x7f410810c020 2024-09-21T05:56:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.651+0000 7f410d400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4108115eb0 con 0x7f410810b6d0 2024-09-21T05:56:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.651+0000 7f4106800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4108105d90 0x7f410819c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.651+0000 7f4106800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4108105d90 0x7f410819c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39250/0 (socket says 172.21.15.37:39250) 2024-09-21T05:56:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.651+0000 7f4106800640 1 -- 172.21.15.37:0/2961159605 learned_addr learned my addr 172.21.15.37:0/2961159605 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.651+0000 7f40fde00640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f410810b6d0 0x7f410819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.652+0000 7f4107200640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f410810c020 0x7f41081a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.652+0000 7f4106800640 1 -- 172.21.15.37:0/2961159605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f410810b6d0 msgr2=0x7f410819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.652+0000 7f4106800640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f410810b6d0 0x7f410819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.652+0000 7f4106800640 1 -- 172.21.15.37:0/2961159605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f410810c020 msgr2=0x7f41081a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.652+0000 7f4106800640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f410810c020 0x7f41081a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.652+0000 7f4106800640 1 -- 172.21.15.37:0/2961159605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41081a2690 con 0x7f4108105d90 2024-09-21T05:56:49.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.652+0000 7f40fde00640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f410810b6d0 0x7f410819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.652+0000 7f4106800640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4108105d90 0x7f410819c720 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f40f8005ab0 tx=0x7f40f8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.653+0000 7f40ffe00640 1 -- 172.21.15.37:0/2961159605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f803f070 con 0x7f4108105d90 2024-09-21T05:56:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.653+0000 7f410d400640 1 -- 172.21.15.37:0/2961159605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41081a2920 con 0x7f4108105d90 2024-09-21T05:56:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.653+0000 7f410d400640 1 -- 172.21.15.37:0/2961159605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41081a90e0 con 0x7f4108105d90 2024-09-21T05:56:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.653+0000 7f40ffe00640 1 -- 172.21.15.37:0/2961159605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40f8031b60 con 0x7f4108105d90 2024-09-21T05:56:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.653+0000 7f40ffe00640 1 -- 172.21.15.37:0/2961159605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f8035030 con 0x7f4108105d90 2024-09-21T05:56:49.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.654+0000 7f410d400640 1 -- 172.21.15.37:0/2961159605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41081061a0 con 0x7f4108105d90 2024-09-21T05:56:49.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.658+0000 7f40ffe00640 1 -- 172.21.15.37:0/2961159605 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f40f8042070 con 0x7f4108105d90 2024-09-21T05:56:49.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.659+0000 7f40ffe00640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f40ec0b6590 0x7f40ec0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.660+0000 7f40ffe00640 1 -- 172.21.15.37:0/2961159605 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f40f8108590 con 0x7f4108105d90 2024-09-21T05:56:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.660+0000 7f40fde00640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f40ec0b6590 0x7f40ec0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.660+0000 7f40fde00640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f40ec0b6590 0x7f40ec0b8aa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f410810b1f0 tx=0x7f40f0005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:49.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.662+0000 7f40ffe00640 1 -- 172.21.15.37:0/2961159605 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f40f80ce9f0 con 0x7f4108105d90 2024-09-21T05:56:49.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:49 smithi144 ceph-mon[34351]: pgmap v501: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T05:56:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.901+0000 7f410d400640 1 -- 172.21.15.37:0/2961159605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f410810de20 con 0x7f4108105d90 2024-09-21T05:56:49.904 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:49 smithi037 ceph-mon[30631]: pgmap v501: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T05:56:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.902+0000 7f40ffe00640 1 -- 172.21.15.37:0/2961159605 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f40f80d2dd0 con 0x7f4108105d90 2024-09-21T05:56:49.905 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:56:49.905 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:56:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:56:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.905+0000 7f410d400640 1 -- 172.21.15.37:0/2961159605 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f40ec0b6590 msgr2=0x7f40ec0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.905+0000 7f410d400640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f40ec0b6590 0x7f40ec0b8aa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f410810b1f0 tx=0x7f40f0005f90 comp rx=0 tx=0).stop 2024-09-21T05:56:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.905+0000 7f410d400640 1 -- 172.21.15.37:0/2961159605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4108105d90 msgr2=0x7f410819c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.905+0000 7f410d400640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4108105d90 0x7f410819c720 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f40f8005ab0 tx=0x7f40f8003c10 comp rx=0 tx=0).stop 2024-09-21T05:56:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.905+0000 7f410d400640 1 -- 172.21.15.37:0/2961159605 shutdown_connections 2024-09-21T05:56:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.905+0000 7f410d400640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f40ec0b6590 0x7f40ec0b8aa0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.905+0000 7f410d400640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f410810c020 0x7f41081a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.905+0000 7f410d400640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f410810b6d0 0x7f410819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.905+0000 7f410d400640 1 --2- 172.21.15.37:0/2961159605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4108105d90 0x7f410819c720 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.905+0000 7f410d400640 1 -- 172.21.15.37:0/2961159605 >> 172.21.15.37:0/2961159605 conn(0x7f4108101860 msgr2=0x7f4108103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.905+0000 7f410d400640 1 -- 172.21.15.37:0/2961159605 shutdown_connections 2024-09-21T05:56:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:49.906+0000 7f410d400640 1 -- 172.21.15.37:0/2961159605 wait complete. 2024-09-21T05:56:49.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:49 smithi067 ceph-mon[34443]: pgmap v501: 129 pgs: 129 active+clean; 71 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T05:56:50.712 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db --set-id 76d845ce --release --await' 2024-09-21T05:56:50.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db --set-id 76d845ce --release --await 2024-09-21T05:56:50.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:50 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2961159605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:56:50.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:50 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2961159605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:56:50.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:50 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2961159605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:56:51.099 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:56:51.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:51 smithi037 ceph-mon[30631]: pgmap v502: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T05:56:51.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:51 smithi144 ceph-mon[34351]: pgmap v502: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T05:56:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.910+0000 7f50c1a00640 1 -- 172.21.15.37:0/921774775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc1100c0 msgr2=0x7f50bc112500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.910+0000 7f50c1a00640 1 --2- 172.21.15.37:0/921774775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc1100c0 0x7f50bc112500 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009ca0 tx=0x7f50b402a8c0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.910+0000 7f50c1a00640 1 -- 172.21.15.37:0/921774775 shutdown_connections 2024-09-21T05:56:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.910+0000 7f50c1a00640 1 --2- 172.21.15.37:0/921774775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc1100c0 0x7f50bc112500 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.910+0000 7f50c1a00640 1 --2- 172.21.15.37:0/921774775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50bc076100 0x7f50bc10fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.910+0000 7f50c1a00640 1 --2- 172.21.15.37:0/921774775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50bc0757b0 0x7f50bc075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.910+0000 7f50c1a00640 1 -- 172.21.15.37:0/921774775 >> 172.21.15.37:0/921774775 conn(0x7f50bc07b850 msgr2=0x7f50bc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.910+0000 7f50c1a00640 1 -- 172.21.15.37:0/921774775 shutdown_connections 2024-09-21T05:56:51.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.910+0000 7f50c1a00640 1 -- 172.21.15.37:0/921774775 wait complete. 2024-09-21T05:56:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.911+0000 7f50c1a00640 1 Processor -- start 2024-09-21T05:56:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.912+0000 7f50c1a00640 1 -- start start 2024-09-21T05:56:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.912+0000 7f50c1a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc0757b0 0x7f50bc19c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.912+0000 7f50c1a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50bc076100 0x7f50bc19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.912+0000 7f50c1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50bc1100c0 0x7f50bc1a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.912+0000 7f50c1a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc115c70 con 0x7f50bc0757b0 2024-09-21T05:56:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.912+0000 7f50c1a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc115af0 con 0x7f50bc076100 2024-09-21T05:56:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.912+0000 7f50c1a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc115df0 con 0x7f50bc1100c0 2024-09-21T05:56:51.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.912+0000 7f50baa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc0757b0 0x7f50bc19c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.912+0000 7f50baa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc0757b0 0x7f50bc19c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58740/0 (socket says 172.21.15.37:58740) 2024-09-21T05:56:51.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.912+0000 7f50baa00640 1 -- 172.21.15.37:0/1215243833 learned_addr learned my addr 172.21.15.37:0/1215243833 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:51.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.912+0000 7f50b2000640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50bc076100 0x7f50bc19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.913+0000 7f50bb400640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50bc1100c0 0x7f50bc1a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.913+0000 7f50baa00640 1 -- 172.21.15.37:0/1215243833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50bc1100c0 msgr2=0x7f50bc1a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:51.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.913+0000 7f50baa00640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50bc1100c0 0x7f50bc1a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.913+0000 7f50baa00640 1 -- 172.21.15.37:0/1215243833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50bc076100 msgr2=0x7f50bc19cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:51.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.913+0000 7f50baa00640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50bc076100 0x7f50bc19cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.913+0000 7f50baa00640 1 -- 172.21.15.37:0/1215243833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc1a2570 con 0x7f50bc0757b0 2024-09-21T05:56:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.913+0000 7f50b2000640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50bc076100 0x7f50bc19cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.913+0000 7f50baa00640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc0757b0 0x7f50bc19c600 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00e9f0 tx=0x7f50ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.914+0000 7f50b3e00640 1 -- 172.21.15.37:0/1215243833 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac00cd80 con 0x7f50bc0757b0 2024-09-21T05:56:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.914+0000 7f50b3e00640 1 -- 172.21.15.37:0/1215243833 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50ac0054d0 con 0x7f50bc0757b0 2024-09-21T05:56:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.914+0000 7f50c1a00640 1 -- 172.21.15.37:0/1215243833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50bc1a2860 con 0x7f50bc0757b0 2024-09-21T05:56:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.914+0000 7f50b3e00640 1 -- 172.21.15.37:0/1215243833 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac010690 con 0x7f50bc0757b0 2024-09-21T05:56:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.914+0000 7f50c1a00640 1 -- 172.21.15.37:0/1215243833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50bc1a8fc0 con 0x7f50bc0757b0 2024-09-21T05:56:51.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.917+0000 7f50c86b2740 1 Processor -- start 2024-09-21T05:56:51.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.917+0000 7f50c86b2740 1 -- start start 2024-09-21T05:56:51.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.917+0000 7f50b3e00640 1 -- 172.21.15.37:0/1215243833 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f50ac004e90 con 0x7f50bc0757b0 2024-09-21T05:56:51.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.917+0000 7f50c86b2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923dc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.917+0000 7f50c86b2740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56039200c660 0x5603923dc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.917+0000 7f50c86b2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560392014840 0x5603923dcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.918+0000 7f50c86b2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560392353290 con 0x560392035520 2024-09-21T05:56:51.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.918+0000 7f50c86b2740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5603923426c0 con 0x56039200c660 2024-09-21T05:56:51.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.918+0000 7f50c86b2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5603923464d0 con 0x560392014840 2024-09-21T05:56:51.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.918+0000 7f50bb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923dc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.918+0000 7f50bb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923dc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58754/0 (socket says 172.21.15.37:58754) 2024-09-21T05:56:51.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.918+0000 7f50bb400640 1 -- 172.21.15.37:0/702242199 learned_addr learned my addr 172.21.15.37:0/702242199 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:51.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.918+0000 7f50baa00640 1 --2- 172.21.15.37:0/702242199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56039200c660 0x5603923dc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.918+0000 7f50b2000640 1 --2- 172.21.15.37:0/702242199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560392014840 0x5603923dcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.918+0000 7f50bb400640 1 -- 172.21.15.37:0/702242199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560392014840 msgr2=0x5603923dcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.918+0000 7f50bb400640 1 --2- 172.21.15.37:0/702242199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560392014840 0x5603923dcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.918+0000 7f50bb400640 1 -- 172.21.15.37:0/702242199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56039200c660 msgr2=0x5603923dc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.918+0000 7f50bb400640 1 --2- 172.21.15.37:0/702242199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56039200c660 0x5603923dc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.918+0000 7f50bb400640 1 -- 172.21.15.37:0/702242199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603922cf460 con 0x560392035520 2024-09-21T05:56:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.919+0000 7f50bb400640 1 --2- 172.21.15.37:0/702242199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923dc1c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f50b402f410 tx=0x7f50b402f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db192c9fb720377b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.919+0000 7f50abe00640 1 -- 172.21.15.37:0/702242199 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4031cf0 con 0x560392035520 2024-09-21T05:56:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.919+0000 7f50abe00640 1 -- 172.21.15.37:0/702242199 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50b4036030 con 0x560392035520 2024-09-21T05:56:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.919+0000 7f50abe00640 1 -- 172.21.15.37:0/702242199 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b40042a0 con 0x560392035520 2024-09-21T05:56:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.920+0000 7f50b3e00640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f50a00b6510 0x7f50a00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.920+0000 7f50baa00640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f50a00b6510 0x7f50a00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.920+0000 7f50b3e00640 1 -- 172.21.15.37:0/1215243833 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f50ac0e7b20 con 0x7f50bc0757b0 2024-09-21T05:56:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.920+0000 7f50c86b2740 1 -- 172.21.15.37:0/702242199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 msgr2=0x5603923dc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.920+0000 7f50c86b2740 1 --2- 172.21.15.37:0/702242199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923dc1c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f50b402f410 tx=0x7f50b402f440 comp rx=0 tx=0).stop 2024-09-21T05:56:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.920+0000 7f50c86b2740 1 -- 172.21.15.37:0/702242199 shutdown_connections 2024-09-21T05:56:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.920+0000 7f50c86b2740 1 --2- 172.21.15.37:0/702242199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560392014840 0x5603923dcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.921+0000 7f50c86b2740 1 --2- 172.21.15.37:0/702242199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56039200c660 0x5603923dc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.921+0000 7f50c86b2740 1 --2- 172.21.15.37:0/702242199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923dc1c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.921+0000 7f50c86b2740 1 -- 172.21.15.37:0/702242199 >> 172.21.15.37:0/702242199 conn(0x560392029910 msgr2=0x5603923da0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.921+0000 7f50baa00640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f50a00b6510 0x7f50a00b8a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0ad580 tx=0x7f50ac0a9040 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.921+0000 7f50c86b2740 1 -- 172.21.15.37:0/702242199 shutdown_connections 2024-09-21T05:56:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.921+0000 7f50c86b2740 1 -- 172.21.15.37:0/702242199 wait complete. 2024-09-21T05:56:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.921+0000 7f50c86b2740 1 -- start start 2024-09-21T05:56:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.922+0000 7f50c86b2740 1 Processor -- start 2024-09-21T05:56:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.922+0000 7f50c86b2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 0x5603923e7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.922+0000 7f50c86b2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392014840 0x5603923e83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.922+0000 7f50c86b2740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392035520 0x5603923f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.922+0000 7f50c86b2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5603921a3bb0 con 0x560392014840 2024-09-21T05:56:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.922+0000 7f50c86b2740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5603922dd6c0 con 0x560392035520 2024-09-21T05:56:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.922+0000 7f50c86b2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5603923ea7c0 con 0x56039200c660 2024-09-21T05:56:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.922+0000 7f50c86b2740 10 client.0 _ll_register_callbacks cb 0x5603922f8490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.922+0000 7f50b2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392014840 0x5603923e83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.923+0000 7f50b2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392014840 0x5603923e83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58756/0 (socket says 172.21.15.37:58756) 2024-09-21T05:56:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.923+0000 7f50b2000640 1 -- 172.21.15.37:0/3222753862 learned_addr learned my addr 172.21.15.37:0/3222753862 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.923+0000 7f50bb400640 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392035520 0x5603923f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.923+0000 7f50bb400640 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 0x5603923e7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.923+0000 7f50b2000640 1 -- 172.21.15.37:0/3222753862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 msgr2=0x5603923e7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.923+0000 7f50b2000640 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 0x5603923e7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.923+0000 7f50b2000640 1 -- 172.21.15.37:0/3222753862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392035520 msgr2=0x5603923f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.923+0000 7f50b2000640 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392035520 0x5603923f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.923+0000 7f50b2000640 1 -- 172.21.15.37:0/3222753862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603920a0b00 con 0x560392014840 2024-09-21T05:56:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.923+0000 7f50bb400640 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 0x5603923e7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:56:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.923+0000 7f50b2000640 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392014840 0x5603923e83a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f50a4012b10 tx=0x7f50a400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231a8fac3d333306 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.923+0000 7f50a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T05:56:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.924+0000 7f50a8c00640 1 -- 172.21.15.37:0/3222753862 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a400fb40 con 0x560392014840 2024-09-21T05:56:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.924+0000 7f50a8c00640 1 -- 172.21.15.37:0/3222753862 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f50a400fce0 con 0x560392014840 2024-09-21T05:56:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.924+0000 7f50c86b2740 1 -- 172.21.15.37:0/3222753862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50b4036030 con 0x560392014840 2024-09-21T05:56:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.924+0000 7f50a8c00640 1 -- 172.21.15.37:0/3222753862 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f50a4025050 con 0x560392014840 2024-09-21T05:56:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.924+0000 7f50c86b2740 10 client.15471 fetch_fsmap learned FSMap version 21 2024-09-21T05:56:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.924+0000 7f50c86b2740 1 -- 172.21.15.37:0/3222753862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560392117960 con 0x560392014840 2024-09-21T05:56:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.924+0000 7f50a8c00640 1 -- 172.21.15.37:0/3222753862 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50b4036030 con 0x560392014840 2024-09-21T05:56:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.925+0000 7f50a8c00640 1 -- 172.21.15.37:0/3222753862 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f50a4003c40 con 0x560392014840 2024-09-21T05:56:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.925+0000 7f50c86b2740 10 client.15471 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:56:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.925+0000 7f50c86b2740 10 client.15471 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:56:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.925+0000 7f50c86b2740 20 client.15471 populate_metadata read hostname 'smithi037' 2024-09-21T05:56:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.925+0000 7f50c86b2740 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x560391ff3ea0 0x5603923f9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.925+0000 7f50c86b2740 4 client.15471 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:56:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.925+0000 7f50c86b2740 1 -- 172.21.15.37:0/3222753862 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603923551e0 con 0x560391ff3ea0 2024-09-21T05:56:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.925+0000 7f50bb400640 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x560391ff3ea0 0x5603923f9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.926+0000 7f50bb400640 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x560391ff3ea0 0x5603923f9c30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4c328bc7e44f22f server_cookie=dbfcdd997c810d03 in_seq=0 out_seq=0 2024-09-21T05:56:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.926+0000 7f50a8c00640 10 client.15471 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:56:51.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.927+0000 7f50a8c00640 1 -- 172.21.15.37:0/3222753862 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603923551e0 con 0x560391ff3ea0 2024-09-21T05:56:51.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.927+0000 7f50a8c00640 10 client.15471 handle_command_reply: tid=0 2024-09-21T05:56:51.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.927+0000 7f50c86b2740 1 client.15471 shutdown 2024-09-21T05:56:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.927+0000 7f50c86b2740 1 -- 172.21.15.37:0/3222753862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392014840 msgr2=0x5603923e83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.927+0000 7f50c86b2740 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392014840 0x5603923e83a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f50a4012b10 tx=0x7f50a400f3c0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.927+0000 7f50c86b2740 1 -- 172.21.15.37:0/3222753862 shutdown_connections 2024-09-21T05:56:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.927+0000 7f50c86b2740 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x560391ff3ea0 0x5603923f9c30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.927+0000 7f50c86b2740 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392035520 0x5603923f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.927+0000 7f50c86b2740 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392014840 0x5603923e83a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.927+0000 7f50a8c00640 0 client.15471 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:56:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.927+0000 7f50c86b2740 1 --2- 172.21.15.37:0/3222753862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 0x5603923e7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.927+0000 7f50c86b2740 1 -- 172.21.15.37:0/3222753862 >> 172.21.15.37:0/3222753862 conn(0x560392029910 msgr2=0x5603923df3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.927+0000 7f50c86b2740 1 -- 172.21.15.37:0/3222753862 shutdown_connections 2024-09-21T05:56:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.928+0000 7f50c86b2740 1 -- 172.21.15.37:0/3222753862 wait complete. 2024-09-21T05:56:51.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.928+0000 7f50c86b2740 20 client.15471 trim_cache size 0 max 16384 2024-09-21T05:56:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.946+0000 7f50c86b2740 1 Processor -- start 2024-09-21T05:56:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.946+0000 7f50c86b2740 1 -- start start 2024-09-21T05:56:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.946+0000 7f50c86b2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 0x5603923e9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.946+0000 7f50c86b2740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392014840 0x5603923dd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.946+0000 7f50c86b2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.946+0000 7f50c86b2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1b0cf0 con 0x560392035520 2024-09-21T05:56:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.946+0000 7f50c86b2740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1b3570 con 0x560392014840 2024-09-21T05:56:51.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.946+0000 7f50c86b2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1b1360 con 0x56039200c660 2024-09-21T05:56:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.947+0000 7f50bb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.947+0000 7f50bb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923f39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58760/0 (socket says 172.21.15.37:58760) 2024-09-21T05:56:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.947+0000 7f50bb400640 1 -- 172.21.15.37:0/1125136250 learned_addr learned my addr 172.21.15.37:0/1125136250 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.947+0000 7f50b2000640 1 --2- 172.21.15.37:0/1125136250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392014840 0x5603923dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.947+0000 7f50bb400640 1 --2- 172.21.15.37:0/1125136250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 0x5603923e9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.947+0000 7f50b2000640 1 -- 172.21.15.37:0/1125136250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 msgr2=0x5603923e9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.947+0000 7f50b2000640 1 --2- 172.21.15.37:0/1125136250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 0x5603923e9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.947+0000 7f50b2000640 1 -- 172.21.15.37:0/1125136250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 msgr2=0x5603923f39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.947+0000 7f50b2000640 1 --2- 172.21.15.37:0/1125136250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923f39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.947+0000 7f50b2000640 1 -- 172.21.15.37:0/1125136250 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603923e8820 con 0x560392014840 2024-09-21T05:56:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.947+0000 7f50bb400640 1 --2- 172.21.15.37:0/1125136250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923f39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:56:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.947+0000 7f50b2000640 1 --2- 172.21.15.37:0/1125136250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392014840 0x5603923dd900 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50a4000c00 tx=0x7f50a40109c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfdf97cb8152690a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.948+0000 7f50ab400640 1 -- 172.21.15.37:0/1125136250 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a4022040 con 0x560392014840 2024-09-21T05:56:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.948+0000 7f50ab400640 1 -- 172.21.15.37:0/1125136250 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50a400fc00 con 0x560392014840 2024-09-21T05:56:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.948+0000 7f50ab400640 1 -- 172.21.15.37:0/1125136250 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a40055d0 con 0x560392014840 2024-09-21T05:56:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.948+0000 7f50c86b2740 1 -- 172.21.15.37:0/1125136250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392014840 msgr2=0x5603923dd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.948+0000 7f50c86b2740 1 --2- 172.21.15.37:0/1125136250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392014840 0x5603923dd900 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50a4000c00 tx=0x7f50a40109c0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.948+0000 7f50c86b2740 1 -- 172.21.15.37:0/1125136250 shutdown_connections 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.948+0000 7f50c86b2740 1 --2- 172.21.15.37:0/1125136250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923f39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.948+0000 7f50c86b2740 1 --2- 172.21.15.37:0/1125136250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392014840 0x5603923dd900 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.948+0000 7f50c86b2740 1 --2- 172.21.15.37:0/1125136250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 0x5603923e9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.948+0000 7f50c86b2740 1 -- 172.21.15.37:0/1125136250 >> 172.21.15.37:0/1125136250 conn(0x560392029910 msgr2=0x5603923dd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.949+0000 7f50c86b2740 1 -- 172.21.15.37:0/1125136250 shutdown_connections 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.949+0000 7f50c86b2740 1 -- 172.21.15.37:0/1125136250 wait complete. 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.949+0000 7f50c86b2740 1 -- start start 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.949+0000 7f50c86b2740 1 Processor -- start 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.950+0000 7f50c86b2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 0x5603923f0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.950+0000 7f50c86b2740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392014840 0x5603923eaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.950+0000 7f50c86b2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923eb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.950+0000 7f50c86b2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1b1a30 con 0x560392035520 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.950+0000 7f50c86b2740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1b2ea0 con 0x560392014840 2024-09-21T05:56:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.950+0000 7f50c86b2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1b2100 con 0x56039200c660 2024-09-21T05:56:51.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.950+0000 7f50c86b2740 10 client.0 _ll_register_callbacks cb 0x7f50a4009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:56:51.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.950+0000 7f50bb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923eb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.950+0000 7f50bb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923eb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58762/0 (socket says 172.21.15.37:58762) 2024-09-21T05:56:51.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.950+0000 7f50bb400640 1 -- 172.21.15.37:0/4115727245 learned_addr learned my addr 172.21.15.37:0/4115727245 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:56:51.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.950+0000 7f50bb400640 1 --2- 172.21.15.37:0/4115727245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 0x5603923f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.950+0000 7f50b2000640 1 --2- 172.21.15.37:0/4115727245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392014840 0x5603923eaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.951+0000 7f50bb400640 1 -- 172.21.15.37:0/4115727245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 msgr2=0x5603923f0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:51.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.951+0000 7f50bb400640 1 --2- 172.21.15.37:0/4115727245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 0x5603923f0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.951+0000 7f50bb400640 1 -- 172.21.15.37:0/4115727245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392014840 msgr2=0x5603923eaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:56:51.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.951+0000 7f50bb400640 1 --2- 172.21.15.37:0/4115727245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392014840 0x5603923eaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.951+0000 7f50bb400640 1 -- 172.21.15.37:0/4115727245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603924645b0 con 0x560392035520 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.951+0000 7f50bb400640 1 --2- 172.21.15.37:0/4115727245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923eb190 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f50b4003fd0 tx=0x7f50b402f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e07a1e596351b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.951+0000 7f50a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.951+0000 7f50a8c00640 1 -- 172.21.15.37:0/4115727245 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b404a040 con 0x560392035520 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.951+0000 7f50c86b2740 1 -- 172.21.15.37:0/4115727245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50a400fc00 con 0x560392035520 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.951+0000 7f50a8c00640 1 -- 172.21.15.37:0/4115727245 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f50b4031650 con 0x560392035520 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.952+0000 7f50a8c00640 1 -- 172.21.15.37:0/4115727245 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f50b4031850 con 0x560392035520 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.952+0000 7f50c86b2740 10 client.15477 fetch_fsmap learned FSMap version 21 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.952+0000 7f50c86b2740 1 -- 172.21.15.37:0/4115727245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560392465780 con 0x560392035520 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.952+0000 7f50a8c00640 1 -- 172.21.15.37:0/4115727245 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50a400fc00 con 0x560392035520 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.952+0000 7f50a8c00640 1 -- 172.21.15.37:0/4115727245 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f50b4043070 con 0x560392035520 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.952+0000 7f50c86b2740 10 client.15477 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.952+0000 7f50c86b2740 10 client.15477 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.952+0000 7f50c86b2740 20 client.15477 populate_metadata read hostname 'smithi037' 2024-09-21T05:56:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.952+0000 7f50c86b2740 1 --2- 172.21.15.37:0/4115727245 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x560391fc9250 0x560392467b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:56:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.952+0000 7f50c86b2740 4 client.15477 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "76d845ce", "release": true, "await": true}] 2024-09-21T05:56:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.952+0000 7f50c86b2740 1 -- 172.21.15.37:0/4115727245 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "set_id": "76d845ce", "release": true, "await": true}) -- 0x560392350c90 con 0x560391fc9250 2024-09-21T05:56:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.953+0000 7f50b2000640 1 --2- 172.21.15.37:0/4115727245 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x560391fc9250 0x560392467b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:56:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.953+0000 7f50b2000640 1 --2- 172.21.15.37:0/4115727245 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x560391fc9250 0x560392467b70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=185d32e1bbfab5f9 server_cookie=e0c52c215e975d3b in_seq=0 out_seq=0 2024-09-21T05:56:51.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:51.953+0000 7f50a8c00640 10 client.15477 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:56:51.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:51 smithi067 ceph-mon[34443]: pgmap v502: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T05:56:52.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.149+0000 7f50a8c00640 1 -- 172.21.15.37:0/4115727245 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560392350c90 con 0x560391fc9250 2024-09-21T05:56:52.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.149+0000 7f50a8c00640 10 client.15477 handle_command_reply: tid=0 2024-09-21T05:56:52.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.149+0000 7f50c86b2740 1 client.15477 shutdown 2024-09-21T05:56:52.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.149+0000 7f50c86b2740 1 -- 172.21.15.37:0/4115727245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 msgr2=0x5603923eb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:52.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.149+0000 7f50c86b2740 1 --2- 172.21.15.37:0/4115727245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923eb190 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f50b4003fd0 tx=0x7f50b402f3a0 comp rx=0 tx=0).stop 2024-09-21T05:56:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.150+0000 7f50c86b2740 1 -- 172.21.15.37:0/4115727245 shutdown_connections 2024-09-21T05:56:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.150+0000 7f50c86b2740 1 --2- 172.21.15.37:0/4115727245 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x560391fc9250 0x560392467b70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.150+0000 7f50c86b2740 1 --2- 172.21.15.37:0/4115727245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392035520 0x5603923eb190 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.150+0000 7f50c86b2740 1 --2- 172.21.15.37:0/4115727245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560392014840 0x5603923eaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.150+0000 7f50c86b2740 1 --2- 172.21.15.37:0/4115727245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56039200c660 0x5603923f0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.150+0000 7f50c86b2740 1 -- 172.21.15.37:0/4115727245 >> 172.21.15.37:0/4115727245 conn(0x560392029910 msgr2=0x5603923e9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.150+0000 7f50a8c00640 0 client.15477 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:56:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.150+0000 7f50c86b2740 1 -- 172.21.15.37:0/4115727245 shutdown_connections 2024-09-21T05:56:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.150+0000 7f50c86b2740 1 -- 172.21.15.37:0/4115727245 wait complete. 2024-09-21T05:56:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.150+0000 7f50c86b2740 20 client.15477 trim_cache size 0 max 16384 2024-09-21T05:56:52.154 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:56:52.154 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:56:52.154 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:56:52.155 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 16, 2024-09-21T05:56:52.155 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:56:52.155 INFO:teuthology.orchestra.run.smithi037.stdout: "76d845ce": { 2024-09-21T05:56:52.155 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 16, 2024-09-21T05:56:52.155 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:56:52.155 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:56:52.155 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:56:52.155 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:56:52.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:56:52.155 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:56:52.155 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 147.8, 2024-09-21T05:56:52.156 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:56:52.156 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:56:52.156 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:56:52.156 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:56:52.156 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:56:52.156 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:56:52.156 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:52.156 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:52.156 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:52.156 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:52.156 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:56:52.157 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:56:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.151+0000 7f50c1a00640 1 -- 172.21.15.37:0/1215243833 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f50a00b6510 msgr2=0x7f50a00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.151+0000 7f50c1a00640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f50a00b6510 0x7f50a00b8a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0ad580 tx=0x7f50ac0a9040 comp rx=0 tx=0).stop 2024-09-21T05:56:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.151+0000 7f50c1a00640 1 -- 172.21.15.37:0/1215243833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc0757b0 msgr2=0x7f50bc19c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:56:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.151+0000 7f50c1a00640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc0757b0 0x7f50bc19c600 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00e9f0 tx=0x7f50ac00edf0 comp rx=0 tx=0).stop 2024-09-21T05:56:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.151+0000 7f50c1a00640 1 -- 172.21.15.37:0/1215243833 shutdown_connections 2024-09-21T05:56:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.151+0000 7f50c1a00640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50bc1100c0 0x7f50bc1a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.151+0000 7f50c1a00640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f50a00b6510 0x7f50a00b8a20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.151+0000 7f50c1a00640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50bc076100 0x7f50bc19cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.151+0000 7f50c1a00640 1 --2- 172.21.15.37:0/1215243833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50bc0757b0 0x7f50bc19c600 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:56:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.151+0000 7f50c1a00640 1 -- 172.21.15.37:0/1215243833 >> 172.21.15.37:0/1215243833 conn(0x7f50bc07b850 msgr2=0x7f50bc100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:56:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.151+0000 7f50c1a00640 1 -- 172.21.15.37:0/1215243833 shutdown_connections 2024-09-21T05:56:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:56:52.151+0000 7f50c1a00640 1 -- 172.21.15.37:0/1215243833 wait complete. 2024-09-21T05:56:52.235 INFO:tasks.workunit.client.0.smithi037.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-09-21T05:56:52.235 INFO:tasks.workunit.client.0.smithi037.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-09-21T05:56:52.294 INFO:tasks.workunit.client.0.smithi037.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-09-21T05:56:52.391 INFO:tasks.workunit.client.0.smithi037.stdout:checking if gcc static flag -static works... no 2024-09-21T05:56:52.484 INFO:tasks.workunit.client.0.smithi037.stdout:checking if gcc supports -c -o file.o... yes 2024-09-21T05:56:52.484 INFO:tasks.workunit.client.0.smithi037.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-09-21T05:56:52.500 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-09-21T05:56:52.611 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether -lc should be explicitly linked in... no 2024-09-21T05:56:52.720 INFO:tasks.workunit.client.0.smithi037.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-09-21T05:56:52.720 INFO:tasks.workunit.client.0.smithi037.stdout:checking how to hardcode library paths into programs... immediate 2024-09-21T05:56:52.723 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether stripping libraries is possible... yes 2024-09-21T05:56:52.723 INFO:tasks.workunit.client.0.smithi037.stdout:checking if libtool supports shared libraries... yes 2024-09-21T05:56:52.723 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether to build shared libraries... yes 2024-09-21T05:56:52.723 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether to build static libraries... yes 2024-09-21T05:56:52.740 INFO:tasks.workunit.client.0.smithi037.stdout:checking for gcc... (cached) gcc 2024-09-21T05:56:52.794 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-21T05:56:52.794 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-21T05:56:52.795 INFO:tasks.workunit.client.0.smithi037.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-21T05:56:52.795 INFO:tasks.workunit.client.0.smithi037.stdout:checking for gmake... /usr/bin/gmake 2024-09-21T05:56:52.795 INFO:tasks.workunit.client.0.smithi037.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-09-21T05:56:52.796 INFO:tasks.workunit.client.0.smithi037.stdout:checking for tar... /bin/tar 2024-09-21T05:56:52.796 INFO:tasks.workunit.client.0.smithi037.stdout:checking for gzip... /bin/gzip 2024-09-21T05:56:52.852 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether gcc -MM is supported... yes 2024-09-21T05:56:52.852 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sort... /bin/sort 2024-09-21T05:56:52.853 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether ln -s works... yes 2024-09-21T05:56:52.853 INFO:tasks.workunit.client.0.smithi037.stdout:checking for rpm... /bin/rpm 2024-09-21T05:56:52.862 INFO:tasks.workunit.client.0.smithi037.stdout:checking for rpmbuild... no 2024-09-21T05:56:52.955 INFO:tasks.workunit.client.0.smithi037.stdout:checking assert.h usability... yes 2024-09-21T05:56:52.981 INFO:tasks.workunit.client.0.smithi037.stdout:checking assert.h presence... yes 2024-09-21T05:56:52.981 INFO:tasks.workunit.client.0.smithi037.stdout:checking for assert.h... yes 2024-09-21T05:56:53.073 INFO:tasks.workunit.client.0.smithi037.stdout:checking bstring.h usability... no 2024-09-21T05:56:53.116 INFO:tasks.workunit.client.0.smithi037.stdout:checking bstring.h presence... no 2024-09-21T05:56:53.116 INFO:tasks.workunit.client.0.smithi037.stdout:checking for bstring.h... no 2024-09-21T05:56:53.144 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '76d845ce', total seconds elapsed: 32.3 2024-09-21T05:56:53.186 INFO:tasks.workunit.client.0.smithi037.stdout:checking libgen.h usability... yes 2024-09-21T05:56:53.219 INFO:tasks.workunit.client.0.smithi037.stdout:checking libgen.h presence... yes 2024-09-21T05:56:53.219 INFO:tasks.workunit.client.0.smithi037.stdout:checking for libgen.h... yes 2024-09-21T05:56:53.318 INFO:tasks.workunit.client.0.smithi037.stdout:checking dirent.h usability... yes 2024-09-21T05:56:53.345 INFO:tasks.workunit.client.0.smithi037.stdout:checking dirent.h presence... yes 2024-09-21T05:56:53.345 INFO:tasks.workunit.client.0.smithi037.stdout:checking for dirent.h... yes 2024-09-21T05:56:53.419 INFO:tasks.workunit.client.0.smithi037.stdout:checking errno.h usability... yes 2024-09-21T05:56:53.446 INFO:tasks.workunit.client.0.smithi037.stdout:checking errno.h presence... yes 2024-09-21T05:56:53.446 INFO:tasks.workunit.client.0.smithi037.stdout:checking for errno.h... yes 2024-09-21T05:56:53.527 INFO:tasks.workunit.client.0.smithi037.stdout:checking malloc.h usability... yes 2024-09-21T05:56:53.555 INFO:tasks.workunit.client.0.smithi037.stdout:checking malloc.h presence... yes 2024-09-21T05:56:53.556 INFO:tasks.workunit.client.0.smithi037.stdout:checking for malloc.h... yes 2024-09-21T05:56:53.635 INFO:tasks.workunit.client.0.smithi037.stdout:checking uuid.h usability... no 2024-09-21T05:56:53.678 INFO:tasks.workunit.client.0.smithi037.stdout:checking uuid.h presence... no 2024-09-21T05:56:53.678 INFO:tasks.workunit.client.0.smithi037.stdout:checking for uuid.h... no 2024-09-21T05:56:53.751 INFO:tasks.workunit.client.0.smithi037.stdout:checking uuid/uuid.h usability... yes 2024-09-21T05:56:53.781 INFO:tasks.workunit.client.0.smithi037.stdout:checking uuid/uuid.h presence... yes 2024-09-21T05:56:53.781 INFO:tasks.workunit.client.0.smithi037.stdout:checking for uuid/uuid.h... yes 2024-09-21T05:56:53.860 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/uuid.h usability... no 2024-09-21T05:56:53.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:53 smithi144 ceph-mon[34351]: pgmap v503: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-09-21T05:56:53.902 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/uuid.h presence... no 2024-09-21T05:56:53.902 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/uuid.h... no 2024-09-21T05:56:53.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:53 smithi037 ceph-mon[30631]: pgmap v503: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-09-21T05:56:53.976 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/file.h usability... yes 2024-09-21T05:56:53.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:53 smithi067 ceph-mon[34443]: pgmap v503: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-09-21T05:56:54.004 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/file.h presence... yes 2024-09-21T05:56:54.004 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/file.h... yes 2024-09-21T05:56:54.092 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/fcntl.h usability... yes 2024-09-21T05:56:54.119 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/fcntl.h presence... yes 2024-09-21T05:56:54.119 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/fcntl.h... yes 2024-09-21T05:56:54.205 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/syssgi.h usability... no 2024-09-21T05:56:54.247 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/syssgi.h presence... no 2024-09-21T05:56:54.247 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/syssgi.h... no 2024-09-21T05:56:54.380 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/param.h usability... yes 2024-09-21T05:56:54.412 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/param.h presence... yes 2024-09-21T05:56:54.412 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/param.h... yes 2024-09-21T05:56:54.434 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/stat.h... (cached) yes 2024-09-21T05:56:54.503 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/statvfs.h usability... yes 2024-09-21T05:56:54.530 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/statvfs.h presence... yes 2024-09-21T05:56:54.530 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/statvfs.h... yes 2024-09-21T05:56:54.604 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/time.h usability... yes 2024-09-21T05:56:54.632 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/time.h presence... yes 2024-09-21T05:56:54.632 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/time.h... yes 2024-09-21T05:56:54.707 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/ioctl.h usability... yes 2024-09-21T05:56:54.735 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/ioctl.h presence... yes 2024-09-21T05:56:54.735 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/ioctl.h... yes 2024-09-21T05:56:54.822 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/wait.h usability... yes 2024-09-21T05:56:54.852 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/wait.h presence... yes 2024-09-21T05:56:54.852 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/wait.h... yes 2024-09-21T05:56:54.879 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/types.h... (cached) yes 2024-09-21T05:56:54.891 INFO:tasks.workunit.client.0.smithi037.stdout:checking for strings.h... (cached) yes 2024-09-21T05:56:54.969 INFO:tasks.workunit.client.0.smithi037.stdout:checking err.h usability... yes 2024-09-21T05:56:54.996 INFO:tasks.workunit.client.0.smithi037.stdout:checking err.h presence... yes 2024-09-21T05:56:54.996 INFO:tasks.workunit.client.0.smithi037.stdout:checking for err.h... yes 2024-09-21T05:56:55.070 INFO:tasks.workunit.client.0.smithi037.stdout:checking linux/falloc.h usability... yes 2024-09-21T05:56:55.095 INFO:tasks.workunit.client.0.smithi037.stdout:checking linux/falloc.h presence... yes 2024-09-21T05:56:55.095 INFO:tasks.workunit.client.0.smithi037.stdout:checking for linux/falloc.h... yes 2024-09-21T05:56:55.177 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-09-21T05:56:55.221 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-09-21T05:56:55.221 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/fs/xfs_fsops.h... no 2024-09-21T05:56:55.290 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/fs/xfs_itable.h usability... no 2024-09-21T05:56:55.333 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/fs/xfs_itable.h presence... no 2024-09-21T05:56:55.333 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/fs/xfs_itable.h... no 2024-09-21T05:56:55.401 INFO:tasks.workunit.client.0.smithi037.stdout:checking xfs/platform_defs.h usability... no 2024-09-21T05:56:55.444 INFO:tasks.workunit.client.0.smithi037.stdout:checking xfs/platform_defs.h presence... no 2024-09-21T05:56:55.444 INFO:tasks.workunit.client.0.smithi037.stdout:checking for xfs/platform_defs.h... no 2024-09-21T05:56:55.511 INFO:tasks.workunit.client.0.smithi037.stdout:checking btrfs/ioctl.h usability... no 2024-09-21T05:56:55.555 INFO:tasks.workunit.client.0.smithi037.stdout:checking btrfs/ioctl.h presence... no 2024-09-21T05:56:55.556 INFO:tasks.workunit.client.0.smithi037.stdout:checking for btrfs/ioctl.h... no 2024-09-21T05:56:55.624 INFO:tasks.workunit.client.0.smithi037.stdout:checking cifs/ioctl.h usability... no 2024-09-21T05:56:55.667 INFO:tasks.workunit.client.0.smithi037.stdout:checking cifs/ioctl.h presence... no 2024-09-21T05:56:55.667 INFO:tasks.workunit.client.0.smithi037.stdout:checking for cifs/ioctl.h... no 2024-09-21T05:56:55.744 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/mman.h usability... yes 2024-09-21T05:56:55.770 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/mman.h presence... yes 2024-09-21T05:56:55.770 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/mman.h... yes 2024-09-21T05:56:55.849 INFO:tasks.workunit.client.0.smithi037.stdout:checking linux/ext4.h usability... no 2024-09-21T05:56:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:55 smithi144 ceph-mon[34351]: pgmap v504: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T05:56:55.896 INFO:tasks.workunit.client.0.smithi037.stdout:checking linux/ext4.h presence... no 2024-09-21T05:56:55.897 INFO:tasks.workunit.client.0.smithi037.stdout:checking for linux/ext4.h... no 2024-09-21T05:56:55.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:55 smithi037 ceph-mon[30631]: pgmap v504: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T05:56:55.943 INFO:tasks.workunit.client.0.smithi037.stdout:checking for xfs/xfs_log_format.h... no 2024-09-21T05:56:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:55 smithi067 ceph-mon[34443]: pgmap v504: 129 pgs: 129 active+clean; 71 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T05:56:56.038 INFO:tasks.workunit.client.0.smithi037.stdout:checking for uuid_compare... no 2024-09-21T05:56:56.104 INFO:tasks.workunit.client.0.smithi037.stdout:checking for uuid_compare in -luuid... yes 2024-09-21T05:56:56.214 INFO:tasks.workunit.client.0.smithi037.stdout:checking for xfs/xfs.h... yes 2024-09-21T05:56:56.266 INFO:tasks.workunit.client.0.smithi037.stdout:checking for xfs/libxfs.h... no 2024-09-21T05:56:56.317 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether xlog_assign_lsn is declared... no 2024-09-21T05:56:56.381 INFO:tasks.workunit.client.0.smithi037.stdout:checking for xfs/xqm.h... yes 2024-09-21T05:56:56.471 INFO:tasks.workunit.client.0.smithi037.stdout:checking xfsctl from xfs/xfs.h... ok 2024-09-21T05:56:56.530 INFO:tasks.workunit.client.0.smithi037.stdout:checking xfs/handle.h usability... yes 2024-09-21T05:56:56.556 INFO:tasks.workunit.client.0.smithi037.stdout:checking xfs/handle.h presence... yes 2024-09-21T05:56:56.556 INFO:tasks.workunit.client.0.smithi037.stdout:checking for xfs/handle.h... yes 2024-09-21T05:56:56.633 INFO:tasks.workunit.client.0.smithi037.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-09-21T05:56:56.694 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/acl.h usability... yes 2024-09-21T05:56:56.723 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/acl.h presence... yes 2024-09-21T05:56:56.724 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/acl.h... yes 2024-09-21T05:56:56.786 INFO:tasks.workunit.client.0.smithi037.stdout:checking acl/libacl.h usability... yes 2024-09-21T05:56:56.815 INFO:tasks.workunit.client.0.smithi037.stdout:checking acl/libacl.h presence... yes 2024-09-21T05:56:56.815 INFO:tasks.workunit.client.0.smithi037.stdout:checking for acl/libacl.h... yes 2024-09-21T05:56:56.884 INFO:tasks.workunit.client.0.smithi037.stdout:checking for acl_init in -lacl... yes 2024-09-21T05:56:56.973 INFO:tasks.workunit.client.0.smithi037.stdout:checking gdbm-ndbm.h usability... no 2024-09-21T05:56:57.016 INFO:tasks.workunit.client.0.smithi037.stdout:checking gdbm-ndbm.h presence... no 2024-09-21T05:56:57.016 INFO:tasks.workunit.client.0.smithi037.stdout:checking for gdbm-ndbm.h... no 2024-09-21T05:56:57.077 INFO:tasks.workunit.client.0.smithi037.stdout:checking gdbm/ndbm.h usability... no 2024-09-21T05:56:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:checking gdbm/ndbm.h presence... no 2024-09-21T05:56:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:checking for gdbm/ndbm.h... no 2024-09-21T05:56:57.178 INFO:tasks.workunit.client.0.smithi037.stdout:checking ndbm.h usability... no 2024-09-21T05:56:57.221 INFO:tasks.workunit.client.0.smithi037.stdout:checking ndbm.h presence... no 2024-09-21T05:56:57.222 INFO:tasks.workunit.client.0.smithi037.stdout:checking for ndbm.h... no 2024-09-21T05:56:57.275 INFO:tasks.workunit.client.0.smithi037.stdout:checking libaio.h usability... yes 2024-09-21T05:56:57.305 INFO:tasks.workunit.client.0.smithi037.stdout:checking libaio.h presence... yes 2024-09-21T05:56:57.305 INFO:tasks.workunit.client.0.smithi037.stdout:checking for libaio.h... yes 2024-09-21T05:56:57.372 INFO:tasks.workunit.client.0.smithi037.stdout:checking liburing.h usability... no 2024-09-21T05:56:57.415 INFO:tasks.workunit.client.0.smithi037.stdout:checking liburing.h presence... no 2024-09-21T05:56:57.415 INFO:tasks.workunit.client.0.smithi037.stdout:checking for liburing.h... no 2024-09-21T05:56:57.474 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/capability.h usability... no 2024-09-21T05:56:57.518 INFO:tasks.workunit.client.0.smithi037.stdout:checking sys/capability.h presence... no 2024-09-21T05:56:57.518 INFO:tasks.workunit.client.0.smithi037.stdout:checking for sys/capability.h... no 2024-09-21T05:56:57.574 INFO:tasks.workunit.client.0.smithi037.stdout:checking linux/fiemap.h usability... yes 2024-09-21T05:56:57.599 INFO:tasks.workunit.client.0.smithi037.stdout:checking linux/fiemap.h presence... yes 2024-09-21T05:56:57.599 INFO:tasks.workunit.client.0.smithi037.stdout:checking for linux/fiemap.h... yes 2024-09-21T05:56:57.801 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:57 smithi037 ceph-mon[30631]: pgmap v505: 129 pgs: 129 active+clean; 71 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-21T05:56:57.811 INFO:tasks.workunit.client.0.smithi037.stdout:checking for fallocate... yes 2024-09-21T05:56:57.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:57 smithi144 ceph-mon[34351]: pgmap v505: 129 pgs: 129 active+clean; 71 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-21T05:56:57.943 INFO:tasks.workunit.client.0.smithi037.stdout:checking for open_by_handle_at... yes 2024-09-21T05:56:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:57 smithi067 ceph-mon[34443]: pgmap v505: 129 pgs: 129 active+clean; 71 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-21T05:56:58.003 INFO:tasks.workunit.client.0.smithi037.stdout:checking linux/fs.h usability... yes 2024-09-21T05:56:58.031 INFO:tasks.workunit.client.0.smithi037.stdout:checking linux/fs.h presence... yes 2024-09-21T05:56:58.031 INFO:tasks.workunit.client.0.smithi037.stdout:checking for linux/fs.h... yes 2024-09-21T05:56:58.099 INFO:tasks.workunit.client.0.smithi037.stdout:checking btrfsutil.h usability... no 2024-09-21T05:56:58.140 INFO:tasks.workunit.client.0.smithi037.stdout:checking btrfsutil.h presence... no 2024-09-21T05:56:58.140 INFO:tasks.workunit.client.0.smithi037.stdout:checking for btrfsutil.h... no 2024-09-21T05:56:58.214 INFO:tasks.workunit.client.0.smithi037.stdout:checking for copy_file_range... yes 2024-09-21T05:56:58.351 INFO:tasks.workunit.client.0.smithi037.stdout:checking for SEEK_DATA... yes 2024-09-21T05:56:58.454 INFO:tasks.workunit.client.0.smithi037.stdout:checking for BMV_OF_SHARED... yes 2024-09-21T05:56:58.529 INFO:tasks.workunit.client.0.smithi037.stdout:checking for nftw... yes 2024-09-21T05:56:58.607 INFO:tasks.workunit.client.0.smithi037.stdout:checking for RLIMIT_NOFILE... yes 2024-09-21T05:56:58.679 INFO:tasks.workunit.client.0.smithi037.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-09-21T05:56:58.752 INFO:tasks.workunit.client.0.smithi037.stdout:checking for FICLONE... yes 2024-09-21T05:56:58.827 INFO:tasks.workunit.client.0.smithi037.stdout:checking for renameat2... yes 2024-09-21T05:56:58.898 INFO:tasks.workunit.client.0.smithi037.stdout:checking for reallocarray... yes 2024-09-21T05:56:59.003 INFO:tasks.workunit.client.0.smithi037.stdout:checking for struct mount_attr... yes 2024-09-21T05:56:59.108 INFO:tasks.workunit.client.0.smithi037.stdout:checking for struct btrfs_qgroup_limit... yes 2024-09-21T05:56:59.206 INFO:tasks.workunit.client.0.smithi037.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-09-21T05:56:59.302 INFO:tasks.workunit.client.0.smithi037.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-09-21T05:56:59.398 INFO:tasks.workunit.client.0.smithi037.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-09-21T05:56:59.497 INFO:tasks.workunit.client.0.smithi037.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-09-21T05:56:59.599 INFO:tasks.workunit.client.0.smithi037.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-09-21T05:56:59.694 INFO:tasks.workunit.client.0.smithi037.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-09-21T05:56:59.761 INFO:tasks.workunit.client.0.smithi037.stdout:checking linux/btrfs.h usability... yes 2024-09-21T05:56:59.788 INFO:tasks.workunit.client.0.smithi037.stdout:checking linux/btrfs.h presence... yes 2024-09-21T05:56:59.788 INFO:tasks.workunit.client.0.smithi037.stdout:checking for linux/btrfs.h... yes 2024-09-21T05:56:59.870 INFO:tasks.workunit.client.0.smithi037.stdout:checking linux/btrfs_tree.h usability... yes 2024-09-21T05:56:59.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:59 smithi144 ceph-mon[34351]: pgmap v506: 129 pgs: 129 active+clean; 73 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 176 KiB/s wr, 11 op/s 2024-09-21T05:56:59.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:56:59 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:56:59.897 INFO:tasks.workunit.client.0.smithi037.stdout:checking linux/btrfs_tree.h presence... yes 2024-09-21T05:56:59.897 INFO:tasks.workunit.client.0.smithi037.stdout:checking for linux/btrfs_tree.h... yes 2024-09-21T05:56:59.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:59 smithi037 ceph-mon[30631]: pgmap v506: 129 pgs: 129 active+clean; 73 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 176 KiB/s wr, 11 op/s 2024-09-21T05:56:59.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:56:59 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:56:59.964 INFO:tasks.workunit.client.0.smithi037.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-09-21T05:56:59.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:59 smithi067 ceph-mon[34443]: pgmap v506: 129 pgs: 129 active+clean; 73 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 176 KiB/s wr, 11 op/s 2024-09-21T05:56:59.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:56:59 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:57:00.019 INFO:tasks.workunit.client.0.smithi037.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-09-21T05:57:00.052 INFO:tasks.workunit.client.0.smithi037.stdout:configure: creating ./config.status 2024-09-21T05:57:00.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:00 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:57:00.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:00 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:57:00.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:00 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:57:00.913 INFO:tasks.workunit.client.0.smithi037.stdout:config.status: creating include/builddefs 2024-09-21T05:57:00.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:00 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:57:00.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:00 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:57:00.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:00 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:57:00.950 INFO:tasks.workunit.client.0.smithi037.stdout:config.status: creating include/config.h 2024-09-21T05:57:00.976 INFO:tasks.workunit.client.0.smithi037.stdout:config.status: executing libtool commands 2024-09-21T05:57:00.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:00 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:57:00.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:00 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:57:00.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:00 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:57:01.106 INFO:tasks.workunit.client.0.smithi037.stdout:Building include 2024-09-21T05:57:01.106 INFO:tasks.workunit.client.0.smithi037.stdout:Building lib 2024-09-21T05:57:01.106 INFO:tasks.workunit.client.0.smithi037.stdout:Building tests 2024-09-21T05:57:01.117 INFO:tasks.workunit.client.0.smithi037.stdout: [LTDEP] 2024-09-21T05:57:01.121 INFO:tasks.workunit.client.0.smithi037.stdout:Building ceph 2024-09-21T05:57:01.122 INFO:tasks.workunit.client.0.smithi037.stdout:Building btrfs 2024-09-21T05:57:01.122 INFO:tasks.workunit.client.0.smithi037.stdout:Building cifs 2024-09-21T05:57:01.141 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/cifs/group.list 2024-09-21T05:57:01.144 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ceph/group.list 2024-09-21T05:57:01.165 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/btrfs/group.list 2024-09-21T05:57:01.198 INFO:tasks.workunit.client.0.smithi037.stdout:Building ext4 2024-09-21T05:57:01.210 INFO:tasks.workunit.client.0.smithi037.stdout:Building f2fs 2024-09-21T05:57:01.222 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ext4/group.list 2024-09-21T05:57:01.224 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/f2fs/group.list 2024-09-21T05:57:01.286 INFO:tasks.workunit.client.0.smithi037.stdout:Building generic 2024-09-21T05:57:01.392 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/generic/group.list 2024-09-21T05:57:01.504 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] dataascii.lo 2024-09-21T05:57:01.516 INFO:tasks.workunit.client.0.smithi037.stdout:Building nfs 2024-09-21T05:57:01.531 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/nfs/group.list 2024-09-21T05:57:01.580 INFO:tasks.workunit.client.0.smithi037.stdout:Building ocfs2 2024-09-21T05:57:01.595 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ocfs2/group.list 2024-09-21T05:57:01.640 INFO:tasks.workunit.client.0.smithi037.stdout:Building overlay 2024-09-21T05:57:01.666 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/overlay/group.list 2024-09-21T05:57:01.757 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] databin.lo 2024-09-21T05:57:02.025 INFO:tasks.workunit.client.0.smithi037.stdout:Building perf 2024-09-21T05:57:02.039 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/perf/group.list 2024-09-21T05:57:02.041 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] datapid.lo 2024-09-21T05:57:02.079 INFO:tasks.workunit.client.0.smithi037.stdout:Building selftest 2024-09-21T05:57:02.093 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/selftest/group.list 2024-09-21T05:57:02.114 INFO:tasks.workunit.client.0.smithi037.stdout:Building shared 2024-09-21T05:57:02.132 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/shared/group.list 2024-09-21T05:57:02.146 INFO:tasks.workunit.client.0.smithi037.stdout:Building tmpfs 2024-09-21T05:57:02.159 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/tmpfs/group.list 2024-09-21T05:57:02.203 INFO:tasks.workunit.client.0.smithi037.stdout:Building udf 2024-09-21T05:57:02.206 INFO:tasks.workunit.client.0.smithi037.stdout:Building xfs 2024-09-21T05:57:02.217 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/udf/group.list 2024-09-21T05:57:02.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:01 smithi067 ceph-mon[34443]: pgmap v507: 129 pgs: 129 active+clean; 73 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 195 KiB/s wr, 29 op/s 2024-09-21T05:57:02.255 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] file_lock.lo 2024-09-21T05:57:02.277 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] forker.lo 2024-09-21T05:57:02.328 INFO:tasks.workunit.client.0.smithi037.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/xfs/group.list 2024-09-21T05:57:02.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:01 smithi144 ceph-mon[34351]: pgmap v507: 129 pgs: 129 active+clean; 73 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 195 KiB/s wr, 29 op/s 2024-09-21T05:57:02.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:01 smithi037 ceph-mon[30631]: pgmap v507: 129 pgs: 129 active+clean; 73 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 195 KiB/s wr, 29 op/s 2024-09-21T05:57:02.533 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] pattern.lo 2024-09-21T05:57:02.536 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] open_flags.lo 2024-09-21T05:57:02.769 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] random_range.lo 2024-09-21T05:57:02.808 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] string_to_tokens.lo 2024-09-21T05:57:03.021 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] str_to_bytes.lo 2024-09-21T05:57:03.150 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] tlibio.lo 2024-09-21T05:57:03.490 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] write_log.lo 2024-09-21T05:57:03.503 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] random.lo 2024-09-21T05:57:03.857 INFO:tasks.workunit.client.0.smithi037.stdout: [LD] 2024-09-21T05:57:04.048 INFO:tasks.workunit.client.0.smithi037.stdout:Building ltp 2024-09-21T05:57:04.049 INFO:tasks.workunit.client.0.smithi037.stdout:Building src 2024-09-21T05:57:04.049 INFO:tasks.workunit.client.0.smithi037.stdout:Building m4 2024-09-21T05:57:04.059 INFO:tasks.workunit.client.0.smithi037.stdout: [DEP] 2024-09-21T05:57:04.060 INFO:tasks.workunit.client.0.smithi037.stdout:Building common 2024-09-21T05:57:04.074 INFO:tasks.workunit.client.0.smithi037.stdout: [DEP] 2024-09-21T05:57:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:03 smithi067 ceph-mon[34443]: pgmap v508: 129 pgs: 129 active+clean; 75 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 346 KiB/s wr, 88 op/s 2024-09-21T05:57:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:03 smithi144 ceph-mon[34351]: pgmap v508: 129 pgs: 129 active+clean; 75 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 346 KiB/s wr, 88 op/s 2024-09-21T05:57:04.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:03 smithi037 ceph-mon[30631]: pgmap v508: 129 pgs: 129 active+clean; 75 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 346 KiB/s wr, 88 op/s 2024-09-21T05:57:04.445 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] doio 2024-09-21T05:57:04.445 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fsstress 2024-09-21T05:57:04.446 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fsx 2024-09-21T05:57:05.309 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] growfiles 2024-09-21T05:57:05.403 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] iogen 2024-09-21T05:57:05.911 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-stress 2024-09-21T05:57:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:05 smithi067 ceph-mon[34443]: pgmap v509: 129 pgs: 129 active+clean; 74 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 349 KiB/s wr, 118 op/s 2024-09-21T05:57:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:05 smithi144 ceph-mon[34351]: pgmap v509: 129 pgs: 129 active+clean; 74 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 349 KiB/s wr, 118 op/s 2024-09-21T05:57:06.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:05 smithi037 ceph-mon[30631]: pgmap v509: 129 pgs: 129 active+clean; 74 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 349 KiB/s wr, 118 op/s 2024-09-21T05:57:07.726 INFO:tasks.workunit.client.0.smithi037.stdout: [DEP] 2024-09-21T05:57:07.727 INFO:tasks.workunit.client.0.smithi037.stdout: [DEP] 2024-09-21T05:57:07.728 INFO:tasks.workunit.client.0.smithi037.stdout: [DEP] 2024-09-21T05:57:07.729 INFO:tasks.workunit.client.0.smithi037.stdout: [DEP] 2024-09-21T05:57:08.175 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] dirstress 2024-09-21T05:57:08.176 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fill 2024-09-21T05:57:08.177 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fill2 2024-09-21T05:57:08.177 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] getpagesize 2024-09-21T05:57:08.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:07 smithi067 ceph-mon[34443]: pgmap v510: 129 pgs: 129 active+clean; 75 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 415 KiB/s wr, 332 op/s 2024-09-21T05:57:08.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:07 smithi144 ceph-mon[34351]: pgmap v510: 129 pgs: 129 active+clean; 75 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 415 KiB/s wr, 332 op/s 2024-09-21T05:57:08.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:07 smithi037 ceph-mon[30631]: pgmap v510: 129 pgs: 129 active+clean; 75 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 415 KiB/s wr, 332 op/s 2024-09-21T05:57:08.458 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] holes 2024-09-21T05:57:08.469 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] lstat64 2024-09-21T05:57:08.561 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] nametest 2024-09-21T05:57:08.590 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] permname 2024-09-21T05:57:08.795 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] randholes 2024-09-21T05:57:08.820 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] runas 2024-09-21T05:57:08.936 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] truncfile 2024-09-21T05:57:08.953 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] usemem 2024-09-21T05:57:09.166 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] mmapcat 2024-09-21T05:57:09.215 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] append_reader 2024-09-21T05:57:09.216 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] append_writer 2024-09-21T05:57:09.242 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] dirperf 2024-09-21T05:57:09.444 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] metaperf 2024-09-21T05:57:09.501 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] devzero 2024-09-21T05:57:09.502 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] feature 2024-09-21T05:57:09.636 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] alloc 2024-09-21T05:57:09.813 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fault 2024-09-21T05:57:09.854 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fstest 2024-09-21T05:57:09.898 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_access_root 2024-09-21T05:57:10.024 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] godown 2024-09-21T05:57:10.131 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] resvtest 2024-09-21T05:57:10.206 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] writemod 2024-09-21T05:57:10.241 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] writev_on_pagefault 2024-09-21T05:57:10.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:09 smithi067 ceph-mon[34443]: pgmap v511: 129 pgs: 129 active+clean; 75 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 474 KiB/s wr, 414 op/s 2024-09-21T05:57:10.350 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] makeextents 2024-09-21T05:57:10.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:09 smithi144 ceph-mon[34351]: pgmap v511: 129 pgs: 129 active+clean; 75 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 474 KiB/s wr, 414 op/s 2024-09-21T05:57:10.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:09 smithi037 ceph-mon[30631]: pgmap v511: 129 pgs: 129 active+clean; 75 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 474 KiB/s wr, 414 op/s 2024-09-21T05:57:10.459 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] itrash 2024-09-21T05:57:10.476 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] rename 2024-09-21T05:57:10.534 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] multi_open_unlink 2024-09-21T05:57:10.680 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] unwritten_sync 2024-09-21T05:57:10.734 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] genhashnames 2024-09-21T05:57:10.744 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_holes 2024-09-21T05:57:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_mmap_writev 2024-09-21T05:57:10.999 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_truncate_cmtime 2024-09-21T05:57:11.021 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] dirhash_collide 2024-09-21T05:57:11.076 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_rename_overwrite 2024-09-21T05:57:11.135 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] holetest 2024-09-21T05:57:11.286 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_truncate_self 2024-09-21T05:57:11.334 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] af_unix 2024-09-21T05:57:11.346 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_mmap_stale_pmd 2024-09-21T05:57:11.532 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_mmap_cow_race 2024-09-21T05:57:11.565 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_mmap_fallocate 2024-09-21T05:57:11.611 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fsync-err 2024-09-21T05:57:11.638 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_mmap_write_ro 2024-09-21T05:57:11.835 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_ext4_dax_journal_corruption 2024-09-21T05:57:11.846 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_ext4_dax_inline_corruption 2024-09-21T05:57:11.913 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_ofd_locks 2024-09-21T05:57:11.945 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_mmap_collision 2024-09-21T05:57:12.134 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] mmap-write-concurrent 2024-09-21T05:57:12.138 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_get_file_time 2024-09-21T05:57:12.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:11 smithi037 ceph-mon[30631]: pgmap v512: 129 pgs: 129 active+clean; 75 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 302 KiB/s wr, 409 op/s 2024-09-21T05:57:12.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:11 smithi067 ceph-mon[34443]: pgmap v512: 129 pgs: 129 active+clean; 75 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 302 KiB/s wr, 409 op/s 2024-09-21T05:57:12.259 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_create_short_dirs 2024-09-21T05:57:12.314 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_create_long_dirs 2024-09-21T05:57:12.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:11 smithi144 ceph-mon[34351]: pgmap v512: 129 pgs: 129 active+clean; 75 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 302 KiB/s wr, 409 op/s 2024-09-21T05:57:12.407 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_enospc 2024-09-21T05:57:12.447 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_mmap_writev_overlap 2024-09-21T05:57:12.567 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] checkpoint_journal 2024-09-21T05:57:12.619 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] mmap-rw-fault 2024-09-21T05:57:12.728 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] allocstale 2024-09-21T05:57:12.763 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_mmap_cow_memory_failure 2024-09-21T05:57:12.865 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fake-dump-rootino 2024-09-21T05:57:12.953 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] dio-buf-fault 2024-09-21T05:57:13.050 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] rewinddir-test 2024-09-21T05:57:13.076 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] readdir-while-renames 2024-09-21T05:57:13.171 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] xfsctl 2024-09-21T05:57:13.255 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] bstat 2024-09-21T05:57:13.367 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_mtab 2024-09-21T05:57:13.408 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] getdevicesize 2024-09-21T05:57:13.541 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] preallo_rw_pattern_reader 2024-09-21T05:57:13.658 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] preallo_rw_pattern_writer 2024-09-21T05:57:13.702 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] ftrunc 2024-09-21T05:57:13.756 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] trunc 2024-09-21T05:57:13.902 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fs_perms 2024-09-21T05:57:13.986 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] testx 2024-09-21T05:57:14.042 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] looptest 2024-09-21T05:57:14.177 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] locktest 2024-09-21T05:57:14.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:13 smithi067 ceph-mon[34443]: pgmap v513: 129 pgs: 129 active+clean; 76 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 292 KiB/s wr, 396 op/s 2024-09-21T05:57:14.319 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] unwritten_mmap 2024-09-21T05:57:14.322 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] bulkstat_unlink_test 2024-09-21T05:57:14.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:13 smithi144 ceph-mon[34351]: pgmap v513: 129 pgs: 129 active+clean; 76 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 292 KiB/s wr, 396 op/s 2024-09-21T05:57:14.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:13 smithi037 ceph-mon[30631]: pgmap v513: 129 pgs: 129 active+clean; 76 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 292 KiB/s wr, 396 op/s 2024-09-21T05:57:14.443 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] deduperace 2024-09-21T05:57:14.642 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] bulkstat_unlink_test_modified 2024-09-21T05:57:14.705 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_dir_offset 2024-09-21T05:57:14.710 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_futimens 2024-09-21T05:57:14.868 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_immutable 2024-09-21T05:57:15.021 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] stale_handle 2024-09-21T05:57:15.024 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] pwrite_mmap_blocked 2024-09-21T05:57:15.035 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_dir_offset2 2024-09-21T05:57:15.315 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] seek_sanity_test 2024-09-21T05:57:15.335 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] seek_copy_test 2024-09-21T05:57:15.367 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_readdir_1 2024-09-21T05:57:15.643 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_readdir_2 2024-09-21T05:57:15.646 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fsync-tester 2024-09-21T05:57:15.816 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] nsexec 2024-09-21T05:57:15.936 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] cloner 2024-09-21T05:57:15.951 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] renameat2 2024-09-21T05:57:16.064 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_getcwd 2024-09-21T05:57:16.136 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] e4compact 2024-09-21T05:57:16.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:15 smithi067 ceph-mon[34443]: pgmap v514: 129 pgs: 129 active+clean; 76 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 141 KiB/s wr, 338 op/s 2024-09-21T05:57:16.262 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] test-nextquota 2024-09-21T05:57:16.263 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] punch-alternating 2024-09-21T05:57:16.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:15 smithi144 ceph-mon[34351]: pgmap v514: 129 pgs: 129 active+clean; 76 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 141 KiB/s wr, 338 op/s 2024-09-21T05:57:16.383 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] attr-list-by-handle-cursor-test 2024-09-21T05:57:16.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:15 smithi037 ceph-mon[30631]: pgmap v514: 129 pgs: 129 active+clean; 76 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 141 KiB/s wr, 338 op/s 2024-09-21T05:57:16.517 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] listxattr 2024-09-21T05:57:16.568 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] dio-interleaved 2024-09-21T05:57:16.572 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_dir_type 2024-09-21T05:57:16.732 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] dio-invalidate-cache 2024-09-21T05:57:16.805 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] stat_test 2024-09-21T05:57:16.839 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_encrypted_d_revalidate 2024-09-21T05:57:16.866 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] attr_replace_test 2024-09-21T05:57:17.098 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] swapon 2024-09-21T05:57:17.136 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] mkswap 2024-09-21T05:57:17.169 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_attr_corruption 2024-09-21T05:57:17.257 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_open_tmpfiles 2024-09-21T05:57:17.401 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fscrypt-crypt-util 2024-09-21T05:57:17.413 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] bulkstat_null_ocount 2024-09-21T05:57:17.464 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] splice-test 2024-09-21T05:57:17.576 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] chprojid_fail 2024-09-21T05:57:17.701 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] detached_mounts_propagation 2024-09-21T05:57:17.792 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] ext4_resize 2024-09-21T05:57:17.897 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_readdir_3 2024-09-21T05:57:18.036 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] splice2pipe 2024-09-21T05:57:18.070 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] uuid_ioctl 2024-09-21T05:57:18.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:17 smithi067 ceph-mon[34443]: pgmap v515: 129 pgs: 129 active+clean; 77 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 284 KiB/s wr, 312 op/s 2024-09-21T05:57:18.284 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_snapshot_deleted_subvolume 2024-09-21T05:57:18.316 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fiemap-fault 2024-09-21T05:57:18.347 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fiemap-tester 2024-09-21T05:57:18.361 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_stripealign 2024-09-21T05:57:18.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:17 smithi144 ceph-mon[34351]: pgmap v515: 129 pgs: 129 active+clean; 77 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 284 KiB/s wr, 312 op/s 2024-09-21T05:57:18.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:17 smithi037 ceph-mon[30631]: pgmap v515: 129 pgs: 129 active+clean; 77 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 284 KiB/s wr, 312 op/s 2024-09-21T05:57:18.590 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] open_by_handle 2024-09-21T05:57:18.596 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_mmap_dio 2024-09-21T05:57:18.651 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] xfsfind 2024-09-21T05:57:18.789 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] t_reflink_read_race 2024-09-21T05:57:18.877 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] fssum 2024-09-21T05:57:18.993 INFO:tasks.workunit.client.0.smithi037.stdout:Building log-writes 2024-09-21T05:57:19.004 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] replay-log 2024-09-21T05:57:19.018 INFO:tasks.workunit.client.0.smithi037.stdout:Building perf 2024-09-21T05:57:19.026 INFO:tasks.workunit.client.0.smithi037.stdout:Building aio-dio-regress 2024-09-21T05:57:19.040 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aiocp 2024-09-21T05:57:19.123 INFO:tasks.workunit.client.0.smithi037.stdout:Building vfs 2024-09-21T05:57:19.135 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] vfstest 2024-09-21T05:57:19.415 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-dio-append-write-fallocate-race 2024-09-21T05:57:19.521 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-dio-append-write-read-race 2024-09-21T05:57:19.535 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-dio-cow-race 2024-09-21T05:57:19.704 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] mount-idmapped 2024-09-21T05:57:19.836 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-dio-cycle-write 2024-09-21T05:57:19.836 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-dio-eof-race 2024-09-21T05:57:20.149 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-dio-extend-stat 2024-09-21T05:57:20.166 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-dio-fcntl-race 2024-09-21T05:57:20.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:19 smithi067 ceph-mon[34443]: pgmap v516: 129 pgs: 129 active+clean; 79 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 386 KiB/s wr, 103 op/s 2024-09-21T05:57:20.344 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-dio-hole-filling-race 2024-09-21T05:57:20.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:19 smithi144 ceph-mon[34351]: pgmap v516: 129 pgs: 129 active+clean; 79 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 386 KiB/s wr, 103 op/s 2024-09-21T05:57:20.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:19 smithi037 ceph-mon[30631]: pgmap v516: 129 pgs: 129 active+clean; 79 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 386 KiB/s wr, 103 op/s 2024-09-21T05:57:20.455 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-dio-invalidate-failure 2024-09-21T05:57:20.467 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-dio-invalidate-readahead 2024-09-21T05:57:20.632 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aiodio_sparse2 2024-09-21T05:57:20.769 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-dio-subblock-eof-read 2024-09-21T05:57:20.775 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-dio-write-verify 2024-09-21T05:57:21.001 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-09-21T05:57:21.058 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-09-21T05:57:21.152 INFO:tasks.workunit.client.0.smithi037.stdout: [CC] aio-last-ref-held-by-io 2024-09-21T05:57:21.790 INFO:tasks.workunit.client.0.smithi037.stderr:+ cd .. 2024-09-21T05:57:21.790 INFO:tasks.workunit.client.0.smithi037.stderr:+ cp xfstests-dev/ltp/fsx . 2024-09-21T05:57:21.796 INFO:tasks.workunit.client.0.smithi037.stderr:+ OPTIONS=-z 2024-09-21T05:57:21.799 INFO:tasks.workunit.client.0.smithi037.stderr:+ ./fsx -z 1MB -N 50000 -p 10000 -l 1048576 2024-09-21T05:57:21.800 INFO:tasks.workunit.client.0.smithi037.stdout:Seed set to 1 2024-09-21T05:57:21.833 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-21T05:57:21.833 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-21T05:57:21.837 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-21T05:57:21.837 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-21T05:57:21.837 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support clone range, disabling! 2024-09-21T05:57:21.839 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-21T05:57:21.842 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support exchange range, disabling! 2024-09-21T05:57:21.842 INFO:tasks.workunit.client.0.smithi037.stdout:skipping zero size read 2024-09-21T05:57:21.842 INFO:tasks.workunit.client.0.smithi037.stdout:skipping zero size read 2024-09-21T05:57:21.842 INFO:tasks.workunit.client.0.smithi037.stdout:truncating to largest ever: 0x81d54 2024-09-21T05:57:21.847 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0xb86d7 2024-09-21T05:57:21.858 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0xe627e 2024-09-21T05:57:21.912 INFO:tasks.workunit.client.0.smithi037.stdout:truncating to largest ever: 0xf3194 2024-09-21T05:57:21.947 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0xf3ceb 2024-09-21T05:57:21.954 INFO:tasks.workunit.client.0.smithi037.stdout:truncating to largest ever: 0xf47e4 2024-09-21T05:57:22.087 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0xfaccc 2024-09-21T05:57:22.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:21 smithi067 ceph-mon[34443]: pgmap v517: 129 pgs: 129 active+clean; 79 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 326 KiB/s wr, 20 op/s 2024-09-21T05:57:22.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:21 smithi144 ceph-mon[34351]: pgmap v517: 129 pgs: 129 active+clean; 79 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 326 KiB/s wr, 20 op/s 2024-09-21T05:57:22.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:21 smithi037 ceph-mon[30631]: pgmap v517: 129 pgs: 129 active+clean; 79 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 326 KiB/s wr, 20 op/s 2024-09-21T05:57:22.725 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0xfe423 2024-09-21T05:57:24.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:23 smithi067 ceph-mon[34443]: pgmap v518: 129 pgs: 129 active+clean; 80 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 470 KiB/s wr, 41 op/s 2024-09-21T05:57:24.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:23 smithi144 ceph-mon[34351]: pgmap v518: 129 pgs: 129 active+clean; 80 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 470 KiB/s wr, 41 op/s 2024-09-21T05:57:24.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:23 smithi037 ceph-mon[30631]: pgmap v518: 129 pgs: 129 active+clean; 80 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 470 KiB/s wr, 41 op/s 2024-09-21T05:57:26.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:25 smithi067 ceph-mon[34443]: pgmap v519: 129 pgs: 129 active+clean; 80 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 458 KiB/s wr, 36 op/s 2024-09-21T05:57:26.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:25 smithi144 ceph-mon[34351]: pgmap v519: 129 pgs: 129 active+clean; 80 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 458 KiB/s wr, 36 op/s 2024-09-21T05:57:26.385 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0xfe492 2024-09-21T05:57:26.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:25 smithi037 ceph-mon[30631]: pgmap v519: 129 pgs: 129 active+clean; 80 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 458 KiB/s wr, 36 op/s 2024-09-21T05:57:28.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:27 smithi067 ceph-mon[34443]: pgmap v520: 129 pgs: 129 active+clean; 80 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 459 KiB/s wr, 37 op/s 2024-09-21T05:57:28.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:27 smithi144 ceph-mon[34351]: pgmap v520: 129 pgs: 129 active+clean; 80 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 459 KiB/s wr, 37 op/s 2024-09-21T05:57:28.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:27 smithi037 ceph-mon[30631]: pgmap v520: 129 pgs: 129 active+clean; 80 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 459 KiB/s wr, 37 op/s 2024-09-21T05:57:29.475 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0xff038 2024-09-21T05:57:30.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:29 smithi067 ceph-mon[34443]: pgmap v521: 129 pgs: 129 active+clean; 81 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 243 op/s 2024-09-21T05:57:30.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:29 smithi144 ceph-mon[34351]: pgmap v521: 129 pgs: 129 active+clean; 81 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 243 op/s 2024-09-21T05:57:30.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:29 smithi037 ceph-mon[30631]: pgmap v521: 129 pgs: 129 active+clean; 81 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 243 op/s 2024-09-21T05:57:30.868 INFO:tasks.workunit.client.0.smithi037.stdout:truncating to largest ever: 0xffcac 2024-09-21T05:57:31.051 INFO:tasks.workunit.client.0.smithi037.stdout:10000 copy from 0x2d237 to 0x30552, (0x331b bytes) at 0x82aed 2024-09-21T05:57:32.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:31 smithi067 ceph-mon[34443]: pgmap v522: 129 pgs: 129 active+clean; 82 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 272 op/s 2024-09-21T05:57:32.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:31 smithi144 ceph-mon[34351]: pgmap v522: 129 pgs: 129 active+clean; 82 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 272 op/s 2024-09-21T05:57:32.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:31 smithi037 ceph-mon[30631]: pgmap v522: 129 pgs: 129 active+clean; 82 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 272 op/s 2024-09-21T05:57:34.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:33 smithi067 ceph-mon[34443]: pgmap v523: 129 pgs: 129 active+clean; 83 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 415 op/s 2024-09-21T05:57:34.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:33 smithi144 ceph-mon[34351]: pgmap v523: 129 pgs: 129 active+clean; 83 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 415 op/s 2024-09-21T05:57:34.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:33 smithi037 ceph-mon[30631]: pgmap v523: 129 pgs: 129 active+clean; 83 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 415 op/s 2024-09-21T05:57:36.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:35 smithi067 ceph-mon[34443]: pgmap v524: 129 pgs: 129 active+clean; 83 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 390 op/s 2024-09-21T05:57:36.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:35 smithi144 ceph-mon[34351]: pgmap v524: 129 pgs: 129 active+clean; 83 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 390 op/s 2024-09-21T05:57:36.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:35 smithi037 ceph-mon[30631]: pgmap v524: 129 pgs: 129 active+clean; 83 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 390 op/s 2024-09-21T05:57:38.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:37 smithi144 ceph-mon[34351]: pgmap v525: 129 pgs: 129 active+clean; 84 MiB data, 838 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 455 op/s 2024-09-21T05:57:38.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:37 smithi037 ceph-mon[30631]: pgmap v525: 129 pgs: 129 active+clean; 84 MiB data, 838 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 455 op/s 2024-09-21T05:57:38.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:37 smithi067 ceph-mon[34443]: pgmap v525: 129 pgs: 129 active+clean; 84 MiB data, 838 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 455 op/s 2024-09-21T05:57:40.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:39 smithi144 ceph-mon[34351]: pgmap v526: 129 pgs: 129 active+clean; 85 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.8 MiB/s wr, 573 op/s 2024-09-21T05:57:40.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:39 smithi037 ceph-mon[30631]: pgmap v526: 129 pgs: 129 active+clean; 85 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.8 MiB/s wr, 573 op/s 2024-09-21T05:57:40.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:39 smithi067 ceph-mon[34443]: pgmap v526: 129 pgs: 129 active+clean; 85 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.8 MiB/s wr, 573 op/s 2024-09-21T05:57:42.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:42 smithi144 ceph-mon[34351]: pgmap v527: 129 pgs: 129 active+clean; 86 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 423 op/s 2024-09-21T05:57:42.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:42 smithi037 ceph-mon[30631]: pgmap v527: 129 pgs: 129 active+clean; 86 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 423 op/s 2024-09-21T05:57:42.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:42 smithi067 ceph-mon[34443]: pgmap v527: 129 pgs: 129 active+clean; 86 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 423 op/s 2024-09-21T05:57:44.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:44 smithi144 ceph-mon[34351]: pgmap v528: 129 pgs: 129 active+clean; 86 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 501 op/s 2024-09-21T05:57:44.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:44 smithi037 ceph-mon[30631]: pgmap v528: 129 pgs: 129 active+clean; 86 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 501 op/s 2024-09-21T05:57:44.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:44 smithi067 ceph-mon[34443]: pgmap v528: 129 pgs: 129 active+clean; 86 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 501 op/s 2024-09-21T05:57:46.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:46 smithi144 ceph-mon[34351]: pgmap v529: 129 pgs: 129 active+clean; 86 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 383 op/s 2024-09-21T05:57:46.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:46 smithi037 ceph-mon[30631]: pgmap v529: 129 pgs: 129 active+clean; 86 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 383 op/s 2024-09-21T05:57:46.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:46 smithi067 ceph-mon[34443]: pgmap v529: 129 pgs: 129 active+clean; 86 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 383 op/s 2024-09-21T05:57:48.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:48 smithi144 ceph-mon[34351]: pgmap v530: 129 pgs: 129 active+clean; 87 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 390 op/s 2024-09-21T05:57:48.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:48 smithi037 ceph-mon[30631]: pgmap v530: 129 pgs: 129 active+clean; 87 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 390 op/s 2024-09-21T05:57:48.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:48 smithi067 ceph-mon[34443]: pgmap v530: 129 pgs: 129 active+clean; 87 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 390 op/s 2024-09-21T05:57:50.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:50 smithi144 ceph-mon[34351]: pgmap v531: 129 pgs: 129 active+clean; 88 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 487 op/s 2024-09-21T05:57:50.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:50 smithi037 ceph-mon[30631]: pgmap v531: 129 pgs: 129 active+clean; 88 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 487 op/s 2024-09-21T05:57:50.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:50 smithi067 ceph-mon[34443]: pgmap v531: 129 pgs: 129 active+clean; 88 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 487 op/s 2024-09-21T05:57:52.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:52 smithi144 ceph-mon[34351]: pgmap v532: 129 pgs: 129 active+clean; 89 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 371 op/s 2024-09-21T05:57:52.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:52 smithi037 ceph-mon[30631]: pgmap v532: 129 pgs: 129 active+clean; 89 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 371 op/s 2024-09-21T05:57:52.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:52 smithi067 ceph-mon[34443]: pgmap v532: 129 pgs: 129 active+clean; 89 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 371 op/s 2024-09-21T05:57:54.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:54 smithi144 ceph-mon[34351]: pgmap v533: 129 pgs: 129 active+clean; 90 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 406 op/s 2024-09-21T05:57:54.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:54 smithi037 ceph-mon[30631]: pgmap v533: 129 pgs: 129 active+clean; 90 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 406 op/s 2024-09-21T05:57:54.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:54 smithi067 ceph-mon[34443]: pgmap v533: 129 pgs: 129 active+clean; 90 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 406 op/s 2024-09-21T05:57:55.181 INFO:tasks.workunit.client.0.smithi037.stdout:30000 trunc from 0x7bb2f to 0xcdf83 2024-09-21T05:57:55.764 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0xffcdd 2024-09-21T05:57:56.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:56 smithi144 ceph-mon[34351]: pgmap v534: 129 pgs: 129 active+clean; 92 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 347 op/s 2024-09-21T05:57:56.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:56 smithi037 ceph-mon[30631]: pgmap v534: 129 pgs: 129 active+clean; 92 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 347 op/s 2024-09-21T05:57:56.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:56 smithi067 ceph-mon[34443]: pgmap v534: 129 pgs: 129 active+clean; 92 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 347 op/s 2024-09-21T05:57:58.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:57:58 smithi144 ceph-mon[34351]: pgmap v535: 129 pgs: 129 active+clean; 92 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 325 op/s 2024-09-21T05:57:58.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:57:58 smithi037 ceph-mon[30631]: pgmap v535: 129 pgs: 129 active+clean; 92 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 325 op/s 2024-09-21T05:57:58.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:57:58 smithi067 ceph-mon[34443]: pgmap v535: 129 pgs: 129 active+clean; 92 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 325 op/s 2024-09-21T05:57:58.592 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0xffd97 2024-09-21T05:58:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:00 smithi144 ceph-mon[34351]: pgmap v536: 129 pgs: 129 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 435 op/s 2024-09-21T05:58:00.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:00 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:58:00.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:00 smithi037 ceph-mon[30631]: pgmap v536: 129 pgs: 129 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 435 op/s 2024-09-21T05:58:00.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:00 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:58:00.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:00 smithi067 ceph-mon[34443]: pgmap v536: 129 pgs: 129 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 435 op/s 2024-09-21T05:58:00.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:00 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:58:01.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:01 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:58:01.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:01 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:58:01.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:01 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:58:01.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:58:01.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:58:01.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:58:01.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:01 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:58:01.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:01 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:58:01.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:01 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:58:02.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:02 smithi144 ceph-mon[34351]: pgmap v537: 129 pgs: 129 active+clean; 94 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 322 op/s 2024-09-21T05:58:02.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:02 smithi037 ceph-mon[30631]: pgmap v537: 129 pgs: 129 active+clean; 94 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 322 op/s 2024-09-21T05:58:02.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:02 smithi067 ceph-mon[34443]: pgmap v537: 129 pgs: 129 active+clean; 94 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 322 op/s 2024-09-21T05:58:04.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:04 smithi144 ceph-mon[34351]: pgmap v538: 129 pgs: 129 active+clean; 94 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 405 op/s 2024-09-21T05:58:04.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:04 smithi037 ceph-mon[30631]: pgmap v538: 129 pgs: 129 active+clean; 94 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 405 op/s 2024-09-21T05:58:04.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:04 smithi067 ceph-mon[34443]: pgmap v538: 129 pgs: 129 active+clean; 94 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 405 op/s 2024-09-21T05:58:06.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:06 smithi144 ceph-mon[34351]: pgmap v539: 129 pgs: 129 active+clean; 94 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 307 op/s 2024-09-21T05:58:06.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:06 smithi037 ceph-mon[30631]: pgmap v539: 129 pgs: 129 active+clean; 94 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 307 op/s 2024-09-21T05:58:06.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:06 smithi067 ceph-mon[34443]: pgmap v539: 129 pgs: 129 active+clean; 94 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 307 op/s 2024-09-21T05:58:07.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:07 smithi144 ceph-mon[34351]: pgmap v540: 129 pgs: 129 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 299 op/s 2024-09-21T05:58:07.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:07 smithi037 ceph-mon[30631]: pgmap v540: 129 pgs: 129 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 299 op/s 2024-09-21T05:58:07.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:07 smithi067 ceph-mon[34443]: pgmap v540: 129 pgs: 129 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 299 op/s 2024-09-21T05:58:09.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:09 smithi067 ceph-mon[34443]: pgmap v541: 129 pgs: 129 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 377 op/s 2024-09-21T05:58:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:09 smithi144 ceph-mon[34351]: pgmap v541: 129 pgs: 129 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 377 op/s 2024-09-21T05:58:09.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:09 smithi037 ceph-mon[30631]: pgmap v541: 129 pgs: 129 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 377 op/s 2024-09-21T05:58:11.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:11 smithi067 ceph-mon[34443]: pgmap v542: 129 pgs: 129 active+clean; 97 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 301 op/s 2024-09-21T05:58:11.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:11 smithi144 ceph-mon[34351]: pgmap v542: 129 pgs: 129 active+clean; 97 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 301 op/s 2024-09-21T05:58:11.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:11 smithi037 ceph-mon[30631]: pgmap v542: 129 pgs: 129 active+clean; 97 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 301 op/s 2024-09-21T05:58:13.448 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0xffdb8 2024-09-21T05:58:13.716 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:13 smithi037 ceph-mon[30631]: pgmap v543: 129 pgs: 129 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 328 op/s 2024-09-21T05:58:13.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:13 smithi067 ceph-mon[34443]: pgmap v543: 129 pgs: 129 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 328 op/s 2024-09-21T05:58:13.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:13 smithi144 ceph-mon[34351]: pgmap v543: 129 pgs: 129 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 328 op/s 2024-09-21T05:58:15.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:15 smithi067 ceph-mon[34443]: pgmap v544: 129 pgs: 129 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-21T05:58:15.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:15 smithi144 ceph-mon[34351]: pgmap v544: 129 pgs: 129 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-21T05:58:15.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:15 smithi037 ceph-mon[30631]: pgmap v544: 129 pgs: 129 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-21T05:58:17.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:17 smithi067 ceph-mon[34443]: pgmap v545: 129 pgs: 129 active+clean; 97 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 280 op/s 2024-09-21T05:58:17.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:17 smithi144 ceph-mon[34351]: pgmap v545: 129 pgs: 129 active+clean; 97 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 280 op/s 2024-09-21T05:58:17.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:17 smithi037 ceph-mon[30631]: pgmap v545: 129 pgs: 129 active+clean; 97 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 280 op/s 2024-09-21T05:58:19.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:19 smithi067 ceph-mon[34443]: pgmap v546: 129 pgs: 129 active+clean; 97 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 311 op/s 2024-09-21T05:58:19.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:19 smithi144 ceph-mon[34351]: pgmap v546: 129 pgs: 129 active+clean; 97 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 311 op/s 2024-09-21T05:58:19.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:19 smithi037 ceph-mon[30631]: pgmap v546: 129 pgs: 129 active+clean; 97 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 311 op/s 2024-09-21T05:58:21.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:21 smithi067 ceph-mon[34443]: pgmap v547: 129 pgs: 129 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.5 MiB/s wr, 273 op/s 2024-09-21T05:58:21.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:21 smithi144 ceph-mon[34351]: pgmap v547: 129 pgs: 129 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.5 MiB/s wr, 273 op/s 2024-09-21T05:58:21.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:21 smithi037 ceph-mon[30631]: pgmap v547: 129 pgs: 129 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.5 MiB/s wr, 273 op/s 2024-09-21T05:58:23.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:23 smithi067 ceph-mon[34443]: pgmap v548: 129 pgs: 129 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 306 op/s 2024-09-21T05:58:23.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:23 smithi144 ceph-mon[34351]: pgmap v548: 129 pgs: 129 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 306 op/s 2024-09-21T05:58:23.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:23 smithi037 ceph-mon[30631]: pgmap v548: 129 pgs: 129 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 306 op/s 2024-09-21T05:58:25.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:25 smithi067 ceph-mon[34443]: pgmap v549: 129 pgs: 129 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2024-09-21T05:58:25.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:25 smithi144 ceph-mon[34351]: pgmap v549: 129 pgs: 129 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2024-09-21T05:58:25.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:25 smithi037 ceph-mon[30631]: pgmap v549: 129 pgs: 129 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2024-09-21T05:58:27.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:27 smithi067 ceph-mon[34443]: pgmap v550: 129 pgs: 129 active+clean; 99 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.4 MiB/s wr, 272 op/s 2024-09-21T05:58:27.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:27 smithi144 ceph-mon[34351]: pgmap v550: 129 pgs: 129 active+clean; 99 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.4 MiB/s wr, 272 op/s 2024-09-21T05:58:27.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:27 smithi037 ceph-mon[30631]: pgmap v550: 129 pgs: 129 active+clean; 99 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.4 MiB/s wr, 272 op/s 2024-09-21T05:58:28.083 INFO:tasks.workunit.client.0.smithi037.stdout:50000 copy from 0x898b8 to 0x92015, (0x875d bytes) at 0xb142c 2024-09-21T05:58:28.083 INFO:tasks.workunit.client.0.smithi037.stdout:All 50000 operations completed A-OK! 2024-09-21T05:58:28.086 INFO:tasks.workunit.client.0.smithi037.stderr:+ ./fsx -z 10MB -N 50000 -p 10000 -l 10485760 2024-09-21T05:58:28.087 INFO:tasks.workunit.client.0.smithi037.stdout:Seed set to 1 2024-09-21T05:58:28.235 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-21T05:58:28.235 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-21T05:58:28.237 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-21T05:58:28.237 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-21T05:58:28.237 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support clone range, disabling! 2024-09-21T05:58:28.241 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-21T05:58:28.244 INFO:tasks.workunit.client.0.smithi037.stdout:skipping zero length punch hole 2024-09-21T05:58:28.244 INFO:tasks.workunit.client.0.smithi037.stdout:skipping zero length punch hole 2024-09-21T05:58:28.244 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support exchange range, disabling! 2024-09-21T05:58:28.244 INFO:tasks.workunit.client.0.smithi037.stdout:skipping zero length punch hole 2024-09-21T05:58:28.244 INFO:tasks.workunit.client.0.smithi037.stdout:skipping zero size read 2024-09-21T05:58:28.244 INFO:tasks.workunit.client.0.smithi037.stdout:skipping zero length punch hole 2024-09-21T05:58:28.244 INFO:tasks.workunit.client.0.smithi037.stdout:skipping zero size read 2024-09-21T05:58:28.245 INFO:tasks.workunit.client.0.smithi037.stdout:skipping zero length punch hole 2024-09-21T05:58:28.245 INFO:tasks.workunit.client.0.smithi037.stdout:truncating to largest ever: 0x4310e9 2024-09-21T05:58:28.252 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0x954a45 2024-09-21T05:58:28.333 INFO:tasks.workunit.client.0.smithi037.stdout:truncating to largest ever: 0x9bc582 2024-09-21T05:58:28.378 INFO:tasks.workunit.client.0.smithi037.stdout:truncating to largest ever: 0x9eecbc 2024-09-21T05:58:29.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:29 smithi067 ceph-mon[34443]: pgmap v551: 129 pgs: 129 active+clean; 99 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 305 op/s 2024-09-21T05:58:29.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:29 smithi144 ceph-mon[34351]: pgmap v551: 129 pgs: 129 active+clean; 99 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 305 op/s 2024-09-21T05:58:29.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:29 smithi037 ceph-mon[30631]: pgmap v551: 129 pgs: 129 active+clean; 99 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 305 op/s 2024-09-21T05:58:31.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:31 smithi067 ceph-mon[34443]: pgmap v552: 129 pgs: 129 active+clean; 100 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 291 op/s 2024-09-21T05:58:31.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:31 smithi144 ceph-mon[34351]: pgmap v552: 129 pgs: 129 active+clean; 100 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 291 op/s 2024-09-21T05:58:31.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:31 smithi037 ceph-mon[30631]: pgmap v552: 129 pgs: 129 active+clean; 100 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 291 op/s 2024-09-21T05:58:32.320 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0x9fdd84 2024-09-21T05:58:33.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:33 smithi067 ceph-mon[34443]: pgmap v553: 129 pgs: 129 active+clean; 101 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 288 op/s 2024-09-21T05:58:33.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:33 smithi144 ceph-mon[34351]: pgmap v553: 129 pgs: 129 active+clean; 101 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 288 op/s 2024-09-21T05:58:33.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:33 smithi037 ceph-mon[30631]: pgmap v553: 129 pgs: 129 active+clean; 101 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 288 op/s 2024-09-21T05:58:35.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:35 smithi067 ceph-mon[34443]: pgmap v554: 129 pgs: 129 active+clean; 101 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 239 op/s 2024-09-21T05:58:35.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:35 smithi144 ceph-mon[34351]: pgmap v554: 129 pgs: 129 active+clean; 101 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 239 op/s 2024-09-21T05:58:35.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:35 smithi037 ceph-mon[30631]: pgmap v554: 129 pgs: 129 active+clean; 101 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 239 op/s 2024-09-21T05:58:36.403 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-09-21T05:58:36.403 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:58:36.893 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:37.645 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:37 smithi037 ceph-mon[30631]: pgmap v555: 129 pgs: 129 active+clean; 102 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.1 MiB/s wr, 394 op/s 2024-09-21T05:58:37.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:37 smithi067 ceph-mon[34443]: pgmap v555: 129 pgs: 129 active+clean; 102 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.1 MiB/s wr, 394 op/s 2024-09-21T05:58:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.787+0000 7fcb3be00640 1 -- 172.21.15.37:0/3628646176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c105bc0 msgr2=0x7fcb3c105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.787+0000 7fcb3be00640 1 --2- 172.21.15.37:0/3628646176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c105bc0 0x7fcb3c105fd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009900 tx=0x7fcb2c02a420 comp rx=0 tx=0).stop 2024-09-21T05:58:37.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.787+0000 7fcb3be00640 1 -- 172.21.15.37:0/3628646176 shutdown_connections 2024-09-21T05:58:37.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.787+0000 7fcb3be00640 1 --2- 172.21.15.37:0/3628646176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb3c10be50 0x7fcb3c112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:37.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.787+0000 7fcb3be00640 1 --2- 172.21.15.37:0/3628646176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb3c10b500 0x7fcb3c10b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:37.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.787+0000 7fcb3be00640 1 --2- 172.21.15.37:0/3628646176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c105bc0 0x7fcb3c105fd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:37.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.787+0000 7fcb3be00640 1 -- 172.21.15.37:0/3628646176 >> 172.21.15.37:0/3628646176 conn(0x7fcb3c101630 msgr2=0x7fcb3c103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:37.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.788+0000 7fcb3be00640 1 -- 172.21.15.37:0/3628646176 shutdown_connections 2024-09-21T05:58:37.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.788+0000 7fcb3be00640 1 -- 172.21.15.37:0/3628646176 wait complete. 2024-09-21T05:58:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.790+0000 7fcb3be00640 1 Processor -- start 2024-09-21T05:58:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.790+0000 7fcb3be00640 1 -- start start 2024-09-21T05:58:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.791+0000 7fcb3be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb3c105bc0 0x7fcb3c19c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.791+0000 7fcb3be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb3c10b500 0x7fcb3c19ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.791+0000 7fcb3be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c10be50 0x7fcb3c1a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.791+0000 7fcb3be00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c115b10 con 0x7fcb3c10b500 2024-09-21T05:58:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.791+0000 7fcb3be00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c115990 con 0x7fcb3c10be50 2024-09-21T05:58:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.791+0000 7fcb3be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c115c90 con 0x7fcb3c105bc0 2024-09-21T05:58:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.791+0000 7fcb3b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c10be50 0x7fcb3c1a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.791+0000 7fcb3b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c10be50 0x7fcb3c1a1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:53936/0 (socket says 172.21.15.37:53936) 2024-09-21T05:58:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.791+0000 7fcb3b400640 1 -- 172.21.15.37:0/4087547582 learned_addr learned my addr 172.21.15.37:0/4087547582 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:58:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.791+0000 7fcb3aa00640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb3c105bc0 0x7fcb3c19c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.792+0000 7fcb3a000640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb3c10b500 0x7fcb3c19ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.792+0000 7fcb3b400640 1 -- 172.21.15.37:0/4087547582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb3c105bc0 msgr2=0x7fcb3c19c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.792+0000 7fcb3b400640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb3c105bc0 0x7fcb3c19c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.792+0000 7fcb3b400640 1 -- 172.21.15.37:0/4087547582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb3c10b500 msgr2=0x7fcb3c19ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.792+0000 7fcb3b400640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb3c10b500 0x7fcb3c19ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.792+0000 7fcb3b400640 1 -- 172.21.15.37:0/4087547582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3c1a2450 con 0x7fcb3c10be50 2024-09-21T05:58:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.792+0000 7fcb3a000640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb3c10b500 0x7fcb3c19ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.792+0000 7fcb3b400640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c10be50 0x7fcb3c1a1d20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400eaa0 tx=0x7fcb3400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:37.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.793+0000 7fcb33400640 1 -- 172.21.15.37:0/4087547582 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3400cdb0 con 0x7fcb3c10be50 2024-09-21T05:58:37.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.793+0000 7fcb33400640 1 -- 172.21.15.37:0/4087547582 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb34005020 con 0x7fcb3c10be50 2024-09-21T05:58:37.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.793+0000 7fcb33400640 1 -- 172.21.15.37:0/4087547582 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb340116d0 con 0x7fcb3c10be50 2024-09-21T05:58:37.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.793+0000 7fcb3be00640 1 -- 172.21.15.37:0/4087547582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb3c1a2740 con 0x7fcb3c10be50 2024-09-21T05:58:37.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.793+0000 7fcb3be00640 1 -- 172.21.15.37:0/4087547582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb3c077800 con 0x7fcb3c10be50 2024-09-21T05:58:37.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.795+0000 7fcb3be00640 1 -- 172.21.15.37:0/4087547582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb3c105fd0 con 0x7fcb3c10be50 2024-09-21T05:58:37.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.797+0000 7fcb33400640 1 -- 172.21.15.37:0/4087547582 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fcb340051d0 con 0x7fcb3c10be50 2024-09-21T05:58:37.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.799+0000 7fcb33400640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcb200b6590 0x7fcb200b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:37.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.800+0000 7fcb33400640 1 -- 172.21.15.37:0/4087547582 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fcb340e7940 con 0x7fcb3c10be50 2024-09-21T05:58:37.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.800+0000 7fcb3aa00640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcb200b6590 0x7fcb200b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:37.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.801+0000 7fcb3aa00640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcb200b6590 0x7fcb200b8aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c005f70 tx=0x7fcb2c000bc0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:37.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:37.803+0000 7fcb33400640 1 -- 172.21.15.37:0/4087547582 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb34016030 con 0x7fcb3c10be50 2024-09-21T05:58:37.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:37 smithi144 ceph-mon[34351]: pgmap v555: 129 pgs: 129 active+clean; 102 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.1 MiB/s wr, 394 op/s 2024-09-21T05:58:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.137+0000 7fcb3be00640 1 -- 172.21.15.37:0/4087547582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb3c19d610 con 0x7fcb3c10be50 2024-09-21T05:58:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.138+0000 7fcb33400640 1 -- 172.21.15.37:0/4087547582 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7fcb340adda0 con 0x7fcb3c10be50 2024-09-21T05:58:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:58:38.141 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:58:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:58:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.141+0000 7fcb3be00640 1 -- 172.21.15.37:0/4087547582 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcb200b6590 msgr2=0x7fcb200b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.141+0000 7fcb3be00640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcb200b6590 0x7fcb200b8aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c005f70 tx=0x7fcb2c000bc0 comp rx=0 tx=0).stop 2024-09-21T05:58:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.141+0000 7fcb3be00640 1 -- 172.21.15.37:0/4087547582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c10be50 msgr2=0x7fcb3c1a1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.141+0000 7fcb3be00640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c10be50 0x7fcb3c1a1d20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400eaa0 tx=0x7fcb3400ef60 comp rx=0 tx=0).stop 2024-09-21T05:58:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.141+0000 7fcb3be00640 1 -- 172.21.15.37:0/4087547582 shutdown_connections 2024-09-21T05:58:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.141+0000 7fcb3be00640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fcb200b6590 0x7fcb200b8aa0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.141+0000 7fcb3be00640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb3c10be50 0x7fcb3c1a1d20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.141+0000 7fcb3be00640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb3c10b500 0x7fcb3c19ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.141+0000 7fcb3be00640 1 --2- 172.21.15.37:0/4087547582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb3c105bc0 0x7fcb3c19c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.141+0000 7fcb3be00640 1 -- 172.21.15.37:0/4087547582 >> 172.21.15.37:0/4087547582 conn(0x7fcb3c101630 msgr2=0x7fcb3c103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.141+0000 7fcb3be00640 1 -- 172.21.15.37:0/4087547582 shutdown_connections 2024-09-21T05:58:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:38.141+0000 7fcb3be00640 1 -- 172.21.15.37:0/4087547582 wait complete. 2024-09-21T05:58:38.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:38 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/4087547582' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:58:38.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:38 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/4087547582' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:58:38.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:38 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/4087547582' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:58:39.039 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-09-21T05:58:39.039 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-09-21T05:58:39.548 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:39.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:39 smithi067 ceph-mon[34443]: pgmap v556: 129 pgs: 129 active+clean; 102 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.1 MiB/s wr, 376 op/s 2024-09-21T05:58:39.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:39 smithi144 ceph-mon[34351]: pgmap v556: 129 pgs: 129 active+clean; 102 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.1 MiB/s wr, 376 op/s 2024-09-21T05:58:39.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:39 smithi037 ceph-mon[30631]: pgmap v556: 129 pgs: 129 active+clean; 102 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.1 MiB/s wr, 376 op/s 2024-09-21T05:58:40.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.601+0000 7f1b43e00640 1 -- 172.21.15.37:0/1805846789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b4410b530 msgr2=0x7f1b4410b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.601+0000 7f1b43e00640 1 --2- 172.21.15.37:0/1805846789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b4410b530 0x7f1b4410b940 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009900 tx=0x7f1b3002a3f0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.601+0000 7f1b43e00640 1 -- 172.21.15.37:0/1805846789 shutdown_connections 2024-09-21T05:58:40.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.601+0000 7f1b43e00640 1 --2- 172.21.15.37:0/1805846789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b4410be80 0x7f1b441126b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.601+0000 7f1b43e00640 1 --2- 172.21.15.37:0/1805846789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b4410b530 0x7f1b4410b940 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.601+0000 7f1b43e00640 1 --2- 172.21.15.37:0/1805846789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b44105bf0 0x7f1b44106000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.601+0000 7f1b43e00640 1 -- 172.21.15.37:0/1805846789 >> 172.21.15.37:0/1805846789 conn(0x7f1b44101680 msgr2=0x7f1b44103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:40.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.601+0000 7f1b43e00640 1 -- 172.21.15.37:0/1805846789 shutdown_connections 2024-09-21T05:58:40.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.601+0000 7f1b43e00640 1 -- 172.21.15.37:0/1805846789 wait complete. 2024-09-21T05:58:40.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.602+0000 7f1b43e00640 1 Processor -- start 2024-09-21T05:58:40.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.603+0000 7f1b43e00640 1 -- start start 2024-09-21T05:58:40.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.603+0000 7f1b43e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b44105bf0 0x7f1b44110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.603+0000 7f1b43e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4410b530 0x7f1b44111370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.603+0000 7f1b43e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b4410be80 0x7f1b441ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.603+0000 7f1b43e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b44078350 con 0x7f1b44105bf0 2024-09-21T05:58:40.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.603+0000 7f1b43e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b440781d0 con 0x7f1b4410b530 2024-09-21T05:58:40.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.603+0000 7f1b43e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b440784d0 con 0x7f1b4410be80 2024-09-21T05:58:40.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.604+0000 7f1b42000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4410b530 0x7f1b44111370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.604+0000 7f1b42000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4410b530 0x7f1b44111370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:53946/0 (socket says 172.21.15.37:53946) 2024-09-21T05:58:40.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.604+0000 7f1b42000640 1 -- 172.21.15.37:0/2751265787 learned_addr learned my addr 172.21.15.37:0/2751265787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:58:40.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.604+0000 7f1b43400640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b4410be80 0x7f1b441ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.604+0000 7f1b42a00640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b44105bf0 0x7f1b44110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.604+0000 7f1b42000640 1 -- 172.21.15.37:0/2751265787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b4410be80 msgr2=0x7f1b441ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.604+0000 7f1b42000640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b4410be80 0x7f1b441ac5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.604+0000 7f1b42000640 1 -- 172.21.15.37:0/2751265787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b44105bf0 msgr2=0x7f1b44110e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.604+0000 7f1b42000640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b44105bf0 0x7f1b44110e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.604+0000 7f1b42000640 1 -- 172.21.15.37:0/2751265787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b441acb30 con 0x7f1b4410b530 2024-09-21T05:58:40.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.605+0000 7f1b42000640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4410b530 0x7f1b44111370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1b30031440 tx=0x7f1b30003c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:40.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.605+0000 7f1b3b400640 1 -- 172.21.15.37:0/2751265787 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b30050070 con 0x7f1b4410b530 2024-09-21T05:58:40.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.605+0000 7f1b3b400640 1 -- 172.21.15.37:0/2751265787 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b30031b50 con 0x7f1b4410b530 2024-09-21T05:58:40.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.605+0000 7f1b43e00640 1 -- 172.21.15.37:0/2751265787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4406cde0 con 0x7f1b4410b530 2024-09-21T05:58:40.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.605+0000 7f1b43e00640 1 -- 172.21.15.37:0/2751265787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4406d360 con 0x7f1b4410b530 2024-09-21T05:58:40.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.605+0000 7f1b3b400640 1 -- 172.21.15.37:0/2751265787 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b30035030 con 0x7f1b4410b530 2024-09-21T05:58:40.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.612+0000 7f1b506c4740 1 Processor -- start 2024-09-21T05:58:40.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.612+0000 7f1b506c4740 1 -- start start 2024-09-21T05:58:40.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.612+0000 7f1b506c4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f7d840 0x559a5a325510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.613+0000 7f1b506c4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f54980 0x559a5a325a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.613+0000 7f1b506c4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f5cb60 0x559a5a325f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.613+0000 7f1b506c4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a5a29aca0 con 0x559a59f5cb60 2024-09-21T05:58:40.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.613+0000 7f1b506c4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559a5a28a0d0 con 0x559a59f7d840 2024-09-21T05:58:40.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.613+0000 7f1b506c4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559a5a28dee0 con 0x559a59f54980 2024-09-21T05:58:40.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.613+0000 7f1b43400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f7d840 0x559a5a325510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.613+0000 7f1b43400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f7d840 0x559a5a325510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:53958/0 (socket says 172.21.15.37:53958) 2024-09-21T05:58:40.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.613+0000 7f1b43400640 1 -- 172.21.15.37:0/4237991997 learned_addr learned my addr 172.21.15.37:0/4237991997 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:58:40.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.613+0000 7f1b42a00640 1 --2- 172.21.15.37:0/4237991997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f54980 0x559a5a325a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.614+0000 7f1b43400640 1 -- 172.21.15.37:0/4237991997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f54980 msgr2=0x559a5a325a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.614+0000 7f1b43400640 1 --2- 172.21.15.37:0/4237991997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f54980 0x559a5a325a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.614+0000 7f1b43400640 1 -- 172.21.15.37:0/4237991997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f5cb60 msgr2=0x559a5a325f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T05:58:40.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.614+0000 7f1b43400640 1 --2- 172.21.15.37:0/4237991997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f5cb60 0x559a5a325f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.614+0000 7f1b43400640 1 -- 172.21.15.37:0/4237991997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5a23c400 con 0x559a59f7d840 2024-09-21T05:58:40.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.614+0000 7f1b43400640 1 --2- 172.21.15.37:0/4237991997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f7d840 0x559a5a325510 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00a430 tx=0x7f1b3c009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2829540b41f498ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:40.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.615+0000 7f1b3b400640 1 -- 172.21.15.37:0/2751265787 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1b30053070 con 0x7f1b4410b530 2024-09-21T05:58:40.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.616+0000 7f1b2fe00640 1 -- 172.21.15.37:0/4237991997 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c013790 con 0x559a59f7d840 2024-09-21T05:58:40.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.616+0000 7f1b2fe00640 1 -- 172.21.15.37:0/4237991997 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b3c019070 con 0x559a59f7d840 2024-09-21T05:58:40.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.616+0000 7f1b2fe00640 1 -- 172.21.15.37:0/4237991997 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c014cf0 con 0x559a59f7d840 2024-09-21T05:58:40.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.619+0000 7f1b506c4740 1 -- 172.21.15.37:0/4237991997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f7d840 msgr2=0x559a5a325510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.619+0000 7f1b506c4740 1 --2- 172.21.15.37:0/4237991997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f7d840 0x559a5a325510 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00a430 tx=0x7f1b3c009650 comp rx=0 tx=0).stop 2024-09-21T05:58:40.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.619+0000 7f1b506c4740 1 -- 172.21.15.37:0/4237991997 shutdown_connections 2024-09-21T05:58:40.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.619+0000 7f1b506c4740 1 --2- 172.21.15.37:0/4237991997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f5cb60 0x559a5a325f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.619+0000 7f1b506c4740 1 --2- 172.21.15.37:0/4237991997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f54980 0x559a5a325a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.619+0000 7f1b506c4740 1 --2- 172.21.15.37:0/4237991997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f7d840 0x559a5a325510 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.619+0000 7f1b506c4740 1 -- 172.21.15.37:0/4237991997 >> 172.21.15.37:0/4237991997 conn(0x559a59f71990 msgr2=0x559a5a323400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:40.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.620+0000 7f1b506c4740 1 -- 172.21.15.37:0/4237991997 shutdown_connections 2024-09-21T05:58:40.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.620+0000 7f1b506c4740 1 -- 172.21.15.37:0/4237991997 wait complete. 2024-09-21T05:58:40.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.620+0000 7f1b3b400640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1b280b6560 0x7f1b280b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.620+0000 7f1b506c4740 1 -- start start 2024-09-21T05:58:40.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.620+0000 7f1b506c4740 1 Processor -- start 2024-09-21T05:58:40.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.620+0000 7f1b3b400640 1 -- 172.21.15.37:0/2751265787 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f1b30118af0 con 0x7f1b4410b530 2024-09-21T05:58:40.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.621+0000 7f1b43400640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1b280b6560 0x7f1b280b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.622+0000 7f1b506c4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f54980 0x559a5a330bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.622+0000 7f1b506c4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f5cb60 0x559a5a331130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.622+0000 7f1b506c4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f7d840 0x559a5a34e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.622+0000 7f1b506c4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a5a0eb7a0 con 0x559a59f5cb60 2024-09-21T05:58:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.622+0000 7f1b506c4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559a5a22fa10 con 0x559a59f54980 2024-09-21T05:58:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.622+0000 7f1b506c4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559a5a344d00 con 0x559a59f7d840 2024-09-21T05:58:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.622+0000 7f1b42a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f54980 0x559a5a330bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.622+0000 7f1b42a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f54980 0x559a5a330bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:53964/0 (socket says 172.21.15.37:53964) 2024-09-21T05:58:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.622+0000 7f1b42a00640 1 -- 172.21.15.37:0/2761435106 learned_addr learned my addr 172.21.15.37:0/2761435106 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:58:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.622+0000 7f1b506c4740 10 client.0 _ll_register_callbacks cb 0x559a5a23fbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.623+0000 7f1b42a00640 1 -- 172.21.15.37:0/2761435106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f7d840 msgr2=0x559a5a34e080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T05:58:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.623+0000 7f1b42a00640 1 --2- 172.21.15.37:0/2761435106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f7d840 0x559a5a34e080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.623+0000 7f1b42a00640 1 -- 172.21.15.37:0/2761435106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f5cb60 msgr2=0x559a5a331130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.623+0000 7f1b42a00640 1 --2- 172.21.15.37:0/2761435106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f5cb60 0x559a5a331130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.623+0000 7f1b42a00640 1 -- 172.21.15.37:0/2761435106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a59ff7b90 con 0x559a59f54980 2024-09-21T05:58:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.624+0000 7f1b42a00640 1 --2- 172.21.15.37:0/2761435106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f54980 0x559a5a330bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b34012700 tx=0x7f1b34012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d869d8c63889ab5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.624+0000 7f1b2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:58:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.624+0000 7f1b43400640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1b280b6560 0x7f1b280b8a70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0099f0 tx=0x7f1b3c00af90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.624+0000 7f1b2cc00640 1 -- 172.21.15.37:0/2761435106 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34004030 con 0x559a59f54980 2024-09-21T05:58:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.624+0000 7f1b2cc00640 1 -- 172.21.15.37:0/2761435106 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f1b340041d0 con 0x559a59f54980 2024-09-21T05:58:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.624+0000 7f1b506c4740 1 -- 172.21.15.37:0/2761435106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b3c019070 con 0x559a59f54980 2024-09-21T05:58:40.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.624+0000 7f1b2cc00640 1 -- 172.21.15.37:0/2761435106 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1b340043d0 con 0x559a59f54980 2024-09-21T05:58:40.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.624+0000 7f1b506c4740 10 client.25520 fetch_fsmap learned FSMap version 21 2024-09-21T05:58:40.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.624+0000 7f1b506c4740 1 -- 172.21.15.37:0/2761435106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559a5a350ab0 con 0x559a59f54980 2024-09-21T05:58:40.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.625+0000 7f1b2cc00640 1 -- 172.21.15.37:0/2761435106 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b3c019070 con 0x559a59f54980 2024-09-21T05:58:40.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.625+0000 7f1b2cc00640 1 -- 172.21.15.37:0/2761435106 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1b34003a30 con 0x559a59f54980 2024-09-21T05:58:40.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.625+0000 7f1b506c4740 10 client.25520 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:58:40.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.625+0000 7f1b506c4740 10 client.25520 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:58:40.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.625+0000 7f1b506c4740 20 client.25520 populate_metadata read hostname 'smithi037' 2024-09-21T05:58:40.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.625+0000 7f1b506c4740 1 --2- 172.21.15.37:0/2761435106 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x559a59f3c1c0 0x559a5a353fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.625+0000 7f1b506c4740 4 client.25520 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:58:40.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.625+0000 7f1b506c4740 1 -- 172.21.15.37:0/2761435106 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a5a29cbf0 con 0x559a59f3c1c0 2024-09-21T05:58:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.626+0000 7f1b42000640 1 --2- 172.21.15.37:0/2761435106 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x559a59f3c1c0 0x559a5a353fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.627+0000 7f1b42000640 1 --2- 172.21.15.37:0/2761435106 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x559a59f3c1c0 0x559a5a353fd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26e8761db3a3e83c server_cookie=d32e1c1123b43905 in_seq=0 out_seq=0 2024-09-21T05:58:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.627+0000 7f1b2cc00640 10 client.25520 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:58:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.628+0000 7f1b2cc00640 1 -- 172.21.15.37:0/2761435106 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a5a29cbf0 con 0x559a59f3c1c0 2024-09-21T05:58:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.628+0000 7f1b2cc00640 10 client.25520 handle_command_reply: tid=0 2024-09-21T05:58:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.628+0000 7f1b506c4740 1 client.25520 shutdown 2024-09-21T05:58:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.629+0000 7f1b506c4740 1 -- 172.21.15.37:0/2761435106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f54980 msgr2=0x559a5a330bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.629+0000 7f1b506c4740 1 --2- 172.21.15.37:0/2761435106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f54980 0x559a5a330bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b34012700 tx=0x7f1b34012bc0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.630+0000 7f1b506c4740 1 -- 172.21.15.37:0/2761435106 shutdown_connections 2024-09-21T05:58:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.630+0000 7f1b506c4740 1 --2- 172.21.15.37:0/2761435106 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x559a59f3c1c0 0x559a5a353fd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.630+0000 7f1b506c4740 1 --2- 172.21.15.37:0/2761435106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f7d840 0x559a5a34e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.630+0000 7f1b506c4740 1 --2- 172.21.15.37:0/2761435106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f5cb60 0x559a5a331130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.630+0000 7f1b506c4740 1 --2- 172.21.15.37:0/2761435106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f54980 0x559a5a330bf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.630+0000 7f1b506c4740 1 -- 172.21.15.37:0/2761435106 >> 172.21.15.37:0/2761435106 conn(0x559a59f71990 msgr2=0x559a5a3286a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.630+0000 7f1b2cc00640 0 client.25520 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:58:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.630+0000 7f1b506c4740 1 -- 172.21.15.37:0/2761435106 shutdown_connections 2024-09-21T05:58:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.630+0000 7f1b506c4740 1 -- 172.21.15.37:0/2761435106 wait complete. 2024-09-21T05:58:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.630+0000 7f1b506c4740 20 client.25520 trim_cache size 0 max 16384 2024-09-21T05:58:40.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.656+0000 7f1b506c4740 1 Processor -- start 2024-09-21T05:58:40.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.656+0000 7f1b506c4740 1 -- start start 2024-09-21T05:58:40.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.656+0000 7f1b506c4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f54980 0x559a5a326f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b506c4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f5cb60 0x559a5a34df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b42a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f54980 0x559a5a326f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b506c4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f7d840 0x559a5a332820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b506c4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2400dca0 con 0x559a59f54980 2024-09-21T05:58:40.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b506c4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b24010520 con 0x559a59f7d840 2024-09-21T05:58:40.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b506c4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2400e310 con 0x559a59f5cb60 2024-09-21T05:58:40.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b42a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f54980 0x559a5a326f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52038/0 (socket says 172.21.15.37:52038) 2024-09-21T05:58:40.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b42a00640 1 -- 172.21.15.37:0/4267543972 learned_addr learned my addr 172.21.15.37:0/4267543972 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:58:40.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b43400640 1 --2- 172.21.15.37:0/4267543972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f7d840 0x559a5a332820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b42000640 1 --2- 172.21.15.37:0/4267543972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f5cb60 0x559a5a34df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b42a00640 1 -- 172.21.15.37:0/4267543972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f5cb60 msgr2=0x559a5a34df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b42a00640 1 --2- 172.21.15.37:0/4267543972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f5cb60 0x559a5a34df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b42a00640 1 -- 172.21.15.37:0/4267543972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f7d840 msgr2=0x559a5a332820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b42a00640 1 --2- 172.21.15.37:0/4267543972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f7d840 0x559a5a332820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.657+0000 7f1b42a00640 1 -- 172.21.15.37:0/4267543972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5a331480 con 0x559a59f54980 2024-09-21T05:58:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.658+0000 7f1b42a00640 1 --2- 172.21.15.37:0/4267543972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f54980 0x559a5a326f00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1b340045b0 tx=0x7f1b34009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b766841c795aff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.658+0000 7f1b2f400640 1 -- 172.21.15.37:0/4267543972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3401c460 con 0x559a59f54980 2024-09-21T05:58:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.658+0000 7f1b2f400640 1 -- 172.21.15.37:0/4267543972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b3402b070 con 0x559a59f54980 2024-09-21T05:58:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.658+0000 7f1b2f400640 1 -- 172.21.15.37:0/4267543972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34003850 con 0x559a59f54980 2024-09-21T05:58:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.659+0000 7f1b506c4740 1 -- 172.21.15.37:0/4267543972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f54980 msgr2=0x559a5a326f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:40.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.659+0000 7f1b506c4740 1 --2- 172.21.15.37:0/4267543972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f54980 0x559a5a326f00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1b340045b0 tx=0x7f1b34009f40 comp rx=0 tx=0).stop 2024-09-21T05:58:40.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.659+0000 7f1b506c4740 1 -- 172.21.15.37:0/4267543972 shutdown_connections 2024-09-21T05:58:40.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.659+0000 7f1b506c4740 1 --2- 172.21.15.37:0/4267543972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f7d840 0x559a5a332820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.659+0000 7f1b506c4740 1 --2- 172.21.15.37:0/4267543972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f5cb60 0x559a5a34df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.659+0000 7f1b506c4740 1 --2- 172.21.15.37:0/4267543972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f54980 0x559a5a326f00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.659+0000 7f1b506c4740 1 -- 172.21.15.37:0/4267543972 >> 172.21.15.37:0/4267543972 conn(0x559a59f71990 msgr2=0x559a5a332110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:40.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.659+0000 7f1b506c4740 1 -- 172.21.15.37:0/4267543972 shutdown_connections 2024-09-21T05:58:40.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.660+0000 7f1b506c4740 1 -- 172.21.15.37:0/4267543972 wait complete. 2024-09-21T05:58:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.660+0000 7f1b506c4740 1 -- start start 2024-09-21T05:58:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.660+0000 7f1b506c4740 1 Processor -- start 2024-09-21T05:58:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.661+0000 7f1b506c4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f54980 0x559a5a348890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.661+0000 7f1b506c4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f5cb60 0x559a5a348e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.661+0000 7f1b506c4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f7d840 0x559a5a3b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.661+0000 7f1b506c4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2400e9e0 con 0x559a59f7d840 2024-09-21T05:58:40.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.661+0000 7f1b506c4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2400fe50 con 0x559a59f5cb60 2024-09-21T05:58:40.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.661+0000 7f1b506c4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2400f0b0 con 0x559a59f54980 2024-09-21T05:58:40.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.661+0000 7f1b506c4740 10 client.0 _ll_register_callbacks cb 0x7f1b34009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:40.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.661+0000 7f1b42000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f5cb60 0x559a5a348e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.661+0000 7f1b42000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f5cb60 0x559a5a348e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:53986/0 (socket says 172.21.15.37:53986) 2024-09-21T05:58:40.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.661+0000 7f1b42000640 1 -- 172.21.15.37:0/3506568741 learned_addr learned my addr 172.21.15.37:0/3506568741 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:58:40.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.661+0000 7f1b43400640 1 --2- 172.21.15.37:0/3506568741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f7d840 0x559a5a3b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.662+0000 7f1b42000640 1 -- 172.21.15.37:0/3506568741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f54980 msgr2=0x559a5a348890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.662+0000 7f1b42000640 1 --2- 172.21.15.37:0/3506568741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f54980 0x559a5a348890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.662+0000 7f1b42000640 1 -- 172.21.15.37:0/3506568741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f7d840 msgr2=0x559a5a3b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:40.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.662+0000 7f1b42000640 1 --2- 172.21.15.37:0/3506568741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f7d840 0x559a5a3b7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:40.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.662+0000 7f1b42000640 1 -- 172.21.15.37:0/3506568741 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a5a3b8070 con 0x559a59f5cb60 2024-09-21T05:58:40.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.662+0000 7f1b42000640 1 --2- 172.21.15.37:0/3506568741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f5cb60 0x559a5a348e50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1b301161c0 tx=0x7f1b30031f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=497e930a03d5f0e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:40.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.662+0000 7f1b2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:58:40.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b2cc00640 1 -- 172.21.15.37:0/3506568741 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b300e3330 con 0x559a59f5cb60 2024-09-21T05:58:40.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b2cc00640 1 -- 172.21.15.37:0/3506568741 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f1b300dabc0 con 0x559a59f5cb60 2024-09-21T05:58:40.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b506c4740 1 -- 172.21.15.37:0/3506568741 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b3402b070 con 0x559a59f5cb60 2024-09-21T05:58:40.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b2cc00640 1 -- 172.21.15.37:0/3506568741 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1b300e8270 con 0x559a59f5cb60 2024-09-21T05:58:40.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b506c4740 10 client.25526 fetch_fsmap learned FSMap version 21 2024-09-21T05:58:40.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b506c4740 1 -- 172.21.15.37:0/3506568741 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559a5a3bf350 con 0x559a59f5cb60 2024-09-21T05:58:40.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b2cc00640 1 -- 172.21.15.37:0/3506568741 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b3402b070 con 0x559a59f5cb60 2024-09-21T05:58:40.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b2cc00640 1 -- 172.21.15.37:0/3506568741 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1b300dfb80 con 0x559a59f5cb60 2024-09-21T05:58:40.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b506c4740 10 client.25526 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:58:40.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b506c4740 10 client.25526 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:58:40.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b506c4740 20 client.25526 populate_metadata read hostname 'smithi037' 2024-09-21T05:58:40.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b506c4740 1 --2- 172.21.15.37:0/3506568741 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x559a59f11570 0x559a5a3c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:40.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b506c4740 4 client.25526 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-09-21T05:58:40.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.663+0000 7f1b506c4740 1 -- 172.21.15.37:0/3506568741 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x559a5a2986a0 con 0x559a59f11570 2024-09-21T05:58:40.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.664+0000 7f1b42a00640 1 --2- 172.21.15.37:0/3506568741 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x559a59f11570 0x559a5a3c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:40.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.664+0000 7f1b42a00640 1 --2- 172.21.15.37:0/3506568741 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x559a59f11570 0x559a5a3c1ba0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bade0435a06b23d server_cookie=1c3682810c8a1ae1 in_seq=0 out_seq=0 2024-09-21T05:58:40.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:40.664+0000 7f1b2cc00640 10 client.25526 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:58:41.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:41 smithi067 ceph-mon[34443]: pgmap v557: 129 pgs: 129 active+clean; 106 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.0 MiB/s wr, 397 op/s 2024-09-21T05:58:41.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.784+0000 7f1b2cc00640 1 -- 172.21.15.37:0/3506568741 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559a5a2986a0 con 0x559a59f11570 2024-09-21T05:58:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.784+0000 7f1b2cc00640 10 client.25526 handle_command_reply: tid=0 2024-09-21T05:58:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.784+0000 7f1b506c4740 1 client.25526 shutdown 2024-09-21T05:58:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.785+0000 7f1b506c4740 1 -- 172.21.15.37:0/3506568741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f5cb60 msgr2=0x559a5a348e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.785+0000 7f1b506c4740 1 --2- 172.21.15.37:0/3506568741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f5cb60 0x559a5a348e50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1b301161c0 tx=0x7f1b30031f50 comp rx=0 tx=0).stop 2024-09-21T05:58:41.788 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:41 smithi037 ceph-mon[30631]: pgmap v557: 129 pgs: 129 active+clean; 106 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.0 MiB/s wr, 397 op/s 2024-09-21T05:58:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.785+0000 7f1b506c4740 1 -- 172.21.15.37:0/3506568741 shutdown_connections 2024-09-21T05:58:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.785+0000 7f1b506c4740 1 --2- 172.21.15.37:0/3506568741 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x559a59f11570 0x559a5a3c1ba0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.785+0000 7f1b506c4740 1 --2- 172.21.15.37:0/3506568741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a59f7d840 0x559a5a3b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.785+0000 7f1b506c4740 1 --2- 172.21.15.37:0/3506568741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a59f5cb60 0x559a5a348e50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.785+0000 7f1b506c4740 1 --2- 172.21.15.37:0/3506568741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a59f54980 0x559a5a348890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.785+0000 7f1b506c4740 1 -- 172.21.15.37:0/3506568741 >> 172.21.15.37:0/3506568741 conn(0x559a59f71990 msgr2=0x559a5a326cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.785+0000 7f1b2cc00640 0 client.25526 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:58:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.785+0000 7f1b506c4740 1 -- 172.21.15.37:0/3506568741 shutdown_connections 2024-09-21T05:58:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.785+0000 7f1b506c4740 1 -- 172.21.15.37:0/3506568741 wait complete. 2024-09-21T05:58:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.785+0000 7f1b506c4740 20 client.25526 trim_cache size 0 max 16384 2024-09-21T05:58:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:58:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:58:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:58:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 18, 2024-09-21T05:58:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:58:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "a70746bb": { 2024-09-21T05:58:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 18, 2024-09-21T05:58:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:58:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:58:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:58:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:58:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:58:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:58:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 130.0, 2024-09-21T05:58:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:58:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:58:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:58:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:58:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:58:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:58:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:58:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:58:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:58:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:58:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:58:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:58:41.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.786+0000 7f1b43e00640 1 -- 172.21.15.37:0/2751265787 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1b280b6560 msgr2=0x7f1b280b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:41.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.786+0000 7f1b43e00640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1b280b6560 0x7f1b280b8a70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0099f0 tx=0x7f1b3c00af90 comp rx=0 tx=0).stop 2024-09-21T05:58:41.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.786+0000 7f1b43e00640 1 -- 172.21.15.37:0/2751265787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4410b530 msgr2=0x7f1b44111370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:41.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.786+0000 7f1b43e00640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4410b530 0x7f1b44111370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1b30031440 tx=0x7f1b30003c00 comp rx=0 tx=0).stop 2024-09-21T05:58:41.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.787+0000 7f1b43e00640 1 -- 172.21.15.37:0/2751265787 shutdown_connections 2024-09-21T05:58:41.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.787+0000 7f1b43e00640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b4410be80 0x7f1b441ac5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:41.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.787+0000 7f1b43e00640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f1b280b6560 0x7f1b280b8a70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:41.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.787+0000 7f1b43e00640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4410b530 0x7f1b44111370 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:41.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.787+0000 7f1b43e00640 1 --2- 172.21.15.37:0/2751265787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b44105bf0 0x7f1b44110e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:41.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.787+0000 7f1b43e00640 1 -- 172.21.15.37:0/2751265787 >> 172.21.15.37:0/2751265787 conn(0x7f1b44101680 msgr2=0x7f1b4407ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:41.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.787+0000 7f1b43e00640 1 -- 172.21.15.37:0/2751265787 shutdown_connections 2024-09-21T05:58:41.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:41.787+0000 7f1b43e00640 1 -- 172.21.15.37:0/2751265787 wait complete. 2024-09-21T05:58:41.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:41 smithi144 ceph-mon[34351]: pgmap v557: 129 pgs: 129 active+clean; 106 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.0 MiB/s wr, 397 op/s 2024-09-21T05:58:42.872 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a70746bb', quiesce took 6.5 seconds. Will release after: 3.5 2024-09-21T05:58:43.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:43 smithi067 ceph-mon[34443]: pgmap v558: 129 pgs: 129 active+clean; 110 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.0 MiB/s wr, 377 op/s 2024-09-21T05:58:43.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:43 smithi144 ceph-mon[34351]: pgmap v558: 129 pgs: 129 active+clean; 110 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.0 MiB/s wr, 377 op/s 2024-09-21T05:58:43.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:43 smithi037 ceph-mon[30631]: pgmap v558: 129 pgs: 129 active+clean; 110 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.0 MiB/s wr, 377 op/s 2024-09-21T05:58:45.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:45 smithi067 ceph-mon[34443]: pgmap v559: 129 pgs: 129 active+clean; 110 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.8 MiB/s wr, 349 op/s 2024-09-21T05:58:45.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:45 smithi144 ceph-mon[34351]: pgmap v559: 129 pgs: 129 active+clean; 110 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.8 MiB/s wr, 349 op/s 2024-09-21T05:58:45.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:45 smithi037 ceph-mon[30631]: pgmap v559: 129 pgs: 129 active+clean; 110 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.8 MiB/s wr, 349 op/s 2024-09-21T05:58:46.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:58:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:47.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:47 smithi037 ceph-mon[30631]: pgmap v560: 129 pgs: 129 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.7 MiB/s wr, 334 op/s 2024-09-21T05:58:47.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.742+0000 7fd28b000640 1 -- 172.21.15.37:0/2133213714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd284077380 msgr2=0x7fd2840757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.742+0000 7fd28b000640 1 --2- 172.21.15.37:0/2133213714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd284077380 0x7fd2840757b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd278009900 tx=0x7fd27802a3f0 comp rx=0 tx=0).stop 2024-09-21T05:58:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.742+0000 7fd28b000640 1 -- 172.21.15.37:0/2133213714 shutdown_connections 2024-09-21T05:58:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.742+0000 7fd28b000640 1 --2- 172.21.15.37:0/2133213714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd284114280 0x7fd284116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.742+0000 7fd28b000640 1 --2- 172.21.15.37:0/2133213714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd284075dd0 0x7fd2840761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.742+0000 7fd28b000640 1 --2- 172.21.15.37:0/2133213714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd284077380 0x7fd2840757b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.742+0000 7fd28b000640 1 -- 172.21.15.37:0/2133213714 >> 172.21.15.37:0/2133213714 conn(0x7fd2840ff440 msgr2=0x7fd284101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.742+0000 7fd28b000640 1 -- 172.21.15.37:0/2133213714 shutdown_connections 2024-09-21T05:58:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.742+0000 7fd28b000640 1 -- 172.21.15.37:0/2133213714 wait complete. 2024-09-21T05:58:47.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.743+0000 7fd28b000640 1 Processor -- start 2024-09-21T05:58:47.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.743+0000 7fd28b000640 1 -- start start 2024-09-21T05:58:47.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.743+0000 7fd28b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd284075dd0 0x7fd2841a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:47.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.743+0000 7fd28b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd284077380 0x7fd2841a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:47.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd28b000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd284114280 0x7fd2841a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd28b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd284119f10 con 0x7fd284077380 2024-09-21T05:58:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd28b000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd284119d90 con 0x7fd284114280 2024-09-21T05:58:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd28b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd28411a090 con 0x7fd284075dd0 2024-09-21T05:58:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd289200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd284077380 0x7fd2841a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd289c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd284075dd0 0x7fd2841a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd289200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd284077380 0x7fd2841a0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51530/0 (socket says 172.21.15.37:51530) 2024-09-21T05:58:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd289200640 1 -- 172.21.15.37:0/2505303428 learned_addr learned my addr 172.21.15.37:0/2505303428 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:58:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd289c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd284075dd0 0x7fd2841a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47450/0 (socket says 172.21.15.37:47450) 2024-09-21T05:58:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd28a600640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd284114280 0x7fd2841a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:47.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:47 smithi067 ceph-mon[34443]: pgmap v560: 129 pgs: 129 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.7 MiB/s wr, 334 op/s 2024-09-21T05:58:47.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd289200640 1 -- 172.21.15.37:0/2505303428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd284075dd0 msgr2=0x7fd2841a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd289200640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd284075dd0 0x7fd2841a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd289200640 1 -- 172.21.15.37:0/2505303428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd284114280 msgr2=0x7fd2841a6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd289200640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd284114280 0x7fd2841a6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd289200640 1 -- 172.21.15.37:0/2505303428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2841a6890 con 0x7fd284077380 2024-09-21T05:58:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.744+0000 7fd28a600640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd284114280 0x7fd2841a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:58:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.745+0000 7fd289200640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd284077380 0x7fd2841a0ec0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd27000e9f0 tx=0x7fd27000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.745+0000 7fd282000640 1 -- 172.21.15.37:0/2505303428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27000ccc0 con 0x7fd284077380 2024-09-21T05:58:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.745+0000 7fd282000640 1 -- 172.21.15.37:0/2505303428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2700054d0 con 0x7fd284077380 2024-09-21T05:58:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.745+0000 7fd282000640 1 -- 172.21.15.37:0/2505303428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270010430 con 0x7fd284077380 2024-09-21T05:58:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.745+0000 7fd28b000640 1 -- 172.21.15.37:0/2505303428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2841a6b80 con 0x7fd284077380 2024-09-21T05:58:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.745+0000 7fd28b000640 1 -- 172.21.15.37:0/2505303428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2841ad2e0 con 0x7fd284077380 2024-09-21T05:58:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.746+0000 7fd28b000640 1 -- 172.21.15.37:0/2505303428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2840761e0 con 0x7fd284077380 2024-09-21T05:58:47.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.749+0000 7fd282000640 1 -- 172.21.15.37:0/2505303428 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fd2700046c0 con 0x7fd284077380 2024-09-21T05:58:47.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.751+0000 7fd282000640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd26c0b6590 0x7fd26c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:47.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.751+0000 7fd282000640 1 -- 172.21.15.37:0/2505303428 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fd2700e7c50 con 0x7fd284077380 2024-09-21T05:58:47.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.751+0000 7fd289c00640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd26c0b6590 0x7fd26c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:47.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.752+0000 7fd289c00640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd26c0b6590 0x7fd26c0b8aa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd278005ab0 tx=0x7fd278005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:47.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.753+0000 7fd282000640 1 -- 172.21.15.37:0/2505303428 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd270056710 con 0x7fd284077380 2024-09-21T05:58:47.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:47 smithi144 ceph-mon[34351]: pgmap v560: 129 pgs: 129 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.7 MiB/s wr, 334 op/s 2024-09-21T05:58:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.993+0000 7fd28b000640 1 -- 172.21.15.37:0/2505303428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2841a1a50 con 0x7fd284077380 2024-09-21T05:58:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.993+0000 7fd282000640 1 -- 172.21.15.37:0/2505303428 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7fd2841a1a50 con 0x7fd284077380 2024-09-21T05:58:47.996 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:58:47.996 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:58:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:58:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.996+0000 7fd28b000640 1 -- 172.21.15.37:0/2505303428 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd26c0b6590 msgr2=0x7fd26c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.996+0000 7fd28b000640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd26c0b6590 0x7fd26c0b8aa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd278005ab0 tx=0x7fd278005a20 comp rx=0 tx=0).stop 2024-09-21T05:58:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.996+0000 7fd28b000640 1 -- 172.21.15.37:0/2505303428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd284077380 msgr2=0x7fd2841a0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.996+0000 7fd28b000640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd284077380 0x7fd2841a0ec0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd27000e9f0 tx=0x7fd27000eeb0 comp rx=0 tx=0).stop 2024-09-21T05:58:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.997+0000 7fd28b000640 1 -- 172.21.15.37:0/2505303428 shutdown_connections 2024-09-21T05:58:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.997+0000 7fd28b000640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd26c0b6590 0x7fd26c0b8aa0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.997+0000 7fd28b000640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd284114280 0x7fd2841a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.997+0000 7fd28b000640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd284077380 0x7fd2841a0ec0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.997+0000 7fd28b000640 1 --2- 172.21.15.37:0/2505303428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd284075dd0 0x7fd2841a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.997+0000 7fd28b000640 1 -- 172.21.15.37:0/2505303428 >> 172.21.15.37:0/2505303428 conn(0x7fd2840ff440 msgr2=0x7fd284110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.997+0000 7fd28b000640 1 -- 172.21.15.37:0/2505303428 shutdown_connections 2024-09-21T05:58:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:47.997+0000 7fd28b000640 1 -- 172.21.15.37:0/2505303428 wait complete. 2024-09-21T05:58:48.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:48 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2505303428' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:58:48.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:48 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2505303428' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:58:48.753 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db --set-id a70746bb --release --await' 2024-09-21T05:58:48.753 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db --set-id a70746bb --release --await 2024-09-21T05:58:48.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:48 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2505303428' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:58:49.136 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:58:49.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:49 smithi037 ceph-mon[30631]: pgmap v561: 129 pgs: 129 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 955 KiB/s wr, 180 op/s 2024-09-21T05:58:49.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:49 smithi067 ceph-mon[34443]: pgmap v561: 129 pgs: 129 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 955 KiB/s wr, 180 op/s 2024-09-21T05:58:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.764+0000 7eff2b400640 1 -- 172.21.15.37:0/551737304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff24110140 msgr2=0x7eff24112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.764+0000 7eff2b400640 1 --2- 172.21.15.37:0/551737304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff24110140 0x7eff24112560 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009ca0 tx=0x7eff1c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.764+0000 7eff2b400640 1 -- 172.21.15.37:0/551737304 shutdown_connections 2024-09-21T05:58:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.764+0000 7eff2b400640 1 --2- 172.21.15.37:0/551737304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff24110140 0x7eff24112560 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.764+0000 7eff2b400640 1 --2- 172.21.15.37:0/551737304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff240760a0 0x7eff2410fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.764+0000 7eff2b400640 1 --2- 172.21.15.37:0/551737304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff24075750 0x7eff24075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.764+0000 7eff2b400640 1 -- 172.21.15.37:0/551737304 >> 172.21.15.37:0/551737304 conn(0x7eff240ff5d0 msgr2=0x7eff24101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.764+0000 7eff2b400640 1 -- 172.21.15.37:0/551737304 shutdown_connections 2024-09-21T05:58:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.764+0000 7eff2b400640 1 -- 172.21.15.37:0/551737304 wait complete. 2024-09-21T05:58:49.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.765+0000 7eff2b400640 1 Processor -- start 2024-09-21T05:58:49.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.766+0000 7eff2b400640 1 -- start start 2024-09-21T05:58:49.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.766+0000 7eff2b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff24075750 0x7eff2419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.766+0000 7eff2b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff240760a0 0x7eff2419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.766+0000 7eff2b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff24110140 0x7eff241a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.766+0000 7eff2b400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff24115cb0 con 0x7eff240760a0 2024-09-21T05:58:49.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.766+0000 7eff2b400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7eff24115b30 con 0x7eff24075750 2024-09-21T05:58:49.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.766+0000 7eff2b400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff24115e30 con 0x7eff24110140 2024-09-21T05:58:49.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.766+0000 7eff28a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff24075750 0x7eff2419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.766+0000 7eff1be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff240760a0 0x7eff2419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.766+0000 7eff28a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff24075750 0x7eff2419c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:44362/0 (socket says 172.21.15.37:44362) 2024-09-21T05:58:49.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.766+0000 7eff28a00640 1 -- 172.21.15.37:0/1717741627 learned_addr learned my addr 172.21.15.37:0/1717741627 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:58:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.767+0000 7eff29400640 1 --2- 172.21.15.37:0/1717741627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff24110140 0x7eff241a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.767+0000 7eff28a00640 1 -- 172.21.15.37:0/1717741627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff24110140 msgr2=0x7eff241a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.767+0000 7eff28a00640 1 --2- 172.21.15.37:0/1717741627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff24110140 0x7eff241a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.767+0000 7eff28a00640 1 -- 172.21.15.37:0/1717741627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff240760a0 msgr2=0x7eff2419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.767+0000 7eff28a00640 1 --2- 172.21.15.37:0/1717741627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff240760a0 0x7eff2419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.767+0000 7eff28a00640 1 -- 172.21.15.37:0/1717741627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff241a2630 con 0x7eff24075750 2024-09-21T05:58:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.767+0000 7eff28a00640 1 --2- 172.21.15.37:0/1717741627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff24075750 0x7eff2419c6c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff1400e9f0 tx=0x7eff1400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:49.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.767+0000 7eff22000640 1 -- 172.21.15.37:0/1717741627 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1400cd80 con 0x7eff24075750 2024-09-21T05:58:49.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.768+0000 7eff22000640 1 -- 172.21.15.37:0/1717741627 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff140108e0 con 0x7eff24075750 2024-09-21T05:58:49.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.768+0000 7eff2b400640 1 -- 172.21.15.37:0/1717741627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff241a2920 con 0x7eff24075750 2024-09-21T05:58:49.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.768+0000 7eff22000640 1 -- 172.21.15.37:0/1717741627 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14018980 con 0x7eff24075750 2024-09-21T05:58:49.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.768+0000 7eff2b400640 1 -- 172.21.15.37:0/1717741627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff241a9080 con 0x7eff24075750 2024-09-21T05:58:49.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.771+0000 7eff3202c740 1 Processor -- start 2024-09-21T05:58:49.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.771+0000 7eff3202c740 1 -- start start 2024-09-21T05:58:49.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.771+0000 7eff3202c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c67520 0x55c8c700e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.771+0000 7eff3202c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 0x55c8c700e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.771+0000 7eff3202c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c46840 0x55c8c700ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.771+0000 7eff3202c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c8c6f85290 con 0x55c8c6c46840 2024-09-21T05:58:49.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.771+0000 7eff3202c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c8c6f746c0 con 0x55c8c6c3e660 2024-09-21T05:58:49.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.771+0000 7eff3202c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c8c6f784d0 con 0x55c8c6c67520 2024-09-21T05:58:49.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.771+0000 7eff22000640 1 -- 172.21.15.37:0/1717741627 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7eff14010430 con 0x7eff24075750 2024-09-21T05:58:49.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.772+0000 7eff29400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c67520 0x55c8c700e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.772+0000 7eff29400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c67520 0x55c8c700e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47478/0 (socket says 172.21.15.37:47478) 2024-09-21T05:58:49.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.772+0000 7eff29400640 1 -- 172.21.15.37:0/1271013254 learned_addr learned my addr 172.21.15.37:0/1271013254 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:58:49.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.772+0000 7eff1be00640 1 --2- 172.21.15.37:0/1271013254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c46840 0x55c8c700ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.772+0000 7eff28a00640 1 --2- 172.21.15.37:0/1271013254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 0x55c8c700e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.772+0000 7eff29400640 1 -- 172.21.15.37:0/1271013254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 msgr2=0x55c8c700e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.772+0000 7eff29400640 1 --2- 172.21.15.37:0/1271013254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 0x55c8c700e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.772+0000 7eff29400640 1 -- 172.21.15.37:0/1271013254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c46840 msgr2=0x55c8c700ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.772+0000 7eff29400640 1 --2- 172.21.15.37:0/1271013254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c46840 0x55c8c700ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.772+0000 7eff29400640 1 -- 172.21.15.37:0/1271013254 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8c6f01460 con 0x55c8c6c67520 2024-09-21T05:58:49.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.772+0000 7eff1be00640 1 --2- 172.21.15.37:0/1271013254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c46840 0x55c8c700ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:58:49.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.772+0000 7eff28a00640 1 --2- 172.21.15.37:0/1271013254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 0x55c8c700e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:58:49.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.773+0000 7eff29400640 1 --2- 172.21.15.37:0/1271013254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c67520 0x55c8c700e1c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff1c005cc0 tx=0x7eff1c02f420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5e96086a1de15e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:49.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.773+0000 7eff19c00640 1 -- 172.21.15.37:0/1271013254 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c031cf0 con 0x55c8c6c67520 2024-09-21T05:58:49.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.773+0000 7eff19c00640 1 -- 172.21.15.37:0/1271013254 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff1c036040 con 0x55c8c6c67520 2024-09-21T05:58:49.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.773+0000 7eff19c00640 1 -- 172.21.15.37:0/1271013254 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c004040 con 0x55c8c6c67520 2024-09-21T05:58:49.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.773+0000 7eff22000640 1 --2- 172.21.15.37:0/1717741627 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7eff080b6590 0x7eff080b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.774+0000 7eff22000640 1 -- 172.21.15.37:0/1717741627 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7eff140e7a50 con 0x7eff24075750 2024-09-21T05:58:49.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.774+0000 7eff3202c740 1 -- 172.21.15.37:0/1271013254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c67520 msgr2=0x55c8c700e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.774+0000 7eff3202c740 1 --2- 172.21.15.37:0/1271013254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c67520 0x55c8c700e1c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff1c005cc0 tx=0x7eff1c02f420 comp rx=0 tx=0).stop 2024-09-21T05:58:49.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.774+0000 7eff28a00640 1 --2- 172.21.15.37:0/1717741627 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7eff080b6590 0x7eff080b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.774+0000 7eff3202c740 1 -- 172.21.15.37:0/1271013254 shutdown_connections 2024-09-21T05:58:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.774+0000 7eff3202c740 1 --2- 172.21.15.37:0/1271013254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c46840 0x55c8c700ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.774+0000 7eff3202c740 1 --2- 172.21.15.37:0/1271013254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 0x55c8c700e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.774+0000 7eff3202c740 1 --2- 172.21.15.37:0/1271013254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c67520 0x55c8c700e1c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.774+0000 7eff3202c740 1 -- 172.21.15.37:0/1271013254 >> 172.21.15.37:0/1271013254 conn(0x55c8c6c5b910 msgr2=0x55c8c700c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.774+0000 7eff3202c740 1 -- 172.21.15.37:0/1271013254 shutdown_connections 2024-09-21T05:58:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.774+0000 7eff3202c740 1 -- 172.21.15.37:0/1271013254 wait complete. 2024-09-21T05:58:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.774+0000 7eff28a00640 1 --2- 172.21.15.37:0/1717741627 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7eff080b6590 0x7eff080b8aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7eff140e5120 tx=0x7eff14000bc0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.775+0000 7eff3202c740 1 -- start start 2024-09-21T05:58:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.775+0000 7eff3202c740 1 Processor -- start 2024-09-21T05:58:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.776+0000 7eff3202c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c3e660 0x55c8c7019d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.776+0000 7eff3202c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c46840 0x55c8c701a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.776+0000 7eff3202c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c67520 0x55c8c7025c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.776+0000 7eff3202c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c8c6dd5bb0 con 0x55c8c6c46840 2024-09-21T05:58:49.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.776+0000 7eff3202c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c8c6f0f6c0 con 0x55c8c6c67520 2024-09-21T05:58:49.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.776+0000 7eff3202c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c8c701c940 con 0x55c8c6c3e660 2024-09-21T05:58:49.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.776+0000 7eff3202c740 10 client.0 _ll_register_callbacks cb 0x55c8c6f2a490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:49.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.776+0000 7eff1be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c46840 0x55c8c701a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.776+0000 7eff1be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c46840 0x55c8c701a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51580/0 (socket says 172.21.15.37:51580) 2024-09-21T05:58:49.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.776+0000 7eff1be00640 1 -- 172.21.15.37:0/1699984479 learned_addr learned my addr 172.21.15.37:0/1699984479 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:58:49.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.776+0000 7eff29400640 1 --2- 172.21.15.37:0/1699984479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c67520 0x55c8c7025c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.776+0000 7eff29400640 1 --2- 172.21.15.37:0/1699984479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c3e660 0x55c8c7019d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.776+0000 7eff1be00640 1 -- 172.21.15.37:0/1699984479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c3e660 msgr2=0x55c8c7019d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.777+0000 7eff1be00640 1 --2- 172.21.15.37:0/1699984479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c3e660 0x55c8c7019d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.777+0000 7eff1be00640 1 -- 172.21.15.37:0/1699984479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c67520 msgr2=0x55c8c7025c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.777+0000 7eff1be00640 1 --2- 172.21.15.37:0/1699984479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c67520 0x55c8c7025c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.777+0000 7eff1be00640 1 -- 172.21.15.37:0/1699984479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8c6cd2b00 con 0x55c8c6c46840 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.777+0000 7eff1be00640 1 --2- 172.21.15.37:0/1699984479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c46840 0x55c8c701a2a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7eff0c012730 tx=0x7eff0c012bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a9e425e6dd1790 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.777+0000 7eff12000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.777+0000 7eff12000640 1 -- 172.21.15.37:0/1699984479 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c004050 con 0x55c8c6c46840 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.777+0000 7eff12000640 1 -- 172.21.15.37:0/1699984479 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7eff0c0041f0 con 0x55c8c6c46840 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.777+0000 7eff3202c740 1 -- 172.21.15.37:0/1699984479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff1c036040 con 0x55c8c6c46840 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.777+0000 7eff12000640 1 -- 172.21.15.37:0/1699984479 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7eff0c025050 con 0x55c8c6c46840 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.778+0000 7eff3202c740 10 client.15510 fetch_fsmap learned FSMap version 21 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.778+0000 7eff3202c740 1 -- 172.21.15.37:0/1699984479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c8c6d49960 con 0x55c8c6c46840 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.778+0000 7eff12000640 1 -- 172.21.15.37:0/1699984479 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff1c036040 con 0x55c8c6c46840 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.778+0000 7eff12000640 1 -- 172.21.15.37:0/1699984479 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7eff0c003920 con 0x55c8c6c46840 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.778+0000 7eff3202c740 10 client.15510 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.778+0000 7eff3202c740 10 client.15510 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.778+0000 7eff3202c740 20 client.15510 populate_metadata read hostname 'smithi037' 2024-09-21T05:58:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.778+0000 7eff3202c740 1 --2- 172.21.15.37:0/1699984479 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c8c6c25ea0 0x55c8c702bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.778+0000 7eff3202c740 4 client.15510 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:58:49.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.778+0000 7eff3202c740 1 -- 172.21.15.37:0/1699984479 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8c6f871e0 con 0x55c8c6c25ea0 2024-09-21T05:58:49.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.779+0000 7eff29400640 1 --2- 172.21.15.37:0/1699984479 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c8c6c25ea0 0x55c8c702bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.779+0000 7eff29400640 1 --2- 172.21.15.37:0/1699984479 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c8c6c25ea0 0x55c8c702bd00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=921721bd10f5d907 server_cookie=b9c77fa8ca012d9b in_seq=0 out_seq=0 2024-09-21T05:58:49.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.779+0000 7eff12000640 10 client.15510 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:58:49.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.780+0000 7eff12000640 1 -- 172.21.15.37:0/1699984479 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8c6f871e0 con 0x55c8c6c25ea0 2024-09-21T05:58:49.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.780+0000 7eff12000640 10 client.15510 handle_command_reply: tid=0 2024-09-21T05:58:49.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.780+0000 7eff3202c740 1 client.15510 shutdown 2024-09-21T05:58:49.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.780+0000 7eff3202c740 1 -- 172.21.15.37:0/1699984479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c46840 msgr2=0x55c8c701a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.780+0000 7eff3202c740 1 --2- 172.21.15.37:0/1699984479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c46840 0x55c8c701a2a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7eff0c012730 tx=0x7eff0c012bf0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.781+0000 7eff3202c740 1 -- 172.21.15.37:0/1699984479 shutdown_connections 2024-09-21T05:58:49.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.781+0000 7eff3202c740 1 --2- 172.21.15.37:0/1699984479 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c8c6c25ea0 0x55c8c702bd00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.781+0000 7eff3202c740 1 --2- 172.21.15.37:0/1699984479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c67520 0x55c8c7025c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.781+0000 7eff3202c740 1 --2- 172.21.15.37:0/1699984479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c46840 0x55c8c701a2a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.781+0000 7eff3202c740 1 --2- 172.21.15.37:0/1699984479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c3e660 0x55c8c7019d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.781+0000 7eff3202c740 1 -- 172.21.15.37:0/1699984479 >> 172.21.15.37:0/1699984479 conn(0x55c8c6c5b910 msgr2=0x55c8c7011350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:49.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.781+0000 7eff12000640 0 client.15510 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:58:49.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.781+0000 7eff3202c740 1 -- 172.21.15.37:0/1699984479 shutdown_connections 2024-09-21T05:58:49.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.781+0000 7eff3202c740 1 -- 172.21.15.37:0/1699984479 wait complete. 2024-09-21T05:58:49.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.781+0000 7eff3202c740 20 client.15510 trim_cache size 0 max 16384 2024-09-21T05:58:49.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.799+0000 7eff3202c740 1 Processor -- start 2024-09-21T05:58:49.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.799+0000 7eff3202c740 1 -- start start 2024-09-21T05:58:49.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.799+0000 7eff3202c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 0x55c8c7011c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.799+0000 7eff3202c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c46840 0x55c8c701b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.799+0000 7eff3202c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c67520 0x55c8c7016d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.800+0000 7eff3202c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff241b0eb0 con 0x55c8c6c67520 2024-09-21T05:58:49.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.800+0000 7eff3202c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7eff241b3730 con 0x55c8c6c3e660 2024-09-21T05:58:49.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.800+0000 7eff3202c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff241b1520 con 0x55c8c6c46840 2024-09-21T05:58:49.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.800+0000 7eff29400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c67520 0x55c8c7016d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.800+0000 7eff29400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c67520 0x55c8c7016d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51594/0 (socket says 172.21.15.37:51594) 2024-09-21T05:58:49.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.800+0000 7eff29400640 1 -- 172.21.15.37:0/3124290920 learned_addr learned my addr 172.21.15.37:0/3124290920 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:58:49.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.800+0000 7eff29400640 1 --2- 172.21.15.37:0/3124290920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 0x55c8c7011c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.800+0000 7eff1be00640 1 --2- 172.21.15.37:0/3124290920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c46840 0x55c8c701b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.800+0000 7eff29400640 1 -- 172.21.15.37:0/3124290920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c46840 msgr2=0x55c8c701b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.800+0000 7eff29400640 1 --2- 172.21.15.37:0/3124290920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c46840 0x55c8c701b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.800+0000 7eff29400640 1 -- 172.21.15.37:0/3124290920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 msgr2=0x55c8c7011c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.800+0000 7eff29400640 1 --2- 172.21.15.37:0/3124290920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 0x55c8c7011c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.800+0000 7eff29400640 1 -- 172.21.15.37:0/3124290920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8c7011020 con 0x55c8c6c67520 2024-09-21T05:58:49.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.801+0000 7eff29400640 1 --2- 172.21.15.37:0/3124290920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c67520 0x55c8c7016d50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7eff1c003b60 tx=0x7eff1c003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1336c56a14daa400 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:49.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.801+0000 7eff19200640 1 -- 172.21.15.37:0/3124290920 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c032c30 con 0x55c8c6c67520 2024-09-21T05:58:49.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.801+0000 7eff19200640 1 -- 172.21.15.37:0/3124290920 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff1c036070 con 0x55c8c6c67520 2024-09-21T05:58:49.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.801+0000 7eff19200640 1 -- 172.21.15.37:0/3124290920 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0045d0 con 0x55c8c6c67520 2024-09-21T05:58:49.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.802+0000 7eff3202c740 1 -- 172.21.15.37:0/3124290920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c67520 msgr2=0x55c8c7016d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:49.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.802+0000 7eff3202c740 1 --2- 172.21.15.37:0/3124290920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c67520 0x55c8c7016d50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7eff1c003b60 tx=0x7eff1c003c30 comp rx=0 tx=0).stop 2024-09-21T05:58:49.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.802+0000 7eff3202c740 1 -- 172.21.15.37:0/3124290920 shutdown_connections 2024-09-21T05:58:49.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.802+0000 7eff3202c740 1 --2- 172.21.15.37:0/3124290920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c67520 0x55c8c7016d50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.802+0000 7eff3202c740 1 --2- 172.21.15.37:0/3124290920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c46840 0x55c8c701b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.802+0000 7eff3202c740 1 --2- 172.21.15.37:0/3124290920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 0x55c8c7011c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.802+0000 7eff3202c740 1 -- 172.21.15.37:0/3124290920 >> 172.21.15.37:0/3124290920 conn(0x55c8c6c5b910 msgr2=0x55c8c701b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:49.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.802+0000 7eff3202c740 1 -- 172.21.15.37:0/3124290920 shutdown_connections 2024-09-21T05:58:49.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.802+0000 7eff3202c740 1 -- 172.21.15.37:0/3124290920 wait complete. 2024-09-21T05:58:49.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.802+0000 7eff3202c740 1 -- start start 2024-09-21T05:58:49.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.802+0000 7eff3202c740 1 Processor -- start 2024-09-21T05:58:49.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.803+0000 7eff3202c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 0x55c8c701e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.803+0000 7eff3202c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c46840 0x55c8c701eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.803+0000 7eff3202c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c67520 0x55c8c708f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.803+0000 7eff3202c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff241b1bf0 con 0x55c8c6c67520 2024-09-21T05:58:49.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.803+0000 7eff3202c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7eff241b3060 con 0x55c8c6c3e660 2024-09-21T05:58:49.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.803+0000 7eff3202c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff241b22c0 con 0x55c8c6c46840 2024-09-21T05:58:49.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.803+0000 7eff3202c740 10 client.0 _ll_register_callbacks cb 0x7eff0c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:58:49.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.803+0000 7eff29400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c67520 0x55c8c708f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.803+0000 7eff1be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c46840 0x55c8c701eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.803+0000 7eff1be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c46840 0x55c8c701eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47512/0 (socket says 172.21.15.37:47512) 2024-09-21T05:58:49.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.803+0000 7eff1be00640 1 -- 172.21.15.37:0/3562980896 learned_addr learned my addr 172.21.15.37:0/3562980896 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:58:49.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.803+0000 7eff29400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c67520 0x55c8c708f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51604/0 (socket says 172.21.15.37:51604) 2024-09-21T05:58:49.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.803+0000 7eff29400640 1 --2- 172.21.15.37:0/3562980896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 0x55c8c701e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.804+0000 7eff1be00640 1 -- 172.21.15.37:0/3562980896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 msgr2=0x55c8c701e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.804+0000 7eff1be00640 1 --2- 172.21.15.37:0/3562980896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 0x55c8c701e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.804+0000 7eff1be00640 1 -- 172.21.15.37:0/3562980896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c67520 msgr2=0x55c8c708f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:58:49.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.804+0000 7eff1be00640 1 --2- 172.21.15.37:0/3562980896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c67520 0x55c8c708f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:49.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.804+0000 7eff1be00640 1 -- 172.21.15.37:0/3562980896 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8c708fcc0 con 0x55c8c6c46840 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.804+0000 7eff1be00640 1 --2- 172.21.15.37:0/3562980896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c46840 0x55c8c701eb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7eff0c012730 tx=0x7eff0c00fc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0ce3085fe725177 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.804+0000 7eff12000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.804+0000 7eff12000640 1 -- 172.21.15.37:0/3562980896 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00f790 con 0x55c8c6c46840 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.804+0000 7eff3202c740 1 -- 172.21.15.37:0/3562980896 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff1c036070 con 0x55c8c6c46840 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.804+0000 7eff12000640 1 -- 172.21.15.37:0/3562980896 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7eff0c022070 con 0x55c8c6c46840 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.805+0000 7eff12000640 1 -- 172.21.15.37:0/3562980896 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7eff0c039050 con 0x55c8c6c46840 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.805+0000 7eff3202c740 10 client.25561 fetch_fsmap learned FSMap version 21 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.805+0000 7eff3202c740 1 -- 172.21.15.37:0/3562980896 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c8c7097100 con 0x55c8c6c46840 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.805+0000 7eff12000640 1 -- 172.21.15.37:0/3562980896 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff1c036070 con 0x55c8c6c46840 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.805+0000 7eff12000640 1 -- 172.21.15.37:0/3562980896 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7eff0c003920 con 0x55c8c6c46840 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.805+0000 7eff3202c740 10 client.25561 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.805+0000 7eff3202c740 10 client.25561 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.805+0000 7eff3202c740 20 client.25561 populate_metadata read hostname 'smithi037' 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.805+0000 7eff3202c740 1 --2- 172.21.15.37:0/3562980896 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c8c6bfb250 0x55c8c7099920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.805+0000 7eff3202c740 4 client.25561 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a70746bb", "release": true, "await": true}] 2024-09-21T05:58:49.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.805+0000 7eff3202c740 1 -- 172.21.15.37:0/3562980896 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a70746bb", "release": true, "await": true}) -- 0x55c8c6f82c90 con 0x55c8c6bfb250 2024-09-21T05:58:49.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.806+0000 7eff29400640 1 --2- 172.21.15.37:0/3562980896 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c8c6bfb250 0x55c8c7099920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:58:49.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.806+0000 7eff29400640 1 --2- 172.21.15.37:0/3562980896 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c8c6bfb250 0x55c8c7099920 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdb9060fa599127d server_cookie=baaaa55fc7f6ba6a in_seq=0 out_seq=0 2024-09-21T05:58:49.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:49.806+0000 7eff12000640 10 client.25561 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:58:49.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:49 smithi144 ceph-mon[34351]: pgmap v561: 129 pgs: 129 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 955 KiB/s wr, 180 op/s 2024-09-21T05:58:50.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.009+0000 7eff12000640 1 -- 172.21.15.37:0/3562980896 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c8c6f82c90 con 0x55c8c6bfb250 2024-09-21T05:58:50.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.009+0000 7eff12000640 10 client.25561 handle_command_reply: tid=0 2024-09-21T05:58:50.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.009+0000 7eff3202c740 1 client.25561 shutdown 2024-09-21T05:58:50.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.009+0000 7eff3202c740 1 -- 172.21.15.37:0/3562980896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c46840 msgr2=0x55c8c701eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:50.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.009+0000 7eff3202c740 1 --2- 172.21.15.37:0/3562980896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c46840 0x55c8c701eb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7eff0c012730 tx=0x7eff0c00fc50 comp rx=0 tx=0).stop 2024-09-21T05:58:50.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.009+0000 7eff3202c740 1 -- 172.21.15.37:0/3562980896 shutdown_connections 2024-09-21T05:58:50.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.009+0000 7eff3202c740 1 --2- 172.21.15.37:0/3562980896 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55c8c6bfb250 0x55c8c7099920 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.009+0000 7eff3202c740 1 --2- 172.21.15.37:0/3562980896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8c6c67520 0x55c8c708f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.009+0000 7eff3202c740 1 --2- 172.21.15.37:0/3562980896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c8c6c46840 0x55c8c701eb10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.009+0000 7eff3202c740 1 --2- 172.21.15.37:0/3562980896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c6c3e660 0x55c8c701e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.009+0000 7eff12000640 0 client.25561 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:58:50.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.009+0000 7eff3202c740 1 -- 172.21.15.37:0/3562980896 >> 172.21.15.37:0/3562980896 conn(0x55c8c6c5b910 msgr2=0x55c8c7011c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:50.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.009+0000 7eff3202c740 1 -- 172.21.15.37:0/3562980896 shutdown_connections 2024-09-21T05:58:50.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.010+0000 7eff3202c740 1 -- 172.21.15.37:0/3562980896 wait complete. 2024-09-21T05:58:50.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.010+0000 7eff3202c740 20 client.25561 trim_cache size 0 max 16384 2024-09-21T05:58:50.013 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:58:50.013 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:58:50.013 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:58:50.013 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 20, 2024-09-21T05:58:50.014 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:58:50.014 INFO:teuthology.orchestra.run.smithi037.stdout: "a70746bb": { 2024-09-21T05:58:50.014 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 20, 2024-09-21T05:58:50.014 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:58:50.014 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:58:50.014 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:58:50.014 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:58:50.014 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:58:50.014 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:58:50.014 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 130.0, 2024-09-21T05:58:50.014 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:58:50.014 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:58:50.014 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:58:50.015 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:58:50.015 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:58:50.015 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:58:50.015 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:58:50.015 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:58:50.015 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:58:50.015 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:58:50.015 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:58:50.015 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:58:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.010+0000 7eff2b400640 1 -- 172.21.15.37:0/1717741627 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7eff080b6590 msgr2=0x7eff080b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.010+0000 7eff2b400640 1 --2- 172.21.15.37:0/1717741627 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7eff080b6590 0x7eff080b8aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7eff140e5120 tx=0x7eff14000bc0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.010+0000 7eff2b400640 1 -- 172.21.15.37:0/1717741627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff24075750 msgr2=0x7eff2419c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:58:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.010+0000 7eff2b400640 1 --2- 172.21.15.37:0/1717741627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff24075750 0x7eff2419c6c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff1400e9f0 tx=0x7eff1400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.010+0000 7eff2b400640 1 -- 172.21.15.37:0/1717741627 shutdown_connections 2024-09-21T05:58:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.011+0000 7eff2b400640 1 --2- 172.21.15.37:0/1717741627 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff24110140 0x7eff241a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.011+0000 7eff2b400640 1 --2- 172.21.15.37:0/1717741627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff240760a0 0x7eff2419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.011+0000 7eff2b400640 1 --2- 172.21.15.37:0/1717741627 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7eff080b6590 0x7eff080b8aa0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.011+0000 7eff2b400640 1 --2- 172.21.15.37:0/1717741627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff24075750 0x7eff2419c6c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:58:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.011+0000 7eff2b400640 1 -- 172.21.15.37:0/1717741627 >> 172.21.15.37:0/1717741627 conn(0x7eff240ff5d0 msgr2=0x7eff241011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:58:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.011+0000 7eff2b400640 1 -- 172.21.15.37:0/1717741627 shutdown_connections 2024-09-21T05:58:50.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:58:50.011+0000 7eff2b400640 1 -- 172.21.15.37:0/1717741627 wait complete. 2024-09-21T05:58:51.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:51 smithi037 ceph-mon[30631]: pgmap v562: 129 pgs: 129 active+clean; 111 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 841 KiB/s wr, 161 op/s 2024-09-21T05:58:51.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:51 smithi067 ceph-mon[34443]: pgmap v562: 129 pgs: 129 active+clean; 111 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 841 KiB/s wr, 161 op/s 2024-09-21T05:58:51.833 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a70746bb', total seconds elapsed: 15.4 2024-09-21T05:58:51.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:51 smithi144 ceph-mon[34351]: pgmap v562: 129 pgs: 129 active+clean; 111 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 841 KiB/s wr, 161 op/s 2024-09-21T05:58:53.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:53 smithi144 ceph-mon[34351]: pgmap v563: 129 pgs: 129 active+clean; 107 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 499 KiB/s wr, 78 op/s 2024-09-21T05:58:53.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:53 smithi037 ceph-mon[30631]: pgmap v563: 129 pgs: 129 active+clean; 107 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 499 KiB/s wr, 78 op/s 2024-09-21T05:58:53.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:53 smithi067 ceph-mon[34443]: pgmap v563: 129 pgs: 129 active+clean; 107 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 499 KiB/s wr, 78 op/s 2024-09-21T05:58:55.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:55 smithi144 ceph-mon[34351]: pgmap v564: 129 pgs: 129 active+clean; 107 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 334 KiB/s wr, 51 op/s 2024-09-21T05:58:55.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:55 smithi037 ceph-mon[30631]: pgmap v564: 129 pgs: 129 active+clean; 107 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 334 KiB/s wr, 51 op/s 2024-09-21T05:58:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:55 smithi067 ceph-mon[34443]: pgmap v564: 129 pgs: 129 active+clean; 107 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 334 KiB/s wr, 51 op/s 2024-09-21T05:58:57.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:57 smithi144 ceph-mon[34351]: pgmap v565: 129 pgs: 129 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1001 KiB/s wr, 170 op/s 2024-09-21T05:58:57.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:57 smithi037 ceph-mon[30631]: pgmap v565: 129 pgs: 129 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1001 KiB/s wr, 170 op/s 2024-09-21T05:58:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:57 smithi067 ceph-mon[34443]: pgmap v565: 129 pgs: 129 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1001 KiB/s wr, 170 op/s 2024-09-21T05:58:59.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:58:59 smithi144 ceph-mon[34351]: pgmap v566: 129 pgs: 129 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.1 MiB/s wr, 183 op/s 2024-09-21T05:58:59.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:58:59 smithi037 ceph-mon[30631]: pgmap v566: 129 pgs: 129 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.1 MiB/s wr, 183 op/s 2024-09-21T05:58:59.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:58:59 smithi067 ceph-mon[34443]: pgmap v566: 129 pgs: 129 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.1 MiB/s wr, 183 op/s 2024-09-21T05:59:01.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:01 smithi144 ceph-mon[34351]: pgmap v567: 129 pgs: 129 active+clean; 107 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.4 MiB/s wr, 252 op/s 2024-09-21T05:59:01.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:01 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:59:01.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:01 smithi037 ceph-mon[30631]: pgmap v567: 129 pgs: 129 active+clean; 107 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.4 MiB/s wr, 252 op/s 2024-09-21T05:59:01.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:59:01.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:01 smithi067 ceph-mon[34443]: pgmap v567: 129 pgs: 129 active+clean; 107 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.4 MiB/s wr, 252 op/s 2024-09-21T05:59:01.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:01 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:59:02.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:59:02.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:59:02.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:59:02.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:59:02.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:59:02.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:59:02.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:59:02.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:59:02.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T05:59:04.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:03 smithi144 ceph-mon[34351]: pgmap v568: 129 pgs: 129 active+clean; 106 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.7 MiB/s wr, 287 op/s 2024-09-21T05:59:04.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:03 smithi037 ceph-mon[30631]: pgmap v568: 129 pgs: 129 active+clean; 106 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.7 MiB/s wr, 287 op/s 2024-09-21T05:59:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:03 smithi067 ceph-mon[34443]: pgmap v568: 129 pgs: 129 active+clean; 106 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.7 MiB/s wr, 287 op/s 2024-09-21T05:59:04.573 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0x9ff773 2024-09-21T05:59:05.407 INFO:tasks.workunit.client.0.smithi037.stdout:20000 punch from 0x34ddcb to 0x35324f, (0x5484 bytes) 2024-09-21T05:59:06.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:05 smithi144 ceph-mon[34351]: pgmap v569: 129 pgs: 129 active+clean; 108 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.9 MiB/s wr, 347 op/s 2024-09-21T05:59:06.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:05 smithi037 ceph-mon[30631]: pgmap v569: 129 pgs: 129 active+clean; 108 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.9 MiB/s wr, 347 op/s 2024-09-21T05:59:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:05 smithi067 ceph-mon[34443]: pgmap v569: 129 pgs: 129 active+clean; 108 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.9 MiB/s wr, 347 op/s 2024-09-21T05:59:08.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:07 smithi144 ceph-mon[34351]: pgmap v570: 129 pgs: 129 active+clean; 109 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 2.3 MiB/s wr, 410 op/s 2024-09-21T05:59:08.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:07 smithi037 ceph-mon[30631]: pgmap v570: 129 pgs: 129 active+clean; 109 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 2.3 MiB/s wr, 410 op/s 2024-09-21T05:59:08.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:07 smithi067 ceph-mon[34443]: pgmap v570: 129 pgs: 129 active+clean; 109 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 2.3 MiB/s wr, 410 op/s 2024-09-21T05:59:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:09 smithi144 ceph-mon[34351]: pgmap v571: 129 pgs: 129 active+clean; 110 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.8 MiB/s wr, 345 op/s 2024-09-21T05:59:10.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:09 smithi037 ceph-mon[30631]: pgmap v571: 129 pgs: 129 active+clean; 110 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.8 MiB/s wr, 345 op/s 2024-09-21T05:59:10.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:09 smithi067 ceph-mon[34443]: pgmap v571: 129 pgs: 129 active+clean; 110 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.8 MiB/s wr, 345 op/s 2024-09-21T05:59:10.405 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T05:59:10.405 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-09-21T05:59:10.406 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:59:10.930 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.789+0000 7feb47200640 1 -- 172.21.15.37:0/3510270712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb48114280 msgr2=0x7feb48116750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.789+0000 7feb47200640 1 --2- 172.21.15.37:0/3510270712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb48114280 0x7feb48116750 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7feb40009ca0 tx=0x7feb4002a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.789+0000 7feb47200640 1 -- 172.21.15.37:0/3510270712 shutdown_connections 2024-09-21T05:59:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.789+0000 7feb47200640 1 --2- 172.21.15.37:0/3510270712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb48114280 0x7feb48116750 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.789+0000 7feb47200640 1 --2- 172.21.15.37:0/3510270712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb48075dd0 0x7feb480761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.789+0000 7feb47200640 1 --2- 172.21.15.37:0/3510270712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb48077380 0x7feb480757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.789+0000 7feb47200640 1 -- 172.21.15.37:0/3510270712 >> 172.21.15.37:0/3510270712 conn(0x7feb480ff440 msgr2=0x7feb48101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.790+0000 7feb47200640 1 -- 172.21.15.37:0/3510270712 shutdown_connections 2024-09-21T05:59:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.790+0000 7feb47200640 1 -- 172.21.15.37:0/3510270712 wait complete. 2024-09-21T05:59:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.791+0000 7feb47200640 1 Processor -- start 2024-09-21T05:59:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.791+0000 7feb47200640 1 -- start start 2024-09-21T05:59:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.792+0000 7feb47200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb48075dd0 0x7feb481a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.792+0000 7feb47200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb48077380 0x7feb481a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.792+0000 7feb47200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb48114280 0x7feb481a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.792+0000 7feb47200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feb48119f10 con 0x7feb48075dd0 2024-09-21T05:59:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.792+0000 7feb47200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feb48119d90 con 0x7feb48114280 2024-09-21T05:59:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.792+0000 7feb47200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feb4811a090 con 0x7feb48077380 2024-09-21T05:59:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.792+0000 7feb45e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb48075dd0 0x7feb481a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.792+0000 7feb45e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb48075dd0 0x7feb481a09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55758/0 (socket says 172.21.15.37:55758) 2024-09-21T05:59:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.792+0000 7feb45e00640 1 -- 172.21.15.37:0/44861250 learned_addr learned my addr 172.21.15.37:0/44861250 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.793+0000 7feb46800640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb48114280 0x7feb481a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.793+0000 7feb45400640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb48077380 0x7feb481a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.793+0000 7feb45e00640 1 -- 172.21.15.37:0/44861250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb48077380 msgr2=0x7feb481a0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.793+0000 7feb45e00640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb48077380 0x7feb481a0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.793+0000 7feb45e00640 1 -- 172.21.15.37:0/44861250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb48114280 msgr2=0x7feb481a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.793+0000 7feb45e00640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb48114280 0x7feb481a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.793+0000 7feb45e00640 1 -- 172.21.15.37:0/44861250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb481a6930 con 0x7feb48075dd0 2024-09-21T05:59:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.794+0000 7feb45e00640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb48075dd0 0x7feb481a09c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7feb3800ea60 tx=0x7feb3800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.794+0000 7feb3ea00640 1 -- 172.21.15.37:0/44861250 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3800cde0 con 0x7feb48075dd0 2024-09-21T05:59:11.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.794+0000 7feb47200640 1 -- 172.21.15.37:0/44861250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb481a6c20 con 0x7feb48075dd0 2024-09-21T05:59:11.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.794+0000 7feb47200640 1 -- 172.21.15.37:0/44861250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb481ad380 con 0x7feb48075dd0 2024-09-21T05:59:11.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.794+0000 7feb3ea00640 1 -- 172.21.15.37:0/44861250 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb380035f0 con 0x7feb48075dd0 2024-09-21T05:59:11.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.794+0000 7feb3ea00640 1 -- 172.21.15.37:0/44861250 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb38010690 con 0x7feb48075dd0 2024-09-21T05:59:11.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.796+0000 7feb47200640 1 -- 172.21.15.37:0/44861250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb280052c0 con 0x7feb48075dd0 2024-09-21T05:59:11.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.801+0000 7feb3ea00640 1 -- 172.21.15.37:0/44861250 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7feb38004000 con 0x7feb48075dd0 2024-09-21T05:59:11.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.804+0000 7feb3ea00640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7feb2c0b6590 0x7feb2c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.804+0000 7feb3ea00640 1 -- 172.21.15.37:0/44861250 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7feb380e7c60 con 0x7feb48075dd0 2024-09-21T05:59:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.805+0000 7feb45400640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7feb2c0b6590 0x7feb2c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.805+0000 7feb3ea00640 1 -- 172.21.15.37:0/44861250 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb380042f0 con 0x7feb48075dd0 2024-09-21T05:59:11.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:11.808+0000 7feb45400640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7feb2c0b6590 0x7feb2c0b8aa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feb48116270 tx=0x7feb34005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:11 smithi144 ceph-mon[34351]: pgmap v572: 129 pgs: 129 active+clean; 110 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.0 MiB/s wr, 366 op/s 2024-09-21T05:59:12.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.158+0000 7feb47200640 1 -- 172.21.15.37:0/44861250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb280055b0 con 0x7feb48075dd0 2024-09-21T05:59:12.162 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:11 smithi037 ceph-mon[30631]: pgmap v572: 129 pgs: 129 active+clean; 110 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.0 MiB/s wr, 366 op/s 2024-09-21T05:59:12.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.161+0000 7feb3ea00640 1 -- 172.21.15.37:0/44861250 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7feb380ae0c0 con 0x7feb48075dd0 2024-09-21T05:59:12.163 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:59:12.163 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:59:12.164 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:59:12.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.165+0000 7feb47200640 1 -- 172.21.15.37:0/44861250 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7feb2c0b6590 msgr2=0x7feb2c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:12.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.165+0000 7feb47200640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7feb2c0b6590 0x7feb2c0b8aa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feb48116270 tx=0x7feb34005f90 comp rx=0 tx=0).stop 2024-09-21T05:59:12.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.165+0000 7feb47200640 1 -- 172.21.15.37:0/44861250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb48075dd0 msgr2=0x7feb481a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:12.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.165+0000 7feb47200640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb48075dd0 0x7feb481a09c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7feb3800ea60 tx=0x7feb3800ef20 comp rx=0 tx=0).stop 2024-09-21T05:59:12.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.165+0000 7feb47200640 1 -- 172.21.15.37:0/44861250 shutdown_connections 2024-09-21T05:59:12.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.165+0000 7feb47200640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7feb2c0b6590 0x7feb2c0b8aa0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:12.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.165+0000 7feb47200640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb48114280 0x7feb481a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:12.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.165+0000 7feb47200640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb48077380 0x7feb481a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:12.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.165+0000 7feb47200640 1 --2- 172.21.15.37:0/44861250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb48075dd0 0x7feb481a09c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:12.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.165+0000 7feb47200640 1 -- 172.21.15.37:0/44861250 >> 172.21.15.37:0/44861250 conn(0x7feb480ff440 msgr2=0x7feb48110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:12.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.166+0000 7feb47200640 1 -- 172.21.15.37:0/44861250 shutdown_connections 2024-09-21T05:59:12.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:12.166+0000 7feb47200640 1 -- 172.21.15.37:0/44861250 wait complete. 2024-09-21T05:59:12.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:11 smithi067 ceph-mon[34443]: pgmap v572: 129 pgs: 129 active+clean; 110 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.0 MiB/s wr, 366 op/s 2024-09-21T05:59:13.024 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0' 2024-09-21T05:59:13.024 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0 2024-09-21T05:59:13.097 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:12 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/44861250' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:13.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:12 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/44861250' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:13.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:12 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/44861250' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:13.544 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:14.096 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:13 smithi037 ceph-mon[30631]: pgmap v573: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 1.9 MiB/s wr, 336 op/s 2024-09-21T05:59:14.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:13 smithi144 ceph-mon[34351]: pgmap v573: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 1.9 MiB/s wr, 336 op/s 2024-09-21T05:59:14.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:13 smithi067 ceph-mon[34443]: pgmap v573: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 1.9 MiB/s wr, 336 op/s 2024-09-21T05:59:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.347+0000 7fd45cc00640 1 -- 172.21.15.37:0/1696151638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4580757b0 msgr2=0x7fd458075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.347+0000 7fd45cc00640 1 --2- 172.21.15.37:0/1696151638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4580757b0 0x7fd458075bc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd448009900 tx=0x7fd44802a410 comp rx=0 tx=0).stop 2024-09-21T05:59:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.347+0000 7fd45cc00640 1 -- 172.21.15.37:0/1696151638 shutdown_connections 2024-09-21T05:59:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.347+0000 7fd45cc00640 1 --2- 172.21.15.37:0/1696151638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4581100e0 0x7fd458112520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.347+0000 7fd45cc00640 1 --2- 172.21.15.37:0/1696151638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd458076100 0x7fd45810fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.347+0000 7fd45cc00640 1 --2- 172.21.15.37:0/1696151638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4580757b0 0x7fd458075bc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.347+0000 7fd45cc00640 1 -- 172.21.15.37:0/1696151638 >> 172.21.15.37:0/1696151638 conn(0x7fd4580ff5d0 msgr2=0x7fd458101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.347+0000 7fd45cc00640 1 -- 172.21.15.37:0/1696151638 shutdown_connections 2024-09-21T05:59:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.347+0000 7fd45cc00640 1 -- 172.21.15.37:0/1696151638 wait complete. 2024-09-21T05:59:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.349+0000 7fd45cc00640 1 Processor -- start 2024-09-21T05:59:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.349+0000 7fd45cc00640 1 -- start start 2024-09-21T05:59:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.350+0000 7fd45cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4580757b0 0x7fd458106b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.350+0000 7fd45cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd458076100 0x7fd4581070c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.350+0000 7fd45cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4581100e0 0x7fd458107600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.350+0000 7fd45cc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd458115c90 con 0x7fd458076100 2024-09-21T05:59:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.350+0000 7fd45cc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd458115b10 con 0x7fd4580757b0 2024-09-21T05:59:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.350+0000 7fd45cc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd458115e10 con 0x7fd4581100e0 2024-09-21T05:59:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.350+0000 7fd456800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4581100e0 0x7fd458107600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.350+0000 7fd456800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4581100e0 0x7fd458107600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:59876/0 (socket says 172.21.15.37:59876) 2024-09-21T05:59:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.350+0000 7fd456800640 1 -- 172.21.15.37:0/3030985745 learned_addr learned my addr 172.21.15.37:0/3030985745 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.350+0000 7fd455400640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd458076100 0x7fd4581070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.351+0000 7fd455e00640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4580757b0 0x7fd458106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.351+0000 7fd456800640 1 -- 172.21.15.37:0/3030985745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4580757b0 msgr2=0x7fd458106b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.351+0000 7fd456800640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4580757b0 0x7fd458106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.351+0000 7fd456800640 1 -- 172.21.15.37:0/3030985745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd458076100 msgr2=0x7fd4581070c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.351+0000 7fd456800640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd458076100 0x7fd4581070c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.351+0000 7fd456800640 1 -- 172.21.15.37:0/3030985745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4581a2310 con 0x7fd4581100e0 2024-09-21T05:59:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.351+0000 7fd455400640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd458076100 0x7fd4581070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.351+0000 7fd456800640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4581100e0 0x7fd458107600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd45000eb10 tx=0x7fd45000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.352+0000 7fd44ea00640 1 -- 172.21.15.37:0/3030985745 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450004b20 con 0x7fd4581100e0 2024-09-21T05:59:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.352+0000 7fd44ea00640 1 -- 172.21.15.37:0/3030985745 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd450004cc0 con 0x7fd4581100e0 2024-09-21T05:59:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.352+0000 7fd44ea00640 1 -- 172.21.15.37:0/3030985745 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450010670 con 0x7fd4581100e0 2024-09-21T05:59:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.352+0000 7fd45cc00640 1 -- 172.21.15.37:0/3030985745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4581a2600 con 0x7fd4581100e0 2024-09-21T05:59:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.352+0000 7fd45cc00640 1 -- 172.21.15.37:0/3030985745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4581a2af0 con 0x7fd4581100e0 2024-09-21T05:59:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.356+0000 7fd4637c8740 1 Processor -- start 2024-09-21T05:59:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.356+0000 7fd44ea00640 1 -- 172.21.15.37:0/3030985745 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fd450010830 con 0x7fd4581100e0 2024-09-21T05:59:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.356+0000 7fd4637c8740 1 -- start start 2024-09-21T05:59:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd4637c8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb65a850 0x5569cba019b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd4637c8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb631990 0x5569cba01ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd4637c8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb639b70 0x5569cba02430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd4637c8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5569cb977a90 con 0x5569cb639b70 2024-09-21T05:59:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd4637c8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5569cb966ec0 con 0x5569cb631990 2024-09-21T05:59:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd4637c8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5569cb96acd0 con 0x5569cb65a850 2024-09-21T05:59:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd455e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb631990 0x5569cba01ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd455e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb631990 0x5569cba01ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:44142/0 (socket says 172.21.15.37:44142) 2024-09-21T05:59:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd455e00640 1 -- 172.21.15.37:0/2777949417 learned_addr learned my addr 172.21.15.37:0/2777949417 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd455400640 1 --2- 172.21.15.37:0/2777949417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb65a850 0x5569cba019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd455e00640 1 -- 172.21.15.37:0/2777949417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb65a850 msgr2=0x5569cba019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd455e00640 1 --2- 172.21.15.37:0/2777949417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb65a850 0x5569cba019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd455e00640 1 -- 172.21.15.37:0/2777949417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb639b70 msgr2=0x5569cba02430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd455e00640 1 --2- 172.21.15.37:0/2777949417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb639b70 0x5569cba02430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.357+0000 7fd455e00640 1 -- 172.21.15.37:0/2777949417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569cb90c9d0 con 0x5569cb631990 2024-09-21T05:59:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.358+0000 7fd455400640 1 --2- 172.21.15.37:0/2777949417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb65a850 0x5569cba019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.358+0000 7fd455e00640 1 --2- 172.21.15.37:0/2777949417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb631990 0x5569cba01ef0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd448006010 tx=0x7fd448032ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b84344d6afaeb559 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.358+0000 7fd443000640 1 -- 172.21.15.37:0/2777949417 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44803f070 con 0x5569cb631990 2024-09-21T05:59:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.358+0000 7fd443000640 1 -- 172.21.15.37:0/2777949417 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd448004030 con 0x5569cb631990 2024-09-21T05:59:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.358+0000 7fd44ea00640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd43c0b6590 0x7fd43c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.358+0000 7fd443000640 1 -- 172.21.15.37:0/2777949417 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448035070 con 0x5569cb631990 2024-09-21T05:59:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.359+0000 7fd44ea00640 1 -- 172.21.15.37:0/3030985745 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fd4500e7d20 con 0x7fd4581100e0 2024-09-21T05:59:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.359+0000 7fd455400640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd43c0b6590 0x7fd43c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.360+0000 7fd4637c8740 1 -- 172.21.15.37:0/2777949417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb631990 msgr2=0x5569cba01ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.360+0000 7fd4637c8740 1 --2- 172.21.15.37:0/2777949417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb631990 0x5569cba01ef0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd448006010 tx=0x7fd448032ba0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.360+0000 7fd455400640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd43c0b6590 0x7fd43c0b8aa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd458112590 tx=0x7fd444009600 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.360+0000 7fd4637c8740 1 -- 172.21.15.37:0/2777949417 shutdown_connections 2024-09-21T05:59:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.360+0000 7fd4637c8740 1 --2- 172.21.15.37:0/2777949417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb639b70 0x5569cba02430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.360+0000 7fd4637c8740 1 --2- 172.21.15.37:0/2777949417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb631990 0x5569cba01ef0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.360+0000 7fd4637c8740 1 --2- 172.21.15.37:0/2777949417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb65a850 0x5569cba019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.360+0000 7fd4637c8740 1 -- 172.21.15.37:0/2777949417 >> 172.21.15.37:0/2777949417 conn(0x5569cb64ec40 msgr2=0x5569cb9ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.360+0000 7fd4637c8740 1 -- 172.21.15.37:0/2777949417 shutdown_connections 2024-09-21T05:59:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.360+0000 7fd4637c8740 1 -- 172.21.15.37:0/2777949417 wait complete. 2024-09-21T05:59:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.361+0000 7fd4637c8740 1 -- start start 2024-09-21T05:59:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.361+0000 7fd4637c8740 1 Processor -- start 2024-09-21T05:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.362+0000 7fd4637c8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cba0d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.362+0000 7fd4637c8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb639b70 0x5569cba0d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.362+0000 7fd4637c8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb65a850 0x5569cba19420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.362+0000 7fd4637c8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5569cb7c87b0 con 0x5569cb65a850 2024-09-21T05:59:14.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.362+0000 7fd4637c8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5569cb90b650 con 0x5569cb639b70 2024-09-21T05:59:14.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.362+0000 7fd4637c8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5569cba10130 con 0x5569cb631990 2024-09-21T05:59:14.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.362+0000 7fd4637c8740 10 client.0 _ll_register_callbacks cb 0x5569cb6720a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.363+0000 7fd455e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cba0d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.363+0000 7fd455e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cba0d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:59900/0 (socket says 172.21.15.37:59900) 2024-09-21T05:59:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.363+0000 7fd455e00640 1 -- 172.21.15.37:0/4225247885 learned_addr learned my addr 172.21.15.37:0/4225247885 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.363+0000 7fd456800640 1 --2- 172.21.15.37:0/4225247885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb65a850 0x5569cba19420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.363+0000 7fd455400640 1 --2- 172.21.15.37:0/4225247885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb639b70 0x5569cba0d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.363+0000 7fd455e00640 1 -- 172.21.15.37:0/4225247885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb639b70 msgr2=0x5569cba0d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.363+0000 7fd455e00640 1 --2- 172.21.15.37:0/4225247885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb639b70 0x5569cba0d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.363+0000 7fd455e00640 1 -- 172.21.15.37:0/4225247885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb65a850 msgr2=0x5569cba19420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.363+0000 7fd455e00640 1 --2- 172.21.15.37:0/4225247885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb65a850 0x5569cba19420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.363+0000 7fd455e00640 1 -- 172.21.15.37:0/4225247885 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569cb6d4ba0 con 0x5569cb631990 2024-09-21T05:59:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.364+0000 7fd455e00640 1 --2- 172.21.15.37:0/4225247885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cba0d210 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd4480055c0 tx=0x7fd4480055f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6aade3c3d1ffb8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.364+0000 7fd437400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T05:59:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.364+0000 7fd437400640 1 -- 172.21.15.37:0/4225247885 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44804b020 con 0x5569cb631990 2024-09-21T05:59:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.364+0000 7fd437400640 1 -- 172.21.15.37:0/4225247885 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fd4480314a0 con 0x5569cb631990 2024-09-21T05:59:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.365+0000 7fd4637c8740 1 -- 172.21.15.37:0/4225247885 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd448004030 con 0x5569cb631990 2024-09-21T05:59:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.365+0000 7fd437400640 1 -- 172.21.15.37:0/4225247885 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd448056050 con 0x5569cb631990 2024-09-21T05:59:14.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.367+0000 7fd4637c8740 10 client.25576 fetch_fsmap learned FSMap version 21 2024-09-21T05:59:14.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.367+0000 7fd4637c8740 1 -- 172.21.15.37:0/4225247885 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5569cba1bf60 con 0x5569cb631990 2024-09-21T05:59:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.368+0000 7fd437400640 1 -- 172.21.15.37:0/4225247885 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd448004030 con 0x5569cb631990 2024-09-21T05:59:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.368+0000 7fd437400640 1 -- 172.21.15.37:0/4225247885 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd4480046c0 con 0x5569cb631990 2024-09-21T05:59:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.368+0000 7fd4637c8740 10 client.25576 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:59:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.368+0000 7fd4637c8740 10 client.25576 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:59:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.368+0000 7fd4637c8740 20 client.25576 populate_metadata read hostname 'smithi037' 2024-09-21T05:59:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.368+0000 7fd4637c8740 1 --2- 172.21.15.37:0/4225247885 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5569cb6191d0 0x5569cba1f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.368+0000 7fd4637c8740 4 client.25576 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.368+0000 7fd4637c8740 1 -- 172.21.15.37:0/4225247885 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569cb9799e0 con 0x5569cb6191d0 2024-09-21T05:59:14.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.369+0000 7fd455400640 1 --2- 172.21.15.37:0/4225247885 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5569cb6191d0 0x5569cba1f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.371+0000 7fd455400640 1 --2- 172.21.15.37:0/4225247885 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5569cb6191d0 0x5569cba1f2c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cfdd2dc844791b1 server_cookie=6279a193b4d8dc64 in_seq=0 out_seq=0 2024-09-21T05:59:14.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.371+0000 7fd437400640 10 client.25576 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:14.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.372+0000 7fd437400640 1 -- 172.21.15.37:0/4225247885 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569cb9799e0 con 0x5569cb6191d0 2024-09-21T05:59:14.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.372+0000 7fd437400640 10 client.25576 handle_command_reply: tid=0 2024-09-21T05:59:14.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.372+0000 7fd4637c8740 1 client.25576 shutdown 2024-09-21T05:59:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.372+0000 7fd4637c8740 1 -- 172.21.15.37:0/4225247885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 msgr2=0x5569cba0d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.372+0000 7fd4637c8740 1 --2- 172.21.15.37:0/4225247885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cba0d210 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd4480055c0 tx=0x7fd4480055f0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.372+0000 7fd4637c8740 1 -- 172.21.15.37:0/4225247885 shutdown_connections 2024-09-21T05:59:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.372+0000 7fd4637c8740 1 --2- 172.21.15.37:0/4225247885 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5569cb6191d0 0x5569cba1f2c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.372+0000 7fd4637c8740 1 --2- 172.21.15.37:0/4225247885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb65a850 0x5569cba19420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.372+0000 7fd4637c8740 1 --2- 172.21.15.37:0/4225247885 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb639b70 0x5569cba0d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.372+0000 7fd4637c8740 1 --2- 172.21.15.37:0/4225247885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cba0d210 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.372+0000 7fd4637c8740 1 -- 172.21.15.37:0/4225247885 >> 172.21.15.37:0/4225247885 conn(0x5569cb64ec40 msgr2=0x5569cba04b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.372+0000 7fd437400640 0 client.25576 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.373+0000 7fd4637c8740 1 -- 172.21.15.37:0/4225247885 shutdown_connections 2024-09-21T05:59:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.373+0000 7fd4637c8740 1 -- 172.21.15.37:0/4225247885 wait complete. 2024-09-21T05:59:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.373+0000 7fd4637c8740 20 client.25576 trim_cache size 0 max 16384 2024-09-21T05:59:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.401+0000 7fd4637c8740 1 Processor -- start 2024-09-21T05:59:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.402+0000 7fd4637c8740 1 -- start start 2024-09-21T05:59:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.402+0000 7fd4637c8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cb9fe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.402+0000 7fd4637c8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb639b70 0x5569cb9ff150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.402+0000 7fd4637c8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb65a850 0x5569cba033a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.402+0000 7fd4637c8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd4581bd970 con 0x5569cb639b70 2024-09-21T05:59:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.402+0000 7fd4637c8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd4581c01f0 con 0x5569cb65a850 2024-09-21T05:59:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.402+0000 7fd4637c8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd4581bdfe0 con 0x5569cb631990 2024-09-21T05:59:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.403+0000 7fd455e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cb9fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.403+0000 7fd455e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cb9fe570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:59902/0 (socket says 172.21.15.37:59902) 2024-09-21T05:59:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.403+0000 7fd455e00640 1 -- 172.21.15.37:0/879657727 learned_addr learned my addr 172.21.15.37:0/879657727 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.403+0000 7fd456800640 1 --2- 172.21.15.37:0/879657727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb65a850 0x5569cba033a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.403+0000 7fd456800640 1 -- 172.21.15.37:0/879657727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 msgr2=0x5569cb9fe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.403+0000 7fd456800640 1 --2- 172.21.15.37:0/879657727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cb9fe570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.403+0000 7fd456800640 1 -- 172.21.15.37:0/879657727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb639b70 msgr2=0x5569cb9ff150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.403+0000 7fd456800640 1 --2- 172.21.15.37:0/879657727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb639b70 0x5569cb9ff150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.403+0000 7fd456800640 1 -- 172.21.15.37:0/879657727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569cba03ed0 con 0x5569cb65a850 2024-09-21T05:59:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.404+0000 7fd456800640 1 --2- 172.21.15.37:0/879657727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb65a850 0x5569cba033a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd4500049d0 tx=0x7fd45000cee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac946dabd70975ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.404+0000 7fd442600640 1 -- 172.21.15.37:0/879657727 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4500b2030 con 0x5569cb65a850 2024-09-21T05:59:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.404+0000 7fd442600640 1 -- 172.21.15.37:0/879657727 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4500a9040 con 0x5569cb65a850 2024-09-21T05:59:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.404+0000 7fd442600640 1 -- 172.21.15.37:0/879657727 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4500b2560 con 0x5569cb65a850 2024-09-21T05:59:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.405+0000 7fd4637c8740 1 -- 172.21.15.37:0/879657727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb65a850 msgr2=0x5569cba033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.405+0000 7fd4637c8740 1 --2- 172.21.15.37:0/879657727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb65a850 0x5569cba033a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd4500049d0 tx=0x7fd45000cee0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.405+0000 7fd4637c8740 1 -- 172.21.15.37:0/879657727 shutdown_connections 2024-09-21T05:59:14.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.405+0000 7fd4637c8740 1 --2- 172.21.15.37:0/879657727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb65a850 0x5569cba033a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.405+0000 7fd4637c8740 1 --2- 172.21.15.37:0/879657727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb639b70 0x5569cb9ff150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.405+0000 7fd4637c8740 1 --2- 172.21.15.37:0/879657727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cb9fe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.405+0000 7fd4637c8740 1 -- 172.21.15.37:0/879657727 >> 172.21.15.37:0/879657727 conn(0x5569cb64ec40 msgr2=0x5569cba0ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:14.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.406+0000 7fd4637c8740 1 -- 172.21.15.37:0/879657727 shutdown_connections 2024-09-21T05:59:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.406+0000 7fd4637c8740 1 -- 172.21.15.37:0/879657727 wait complete. 2024-09-21T05:59:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.406+0000 7fd4637c8740 1 -- start start 2024-09-21T05:59:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.407+0000 7fd4637c8740 1 Processor -- start 2024-09-21T05:59:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.407+0000 7fd4637c8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cba1ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.407+0000 7fd4637c8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb639b70 0x5569cba1f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.407+0000 7fd4637c8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb65a850 0x5569cba82a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.407+0000 7fd4637c8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd4581be6b0 con 0x5569cb65a850 2024-09-21T05:59:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.407+0000 7fd4637c8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd4581bfb20 con 0x5569cb639b70 2024-09-21T05:59:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.407+0000 7fd4637c8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd4581bed80 con 0x5569cb631990 2024-09-21T05:59:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.407+0000 7fd4637c8740 10 client.0 _ll_register_callbacks cb 0x7fd444005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.408+0000 7fd455400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb639b70 0x5569cba1f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.408+0000 7fd455400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb639b70 0x5569cba1f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:44170/0 (socket says 172.21.15.37:44170) 2024-09-21T05:59:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.408+0000 7fd455400640 1 -- 172.21.15.37:0/925002138 learned_addr learned my addr 172.21.15.37:0/925002138 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.408+0000 7fd455e00640 1 --2- 172.21.15.37:0/925002138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cba1ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.408+0000 7fd455400640 1 -- 172.21.15.37:0/925002138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 msgr2=0x5569cba1ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.408+0000 7fd455400640 1 --2- 172.21.15.37:0/925002138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cba1ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.408+0000 7fd455400640 1 -- 172.21.15.37:0/925002138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb65a850 msgr2=0x5569cba82a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.408+0000 7fd455400640 1 --2- 172.21.15.37:0/925002138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb65a850 0x5569cba82a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.408+0000 7fd455400640 1 -- 172.21.15.37:0/925002138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569cba830e0 con 0x5569cb639b70 2024-09-21T05:59:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.410+0000 7fd455400640 1 --2- 172.21.15.37:0/925002138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb639b70 0x5569cba1f1f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd444012fd0 tx=0x7fd444005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0a3798d967843f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.410+0000 7fd437400640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:59:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.410+0000 7fd437400640 1 -- 172.21.15.37:0/925002138 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd444005220 con 0x5569cb639b70 2024-09-21T05:59:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.411+0000 7fd437400640 1 -- 172.21.15.37:0/925002138 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fd4440053c0 con 0x5569cb639b70 2024-09-21T05:59:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.411+0000 7fd4637c8740 1 -- 172.21.15.37:0/925002138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4500a9040 con 0x5569cb639b70 2024-09-21T05:59:14.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.412+0000 7fd437400640 1 -- 172.21.15.37:0/925002138 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd4440055c0 con 0x5569cb639b70 2024-09-21T05:59:14.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.412+0000 7fd4637c8740 10 client.25568 fetch_fsmap learned FSMap version 21 2024-09-21T05:59:14.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.412+0000 7fd4637c8740 1 -- 172.21.15.37:0/925002138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5569cba8a460 con 0x5569cb639b70 2024-09-21T05:59:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.412+0000 7fd437400640 1 -- 172.21.15.37:0/925002138 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4500a9040 con 0x5569cb639b70 2024-09-21T05:59:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.412+0000 7fd437400640 1 -- 172.21.15.37:0/925002138 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd444020b50 con 0x5569cb639b70 2024-09-21T05:59:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.413+0000 7fd4637c8740 10 client.25568 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:59:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.413+0000 7fd4637c8740 10 client.25568 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:59:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.413+0000 7fd4637c8740 20 client.25568 populate_metadata read hostname 'smithi037' 2024-09-21T05:59:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.413+0000 7fd4637c8740 1 --2- 172.21.15.37:0/925002138 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5569cb5ee580 0x5569cba8cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.413+0000 7fd4637c8740 4 client.25568 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}] 2024-09-21T05:59:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.413+0000 7fd4637c8740 1 -- 172.21.15.37:0/925002138 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}) -- 0x5569cb975490 con 0x5569cb5ee580 2024-09-21T05:59:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.413+0000 7fd455e00640 1 --2- 172.21.15.37:0/925002138 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5569cb5ee580 0x5569cba8cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.414+0000 7fd455e00640 1 --2- 172.21.15.37:0/925002138 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5569cb5ee580 0x5569cba8cc70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=360cf1c5bf76effa server_cookie=3e4d48348e4ac187 in_seq=0 out_seq=0 2024-09-21T05:59:14.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:14.414+0000 7fd437400640 10 client.25568 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:15.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.359+0000 7fd437400640 1 -- 172.21.15.37:0/925002138 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5569cb975490 con 0x5569cb5ee580 2024-09-21T05:59:15.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.359+0000 7fd437400640 10 client.25568 handle_command_reply: tid=0 2024-09-21T05:59:15.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.359+0000 7fd4637c8740 1 client.25568 shutdown 2024-09-21T05:59:15.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.359+0000 7fd4637c8740 1 -- 172.21.15.37:0/925002138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb639b70 msgr2=0x5569cba1f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:15.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.359+0000 7fd4637c8740 1 --2- 172.21.15.37:0/925002138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb639b70 0x5569cba1f1f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd444012fd0 tx=0x7fd444005f90 comp rx=0 tx=0).stop 2024-09-21T05:59:15.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.359+0000 7fd4637c8740 1 -- 172.21.15.37:0/925002138 shutdown_connections 2024-09-21T05:59:15.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.359+0000 7fd4637c8740 1 --2- 172.21.15.37:0/925002138 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5569cb5ee580 0x5569cba8cc70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:15.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.359+0000 7fd4637c8740 1 --2- 172.21.15.37:0/925002138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569cb65a850 0x5569cba82a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:15.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.359+0000 7fd4637c8740 1 --2- 172.21.15.37:0/925002138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569cb639b70 0x5569cba1f1f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:15.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.359+0000 7fd437400640 0 client.25568 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:15.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.359+0000 7fd4637c8740 1 --2- 172.21.15.37:0/925002138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569cb631990 0x5569cba1ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:15.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.359+0000 7fd4637c8740 1 -- 172.21.15.37:0/925002138 >> 172.21.15.37:0/925002138 conn(0x5569cb64ec40 msgr2=0x5569cba03170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:15.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.360+0000 7fd4637c8740 1 -- 172.21.15.37:0/925002138 shutdown_connections 2024-09-21T05:59:15.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.360+0000 7fd4637c8740 1 -- 172.21.15.37:0/925002138 wait complete. 2024-09-21T05:59:15.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.360+0000 7fd4637c8740 20 client.25568 trim_cache size 0 max 16384 2024-09-21T05:59:15.363 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:59:15.363 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 22, 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: "15ab2d6b": { 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 22, 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 139.2, 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:59:15.364 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:59:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:59:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:59:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:59:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:59:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:15.365 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:15.365 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:59:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.361+0000 7fd45cc00640 1 -- 172.21.15.37:0/3030985745 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd43c0b6590 msgr2=0x7fd43c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.361+0000 7fd45cc00640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd43c0b6590 0x7fd43c0b8aa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd458112590 tx=0x7fd444009600 comp rx=0 tx=0).stop 2024-09-21T05:59:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.361+0000 7fd45cc00640 1 -- 172.21.15.37:0/3030985745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4581100e0 msgr2=0x7fd458107600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.361+0000 7fd45cc00640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4581100e0 0x7fd458107600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd45000eb10 tx=0x7fd45000c2d0 comp rx=0 tx=0).stop 2024-09-21T05:59:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.361+0000 7fd45cc00640 1 -- 172.21.15.37:0/3030985745 shutdown_connections 2024-09-21T05:59:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.361+0000 7fd45cc00640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4581100e0 0x7fd458107600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.361+0000 7fd45cc00640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd458076100 0x7fd4581070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.361+0000 7fd45cc00640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd43c0b6590 0x7fd43c0b8aa0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.361+0000 7fd45cc00640 1 --2- 172.21.15.37:0/3030985745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4580757b0 0x7fd458106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.361+0000 7fd45cc00640 1 -- 172.21.15.37:0/3030985745 >> 172.21.15.37:0/3030985745 conn(0x7fd4580ff5d0 msgr2=0x7fd458109c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:15.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.361+0000 7fd45cc00640 1 -- 172.21.15.37:0/3030985745 shutdown_connections 2024-09-21T05:59:15.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:15.361+0000 7fd45cc00640 1 -- 172.21.15.37:0/3030985745 wait complete. 2024-09-21T05:59:16.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:15 smithi144 ceph-mon[34351]: pgmap v574: 129 pgs: 129 active+clean; 113 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.8 MiB/s wr, 361 op/s 2024-09-21T05:59:16.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:15 smithi037 ceph-mon[30631]: pgmap v574: 129 pgs: 129 active+clean; 113 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.8 MiB/s wr, 361 op/s 2024-09-21T05:59:16.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:15 smithi067 ceph-mon[34443]: pgmap v574: 129 pgs: 129 active+clean; 113 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.8 MiB/s wr, 361 op/s 2024-09-21T05:59:17.377 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '15ab2d6b', quiesce took 7.0 seconds. Will release after: 12.25 2024-09-21T05:59:18.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:17 smithi144 ceph-mon[34351]: pgmap v575: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.9 MiB/s wr, 345 op/s 2024-09-21T05:59:18.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:17 smithi037 ceph-mon[30631]: pgmap v575: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.9 MiB/s wr, 345 op/s 2024-09-21T05:59:18.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:17 smithi067 ceph-mon[34443]: pgmap v575: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.9 MiB/s wr, 345 op/s 2024-09-21T05:59:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:19 smithi144 ceph-mon[34351]: pgmap v576: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 288 op/s 2024-09-21T05:59:20.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:19 smithi037 ceph-mon[30631]: pgmap v576: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 288 op/s 2024-09-21T05:59:20.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:19 smithi067 ceph-mon[34443]: pgmap v576: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 288 op/s 2024-09-21T05:59:22.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:21 smithi144 ceph-mon[34351]: pgmap v577: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 221 op/s 2024-09-21T05:59:22.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:21 smithi037 ceph-mon[30631]: pgmap v577: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 221 op/s 2024-09-21T05:59:22.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:21 smithi067 ceph-mon[34443]: pgmap v577: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 221 op/s 2024-09-21T05:59:24.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:23 smithi144 ceph-mon[34351]: pgmap v578: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 968 KiB/s wr, 177 op/s 2024-09-21T05:59:24.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:23 smithi037 ceph-mon[30631]: pgmap v578: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 968 KiB/s wr, 177 op/s 2024-09-21T05:59:24.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:23 smithi067 ceph-mon[34443]: pgmap v578: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 968 KiB/s wr, 177 op/s 2024-09-21T05:59:26.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:25 smithi144 ceph-mon[34351]: pgmap v579: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 699 KiB/s wr, 139 op/s 2024-09-21T05:59:26.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:25 smithi037 ceph-mon[30631]: pgmap v579: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 699 KiB/s wr, 139 op/s 2024-09-21T05:59:26.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:25 smithi067 ceph-mon[34443]: pgmap v579: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 699 KiB/s wr, 139 op/s 2024-09-21T05:59:28.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:27 smithi144 ceph-mon[34351]: pgmap v580: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 446 KiB/s wr, 74 op/s 2024-09-21T05:59:28.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:27 smithi037 ceph-mon[30631]: pgmap v580: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 446 KiB/s wr, 74 op/s 2024-09-21T05:59:28.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:27 smithi067 ceph-mon[34443]: pgmap v580: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 446 KiB/s wr, 74 op/s 2024-09-21T05:59:29.628 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:59:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:30.163 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:29 smithi037 ceph-mon[30631]: pgmap v581: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 74 KiB/s wr, 21 op/s 2024-09-21T05:59:30.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:29 smithi067 ceph-mon[34443]: pgmap v581: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 74 KiB/s wr, 21 op/s 2024-09-21T05:59:30.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:29 smithi144 ceph-mon[34351]: pgmap v581: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 74 KiB/s wr, 21 op/s 2024-09-21T05:59:30.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.704+0000 7f3975a00640 1 -- 172.21.15.37:0/2833066663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3970109c20 msgr2=0x7f3970110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:30.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.704+0000 7f3975a00640 1 --2- 172.21.15.37:0/2833066663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3970109c20 0x7f3970110450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3968009ca0 tx=0x7f396802a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.704+0000 7f3975a00640 1 -- 172.21.15.37:0/2833066663 shutdown_connections 2024-09-21T05:59:30.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.704+0000 7f3975a00640 1 --2- 172.21.15.37:0/2833066663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3970109c20 0x7f3970110450 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.704+0000 7f3975a00640 1 --2- 172.21.15.37:0/2833066663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39701092d0 0x7f39701096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.704+0000 7f3975a00640 1 --2- 172.21.15.37:0/2833066663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3970103990 0x7f3970103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.704+0000 7f3975a00640 1 -- 172.21.15.37:0/2833066663 >> 172.21.15.37:0/2833066663 conn(0x7f39700ff440 msgr2=0x7f3970101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:30.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.704+0000 7f3975a00640 1 -- 172.21.15.37:0/2833066663 shutdown_connections 2024-09-21T05:59:30.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.705+0000 7f3975a00640 1 -- 172.21.15.37:0/2833066663 wait complete. 2024-09-21T05:59:30.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.706+0000 7f3975a00640 1 Processor -- start 2024-09-21T05:59:30.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.706+0000 7f3975a00640 1 -- start start 2024-09-21T05:59:30.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.707+0000 7f3975a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3970103990 0x7f3970075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.707+0000 7f3975a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39701092d0 0x7f3970075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.707+0000 7f3975a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3970109c20 0x7f3970076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.707+0000 7f3975a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39701138e0 con 0x7f3970109c20 2024-09-21T05:59:30.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.707+0000 7f3975a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3970113760 con 0x7f3970103990 2024-09-21T05:59:30.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.707+0000 7f3975a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3970113a60 con 0x7f39701092d0 2024-09-21T05:59:30.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.707+0000 7f396fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3970103990 0x7f3970075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.707+0000 7f3975000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3970109c20 0x7f3970076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.707+0000 7f3967e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39701092d0 0x7f3970075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.707+0000 7f396fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3970103990 0x7f3970075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:46088/0 (socket says 172.21.15.37:46088) 2024-09-21T05:59:30.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.707+0000 7f3967e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39701092d0 0x7f3970075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:55784/0 (socket says 172.21.15.37:55784) 2024-09-21T05:59:30.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.707+0000 7f3975000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3970109c20 0x7f3970076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45284/0 (socket says 172.21.15.37:45284) 2024-09-21T05:59:30.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.707+0000 7f396fe00640 1 -- 172.21.15.37:0/252647401 learned_addr learned my addr 172.21.15.37:0/252647401 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:30.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.708+0000 7f3975000640 1 -- 172.21.15.37:0/252647401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39701092d0 msgr2=0x7f3970075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:30.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.708+0000 7f3975000640 1 --2- 172.21.15.37:0/252647401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39701092d0 0x7f3970075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.708+0000 7f3975000640 1 -- 172.21.15.37:0/252647401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3970103990 msgr2=0x7f3970075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:30.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.708+0000 7f3975000640 1 --2- 172.21.15.37:0/252647401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3970103990 0x7f3970075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.708+0000 7f3975000640 1 -- 172.21.15.37:0/252647401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39701a8650 con 0x7f3970109c20 2024-09-21T05:59:30.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.708+0000 7f3975000640 1 --2- 172.21.15.37:0/252647401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3970109c20 0x7f3970076190 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f396802ade0 tx=0x7f39680316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:30.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.708+0000 7f396d600640 1 -- 172.21.15.37:0/252647401 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968003b70 con 0x7f3970109c20 2024-09-21T05:59:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.708+0000 7f396d600640 1 -- 172.21.15.37:0/252647401 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3968003d10 con 0x7f3970109c20 2024-09-21T05:59:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.708+0000 7f3975a00640 1 -- 172.21.15.37:0/252647401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39701a88e0 con 0x7f3970109c20 2024-09-21T05:59:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.708+0000 7f396d600640 1 -- 172.21.15.37:0/252647401 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396802f9e0 con 0x7f3970109c20 2024-09-21T05:59:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.709+0000 7f3975a00640 1 -- 172.21.15.37:0/252647401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39701a8e20 con 0x7f3970109c20 2024-09-21T05:59:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.710+0000 7f3975a00640 1 -- 172.21.15.37:0/252647401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3970103da0 con 0x7f3970109c20 2024-09-21T05:59:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.712+0000 7f396d600640 1 -- 172.21.15.37:0/252647401 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f3968004b40 con 0x7f3970109c20 2024-09-21T05:59:30.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.714+0000 7f396d600640 1 --2- 172.21.15.37:0/252647401 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f39540b6510 0x7f39540b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:30.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.714+0000 7f396d600640 1 -- 172.21.15.37:0/252647401 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f3968108990 con 0x7f3970109c20 2024-09-21T05:59:30.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.714+0000 7f396fe00640 1 --2- 172.21.15.37:0/252647401 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f39540b6510 0x7f39540b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:30.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.715+0000 7f396fe00640 1 --2- 172.21.15.37:0/252647401 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f39540b6510 0x7f39540b8a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3970077160 tx=0x7f3960005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.716+0000 7f396d600640 1 -- 172.21.15.37:0/252647401 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f39680cedf0 con 0x7f3970109c20 2024-09-21T05:59:30.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.952+0000 7f3975a00640 1 -- 172.21.15.37:0/252647401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3970076a10 con 0x7f3970109c20 2024-09-21T05:59:30.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.953+0000 7f396d600640 1 -- 172.21.15.37:0/252647401 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f3970076a10 con 0x7f3970109c20 2024-09-21T05:59:30.956 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:59:30.956 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:59:30.956 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:59:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.956+0000 7f3975a00640 1 -- 172.21.15.37:0/252647401 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f39540b6510 msgr2=0x7f39540b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.956+0000 7f3975a00640 1 --2- 172.21.15.37:0/252647401 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f39540b6510 0x7f39540b8a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3970077160 tx=0x7f3960005f90 comp rx=0 tx=0).stop 2024-09-21T05:59:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.956+0000 7f3975a00640 1 -- 172.21.15.37:0/252647401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3970109c20 msgr2=0x7f3970076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.956+0000 7f3975a00640 1 --2- 172.21.15.37:0/252647401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3970109c20 0x7f3970076190 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f396802ade0 tx=0x7f39680316f0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.956+0000 7f3975a00640 1 -- 172.21.15.37:0/252647401 shutdown_connections 2024-09-21T05:59:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.956+0000 7f3975a00640 1 --2- 172.21.15.37:0/252647401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3970109c20 0x7f3970076190 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.956+0000 7f3975a00640 1 --2- 172.21.15.37:0/252647401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39701092d0 0x7f3970075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.956+0000 7f3975a00640 1 --2- 172.21.15.37:0/252647401 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f39540b6510 0x7f39540b8a20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.956+0000 7f3975a00640 1 --2- 172.21.15.37:0/252647401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3970103990 0x7f3970075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:30.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.956+0000 7f3975a00640 1 -- 172.21.15.37:0/252647401 >> 172.21.15.37:0/252647401 conn(0x7f39700ff440 msgr2=0x7f3970108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:30.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.956+0000 7f3975a00640 1 -- 172.21.15.37:0/252647401 shutdown_connections 2024-09-21T05:59:30.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:30.956+0000 7f3975a00640 1 -- 172.21.15.37:0/252647401 wait complete. 2024-09-21T05:59:31.815 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db --set-id 15ab2d6b --release --await' 2024-09-21T05:59:31.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db --set-id 15ab2d6b --release --await 2024-09-21T05:59:32.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:31 smithi037 ceph-mon[30631]: pgmap v582: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-21T05:59:32.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:31 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/252647401' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:32.199 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:32.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:31 smithi067 ceph-mon[34443]: pgmap v582: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-21T05:59:32.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:31 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/252647401' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:31 smithi144 ceph-mon[34351]: pgmap v582: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-21T05:59:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:31 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/252647401' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.830+0000 7f113e800640 1 -- 172.21.15.37:0/1738636711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11380757b0 msgr2=0x7f1138075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.830+0000 7f113e800640 1 --2- 172.21.15.37:0/1738636711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11380757b0 0x7f1138075bc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f112c009900 tx=0x7f112c02a3f0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.830+0000 7f113e800640 1 -- 172.21.15.37:0/1738636711 shutdown_connections 2024-09-21T05:59:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.830+0000 7f113e800640 1 --2- 172.21.15.37:0/1738636711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f113810fef0 0x7f1138112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.830+0000 7f113e800640 1 --2- 172.21.15.37:0/1738636711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1138076100 0x7f113810f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.830+0000 7f113e800640 1 --2- 172.21.15.37:0/1738636711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11380757b0 0x7f1138075bc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.830+0000 7f113e800640 1 -- 172.21.15.37:0/1738636711 >> 172.21.15.37:0/1738636711 conn(0x7f11380ff440 msgr2=0x7f1138101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:32.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.830+0000 7f113e800640 1 -- 172.21.15.37:0/1738636711 shutdown_connections 2024-09-21T05:59:32.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.830+0000 7f113e800640 1 -- 172.21.15.37:0/1738636711 wait complete. 2024-09-21T05:59:32.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.831+0000 7f113e800640 1 Processor -- start 2024-09-21T05:59:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.831+0000 7f113e800640 1 -- start start 2024-09-21T05:59:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.831+0000 7f113e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11380757b0 0x7f113819c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1138076100 0x7f113819c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f113810fef0 0x7f11381a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113e800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1138115af0 con 0x7f1138076100 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113e800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1138115970 con 0x7f11380757b0 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113e800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1138115c70 con 0x7f113810fef0 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1138076100 0x7f113819c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1138076100 0x7f113819c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38850/0 (socket says 172.21.15.37:38850) 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113ca00640 1 -- 172.21.15.37:0/399961578 learned_addr learned my addr 172.21.15.37:0/399961578 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113d400640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11380757b0 0x7f113819c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113de00640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f113810fef0 0x7f11381a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113d400640 1 -- 172.21.15.37:0/399961578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f113810fef0 msgr2=0x7f11381a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113d400640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f113810fef0 0x7f11381a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113d400640 1 -- 172.21.15.37:0/399961578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1138076100 msgr2=0x7f113819c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113d400640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1138076100 0x7f113819c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.832+0000 7f113d400640 1 -- 172.21.15.37:0/399961578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11381a23b0 con 0x7f11380757b0 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.833+0000 7f113ca00640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1138076100 0x7f113819c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.833+0000 7f113d400640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11380757b0 0x7f113819c440 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f112c02a9e0 tx=0x7f112c003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:32.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.833+0000 7f1136000640 1 -- 172.21.15.37:0/399961578 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c03f070 con 0x7f11380757b0 2024-09-21T05:59:32.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.833+0000 7f113e800640 1 -- 172.21.15.37:0/399961578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11381a2640 con 0x7f11380757b0 2024-09-21T05:59:32.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.833+0000 7f1136000640 1 -- 172.21.15.37:0/399961578 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f112c031b50 con 0x7f11380757b0 2024-09-21T05:59:32.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.833+0000 7f1136000640 1 -- 172.21.15.37:0/399961578 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c035030 con 0x7f11380757b0 2024-09-21T05:59:32.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.833+0000 7f113e800640 1 -- 172.21.15.37:0/399961578 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11381a8e00 con 0x7f11380757b0 2024-09-21T05:59:32.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.837+0000 7f1146a77740 1 Processor -- start 2024-09-21T05:59:32.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.838+0000 7f1146a77740 1 -- start start 2024-09-21T05:59:32.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.838+0000 7f1146a77740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 0x5593399ae340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.838+0000 7f1146a77740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.838+0000 7f1146a77740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395e6840 0x5593399aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.838+0000 7f1146a77740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559339925290 con 0x5593395de660 2024-09-21T05:59:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.838+0000 7f1146a77740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5593399146c0 con 0x5593395e6840 2024-09-21T05:59:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.838+0000 7f1146a77740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5593399184d0 con 0x559339607520 2024-09-21T05:59:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.839+0000 7f113ca00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395e6840 0x5593399aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.839+0000 7f113de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 0x5593399ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.839+0000 7f113ca00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395e6840 0x5593399aedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:48920/0 (socket says 172.21.15.37:48920) 2024-09-21T05:59:32.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.839+0000 7f113ca00640 1 -- 172.21.15.37:0/287303999 learned_addr learned my addr 172.21.15.37:0/287303999 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:32.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.839+0000 7f1136000640 1 -- 172.21.15.37:0/399961578 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f112c042070 con 0x7f11380757b0 2024-09-21T05:59:32.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.839+0000 7f113ca00640 1 -- 172.21.15.37:0/287303999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 msgr2=0x5593399ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.839+0000 7f113ca00640 1 --2- 172.21.15.37:0/287303999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 0x5593399ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.839+0000 7f113ca00640 1 -- 172.21.15.37:0/287303999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 msgr2=0x5593399ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.839+0000 7f113ca00640 1 --2- 172.21.15.37:0/287303999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.839+0000 7f113ca00640 1 -- 172.21.15.37:0/287303999 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593398a1460 con 0x5593395e6840 2024-09-21T05:59:32.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.839+0000 7f113ca00640 1 --2- 172.21.15.37:0/287303999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395e6840 0x5593399aedc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f11240115f0 tx=0x7f1124011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83cd8025c1fc8e14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:32.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.840+0000 7f112a600640 1 -- 172.21.15.37:0/287303999 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112401e070 con 0x5593395e6840 2024-09-21T05:59:32.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.840+0000 7f112a600640 1 -- 172.21.15.37:0/287303999 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f112400faf0 con 0x5593395e6840 2024-09-21T05:59:32.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.840+0000 7f112a600640 1 -- 172.21.15.37:0/287303999 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1124019b90 con 0x5593395e6840 2024-09-21T05:59:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.841+0000 7f1136000640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11200b6510 0x7f11200b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.841+0000 7f1146a77740 1 -- 172.21.15.37:0/287303999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395e6840 msgr2=0x5593399aedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.841+0000 7f1146a77740 1 --2- 172.21.15.37:0/287303999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395e6840 0x5593399aedc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f11240115f0 tx=0x7f1124011ab0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.841+0000 7f1136000640 1 -- 172.21.15.37:0/399961578 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f112c107c30 con 0x7f11380757b0 2024-09-21T05:59:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.841+0000 7f1146a77740 1 -- 172.21.15.37:0/287303999 shutdown_connections 2024-09-21T05:59:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.841+0000 7f1146a77740 1 --2- 172.21.15.37:0/287303999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395e6840 0x5593399aedc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.841+0000 7f1146a77740 1 --2- 172.21.15.37:0/287303999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.841+0000 7f1146a77740 1 --2- 172.21.15.37:0/287303999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 0x5593399ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.841+0000 7f1146a77740 1 -- 172.21.15.37:0/287303999 >> 172.21.15.37:0/287303999 conn(0x5593395fb910 msgr2=0x5593399ac230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.841+0000 7f113de00640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11200b6510 0x7f11200b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.841+0000 7f1146a77740 1 -- 172.21.15.37:0/287303999 shutdown_connections 2024-09-21T05:59:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.841+0000 7f1146a77740 1 -- 172.21.15.37:0/287303999 wait complete. 2024-09-21T05:59:32.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.842+0000 7f1146a77740 1 -- start start 2024-09-21T05:59:32.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.842+0000 7f113de00640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11200b6510 0x7f11200b8a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1130005fd0 tx=0x7f1130009500 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:32.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.842+0000 7f1146a77740 1 Processor -- start 2024-09-21T05:59:32.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f1146a77740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399b9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f1146a77740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593395e6840 0x5593399ba370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f1146a77740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559339607520 0x5593399c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f1146a77740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559339775bb0 con 0x5593395de660 2024-09-21T05:59:32.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f1146a77740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5593398af6c0 con 0x559339607520 2024-09-21T05:59:32.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f1146a77740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5593399bcb20 con 0x5593395e6840 2024-09-21T05:59:32.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f1146a77740 10 client.0 _ll_register_callbacks cb 0x5593398ca490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:32.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f113d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399b9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f113d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399b9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38878/0 (socket says 172.21.15.37:38878) 2024-09-21T05:59:32.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f113d400640 1 -- 172.21.15.37:0/3539257510 learned_addr learned my addr 172.21.15.37:0/3539257510 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:32.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f113ca00640 1 --2- 172.21.15.37:0/3539257510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593395e6840 0x5593399ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f113de00640 1 --2- 172.21.15.37:0/3539257510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559339607520 0x5593399c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f113d400640 1 -- 172.21.15.37:0/3539257510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593395e6840 msgr2=0x5593399ba370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f113d400640 1 --2- 172.21.15.37:0/3539257510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593395e6840 0x5593399ba370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f113d400640 1 -- 172.21.15.37:0/3539257510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559339607520 msgr2=0x5593399c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f113d400640 1 --2- 172.21.15.37:0/3539257510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559339607520 0x5593399c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.843+0000 7f113d400640 1 -- 172.21.15.37:0/3539257510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559339672b00 con 0x5593395de660 2024-09-21T05:59:32.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.844+0000 7f113d400640 1 --2- 172.21.15.37:0/3539257510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399b9e30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f112c0cacb0 tx=0x7f112c0c99a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6060ca25650fcd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:32.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.844+0000 7f111ea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T05:59:32.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.844+0000 7f111ea00640 1 -- 172.21.15.37:0/3539257510 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c049030 con 0x5593395de660 2024-09-21T05:59:32.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.844+0000 7f111ea00640 1 -- 172.21.15.37:0/3539257510 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f112c0318a0 con 0x5593395de660 2024-09-21T05:59:32.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.844+0000 7f1146a77740 1 -- 172.21.15.37:0/3539257510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f112400faf0 con 0x5593395de660 2024-09-21T05:59:32.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.844+0000 7f111ea00640 1 -- 172.21.15.37:0/3539257510 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f112c0cd1b0 con 0x5593395de660 2024-09-21T05:59:32.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.844+0000 7f1146a77740 10 client.15546 fetch_fsmap learned FSMap version 21 2024-09-21T05:59:32.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.844+0000 7f1146a77740 1 -- 172.21.15.37:0/3539257510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5593396e9960 con 0x5593395de660 2024-09-21T05:59:32.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.845+0000 7f111ea00640 1 -- 172.21.15.37:0/3539257510 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f112400faf0 con 0x5593395de660 2024-09-21T05:59:32.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.845+0000 7f111ea00640 1 -- 172.21.15.37:0/3539257510 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f112c0d2020 con 0x5593395de660 2024-09-21T05:59:32.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.845+0000 7f1146a77740 10 client.15546 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:59:32.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.845+0000 7f1146a77740 10 client.15546 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:59:32.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.845+0000 7f1146a77740 20 client.15546 populate_metadata read hostname 'smithi037' 2024-09-21T05:59:32.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.845+0000 7f1146a77740 1 --2- 172.21.15.37:0/3539257510 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5593395c5ea0 0x5593399cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.845+0000 7f1146a77740 4 client.15546 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:32.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.845+0000 7f1146a77740 1 -- 172.21.15.37:0/3539257510 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593399271e0 con 0x5593395c5ea0 2024-09-21T05:59:32.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.845+0000 7f113ca00640 1 --2- 172.21.15.37:0/3539257510 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5593395c5ea0 0x5593399cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.846+0000 7f113ca00640 1 --2- 172.21.15.37:0/3539257510 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5593395c5ea0 0x5593399cbd70 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11810cfa98f24384 server_cookie=c9b3da8756d39f68 in_seq=0 out_seq=0 2024-09-21T05:59:32.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.846+0000 7f111ea00640 10 client.15546 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:32.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.847+0000 7f111ea00640 1 -- 172.21.15.37:0/3539257510 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5593399271e0 con 0x5593395c5ea0 2024-09-21T05:59:32.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.847+0000 7f111ea00640 10 client.15546 handle_command_reply: tid=0 2024-09-21T05:59:32.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.847+0000 7f1146a77740 1 client.15546 shutdown 2024-09-21T05:59:32.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.847+0000 7f1146a77740 1 -- 172.21.15.37:0/3539257510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 msgr2=0x5593399b9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.847+0000 7f1146a77740 1 --2- 172.21.15.37:0/3539257510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399b9e30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f112c0cacb0 tx=0x7f112c0c99a0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.847+0000 7f1146a77740 1 -- 172.21.15.37:0/3539257510 shutdown_connections 2024-09-21T05:59:32.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.847+0000 7f1146a77740 1 --2- 172.21.15.37:0/3539257510 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5593395c5ea0 0x5593399cbd70 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.847+0000 7f1146a77740 1 --2- 172.21.15.37:0/3539257510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559339607520 0x5593399c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.847+0000 7f1146a77740 1 --2- 172.21.15.37:0/3539257510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593395e6840 0x5593399ba370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.847+0000 7f1146a77740 1 --2- 172.21.15.37:0/3539257510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399b9e30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.847+0000 7f1146a77740 1 -- 172.21.15.37:0/3539257510 >> 172.21.15.37:0/3539257510 conn(0x5593395fb910 msgr2=0x5593399b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:32.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.848+0000 7f111ea00640 0 client.15546 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:32.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.848+0000 7f1146a77740 1 -- 172.21.15.37:0/3539257510 shutdown_connections 2024-09-21T05:59:32.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.848+0000 7f1146a77740 1 -- 172.21.15.37:0/3539257510 wait complete. 2024-09-21T05:59:32.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.848+0000 7f1146a77740 20 client.15546 trim_cache size 0 max 16384 2024-09-21T05:59:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.866+0000 7f1146a77740 1 Processor -- start 2024-09-21T05:59:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.866+0000 7f1146a77740 1 -- start start 2024-09-21T05:59:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.867+0000 7f1146a77740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395de660 0x5593399bb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.867+0000 7f1146a77740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395e6840 0x5593399c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.867+0000 7f1146a77740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 0x5593399c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.867+0000 7f1146a77740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f11381b0a50 con 0x5593395e6840 2024-09-21T05:59:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.867+0000 7f1146a77740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f11381b32d0 con 0x5593395de660 2024-09-21T05:59:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.867+0000 7f1146a77740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f11381b10c0 con 0x559339607520 2024-09-21T05:59:32.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.867+0000 7f113ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395e6840 0x5593399c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.867+0000 7f113ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395e6840 0x5593399c5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38890/0 (socket says 172.21.15.37:38890) 2024-09-21T05:59:32.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.867+0000 7f113ca00640 1 -- 172.21.15.37:0/4000939195 learned_addr learned my addr 172.21.15.37:0/4000939195 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:32.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.867+0000 7f113d400640 1 --2- 172.21.15.37:0/4000939195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395de660 0x5593399bb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.867+0000 7f113de00640 1 --2- 172.21.15.37:0/4000939195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 0x5593399c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.868+0000 7f113ca00640 1 -- 172.21.15.37:0/4000939195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 msgr2=0x5593399c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.868+0000 7f113ca00640 1 --2- 172.21.15.37:0/4000939195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 0x5593399c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.868+0000 7f113ca00640 1 -- 172.21.15.37:0/4000939195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395de660 msgr2=0x5593399bb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.868+0000 7f113ca00640 1 --2- 172.21.15.37:0/4000939195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395de660 0x5593399bb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.868+0000 7f113ca00640 1 -- 172.21.15.37:0/4000939195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593399b0a30 con 0x5593395e6840 2024-09-21T05:59:32.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.868+0000 7f113ca00640 1 --2- 172.21.15.37:0/4000939195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395e6840 0x5593399c5d40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1124013fd0 tx=0x7f1124014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57970ce41d43c659 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:32.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.868+0000 7f1129c00640 1 -- 172.21.15.37:0/4000939195 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112402a070 con 0x5593395e6840 2024-09-21T05:59:32.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.868+0000 7f1129c00640 1 -- 172.21.15.37:0/4000939195 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11240197a0 con 0x5593395e6840 2024-09-21T05:59:32.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.868+0000 7f1129c00640 1 -- 172.21.15.37:0/4000939195 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112401e040 con 0x5593395e6840 2024-09-21T05:59:32.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.869+0000 7f1146a77740 1 -- 172.21.15.37:0/4000939195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395e6840 msgr2=0x5593399c5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:32.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.869+0000 7f1146a77740 1 --2- 172.21.15.37:0/4000939195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395e6840 0x5593399c5d40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1124013fd0 tx=0x7f1124014000 comp rx=0 tx=0).stop 2024-09-21T05:59:32.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.869+0000 7f1146a77740 1 -- 172.21.15.37:0/4000939195 shutdown_connections 2024-09-21T05:59:32.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.869+0000 7f1146a77740 1 --2- 172.21.15.37:0/4000939195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 0x5593399c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.869+0000 7f1146a77740 1 --2- 172.21.15.37:0/4000939195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395e6840 0x5593399c5d40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.869+0000 7f1146a77740 1 --2- 172.21.15.37:0/4000939195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395de660 0x5593399bb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.869+0000 7f1146a77740 1 -- 172.21.15.37:0/4000939195 >> 172.21.15.37:0/4000939195 conn(0x5593395fb910 msgr2=0x5593399bb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:32.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.869+0000 7f1146a77740 1 -- 172.21.15.37:0/4000939195 shutdown_connections 2024-09-21T05:59:32.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.869+0000 7f1146a77740 1 -- 172.21.15.37:0/4000939195 wait complete. 2024-09-21T05:59:32.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.870+0000 7f1146a77740 1 -- start start 2024-09-21T05:59:32.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.870+0000 7f1146a77740 1 Processor -- start 2024-09-21T05:59:32.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.870+0000 7f1146a77740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399be780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.870+0000 7f1146a77740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395e6840 0x5593399bed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.870+0000 7f1146a77740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 0x559339a2f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.870+0000 7f1146a77740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f11381b1790 con 0x5593395de660 2024-09-21T05:59:32.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.870+0000 7f1146a77740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f11381b2c00 con 0x5593395e6840 2024-09-21T05:59:32.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.870+0000 7f1146a77740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f11381b1e60 con 0x559339607520 2024-09-21T05:59:32.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.871+0000 7f1146a77740 10 client.0 _ll_register_callbacks cb 0x7f112c0ca090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:32.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.871+0000 7f113d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399be780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.871+0000 7f113d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399be780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38904/0 (socket says 172.21.15.37:38904) 2024-09-21T05:59:32.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.871+0000 7f113d400640 1 -- 172.21.15.37:0/400789256 learned_addr learned my addr 172.21.15.37:0/400789256 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:32.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.871+0000 7f113de00640 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 0x559339a2f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.871+0000 7f113ca00640 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395e6840 0x5593399bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.871+0000 7f113d400640 1 -- 172.21.15.37:0/400789256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 msgr2=0x559339a2f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.871+0000 7f113d400640 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 0x559339a2f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.871+0000 7f113d400640 1 -- 172.21.15.37:0/400789256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395e6840 msgr2=0x5593399bed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:32.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.871+0000 7f113d400640 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395e6840 0x5593399bed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:32.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.871+0000 7f113d400640 1 -- 172.21.15.37:0/400789256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559339a2fd70 con 0x5593395de660 2024-09-21T05:59:32.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.871+0000 7f113ca00640 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395e6840 0x5593399bed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:32.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.872+0000 7f113d400640 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399be780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f112c03bb20 tx=0x7f112c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7255ec3b04ba3794 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:32.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.872+0000 7f111ea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T05:59:32.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.872+0000 7f111ea00640 1 -- 172.21.15.37:0/400789256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c049070 con 0x5593395de660 2024-09-21T05:59:32.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.872+0000 7f111ea00640 1 -- 172.21.15.37:0/400789256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f112c0c95a0 con 0x5593395de660 2024-09-21T05:59:32.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.872+0000 7f1146a77740 1 -- 172.21.15.37:0/400789256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11240197a0 con 0x5593395de660 2024-09-21T05:59:32.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.872+0000 7f111ea00640 1 -- 172.21.15.37:0/400789256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f112c0cd390 con 0x5593395de660 2024-09-21T05:59:32.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.872+0000 7f1146a77740 10 client.15552 fetch_fsmap learned FSMap version 21 2024-09-21T05:59:32.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.872+0000 7f1146a77740 1 -- 172.21.15.37:0/400789256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559339a371d0 con 0x5593395de660 2024-09-21T05:59:32.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.872+0000 7f111ea00640 1 -- 172.21.15.37:0/400789256 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11240197a0 con 0x5593395de660 2024-09-21T05:59:32.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.873+0000 7f111ea00640 1 -- 172.21.15.37:0/400789256 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f112c0d3600 con 0x5593395de660 2024-09-21T05:59:32.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.873+0000 7f1146a77740 10 client.15552 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:59:32.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.873+0000 7f1146a77740 10 client.15552 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:59:32.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.873+0000 7f1146a77740 20 client.15552 populate_metadata read hostname 'smithi037' 2024-09-21T05:59:32.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.873+0000 7f1146a77740 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55933959b250 0x559339a397b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:32.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.873+0000 7f1146a77740 4 client.15552 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "15ab2d6b", "release": true, "await": true}] 2024-09-21T05:59:32.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.873+0000 7f1146a77740 1 -- 172.21.15.37:0/400789256 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "set_id": "15ab2d6b", "release": true, "await": true}) -- 0x5593399ba720 con 0x55933959b250 2024-09-21T05:59:32.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.873+0000 7f113ca00640 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55933959b250 0x559339a397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:32.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.874+0000 7f113ca00640 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55933959b250 0x559339a397b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=408719f049549829 server_cookie=e2c6a4113363daaa in_seq=0 out_seq=0 2024-09-21T05:59:32.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:32.874+0000 7f111ea00640 10 client.15552 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.088+0000 7f111ea00640 1 -- 172.21.15.37:0/400789256 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5593399ba720 con 0x55933959b250 2024-09-21T05:59:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.088+0000 7f111ea00640 10 client.15552 handle_command_reply: tid=0 2024-09-21T05:59:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.088+0000 7f1146a77740 1 client.15552 shutdown 2024-09-21T05:59:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.088+0000 7f1146a77740 1 -- 172.21.15.37:0/400789256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 msgr2=0x5593399be780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.088+0000 7f1146a77740 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399be780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f112c03bb20 tx=0x7f112c003f90 comp rx=0 tx=0).stop 2024-09-21T05:59:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.088+0000 7f1146a77740 1 -- 172.21.15.37:0/400789256 shutdown_connections 2024-09-21T05:59:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.088+0000 7f1146a77740 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55933959b250 0x559339a397b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.088+0000 7f1146a77740 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559339607520 0x559339a2f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.088+0000 7f1146a77740 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5593395e6840 0x5593399bed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.088+0000 7f1146a77740 1 --2- 172.21.15.37:0/400789256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5593395de660 0x5593399be780 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.088+0000 7f1146a77740 1 -- 172.21.15.37:0/400789256 >> 172.21.15.37:0/400789256 conn(0x5593395fb910 msgr2=0x5593399bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.088+0000 7f111ea00640 0 client.15552 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.089+0000 7f1146a77740 1 -- 172.21.15.37:0/400789256 shutdown_connections 2024-09-21T05:59:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.089+0000 7f1146a77740 1 -- 172.21.15.37:0/400789256 wait complete. 2024-09-21T05:59:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.089+0000 7f1146a77740 20 client.15552 trim_cache size 0 max 16384 2024-09-21T05:59:33.092 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:59:33.092 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 24, 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: "15ab2d6b": { 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 24, 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 139.2, 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:59:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:59:33.094 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:59:33.094 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:59:33.094 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:59:33.094 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:59:33.094 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:33.094 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:33.094 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:33.094 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:33.094 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:33.094 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:59:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.090+0000 7f113e800640 1 -- 172.21.15.37:0/399961578 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11200b6510 msgr2=0x7f11200b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.090+0000 7f113e800640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11200b6510 0x7f11200b8a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1130005fd0 tx=0x7f1130009500 comp rx=0 tx=0).stop 2024-09-21T05:59:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.090+0000 7f113e800640 1 -- 172.21.15.37:0/399961578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11380757b0 msgr2=0x7f113819c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.090+0000 7f113e800640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11380757b0 0x7f113819c440 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f112c02a9e0 tx=0x7f112c003b90 comp rx=0 tx=0).stop 2024-09-21T05:59:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.090+0000 7f113e800640 1 -- 172.21.15.37:0/399961578 shutdown_connections 2024-09-21T05:59:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.090+0000 7f113e800640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f113810fef0 0x7f11381a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.090+0000 7f113e800640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1138076100 0x7f113819c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.090+0000 7f113e800640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11200b6510 0x7f11200b8a20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.090+0000 7f113e800640 1 --2- 172.21.15.37:0/399961578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f11380757b0 0x7f113819c440 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.090+0000 7f113e800640 1 -- 172.21.15.37:0/399961578 >> 172.21.15.37:0/399961578 conn(0x7f11380ff440 msgr2=0x7f1138109a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.090+0000 7f113e800640 1 -- 172.21.15.37:0/399961578 shutdown_connections 2024-09-21T05:59:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:33.091+0000 7f113e800640 1 -- 172.21.15.37:0/399961578 wait complete. 2024-09-21T05:59:34.139 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:33 smithi037 ceph-mon[30631]: pgmap v583: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T05:59:34.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:33 smithi067 ceph-mon[34443]: pgmap v583: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T05:59:34.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:33 smithi144 ceph-mon[34351]: pgmap v583: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T05:59:34.540 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '15ab2d6b', total seconds elapsed: 24.1 2024-09-21T05:59:34.540 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-09-21T05:59:34.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:59:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.873+0000 7fc878c00640 1 -- 172.21.15.37:0/1084158975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc874105080 msgr2=0x7fc87410d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.873+0000 7fc878c00640 1 --2- 172.21.15.37:0/1084158975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc874105080 0x7fc87410d6c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc860009900 tx=0x7fc86002a410 comp rx=0 tx=0).stop 2024-09-21T05:59:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.873+0000 7fc878c00640 1 -- 172.21.15.37:0/1084158975 shutdown_connections 2024-09-21T05:59:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.873+0000 7fc878c00640 1 --2- 172.21.15.37:0/1084158975 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc87410dc00 0x7fc874110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.873+0000 7fc878c00640 1 --2- 172.21.15.37:0/1084158975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc874105080 0x7fc87410d6c0 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc860009900 tx=0x7fc86002a410 comp rx=0 tx=0).stop 2024-09-21T05:59:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.873+0000 7fc878c00640 1 --2- 172.21.15.37:0/1084158975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc874104650 0x7fc874104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.873+0000 7fc878c00640 1 -- 172.21.15.37:0/1084158975 >> 172.21.15.37:0/1084158975 conn(0x7fc8740fe2c0 msgr2=0x7fc874100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.873+0000 7fc878c00640 1 -- 172.21.15.37:0/1084158975 shutdown_connections 2024-09-21T05:59:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.873+0000 7fc878c00640 1 -- 172.21.15.37:0/1084158975 wait complete. 2024-09-21T05:59:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.875+0000 7fc878c00640 1 Processor -- start 2024-09-21T05:59:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.875+0000 7fc878c00640 1 -- start start 2024-09-21T05:59:35.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.876+0000 7fc878c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc874104650 0x7fc874102560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.876+0000 7fc878c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc87410dc00 0x7fc874102aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.876+0000 7fc878c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc874102fe0 0x7fc8741a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.876+0000 7fc878c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc8741138d0 con 0x7fc874104650 2024-09-21T05:59:35.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.876+0000 7fc878c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc874113750 con 0x7fc87410dc00 2024-09-21T05:59:35.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.876+0000 7fc878c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc874113a50 con 0x7fc874102fe0 2024-09-21T05:59:35.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.876+0000 7fc872a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc87410dc00 0x7fc874102aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.876+0000 7fc872a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc87410dc00 0x7fc874102aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:48972/0 (socket says 172.21.15.37:48972) 2024-09-21T05:59:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.876+0000 7fc872a00640 1 -- 172.21.15.37:0/1798486135 learned_addr learned my addr 172.21.15.37:0/1798486135 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.877+0000 7fc873e00640 1 --2- 172.21.15.37:0/1798486135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc874102fe0 0x7fc8741a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.877+0000 7fc872a00640 1 -- 172.21.15.37:0/1798486135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc874102fe0 msgr2=0x7fc8741a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.877+0000 7fc872a00640 1 --2- 172.21.15.37:0/1798486135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc874102fe0 0x7fc8741a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.877+0000 7fc872a00640 1 -- 172.21.15.37:0/1798486135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc874104650 msgr2=0x7fc874102560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.877+0000 7fc872a00640 1 --2- 172.21.15.37:0/1798486135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc874104650 0x7fc874102560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.877+0000 7fc872a00640 1 -- 172.21.15.37:0/1798486135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8741a8ae0 con 0x7fc87410dc00 2024-09-21T05:59:35.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.877+0000 7fc872a00640 1 --2- 172.21.15.37:0/1798486135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc87410dc00 0x7fc874102aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc860006010 tx=0x7fc860003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.878+0000 7fc86be00640 1 -- 172.21.15.37:0/1798486135 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86003f020 con 0x7fc87410dc00 2024-09-21T05:59:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.878+0000 7fc86be00640 1 -- 172.21.15.37:0/1798486135 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc860031b50 con 0x7fc87410dc00 2024-09-21T05:59:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.878+0000 7fc86be00640 1 -- 172.21.15.37:0/1798486135 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860035070 con 0x7fc87410dc00 2024-09-21T05:59:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.878+0000 7fc878c00640 1 -- 172.21.15.37:0/1798486135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87419a070 con 0x7fc87410dc00 2024-09-21T05:59:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.878+0000 7fc878c00640 1 -- 172.21.15.37:0/1798486135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc87419a4d0 con 0x7fc87410dc00 2024-09-21T05:59:35.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.880+0000 7fc878c00640 1 -- 172.21.15.37:0/1798486135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc874104a60 con 0x7fc87410dc00 2024-09-21T05:59:35.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.883+0000 7fc86be00640 1 -- 172.21.15.37:0/1798486135 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc860042020 con 0x7fc87410dc00 2024-09-21T05:59:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.885+0000 7fc86be00640 1 --2- 172.21.15.37:0/1798486135 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8580b6590 0x7fc8580b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.886+0000 7fc873400640 1 --2- 172.21.15.37:0/1798486135 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8580b6590 0x7fc8580b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:35.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.886+0000 7fc86be00640 1 -- 172.21.15.37:0/1798486135 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fc860038e30 con 0x7fc87410dc00 2024-09-21T05:59:35.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.887+0000 7fc873400640 1 --2- 172.21.15.37:0/1798486135 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8580b6590 0x7fc8580b8aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc864005fd0 tx=0x7fc864005850 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:35.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:35.892+0000 7fc86be00640 1 -- 172.21.15.37:0/1798486135 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc860049030 con 0x7fc87410dc00 2024-09-21T05:59:36.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:35 smithi037 ceph-mon[30631]: pgmap v584: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-21T05:59:36.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.219+0000 7fc878c00640 1 -- 172.21.15.37:0/1798486135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc874103860 con 0x7fc87410dc00 2024-09-21T05:59:36.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.220+0000 7fc86be00640 1 -- 172.21.15.37:0/1798486135 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7fc8600d24d0 con 0x7fc87410dc00 2024-09-21T05:59:36.223 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:59:36.223 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:59:36.223 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:59:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.223+0000 7fc878c00640 1 -- 172.21.15.37:0/1798486135 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8580b6590 msgr2=0x7fc8580b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.223+0000 7fc878c00640 1 --2- 172.21.15.37:0/1798486135 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8580b6590 0x7fc8580b8aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc864005fd0 tx=0x7fc864005850 comp rx=0 tx=0).stop 2024-09-21T05:59:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.223+0000 7fc878c00640 1 -- 172.21.15.37:0/1798486135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc87410dc00 msgr2=0x7fc874102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.223+0000 7fc878c00640 1 --2- 172.21.15.37:0/1798486135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc87410dc00 0x7fc874102aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc860006010 tx=0x7fc860003c10 comp rx=0 tx=0).stop 2024-09-21T05:59:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.223+0000 7fc878c00640 1 -- 172.21.15.37:0/1798486135 shutdown_connections 2024-09-21T05:59:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.223+0000 7fc878c00640 1 --2- 172.21.15.37:0/1798486135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc874102fe0 0x7fc8741a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.223+0000 7fc878c00640 1 --2- 172.21.15.37:0/1798486135 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8580b6590 0x7fc8580b8aa0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.223+0000 7fc878c00640 1 --2- 172.21.15.37:0/1798486135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc87410dc00 0x7fc874102aa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.223+0000 7fc878c00640 1 --2- 172.21.15.37:0/1798486135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc874104650 0x7fc874102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.223+0000 7fc878c00640 1 -- 172.21.15.37:0/1798486135 >> 172.21.15.37:0/1798486135 conn(0x7fc8740fe2c0 msgr2=0x7fc8741001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.223+0000 7fc878c00640 1 -- 172.21.15.37:0/1798486135 shutdown_connections 2024-09-21T05:59:36.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:36.224+0000 7fc878c00640 1 -- 172.21.15.37:0/1798486135 wait complete. 2024-09-21T05:59:36.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:35 smithi067 ceph-mon[34443]: pgmap v584: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-21T05:59:36.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:35 smithi144 ceph-mon[34351]: pgmap v584: 129 pgs: 129 active+clean; 112 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-21T05:59:36.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:36 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1798486135' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:37.197 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0' 2024-09-21T05:59:37.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0 2024-09-21T05:59:37.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:36 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1798486135' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:37.274 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:36 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1798486135' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:38.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:37 smithi037 ceph-mon[30631]: pgmap v585: 129 pgs: 129 active+clean; 113 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 290 KiB/s wr, 49 op/s 2024-09-21T05:59:38.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:37 smithi067 ceph-mon[34443]: pgmap v585: 129 pgs: 129 active+clean; 113 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 290 KiB/s wr, 49 op/s 2024-09-21T05:59:38.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:37 smithi144 ceph-mon[34351]: pgmap v585: 129 pgs: 129 active+clean; 113 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 290 KiB/s wr, 49 op/s 2024-09-21T05:59:38.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.441+0000 7fc59e000640 1 -- 172.21.15.37:0/1950244786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59810a3c0 msgr2=0x7fc59810a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.441+0000 7fc59e000640 1 --2- 172.21.15.37:0/1950244786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59810a3c0 0x7fc59810a7d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc588009900 tx=0x7fc58802a420 comp rx=0 tx=0).stop 2024-09-21T05:59:38.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.441+0000 7fc59e000640 1 -- 172.21.15.37:0/1950244786 shutdown_connections 2024-09-21T05:59:38.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.441+0000 7fc59e000640 1 --2- 172.21.15.37:0/1950244786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc59811d0e0 0x7fc59811f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.441+0000 7fc59e000640 1 --2- 172.21.15.37:0/1950244786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc59810ad10 0x7fc59811cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.441+0000 7fc59e000640 1 --2- 172.21.15.37:0/1950244786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59810a3c0 0x7fc59810a7d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.441+0000 7fc59e000640 1 -- 172.21.15.37:0/1950244786 >> 172.21.15.37:0/1950244786 conn(0x7fc598070e80 msgr2=0x7fc598071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.441+0000 7fc59e000640 1 -- 172.21.15.37:0/1950244786 shutdown_connections 2024-09-21T05:59:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.441+0000 7fc59e000640 1 -- 172.21.15.37:0/1950244786 wait complete. 2024-09-21T05:59:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.443+0000 7fc59e000640 1 Processor -- start 2024-09-21T05:59:38.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.443+0000 7fc59e000640 1 -- start start 2024-09-21T05:59:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.444+0000 7fc59e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc59810a3c0 0x7fc5981a9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.444+0000 7fc59e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc59810ad10 0x7fc5981a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.444+0000 7fc59e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59811d0e0 0x7fc5981aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.444+0000 7fc59e000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc598122910 con 0x7fc59811d0e0 2024-09-21T05:59:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.444+0000 7fc59e000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc598122790 con 0x7fc59810ad10 2024-09-21T05:59:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.444+0000 7fc59e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc598122a90 con 0x7fc59810a3c0 2024-09-21T05:59:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.444+0000 7fc597e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59811d0e0 0x7fc5981aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.444+0000 7fc596a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc59810ad10 0x7fc5981a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.444+0000 7fc596a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc59810ad10 0x7fc5981a9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:48994/0 (socket says 172.21.15.37:48994) 2024-09-21T05:59:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.444+0000 7fc596a00640 1 -- 172.21.15.37:0/3408131252 learned_addr learned my addr 172.21.15.37:0/3408131252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.444+0000 7fc597400640 1 --2- 172.21.15.37:0/3408131252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc59810a3c0 0x7fc5981a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.445+0000 7fc596a00640 1 -- 172.21.15.37:0/3408131252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc59810a3c0 msgr2=0x7fc5981a9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.445+0000 7fc596a00640 1 --2- 172.21.15.37:0/3408131252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc59810a3c0 0x7fc5981a9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.445+0000 7fc596a00640 1 -- 172.21.15.37:0/3408131252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59811d0e0 msgr2=0x7fc5981aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.445+0000 7fc596a00640 1 --2- 172.21.15.37:0/3408131252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59811d0e0 0x7fc5981aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.445+0000 7fc596a00640 1 -- 172.21.15.37:0/3408131252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5981af2d0 con 0x7fc59810ad10 2024-09-21T05:59:38.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.445+0000 7fc596a00640 1 --2- 172.21.15.37:0/3408131252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc59810ad10 0x7fc5981a9900 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc58400e9f0 tx=0x7fc58400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:38.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.447+0000 7fc58fe00640 1 -- 172.21.15.37:0/3408131252 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58400ccc0 con 0x7fc59810ad10 2024-09-21T05:59:38.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.447+0000 7fc58fe00640 1 -- 172.21.15.37:0/3408131252 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5840108e0 con 0x7fc59810ad10 2024-09-21T05:59:38.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.447+0000 7fc58fe00640 1 -- 172.21.15.37:0/3408131252 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584018860 con 0x7fc59810ad10 2024-09-21T05:59:38.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.448+0000 7fc59e000640 1 -- 172.21.15.37:0/3408131252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5981af5c0 con 0x7fc59810ad10 2024-09-21T05:59:38.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.448+0000 7fc59e000640 1 -- 172.21.15.37:0/3408131252 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5981b5d20 con 0x7fc59810ad10 2024-09-21T05:59:38.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.451+0000 7fc5a4c29740 1 Processor -- start 2024-09-21T05:59:38.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.452+0000 7fc5a4c29740 1 -- start start 2024-09-21T05:59:38.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.452+0000 7fc5a4c29740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e280850 0x55f05e6279b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.452+0000 7fc5a4c29740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e257990 0x55f05e627ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.452+0000 7fc5a4c29740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e25fb70 0x55f05e628430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.452+0000 7fc5a4c29740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f05e59da90 con 0x55f05e25fb70 2024-09-21T05:59:38.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.452+0000 7fc5a4c29740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f05e58cec0 con 0x55f05e280850 2024-09-21T05:59:38.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.452+0000 7fc5a4c29740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f05e590cd0 con 0x55f05e257990 2024-09-21T05:59:38.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.453+0000 7fc597400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e257990 0x55f05e627ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.453+0000 7fc597400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e257990 0x55f05e627ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:39146/0 (socket says 172.21.15.37:39146) 2024-09-21T05:59:38.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.453+0000 7fc597400640 1 -- 172.21.15.37:0/2990603307 learned_addr learned my addr 172.21.15.37:0/2990603307 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:38.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.453+0000 7fc597400640 1 -- 172.21.15.37:0/2990603307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e280850 msgr2=0x55f05e6279b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.453+0000 7fc597400640 1 --2- 172.21.15.37:0/2990603307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e280850 0x55f05e6279b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.453+0000 7fc597400640 1 -- 172.21.15.37:0/2990603307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e25fb70 msgr2=0x55f05e628430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.453+0000 7fc597400640 1 --2- 172.21.15.37:0/2990603307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e25fb70 0x55f05e628430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.453+0000 7fc597400640 1 -- 172.21.15.37:0/2990603307 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f05e5329d0 con 0x55f05e257990 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.454+0000 7fc597400640 1 --2- 172.21.15.37:0/2990603307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e257990 0x55f05e627ef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc588000c00 tx=0x7fc588004150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8d9508303070941 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.454+0000 7fc58fe00640 1 -- 172.21.15.37:0/3408131252 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc584010430 con 0x7fc59810ad10 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.454+0000 7fc583e00640 1 -- 172.21.15.37:0/2990603307 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc588035030 con 0x55f05e257990 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.454+0000 7fc583e00640 1 -- 172.21.15.37:0/2990603307 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5880054f0 con 0x55f05e257990 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.454+0000 7fc583e00640 1 -- 172.21.15.37:0/2990603307 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5880035f0 con 0x55f05e257990 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.455+0000 7fc5a4c29740 1 -- 172.21.15.37:0/2990603307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e257990 msgr2=0x55f05e627ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.455+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/2990603307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e257990 0x55f05e627ef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc588000c00 tx=0x7fc588004150 comp rx=0 tx=0).stop 2024-09-21T05:59:38.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.456+0000 7fc5a4c29740 1 -- 172.21.15.37:0/2990603307 shutdown_connections 2024-09-21T05:59:38.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.456+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/2990603307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e25fb70 0x55f05e628430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.456+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/2990603307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e257990 0x55f05e627ef0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.456+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/2990603307 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e280850 0x55f05e6279b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.456+0000 7fc5a4c29740 1 -- 172.21.15.37:0/2990603307 >> 172.21.15.37:0/2990603307 conn(0x55f05e274c40 msgr2=0x55f05e6258a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.456+0000 7fc5a4c29740 1 -- 172.21.15.37:0/2990603307 shutdown_connections 2024-09-21T05:59:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.456+0000 7fc5a4c29740 1 -- 172.21.15.37:0/2990603307 wait complete. 2024-09-21T05:59:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.456+0000 7fc58fe00640 1 --2- 172.21.15.37:0/3408131252 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc57c0b64c0 0x7fc57c0b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.457+0000 7fc58fe00640 1 -- 172.21.15.37:0/3408131252 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fc5840e7bf0 con 0x7fc59810ad10 2024-09-21T05:59:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.457+0000 7fc597400640 1 --2- 172.21.15.37:0/3408131252 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc57c0b64c0 0x7fc57c0b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.457+0000 7fc5a4c29740 1 -- start start 2024-09-21T05:59:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.457+0000 7fc5a4c29740 1 Processor -- start 2024-09-21T05:59:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.458+0000 7fc597400640 1 --2- 172.21.15.37:0/3408131252 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc57c0b64c0 0x7fc57c0b89d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc5880057c0 tx=0x7fc588005fd0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.458+0000 7fc5a4c29740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e257990 0x55f05e633450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.458+0000 7fc5a4c29740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e25fb70 0x55f05e633990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.458+0000 7fc5a4c29740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e280850 0x55f05e63f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.458+0000 7fc5a4c29740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f05e3ee7b0 con 0x55f05e257990 2024-09-21T05:59:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.458+0000 7fc5a4c29740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f05e531650 con 0x55f05e25fb70 2024-09-21T05:59:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.458+0000 7fc5a4c29740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f05e636130 con 0x55f05e280850 2024-09-21T05:59:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.458+0000 7fc5a4c29740 10 client.0 _ll_register_callbacks cb 0x55f05e2980a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.458+0000 7fc597400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e257990 0x55f05e633450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.458+0000 7fc597400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e257990 0x55f05e633450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38938/0 (socket says 172.21.15.37:38938) 2024-09-21T05:59:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.458+0000 7fc597400640 1 -- 172.21.15.37:0/2692046236 learned_addr learned my addr 172.21.15.37:0/2692046236 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.459+0000 7fc596a00640 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e25fb70 0x55f05e633990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.459+0000 7fc597e00640 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e280850 0x55f05e63f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.459+0000 7fc596a00640 1 -- 172.21.15.37:0/2692046236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e280850 msgr2=0x55f05e63f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.459+0000 7fc596a00640 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e280850 0x55f05e63f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.459+0000 7fc596a00640 1 -- 172.21.15.37:0/2692046236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e257990 msgr2=0x55f05e633450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.459+0000 7fc596a00640 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e257990 0x55f05e633450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.459+0000 7fc596a00640 1 -- 172.21.15.37:0/2692046236 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f05e2faba0 con 0x55f05e25fb70 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.459+0000 7fc597400640 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e257990 0x55f05e633450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.459+0000 7fc596a00640 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e25fb70 0x55f05e633990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc58400c6a0 tx=0x7fc584009740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74454a3f110772b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.459+0000 7fc580c00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.460+0000 7fc580c00640 1 -- 172.21.15.37:0/2692046236 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5840d1070 con 0x55f05e25fb70 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.460+0000 7fc580c00640 1 -- 172.21.15.37:0/2692046236 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fc5840ace20 con 0x55f05e25fb70 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.460+0000 7fc5a4c29740 1 -- 172.21.15.37:0/2692046236 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5880054f0 con 0x55f05e25fb70 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.460+0000 7fc580c00640 1 -- 172.21.15.37:0/2692046236 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc5840ad4c0 con 0x55f05e25fb70 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.460+0000 7fc5a4c29740 10 client.25607 fetch_fsmap learned FSMap version 21 2024-09-21T05:59:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.460+0000 7fc5a4c29740 1 -- 172.21.15.37:0/2692046236 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f05e642120 con 0x55f05e25fb70 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.460+0000 7fc580c00640 1 -- 172.21.15.37:0/2692046236 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5880054f0 con 0x55f05e25fb70 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.461+0000 7fc580c00640 1 -- 172.21.15.37:0/2692046236 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc5840aece0 con 0x55f05e25fb70 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.461+0000 7fc5a4c29740 10 client.25607 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.461+0000 7fc5a4c29740 10 client.25607 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.461+0000 7fc5a4c29740 20 client.25607 populate_metadata read hostname 'smithi037' 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.461+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f05e23f1d0 0x55f05e645640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.461+0000 7fc5a4c29740 4 client.25607 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.461+0000 7fc5a4c29740 1 -- 172.21.15.37:0/2692046236 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f05e59f9e0 con 0x55f05e23f1d0 2024-09-21T05:59:38.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.461+0000 7fc597400640 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f05e23f1d0 0x55f05e645640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.462+0000 7fc597400640 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f05e23f1d0 0x55f05e645640 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5c905a3aa2e99 server_cookie=d8101a57b226138e in_seq=0 out_seq=0 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.462+0000 7fc580c00640 10 client.25607 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.463+0000 7fc580c00640 1 -- 172.21.15.37:0/2692046236 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f05e59f9e0 con 0x55f05e23f1d0 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.463+0000 7fc580c00640 10 client.25607 handle_command_reply: tid=0 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.464+0000 7fc5a4c29740 1 client.25607 shutdown 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.464+0000 7fc5a4c29740 1 -- 172.21.15.37:0/2692046236 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e25fb70 msgr2=0x55f05e633990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.464+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e25fb70 0x55f05e633990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc58400c6a0 tx=0x7fc584009740 comp rx=0 tx=0).stop 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.465+0000 7fc5a4c29740 1 -- 172.21.15.37:0/2692046236 shutdown_connections 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.465+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f05e23f1d0 0x55f05e645640 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.465+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e280850 0x55f05e63f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.465+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e25fb70 0x55f05e633990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.465+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/2692046236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e257990 0x55f05e633450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.465+0000 7fc5a4c29740 1 -- 172.21.15.37:0/2692046236 >> 172.21.15.37:0/2692046236 conn(0x55f05e274c40 msgr2=0x55f05e62ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.465+0000 7fc580c00640 0 client.25607 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.465+0000 7fc5a4c29740 1 -- 172.21.15.37:0/2692046236 shutdown_connections 2024-09-21T05:59:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.466+0000 7fc5a4c29740 1 -- 172.21.15.37:0/2692046236 wait complete. 2024-09-21T05:59:38.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.466+0000 7fc5a4c29740 20 client.25607 trim_cache size 0 max 16384 2024-09-21T05:59:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.494+0000 7fc5a4c29740 1 Processor -- start 2024-09-21T05:59:38.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.494+0000 7fc5a4c29740 1 -- start start 2024-09-21T05:59:38.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.494+0000 7fc5a4c29740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e257990 0x55f05e6248c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.494+0000 7fc5a4c29740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e25fb70 0x55f05e62dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.494+0000 7fc5a4c29740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e280850 0x55f05e63f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.494+0000 7fc5a4c29740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc5981bdad0 con 0x55f05e257990 2024-09-21T05:59:38.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.494+0000 7fc5a4c29740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc5981c0350 con 0x55f05e25fb70 2024-09-21T05:59:38.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.494+0000 7fc5a4c29740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc5981be140 con 0x55f05e280850 2024-09-21T05:59:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.495+0000 7fc596a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e25fb70 0x55f05e62dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.495+0000 7fc596a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e25fb70 0x55f05e62dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:49014/0 (socket says 172.21.15.37:49014) 2024-09-21T05:59:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.495+0000 7fc596a00640 1 -- 172.21.15.37:0/3028333928 learned_addr learned my addr 172.21.15.37:0/3028333928 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.495+0000 7fc597e00640 1 --2- 172.21.15.37:0/3028333928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e280850 0x55f05e63f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.495+0000 7fc597400640 1 --2- 172.21.15.37:0/3028333928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e257990 0x55f05e6248c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.495+0000 7fc596a00640 1 -- 172.21.15.37:0/3028333928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e280850 msgr2=0x55f05e63f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.495+0000 7fc596a00640 1 --2- 172.21.15.37:0/3028333928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e280850 0x55f05e63f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.496+0000 7fc596a00640 1 -- 172.21.15.37:0/3028333928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e257990 msgr2=0x55f05e6248c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.496+0000 7fc596a00640 1 --2- 172.21.15.37:0/3028333928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e257990 0x55f05e6248c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.496+0000 7fc596a00640 1 -- 172.21.15.37:0/3028333928 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f05e634510 con 0x55f05e25fb70 2024-09-21T05:59:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.496+0000 7fc597400640 1 --2- 172.21.15.37:0/3028333928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e257990 0x55f05e6248c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.496+0000 7fc596a00640 1 --2- 172.21.15.37:0/3028333928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e25fb70 0x55f05e62dad0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc5840e5370 tx=0x7fc5840096a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d85c2c5eb55cdee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.497+0000 7fc583400640 1 -- 172.21.15.37:0/3028333928 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5840ae0b0 con 0x55f05e25fb70 2024-09-21T05:59:38.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.497+0000 7fc583400640 1 -- 172.21.15.37:0/3028333928 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5840b73d0 con 0x55f05e25fb70 2024-09-21T05:59:38.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.497+0000 7fc583400640 1 -- 172.21.15.37:0/3028333928 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5840b3620 con 0x55f05e25fb70 2024-09-21T05:59:38.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.498+0000 7fc5a4c29740 1 -- 172.21.15.37:0/3028333928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e25fb70 msgr2=0x55f05e62dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:38.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.498+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/3028333928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e25fb70 0x55f05e62dad0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc5840e5370 tx=0x7fc5840096a0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.498+0000 7fc5a4c29740 1 -- 172.21.15.37:0/3028333928 shutdown_connections 2024-09-21T05:59:38.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.498+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/3028333928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e280850 0x55f05e63f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.498+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/3028333928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e25fb70 0x55f05e62dad0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.498+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/3028333928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e257990 0x55f05e6248c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.498+0000 7fc5a4c29740 1 -- 172.21.15.37:0/3028333928 >> 172.21.15.37:0/3028333928 conn(0x55f05e274c40 msgr2=0x55f05e625150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:38.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.498+0000 7fc5a4c29740 1 -- 172.21.15.37:0/3028333928 shutdown_connections 2024-09-21T05:59:38.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.498+0000 7fc5a4c29740 1 -- 172.21.15.37:0/3028333928 wait complete. 2024-09-21T05:59:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.499+0000 7fc5a4c29740 1 -- start start 2024-09-21T05:59:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.499+0000 7fc5a4c29740 1 Processor -- start 2024-09-21T05:59:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.499+0000 7fc5a4c29740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e257990 0x55f05e6ad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.500+0000 7fc5a4c29740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e25fb70 0x55f05e63b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.500+0000 7fc5a4c29740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e280850 0x55f05e63b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.500+0000 7fc5a4c29740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc5981be810 con 0x55f05e280850 2024-09-21T05:59:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.500+0000 7fc5a4c29740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc5981bfc80 con 0x55f05e257990 2024-09-21T05:59:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.500+0000 7fc5a4c29740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc5981beee0 con 0x55f05e25fb70 2024-09-21T05:59:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.500+0000 7fc5a4c29740 10 client.0 _ll_register_callbacks cb 0x7fc5840ad300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.501+0000 7fc596a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e25fb70 0x55f05e63b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.501+0000 7fc596a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e25fb70 0x55f05e63b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:39154/0 (socket says 172.21.15.37:39154) 2024-09-21T05:59:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.501+0000 7fc596a00640 1 -- 172.21.15.37:0/3845272220 learned_addr learned my addr 172.21.15.37:0/3845272220 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.501+0000 7fc597400640 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e257990 0x55f05e6ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.502+0000 7fc596a00640 1 -- 172.21.15.37:0/3845272220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e257990 msgr2=0x55f05e6ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.502+0000 7fc597e00640 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e280850 0x55f05e63b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.502+0000 7fc596a00640 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e257990 0x55f05e6ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.502+0000 7fc596a00640 1 -- 172.21.15.37:0/3845272220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e280850 msgr2=0x55f05e63b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.502+0000 7fc596a00640 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e280850 0x55f05e63b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.502+0000 7fc596a00640 1 -- 172.21.15.37:0/3845272220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f05e63bf50 con 0x55f05e25fb70 2024-09-21T05:59:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.502+0000 7fc597400640 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e257990 0x55f05e6ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.502+0000 7fc597e00640 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e280850 0x55f05e63b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T05:59:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.503+0000 7fc596a00640 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e25fb70 0x55f05e63b420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc5840d50f0 tx=0x7fc5840a9870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f8795f61eeeef29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.503+0000 7fc580c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T05:59:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.503+0000 7fc580c00640 1 -- 172.21.15.37:0/3845272220 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5840ae0b0 con 0x55f05e25fb70 2024-09-21T05:59:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.503+0000 7fc580c00640 1 -- 172.21.15.37:0/3845272220 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fc5840b3620 con 0x55f05e25fb70 2024-09-21T05:59:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.503+0000 7fc5a4c29740 1 -- 172.21.15.37:0/3845272220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5840b73d0 con 0x55f05e25fb70 2024-09-21T05:59:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.504+0000 7fc580c00640 1 -- 172.21.15.37:0/3845272220 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc5840b38a0 con 0x55f05e25fb70 2024-09-21T05:59:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.504+0000 7fc5a4c29740 10 client.25630 fetch_fsmap learned FSMap version 21 2024-09-21T05:59:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.504+0000 7fc5a4c29740 1 -- 172.21.15.37:0/3845272220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f05e63bf50 con 0x55f05e25fb70 2024-09-21T05:59:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.504+0000 7fc580c00640 1 -- 172.21.15.37:0/3845272220 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5840b73d0 con 0x55f05e25fb70 2024-09-21T05:59:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.504+0000 7fc580c00640 1 -- 172.21.15.37:0/3845272220 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc5840aece0 con 0x55f05e25fb70 2024-09-21T05:59:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.504+0000 7fc5a4c29740 10 client.25630 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:59:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.504+0000 7fc5a4c29740 10 client.25630 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:59:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.504+0000 7fc5a4c29740 20 client.25630 populate_metadata read hostname 'smithi037' 2024-09-21T05:59:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.504+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f05e214580 0x55f05e6c3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:38.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.505+0000 7fc5a4c29740 4 client.25630 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}] 2024-09-21T05:59:38.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.505+0000 7fc5a4c29740 1 -- 172.21.15.37:0/3845272220 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}) -- 0x55f05e59b490 con 0x55f05e214580 2024-09-21T05:59:38.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.505+0000 7fc597400640 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f05e214580 0x55f05e6c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:38.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.506+0000 7fc580c00640 10 client.25630 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:38.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:38.506+0000 7fc597400640 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f05e214580 0x55f05e6c3070 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5286f8196bfa1f1f server_cookie=1319f364cd0d5f71 in_seq=0 out_seq=0 2024-09-21T05:59:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.457+0000 7fc580c00640 1 -- 172.21.15.37:0/3845272220 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f05e59b490 con 0x55f05e214580 2024-09-21T05:59:39.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.457+0000 7fc580c00640 10 client.25630 handle_command_reply: tid=0 2024-09-21T05:59:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.457+0000 7fc5a4c29740 1 client.25630 shutdown 2024-09-21T05:59:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.457+0000 7fc5a4c29740 1 -- 172.21.15.37:0/3845272220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e25fb70 msgr2=0x55f05e63b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.457+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e25fb70 0x55f05e63b420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc5840d50f0 tx=0x7fc5840a9870 comp rx=0 tx=0).stop 2024-09-21T05:59:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.457+0000 7fc5a4c29740 1 -- 172.21.15.37:0/3845272220 shutdown_connections 2024-09-21T05:59:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.457+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f05e214580 0x55f05e6c3070 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.457+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f05e280850 0x55f05e63b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.457+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f05e25fb70 0x55f05e63b420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.457+0000 7fc5a4c29740 1 --2- 172.21.15.37:0/3845272220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f05e257990 0x55f05e6ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.457+0000 7fc580c00640 0 client.25630 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.457+0000 7fc5a4c29740 1 -- 172.21.15.37:0/3845272220 >> 172.21.15.37:0/3845272220 conn(0x55f05e274c40 msgr2=0x55f05e6316f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.458+0000 7fc5a4c29740 1 -- 172.21.15.37:0/3845272220 shutdown_connections 2024-09-21T05:59:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.458+0000 7fc5a4c29740 1 -- 172.21.15.37:0/3845272220 wait complete. 2024-09-21T05:59:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.458+0000 7fc5a4c29740 20 client.25630 trim_cache size 0 max 16384 2024-09-21T05:59:39.461 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:59:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:59:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:59:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 26, 2024-09-21T05:59:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:59:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: "61d8a03d": { 2024-09-21T05:59:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 26, 2024-09-21T05:59:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:59:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:59:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:59:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:59:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:59:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:59:39.462 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 139.2, 2024-09-21T05:59:39.463 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:59:39.463 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:59:39.463 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:59:39.463 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:59:39.463 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T05:59:39.463 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:59:39.463 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:39.463 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:39.463 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:39.463 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:39.463 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:39.463 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:59:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.459+0000 7fc59e000640 1 -- 172.21.15.37:0/3408131252 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc57c0b64c0 msgr2=0x7fc57c0b89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.459+0000 7fc59e000640 1 --2- 172.21.15.37:0/3408131252 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc57c0b64c0 0x7fc57c0b89d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc5880057c0 tx=0x7fc588005fd0 comp rx=0 tx=0).stop 2024-09-21T05:59:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.459+0000 7fc59e000640 1 -- 172.21.15.37:0/3408131252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc59810ad10 msgr2=0x7fc5981a9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.459+0000 7fc59e000640 1 --2- 172.21.15.37:0/3408131252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc59810ad10 0x7fc5981a9900 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc58400e9f0 tx=0x7fc58400eeb0 comp rx=0 tx=0).stop 2024-09-21T05:59:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.459+0000 7fc59e000640 1 -- 172.21.15.37:0/3408131252 shutdown_connections 2024-09-21T05:59:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.459+0000 7fc59e000640 1 --2- 172.21.15.37:0/3408131252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc59811d0e0 0x7fc5981aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.459+0000 7fc59e000640 1 --2- 172.21.15.37:0/3408131252 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc57c0b64c0 0x7fc57c0b89d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.459+0000 7fc59e000640 1 --2- 172.21.15.37:0/3408131252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc59810ad10 0x7fc5981a9900 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.459+0000 7fc59e000640 1 --2- 172.21.15.37:0/3408131252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc59810a3c0 0x7fc5981a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.459+0000 7fc59e000640 1 -- 172.21.15.37:0/3408131252 >> 172.21.15.37:0/3408131252 conn(0x7fc598070e80 msgr2=0x7fc598071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.460+0000 7fc59e000640 1 -- 172.21.15.37:0/3408131252 shutdown_connections 2024-09-21T05:59:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:39.460+0000 7fc59e000640 1 -- 172.21.15.37:0/3408131252 wait complete. 2024-09-21T05:59:40.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:39 smithi037 ceph-mon[30631]: pgmap v586: 129 pgs: 129 active+clean; 113 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 476 KiB/s wr, 82 op/s 2024-09-21T05:59:40.239 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '61d8a03d', quiesce took 5.7 seconds. Will release after: 13.55 2024-09-21T05:59:40.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:39 smithi067 ceph-mon[34443]: pgmap v586: 129 pgs: 129 active+clean; 113 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 476 KiB/s wr, 82 op/s 2024-09-21T05:59:40.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:39 smithi144 ceph-mon[34351]: pgmap v586: 129 pgs: 129 active+clean; 113 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 476 KiB/s wr, 82 op/s 2024-09-21T05:59:42.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:41 smithi037 ceph-mon[30631]: pgmap v587: 129 pgs: 129 active+clean; 111 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 642 KiB/s wr, 105 op/s 2024-09-21T05:59:42.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:41 smithi067 ceph-mon[34443]: pgmap v587: 129 pgs: 129 active+clean; 111 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 642 KiB/s wr, 105 op/s 2024-09-21T05:59:42.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:41 smithi144 ceph-mon[34351]: pgmap v587: 129 pgs: 129 active+clean; 111 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 642 KiB/s wr, 105 op/s 2024-09-21T05:59:44.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:43 smithi037 ceph-mon[30631]: pgmap v588: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 880 KiB/s wr, 149 op/s 2024-09-21T05:59:44.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:43 smithi067 ceph-mon[34443]: pgmap v588: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 880 KiB/s wr, 149 op/s 2024-09-21T05:59:44.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:43 smithi144 ceph-mon[34351]: pgmap v588: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 880 KiB/s wr, 149 op/s 2024-09-21T05:59:46.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:45 smithi037 ceph-mon[30631]: pgmap v589: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 KiB/s wr, 151 op/s 2024-09-21T05:59:46.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:45 smithi067 ceph-mon[34443]: pgmap v589: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 KiB/s wr, 151 op/s 2024-09-21T05:59:46.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:45 smithi144 ceph-mon[34351]: pgmap v589: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 KiB/s wr, 151 op/s 2024-09-21T05:59:48.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:47 smithi067 ceph-mon[34443]: pgmap v590: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 886 KiB/s wr, 151 op/s 2024-09-21T05:59:48.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:47 smithi144 ceph-mon[34351]: pgmap v590: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 886 KiB/s wr, 151 op/s 2024-09-21T05:59:48.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:47 smithi037 ceph-mon[30631]: pgmap v590: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 886 KiB/s wr, 151 op/s 2024-09-21T05:59:50.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:49 smithi067 ceph-mon[34443]: pgmap v591: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 597 KiB/s wr, 104 op/s 2024-09-21T05:59:50.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:49 smithi144 ceph-mon[34351]: pgmap v591: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 597 KiB/s wr, 104 op/s 2024-09-21T05:59:50.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:49 smithi037 ceph-mon[30631]: pgmap v591: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 597 KiB/s wr, 104 op/s 2024-09-21T05:59:52.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:51 smithi067 ceph-mon[34443]: pgmap v592: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 411 KiB/s wr, 71 op/s 2024-09-21T05:59:52.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:51 smithi144 ceph-mon[34351]: pgmap v592: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 411 KiB/s wr, 71 op/s 2024-09-21T05:59:52.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:51 smithi037 ceph-mon[30631]: pgmap v592: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 411 KiB/s wr, 71 op/s 2024-09-21T05:59:53.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T05:59:54.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:53 smithi037 ceph-mon[30631]: pgmap v593: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 245 KiB/s wr, 49 op/s 2024-09-21T05:59:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:54.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:53 smithi067 ceph-mon[34443]: pgmap v593: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 245 KiB/s wr, 49 op/s 2024-09-21T05:59:54.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:53 smithi144 ceph-mon[34351]: pgmap v593: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 245 KiB/s wr, 49 op/s 2024-09-21T05:59:54.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.801+0000 7fc82e200640 1 -- 172.21.15.37:0/3387566855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc828105300 msgr2=0x7fc82810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:54.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.801+0000 7fc82e200640 1 --2- 172.21.15.37:0/3387566855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc828105300 0x7fc82810d850 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc810009900 tx=0x7fc81002a3f0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.801+0000 7fc82e200640 1 -- 172.21.15.37:0/3387566855 shutdown_connections 2024-09-21T05:59:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.801+0000 7fc82e200640 1 --2- 172.21.15.37:0/3387566855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc82810de10 0x7fc828110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.801+0000 7fc82e200640 1 --2- 172.21.15.37:0/3387566855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc828105300 0x7fc82810d850 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.801+0000 7fc82e200640 1 --2- 172.21.15.37:0/3387566855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8281049b0 0x7fc828104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.801+0000 7fc82e200640 1 -- 172.21.15.37:0/3387566855 >> 172.21.15.37:0/3387566855 conn(0x7fc828079760 msgr2=0x7fc828079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.801+0000 7fc82e200640 1 -- 172.21.15.37:0/3387566855 shutdown_connections 2024-09-21T05:59:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.801+0000 7fc82e200640 1 -- 172.21.15.37:0/3387566855 wait complete. 2024-09-21T05:59:54.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.802+0000 7fc82e200640 1 Processor -- start 2024-09-21T05:59:54.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.802+0000 7fc82e200640 1 -- start start 2024-09-21T05:59:54.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.803+0000 7fc82e200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8281049b0 0x7fc82819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:54.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.803+0000 7fc82e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc828105300 0x7fc82819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:54.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.803+0000 7fc82e200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc82810de10 0x7fc82819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:54.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.803+0000 7fc82e200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc828113a70 con 0x7fc8281049b0 2024-09-21T05:59:54.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.803+0000 7fc82e200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc8281138f0 con 0x7fc82810de10 2024-09-21T05:59:54.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.803+0000 7fc82e200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc828113bf0 con 0x7fc828105300 2024-09-21T05:59:54.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.803+0000 7fc827400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8281049b0 0x7fc82819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:54.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.803+0000 7fc81fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc828105300 0x7fc82819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:54.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.803+0000 7fc827400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8281049b0 0x7fc82819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59348/0 (socket says 172.21.15.37:59348) 2024-09-21T05:59:54.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.803+0000 7fc827400640 1 -- 172.21.15.37:0/1423082536 learned_addr learned my addr 172.21.15.37:0/1423082536 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:54.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.803+0000 7fc827e00640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc82810de10 0x7fc82819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:54.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.804+0000 7fc81fe00640 1 -- 172.21.15.37:0/1423082536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc82810de10 msgr2=0x7fc82819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:54.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.804+0000 7fc81fe00640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc82810de10 0x7fc82819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.804+0000 7fc81fe00640 1 -- 172.21.15.37:0/1423082536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8281049b0 msgr2=0x7fc82819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:54.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.804+0000 7fc81fe00640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8281049b0 0x7fc82819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:54.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.804+0000 7fc81fe00640 1 -- 172.21.15.37:0/1423082536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8281a0410 con 0x7fc828105300 2024-09-21T05:59:54.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.804+0000 7fc827400640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8281049b0 0x7fc82819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:54.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.804+0000 7fc81fe00640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc828105300 0x7fc82819aa40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc81002a910 tx=0x7fc810031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:54.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.804+0000 7fc824c00640 1 -- 172.21.15.37:0/1423082536 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81003f070 con 0x7fc828105300 2024-09-21T05:59:54.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.805+0000 7fc82e200640 1 -- 172.21.15.37:0/1423082536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8281a06a0 con 0x7fc828105300 2024-09-21T05:59:54.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.805+0000 7fc824c00640 1 -- 172.21.15.37:0/1423082536 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc810004490 con 0x7fc828105300 2024-09-21T05:59:54.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.805+0000 7fc824c00640 1 -- 172.21.15.37:0/1423082536 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810035070 con 0x7fc828105300 2024-09-21T05:59:54.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.805+0000 7fc82e200640 1 -- 172.21.15.37:0/1423082536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8281a6e60 con 0x7fc828105300 2024-09-21T05:59:54.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.806+0000 7fc82e200640 1 -- 172.21.15.37:0/1423082536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc82806c2c0 con 0x7fc828105300 2024-09-21T05:59:54.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.808+0000 7fc824c00640 1 -- 172.21.15.37:0/1423082536 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc81003b460 con 0x7fc828105300 2024-09-21T05:59:54.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.810+0000 7fc824c00640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc80c0b6510 0x7fc80c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:54.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.810+0000 7fc824c00640 1 -- 172.21.15.37:0/1423082536 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fc810107db0 con 0x7fc828105300 2024-09-21T05:59:54.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.810+0000 7fc827400640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc80c0b6510 0x7fc80c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:54.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.811+0000 7fc827400640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc80c0b6510 0x7fc80c0b8a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc8180095f0 tx=0x7fc818005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:54.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:54.812+0000 7fc824c00640 1 -- 172.21.15.37:0/1423082536 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8100d25f0 con 0x7fc828105300 2024-09-21T05:59:55.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.052+0000 7fc82e200640 1 -- 172.21.15.37:0/1423082536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc828104dc0 con 0x7fc828105300 2024-09-21T05:59:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.053+0000 7fc824c00640 1 -- 172.21.15.37:0/1423082536 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7fc828104dc0 con 0x7fc828105300 2024-09-21T05:59:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T05:59:55.056 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T05:59:55.056 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T05:59:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.056+0000 7fc82e200640 1 -- 172.21.15.37:0/1423082536 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc80c0b6510 msgr2=0x7fc80c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:55.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.056+0000 7fc82e200640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc80c0b6510 0x7fc80c0b8a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc8180095f0 tx=0x7fc818005f90 comp rx=0 tx=0).stop 2024-09-21T05:59:55.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.056+0000 7fc82e200640 1 -- 172.21.15.37:0/1423082536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc828105300 msgr2=0x7fc82819aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:55.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.056+0000 7fc82e200640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc828105300 0x7fc82819aa40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc81002a910 tx=0x7fc810031a20 comp rx=0 tx=0).stop 2024-09-21T05:59:55.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.056+0000 7fc82e200640 1 -- 172.21.15.37:0/1423082536 shutdown_connections 2024-09-21T05:59:55.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.056+0000 7fc82e200640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc80c0b6510 0x7fc80c0b8a20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.056+0000 7fc82e200640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc82810de10 0x7fc82819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.056+0000 7fc82e200640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc828105300 0x7fc82819aa40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.056+0000 7fc82e200640 1 --2- 172.21.15.37:0/1423082536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8281049b0 0x7fc82819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:55.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.056+0000 7fc82e200640 1 -- 172.21.15.37:0/1423082536 >> 172.21.15.37:0/1423082536 conn(0x7fc828079760 msgr2=0x7fc828107930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:55.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.056+0000 7fc82e200640 1 -- 172.21.15.37:0/1423082536 shutdown_connections 2024-09-21T05:59:55.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:55.056+0000 7fc82e200640 1 -- 172.21.15.37:0/1423082536 wait complete. 2024-09-21T05:59:55.952 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db --set-id 61d8a03d --release --await' 2024-09-21T05:59:55.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db --set-id 61d8a03d --release --await 2024-09-21T05:59:56.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:55 smithi037 ceph-mon[30631]: pgmap v594: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 6.5 KiB/s wr, 5 op/s 2024-09-21T05:59:56.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:55 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1423082536' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:55 smithi067 ceph-mon[34443]: pgmap v594: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 6.5 KiB/s wr, 5 op/s 2024-09-21T05:59:56.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:55 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1423082536' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:56.335 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:59:56.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:55 smithi144 ceph-mon[34351]: pgmap v594: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 6.5 KiB/s wr, 5 op/s 2024-09-21T05:59:56.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:55 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1423082536' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T05:59:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.994+0000 7f6b7a000640 1 -- 172.21.15.37:0/994351216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b7410ff70 msgr2=0x7f6b74112390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.994+0000 7f6b7a000640 1 --2- 172.21.15.37:0/994351216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b7410ff70 0x7f6b74112390 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c009ca0 tx=0x7f6b6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T05:59:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.994+0000 7f6b7a000640 1 -- 172.21.15.37:0/994351216 shutdown_connections 2024-09-21T05:59:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.994+0000 7f6b7a000640 1 --2- 172.21.15.37:0/994351216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b7410ff70 0x7f6b74112390 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.994+0000 7f6b7a000640 1 --2- 172.21.15.37:0/994351216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b740760a0 0x7f6b7410fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.994+0000 7f6b7a000640 1 --2- 172.21.15.37:0/994351216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b74075750 0x7f6b74075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.994+0000 7f6b7a000640 1 -- 172.21.15.37:0/994351216 >> 172.21.15.37:0/994351216 conn(0x7f6b740ff400 msgr2=0x7f6b74101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.994+0000 7f6b7a000640 1 -- 172.21.15.37:0/994351216 shutdown_connections 2024-09-21T05:59:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.994+0000 7f6b7a000640 1 -- 172.21.15.37:0/994351216 wait complete. 2024-09-21T05:59:56.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.995+0000 7f6b7a000640 1 Processor -- start 2024-09-21T05:59:56.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.995+0000 7f6b7a000640 1 -- start start 2024-09-21T05:59:56.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b7a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74075750 0x7f6b7419c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:56.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b7a000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b740760a0 0x7f6b7419ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:56.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b7a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b7410ff70 0x7f6b741a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:56.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b7a000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b74115b30 con 0x7f6b74075750 2024-09-21T05:59:56.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b7a000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b741159b0 con 0x7f6b740760a0 2024-09-21T05:59:56.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b7a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6b74115cb0 con 0x7f6b7410ff70 2024-09-21T05:59:56.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b78c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74075750 0x7f6b7419c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:56.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b78c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74075750 0x7f6b7419c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59366/0 (socket says 172.21.15.37:59366) 2024-09-21T05:59:56.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b78c00640 1 -- 172.21.15.37:0/826029279 learned_addr learned my addr 172.21.15.37:0/826029279 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:56.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b73e00640 1 --2- 172.21.15.37:0/826029279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b740760a0 0x7f6b7419ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b78c00640 1 -- 172.21.15.37:0/826029279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b7410ff70 msgr2=0x7f6b741a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b78c00640 1 --2- 172.21.15.37:0/826029279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b7410ff70 0x7f6b741a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b78c00640 1 -- 172.21.15.37:0/826029279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b740760a0 msgr2=0x7f6b7419ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b78c00640 1 --2- 172.21.15.37:0/826029279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b740760a0 0x7f6b7419ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.996+0000 7f6b78c00640 1 -- 172.21.15.37:0/826029279 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b741a23f0 con 0x7f6b74075750 2024-09-21T05:59:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.997+0000 7f6b78c00640 1 --2- 172.21.15.37:0/826029279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74075750 0x7f6b7419c480 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800e9f0 tx=0x7f6b6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.997+0000 7f6b71600640 1 -- 172.21.15.37:0/826029279 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800cd80 con 0x7f6b74075750 2024-09-21T05:59:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.997+0000 7f6b71600640 1 -- 172.21.15.37:0/826029279 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b680108e0 con 0x7f6b74075750 2024-09-21T05:59:57.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.997+0000 7f6b7a000640 1 -- 172.21.15.37:0/826029279 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b741a26e0 con 0x7f6b74075750 2024-09-21T05:59:57.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.997+0000 7f6b71600640 1 -- 172.21.15.37:0/826029279 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b68018980 con 0x7f6b74075750 2024-09-21T05:59:57.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:56.997+0000 7f6b7a000640 1 -- 172.21.15.37:0/826029279 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b741a8e40 con 0x7f6b74075750 2024-09-21T05:59:57.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.002+0000 7f6b823ff740 1 Processor -- start 2024-09-21T05:59:57.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.002+0000 7f6b823ff740 1 -- start start 2024-09-21T05:59:57.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.002+0000 7f6b823ff740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1ab3520 0x5654e1e5a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.002+0000 7f6b823ff740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1a8a660 0x5654e1e5a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.002+0000 7f6b823ff740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e5adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.002+0000 7f6b823ff740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5654e1dd1290 con 0x5654e1a8a660 2024-09-21T05:59:57.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.002+0000 7f6b823ff740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5654e1dc06c0 con 0x5654e1a92840 2024-09-21T05:59:57.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.002+0000 7f6b823ff740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5654e1dc44d0 con 0x5654e1ab3520 2024-09-21T05:59:57.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.003+0000 7f6b79600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1ab3520 0x5654e1e5a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.003+0000 7f6b71600640 1 -- 172.21.15.37:0/826029279 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f6b68010430 con 0x7f6b74075750 2024-09-21T05:59:57.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.003+0000 7f6b79600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1ab3520 0x5654e1e5a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47058/0 (socket says 172.21.15.37:47058) 2024-09-21T05:59:57.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.003+0000 7f6b79600640 1 -- 172.21.15.37:0/1679129972 learned_addr learned my addr 172.21.15.37:0/1679129972 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:57.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.003+0000 7f6b73e00640 1 --2- 172.21.15.37:0/1679129972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e5adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.003+0000 7f6b78c00640 1 --2- 172.21.15.37:0/1679129972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1a8a660 0x5654e1e5a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.003+0000 7f6b73e00640 1 -- 172.21.15.37:0/1679129972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1ab3520 msgr2=0x5654e1e5a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.003+0000 7f6b73e00640 1 --2- 172.21.15.37:0/1679129972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1ab3520 0x5654e1e5a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.003+0000 7f6b73e00640 1 -- 172.21.15.37:0/1679129972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1a8a660 msgr2=0x5654e1e5a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.003+0000 7f6b73e00640 1 --2- 172.21.15.37:0/1679129972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1a8a660 0x5654e1e5a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.003+0000 7f6b73e00640 1 -- 172.21.15.37:0/1679129972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654e1d4d460 con 0x5654e1a92840 2024-09-21T05:59:57.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.004+0000 7f6b73e00640 1 --2- 172.21.15.37:0/1679129972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e5adc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6b7406b930 tx=0x7f6b60011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3e780dff7e0a67a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:57.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.004+0000 7f6b65c00640 1 -- 172.21.15.37:0/1679129972 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60009d70 con 0x5654e1a92840 2024-09-21T05:59:57.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.004+0000 7f6b65c00640 1 -- 172.21.15.37:0/1679129972 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b600198c0 con 0x5654e1a92840 2024-09-21T05:59:57.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.004+0000 7f6b65c00640 1 -- 172.21.15.37:0/1679129972 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60018910 con 0x5654e1a92840 2024-09-21T05:59:57.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.005+0000 7f6b823ff740 1 -- 172.21.15.37:0/1679129972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 msgr2=0x5654e1e5adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.005+0000 7f6b823ff740 1 --2- 172.21.15.37:0/1679129972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e5adc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6b7406b930 tx=0x7f6b60011810 comp rx=0 tx=0).stop 2024-09-21T05:59:57.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.005+0000 7f6b823ff740 1 -- 172.21.15.37:0/1679129972 shutdown_connections 2024-09-21T05:59:57.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.005+0000 7f6b823ff740 1 --2- 172.21.15.37:0/1679129972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e5adc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.005+0000 7f6b823ff740 1 --2- 172.21.15.37:0/1679129972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1a8a660 0x5654e1e5a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.005+0000 7f6b823ff740 1 --2- 172.21.15.37:0/1679129972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1ab3520 0x5654e1e5a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.005+0000 7f6b823ff740 1 -- 172.21.15.37:0/1679129972 >> 172.21.15.37:0/1679129972 conn(0x5654e1aa7910 msgr2=0x5654e1e58230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:57.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.005+0000 7f6b823ff740 1 -- 172.21.15.37:0/1679129972 shutdown_connections 2024-09-21T05:59:57.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.005+0000 7f6b71600640 1 --2- 172.21.15.37:0/826029279 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6b5c0b6540 0x7f6b5c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.006+0000 7f6b823ff740 1 -- 172.21.15.37:0/1679129972 wait complete. 2024-09-21T05:59:57.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.006+0000 7f6b71600640 1 -- 172.21.15.37:0/826029279 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f6b680e7d70 con 0x7f6b74075750 2024-09-21T05:59:57.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.006+0000 7f6b73e00640 1 --2- 172.21.15.37:0/826029279 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6b5c0b6540 0x7f6b5c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.006+0000 7f6b823ff740 1 -- start start 2024-09-21T05:59:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.006+0000 7f6b823ff740 1 Processor -- start 2024-09-21T05:59:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.006+0000 7f6b73e00640 1 --2- 172.21.15.37:0/826029279 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6b5c0b6540 0x7f6b5c0b8a50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6b600099b0 tx=0x7f6b60009770 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b823ff740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e65e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b823ff740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b823ff740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1ab3520 0x5654e1e71e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b823ff740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5654e1c21bb0 con 0x5654e1ab3520 2024-09-21T05:59:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b823ff740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5654e1d5b6c0 con 0x5654e1a92840 2024-09-21T05:59:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b823ff740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5654e1e68b20 con 0x5654e1a8a660 2024-09-21T05:59:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b823ff740 10 client.0 _ll_register_callbacks cb 0x5654e1d76490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b79600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1ab3520 0x5654e1e71e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b78c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e65e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b73e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b79600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1ab3520 0x5654e1e71e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59384/0 (socket says 172.21.15.37:59384) 2024-09-21T05:59:57.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b78c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e65e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47060/0 (socket says 172.21.15.37:47060) 2024-09-21T05:59:57.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b79600640 1 -- 172.21.15.37:0/2124261785 learned_addr learned my addr 172.21.15.37:0/2124261785 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:57.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.007+0000 7f6b73e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e663a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:53344/0 (socket says 172.21.15.37:53344) 2024-09-21T05:59:57.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.008+0000 7f6b73e00640 1 -- 172.21.15.37:0/2124261785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 msgr2=0x5654e1e65e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.008+0000 7f6b73e00640 1 --2- 172.21.15.37:0/2124261785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e65e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.008+0000 7f6b73e00640 1 -- 172.21.15.37:0/2124261785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1ab3520 msgr2=0x5654e1e71e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.008+0000 7f6b73e00640 1 --2- 172.21.15.37:0/2124261785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1ab3520 0x5654e1e71e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.008+0000 7f6b73e00640 1 -- 172.21.15.37:0/2124261785 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654e1b1eb00 con 0x5654e1a92840 2024-09-21T05:59:57.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.008+0000 7f6b73e00640 1 --2- 172.21.15.37:0/2124261785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e663a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6b600185f0 tx=0x7f6b60018450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=814f5b057c867046 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:57.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.008+0000 7f6b5a000640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.009+0000 7f6b5a000640 1 -- 172.21.15.37:0/2124261785 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60034060 con 0x5654e1a92840 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.009+0000 7f6b5a000640 1 -- 172.21.15.37:0/2124261785 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f6b60016040 con 0x5654e1a92840 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.009+0000 7f6b823ff740 1 -- 172.21.15.37:0/2124261785 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b600198c0 con 0x5654e1a92840 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.009+0000 7f6b5a000640 1 -- 172.21.15.37:0/2124261785 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6b6003b050 con 0x5654e1a92840 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.009+0000 7f6b823ff740 10 client.25631 fetch_fsmap learned FSMap version 21 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.009+0000 7f6b823ff740 1 -- 172.21.15.37:0/2124261785 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5654e1b95960 con 0x5654e1a92840 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.009+0000 7f6b5a000640 1 -- 172.21.15.37:0/2124261785 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b600198c0 con 0x5654e1a92840 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.009+0000 7f6b5a000640 1 -- 172.21.15.37:0/2124261785 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6b600187b0 con 0x5654e1a92840 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.010+0000 7f6b823ff740 10 client.25631 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.010+0000 7f6b823ff740 10 client.25631 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.010+0000 7f6b823ff740 20 client.25631 populate_metadata read hostname 'smithi037' 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.010+0000 7f6b823ff740 1 --2- 172.21.15.37:0/2124261785 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5654e1a71ea0 0x5654e1e77c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.010+0000 7f6b823ff740 4 client.25631 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.010+0000 7f6b823ff740 1 -- 172.21.15.37:0/2124261785 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654e1dd31e0 con 0x5654e1a71ea0 2024-09-21T05:59:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.010+0000 7f6b78c00640 1 --2- 172.21.15.37:0/2124261785 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5654e1a71ea0 0x5654e1e77c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.010+0000 7f6b78c00640 1 --2- 172.21.15.37:0/2124261785 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5654e1a71ea0 0x5654e1e77c00 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d13fa1058bcdc337 server_cookie=fc84e2737e4e650b in_seq=0 out_seq=0 2024-09-21T05:59:57.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.011+0000 7f6b5a000640 10 client.25631 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:57.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.011+0000 7f6b5a000640 1 -- 172.21.15.37:0/2124261785 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5654e1dd31e0 con 0x5654e1a71ea0 2024-09-21T05:59:57.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.011+0000 7f6b5a000640 10 client.25631 handle_command_reply: tid=0 2024-09-21T05:59:57.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.011+0000 7f6b823ff740 1 client.25631 shutdown 2024-09-21T05:59:57.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.012+0000 7f6b823ff740 1 -- 172.21.15.37:0/2124261785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 msgr2=0x5654e1e663a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.012+0000 7f6b823ff740 1 --2- 172.21.15.37:0/2124261785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e663a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6b600185f0 tx=0x7f6b60018450 comp rx=0 tx=0).stop 2024-09-21T05:59:57.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.012+0000 7f6b823ff740 1 -- 172.21.15.37:0/2124261785 shutdown_connections 2024-09-21T05:59:57.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.012+0000 7f6b823ff740 1 --2- 172.21.15.37:0/2124261785 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5654e1a71ea0 0x5654e1e77c00 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.012+0000 7f6b823ff740 1 --2- 172.21.15.37:0/2124261785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1ab3520 0x5654e1e71e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.012+0000 7f6b823ff740 1 --2- 172.21.15.37:0/2124261785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e663a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.012+0000 7f6b823ff740 1 --2- 172.21.15.37:0/2124261785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e65e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.012+0000 7f6b5a000640 0 client.25631 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:57.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.012+0000 7f6b823ff740 1 -- 172.21.15.37:0/2124261785 >> 172.21.15.37:0/2124261785 conn(0x5654e1aa7910 msgr2=0x5654e1e5d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:57.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.012+0000 7f6b823ff740 1 -- 172.21.15.37:0/2124261785 shutdown_connections 2024-09-21T05:59:57.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.012+0000 7f6b823ff740 1 -- 172.21.15.37:0/2124261785 wait complete. 2024-09-21T05:59:57.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.012+0000 7f6b823ff740 20 client.25631 trim_cache size 0 max 16384 2024-09-21T05:59:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.030+0000 7f6b823ff740 1 Processor -- start 2024-09-21T05:59:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.030+0000 7f6b823ff740 1 -- start start 2024-09-21T05:59:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.031+0000 7f6b823ff740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e5db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.031+0000 7f6b823ff740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e5f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.031+0000 7f6b823ff740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1ab3520 0x5654e1e5f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.031+0000 7f6b823ff740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b741b0ce0 con 0x5654e1ab3520 2024-09-21T05:59:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.031+0000 7f6b823ff740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b741b3560 con 0x5654e1a92840 2024-09-21T05:59:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.031+0000 7f6b823ff740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6b741b1350 con 0x5654e1a8a660 2024-09-21T05:59:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.031+0000 7f6b79600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1ab3520 0x5654e1e5f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.031+0000 7f6b79600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1ab3520 0x5654e1e5f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59392/0 (socket says 172.21.15.37:59392) 2024-09-21T05:59:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.031+0000 7f6b79600640 1 -- 172.21.15.37:0/2083726493 learned_addr learned my addr 172.21.15.37:0/2083726493 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.031+0000 7f6b78c00640 1 --2- 172.21.15.37:0/2083726493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e5db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.031+0000 7f6b73e00640 1 --2- 172.21.15.37:0/2083726493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e5f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.032+0000 7f6b79600640 1 -- 172.21.15.37:0/2083726493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 msgr2=0x5654e1e5db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.032+0000 7f6b79600640 1 --2- 172.21.15.37:0/2083726493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e5db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.032+0000 7f6b79600640 1 -- 172.21.15.37:0/2083726493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 msgr2=0x5654e1e5f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.032+0000 7f6b79600640 1 --2- 172.21.15.37:0/2083726493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e5f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.032+0000 7f6b79600640 1 -- 172.21.15.37:0/2083726493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654e1e61510 con 0x5654e1ab3520 2024-09-21T05:59:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.032+0000 7f6b73e00640 1 --2- 172.21.15.37:0/2083726493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e5f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:57.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.032+0000 7f6b78c00640 1 --2- 172.21.15.37:0/2083726493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e5db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:57.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.032+0000 7f6b79600640 1 --2- 172.21.15.37:0/2083726493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1ab3520 0x5654e1e5f910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c02f530 tx=0x7f6b6c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6907da3f648843 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:57.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.032+0000 7f6b65200640 1 -- 172.21.15.37:0/2083726493 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c031af0 con 0x5654e1ab3520 2024-09-21T05:59:57.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.032+0000 7f6b65200640 1 -- 172.21.15.37:0/2083726493 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b6c036040 con 0x5654e1ab3520 2024-09-21T05:59:57.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.032+0000 7f6b65200640 1 -- 172.21.15.37:0/2083726493 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c004040 con 0x5654e1ab3520 2024-09-21T05:59:57.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.033+0000 7f6b823ff740 1 -- 172.21.15.37:0/2083726493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1ab3520 msgr2=0x5654e1e5f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.033+0000 7f6b823ff740 1 --2- 172.21.15.37:0/2083726493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1ab3520 0x5654e1e5f910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c02f530 tx=0x7f6b6c009800 comp rx=0 tx=0).stop 2024-09-21T05:59:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.033+0000 7f6b823ff740 1 -- 172.21.15.37:0/2083726493 shutdown_connections 2024-09-21T05:59:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.033+0000 7f6b823ff740 1 --2- 172.21.15.37:0/2083726493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1ab3520 0x5654e1e5f910 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.033+0000 7f6b823ff740 1 --2- 172.21.15.37:0/2083726493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1a92840 0x5654e1e5f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.033+0000 7f6b823ff740 1 --2- 172.21.15.37:0/2083726493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e5db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.033+0000 7f6b823ff740 1 -- 172.21.15.37:0/2083726493 >> 172.21.15.37:0/2083726493 conn(0x5654e1aa7910 msgr2=0x5654e1e5d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.033+0000 7f6b823ff740 1 -- 172.21.15.37:0/2083726493 shutdown_connections 2024-09-21T05:59:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.033+0000 7f6b823ff740 1 -- 172.21.15.37:0/2083726493 wait complete. 2024-09-21T05:59:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.034+0000 7f6b823ff740 1 -- start start 2024-09-21T05:59:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.034+0000 7f6b823ff740 1 Processor -- start 2024-09-21T05:59:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.034+0000 7f6b823ff740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e6a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.034+0000 7f6b823ff740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1a92840 0x5654e1e6aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.034+0000 7f6b823ff740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1ab3520 0x5654e1edb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b823ff740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b741b1a20 con 0x5654e1a92840 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b823ff740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b741b2e90 con 0x5654e1ab3520 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b823ff740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6b741b20f0 con 0x5654e1a8a660 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b823ff740 10 client.0 _ll_register_callbacks cb 0x7f6b60005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b78c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e6a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b73e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1a92840 0x5654e1e6aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b78c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e6a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47084/0 (socket says 172.21.15.37:47084) 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b78c00640 1 -- 172.21.15.37:0/3336198372 learned_addr learned my addr 172.21.15.37:0/3336198372 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b79600640 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1ab3520 0x5654e1edb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b78c00640 1 -- 172.21.15.37:0/3336198372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1ab3520 msgr2=0x5654e1edb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b78c00640 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1ab3520 0x5654e1edb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b78c00640 1 -- 172.21.15.37:0/3336198372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1a92840 msgr2=0x5654e1e6aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b78c00640 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1a92840 0x5654e1e6aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b78c00640 1 -- 172.21.15.37:0/3336198372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654e1edbcf0 con 0x5654e1a8a660 2024-09-21T05:59:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b73e00640 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1a92840 0x5654e1e6aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T05:59:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.035+0000 7f6b79600640 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1ab3520 0x5654e1edb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T05:59:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.036+0000 7f6b78c00640 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e6a920 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800e9c0 tx=0x7f6b68000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fd026a755f39743 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T05:59:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.036+0000 7f6b5a000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T05:59:57.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.036+0000 7f6b5a000640 1 -- 172.21.15.37:0/3336198372 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b680ad5e0 con 0x5654e1a8a660 2024-09-21T05:59:57.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.036+0000 7f6b823ff740 1 -- 172.21.15.37:0/3336198372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b6c036040 con 0x5654e1a8a660 2024-09-21T05:59:57.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.036+0000 7f6b5a000640 1 -- 172.21.15.37:0/3336198372 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f6b680a9040 con 0x5654e1a8a660 2024-09-21T05:59:57.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.036+0000 7f6b5a000640 1 -- 172.21.15.37:0/3336198372 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6b680ae1d0 con 0x5654e1a8a660 2024-09-21T05:59:57.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.036+0000 7f6b823ff740 10 client.25651 fetch_fsmap learned FSMap version 21 2024-09-21T05:59:57.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.036+0000 7f6b823ff740 1 -- 172.21.15.37:0/3336198372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5654e1ee3170 con 0x5654e1a8a660 2024-09-21T05:59:57.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.036+0000 7f6b5a000640 1 -- 172.21.15.37:0/3336198372 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b6c036040 con 0x5654e1a8a660 2024-09-21T05:59:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.036+0000 7f6b5a000640 1 -- 172.21.15.37:0/3336198372 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6b680b2210 con 0x5654e1a8a660 2024-09-21T05:59:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.036+0000 7f6b823ff740 10 client.25651 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T05:59:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.036+0000 7f6b823ff740 10 client.25651 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T05:59:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.037+0000 7f6b823ff740 20 client.25651 populate_metadata read hostname 'smithi037' 2024-09-21T05:59:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.037+0000 7f6b823ff740 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5654e1a47250 0x5654e1ee5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T05:59:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.037+0000 7f6b823ff740 4 client.25651 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "61d8a03d", "release": true, "await": true}] 2024-09-21T05:59:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.037+0000 7f6b823ff740 1 -- 172.21.15.37:0/3336198372 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "set_id": "61d8a03d", "release": true, "await": true}) -- 0x5654e1dcec90 con 0x5654e1a47250 2024-09-21T05:59:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.037+0000 7f6b73e00640 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5654e1a47250 0x5654e1ee5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T05:59:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.037+0000 7f6b73e00640 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5654e1a47250 0x5654e1ee5840 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a28899f862491d98 server_cookie=581a4964eb29472a in_seq=0 out_seq=0 2024-09-21T05:59:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.037+0000 7f6b5a000640 10 client.25651 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b5a000640 1 -- 172.21.15.37:0/3336198372 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5654e1dcec90 con 0x5654e1a47250 2024-09-21T05:59:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b5a000640 10 client.25651 handle_command_reply: tid=0 2024-09-21T05:59:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b823ff740 1 client.25651 shutdown 2024-09-21T05:59:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b823ff740 1 -- 172.21.15.37:0/3336198372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 msgr2=0x5654e1e6a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b823ff740 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e6a920 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800e9c0 tx=0x7f6b68000bc0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b823ff740 1 -- 172.21.15.37:0/3336198372 shutdown_connections 2024-09-21T05:59:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b823ff740 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5654e1a47250 0x5654e1ee5840 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b823ff740 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5654e1ab3520 0x5654e1edb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b5a000640 0 client.25651 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T05:59:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b823ff740 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654e1a92840 0x5654e1e6aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b823ff740 1 --2- 172.21.15.37:0/3336198372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e1a8a660 0x5654e1e6a920 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b823ff740 1 -- 172.21.15.37:0/3336198372 >> 172.21.15.37:0/3336198372 conn(0x5654e1aa7910 msgr2=0x5654e1e5b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b823ff740 1 -- 172.21.15.37:0/3336198372 shutdown_connections 2024-09-21T05:59:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b823ff740 1 -- 172.21.15.37:0/3336198372 wait complete. 2024-09-21T05:59:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.284+0000 7f6b823ff740 20 client.25651 trim_cache size 0 max 16384 2024-09-21T05:59:57.288 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T05:59:57.288 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T05:59:57.288 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T05:59:57.288 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 28, 2024-09-21T05:59:57.288 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T05:59:57.288 INFO:teuthology.orchestra.run.smithi037.stdout: "61d8a03d": { 2024-09-21T05:59:57.288 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 28, 2024-09-21T05:59:57.288 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T05:59:57.288 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:59:57.288 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:59:57.288 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:59:57.288 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 139.2, 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T05:59:57.289 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T05:59:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.285+0000 7f6b7a000640 1 -- 172.21.15.37:0/826029279 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6b5c0b6540 msgr2=0x7f6b5c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.285+0000 7f6b7a000640 1 --2- 172.21.15.37:0/826029279 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6b5c0b6540 0x7f6b5c0b8a50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6b600099b0 tx=0x7f6b60009770 comp rx=0 tx=0).stop 2024-09-21T05:59:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.285+0000 7f6b7a000640 1 -- 172.21.15.37:0/826029279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74075750 msgr2=0x7f6b7419c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T05:59:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.285+0000 7f6b7a000640 1 --2- 172.21.15.37:0/826029279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74075750 0x7f6b7419c480 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800e9f0 tx=0x7f6b6800eeb0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.285+0000 7f6b7a000640 1 -- 172.21.15.37:0/826029279 shutdown_connections 2024-09-21T05:59:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.285+0000 7f6b7a000640 1 --2- 172.21.15.37:0/826029279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b7410ff70 0x7f6b741a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.285+0000 7f6b7a000640 1 --2- 172.21.15.37:0/826029279 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f6b5c0b6540 0x7f6b5c0b8a50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.285+0000 7f6b7a000640 1 --2- 172.21.15.37:0/826029279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b740760a0 0x7f6b7419ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.285+0000 7f6b7a000640 1 --2- 172.21.15.37:0/826029279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74075750 0x7f6b7419c480 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T05:59:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.285+0000 7f6b7a000640 1 -- 172.21.15.37:0/826029279 >> 172.21.15.37:0/826029279 conn(0x7f6b740ff400 msgr2=0x7f6b74109a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T05:59:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.286+0000 7f6b7a000640 1 -- 172.21.15.37:0/826029279 shutdown_connections 2024-09-21T05:59:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T05:59:57.286+0000 7f6b7a000640 1 -- 172.21.15.37:0/826029279 wait complete. 2024-09-21T05:59:58.048 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:57 smithi037 ceph-mon[30631]: pgmap v595: 129 pgs: 129 active+clean; 118 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T05:59:58.110 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '61d8a03d', total seconds elapsed: 23.6 2024-09-21T05:59:58.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:57 smithi067 ceph-mon[34443]: pgmap v595: 129 pgs: 129 active+clean; 118 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T05:59:58.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:57 smithi144 ceph-mon[34351]: pgmap v595: 129 pgs: 129 active+clean; 118 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T05:59:58.928 INFO:tasks.workunit.client.0.smithi037.stdout:30000 trunc from 0x7a5444 to 0x143a5 2024-09-21T06:00:00.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 05:59:59 smithi067 ceph-mon[34443]: pgmap v596: 129 pgs: 129 active+clean; 118 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 28 KiB/s wr, 4 op/s 2024-09-21T06:00:00.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 05:59:59 smithi144 ceph-mon[34351]: pgmap v596: 129 pgs: 129 active+clean; 118 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 28 KiB/s wr, 4 op/s 2024-09-21T06:00:00.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 05:59:59 smithi037 ceph-mon[30631]: pgmap v596: 129 pgs: 129 active+clean; 118 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 28 KiB/s wr, 4 op/s 2024-09-21T06:00:01.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:00 smithi067 ceph-mon[34443]: overall HEALTH_OK 2024-09-21T06:00:01.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:00 smithi144 ceph-mon[34351]: overall HEALTH_OK 2024-09-21T06:00:01.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:00 smithi037 ceph-mon[30631]: overall HEALTH_OK 2024-09-21T06:00:02.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:01 smithi067 ceph-mon[34443]: pgmap v597: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 198 KiB/s wr, 25 op/s 2024-09-21T06:00:02.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:01 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:00:02.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:01 smithi144 ceph-mon[34351]: pgmap v597: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 198 KiB/s wr, 25 op/s 2024-09-21T06:00:02.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:01 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:00:02.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:01 smithi037 ceph-mon[30631]: pgmap v597: 129 pgs: 129 active+clean; 114 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 198 KiB/s wr, 25 op/s 2024-09-21T06:00:02.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:01 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:00:03.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:00:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:00:03.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:02 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:00:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:00:03.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:00:03.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:02 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:00:03.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:00:03.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:00:03.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:00:03.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:02 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:00:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:03 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi067 to 176.0M 2024-09-21T06:00:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:03 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi144 to 176.0M 2024-09-21T06:00:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:03 smithi067 ceph-mon[34443]: Unable to set osd_memory_target on smithi067 to 184598220: error parsing value: Value '184598220' is below minimum 939524096 2024-09-21T06:00:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:03 smithi067 ceph-mon[34443]: Unable to set osd_memory_target on smithi144 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:00:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:03 smithi067 ceph-mon[34443]: pgmap v598: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 487 KiB/s wr, 86 op/s 2024-09-21T06:00:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:03 smithi067 ceph-mon[34443]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-09-21T06:00:04.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:03 smithi067 ceph-mon[34443]: Unable to set osd_memory_target on smithi037 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-21T06:00:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:03 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi067 to 176.0M 2024-09-21T06:00:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:03 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi144 to 176.0M 2024-09-21T06:00:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:03 smithi144 ceph-mon[34351]: Unable to set osd_memory_target on smithi067 to 184598220: error parsing value: Value '184598220' is below minimum 939524096 2024-09-21T06:00:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:03 smithi144 ceph-mon[34351]: Unable to set osd_memory_target on smithi144 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:00:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:03 smithi144 ceph-mon[34351]: pgmap v598: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 487 KiB/s wr, 86 op/s 2024-09-21T06:00:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:03 smithi144 ceph-mon[34351]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-09-21T06:00:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:03 smithi144 ceph-mon[34351]: Unable to set osd_memory_target on smithi037 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-21T06:00:04.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:03 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi067 to 176.0M 2024-09-21T06:00:04.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:03 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi144 to 176.0M 2024-09-21T06:00:04.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:03 smithi037 ceph-mon[30631]: Unable to set osd_memory_target on smithi067 to 184598220: error parsing value: Value '184598220' is below minimum 939524096 2024-09-21T06:00:04.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:03 smithi037 ceph-mon[30631]: Unable to set osd_memory_target on smithi144 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:00:04.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:03 smithi037 ceph-mon[30631]: pgmap v598: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 487 KiB/s wr, 86 op/s 2024-09-21T06:00:04.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:03 smithi037 ceph-mon[30631]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-09-21T06:00:04.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:03 smithi037 ceph-mon[30631]: Unable to set osd_memory_target on smithi037 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-21T06:00:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:05 smithi067 ceph-mon[34443]: pgmap v599: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 615 KiB/s wr, 105 op/s 2024-09-21T06:00:06.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:05 smithi144 ceph-mon[34351]: pgmap v599: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 615 KiB/s wr, 105 op/s 2024-09-21T06:00:06.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:05 smithi037 ceph-mon[30631]: pgmap v599: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 615 KiB/s wr, 105 op/s 2024-09-21T06:00:07.095 INFO:tasks.workunit.client.0.smithi037.stdout:truncating to largest ever: 0x9ffb01 2024-09-21T06:00:08.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:07 smithi067 ceph-mon[34443]: pgmap v600: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2024-09-21T06:00:08.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:07 smithi144 ceph-mon[34351]: pgmap v600: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2024-09-21T06:00:08.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:07 smithi037 ceph-mon[30631]: pgmap v600: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2024-09-21T06:00:10.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:09 smithi067 ceph-mon[34443]: pgmap v601: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.4 MiB/s wr, 241 op/s 2024-09-21T06:00:10.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:09 smithi144 ceph-mon[34351]: pgmap v601: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.4 MiB/s wr, 241 op/s 2024-09-21T06:00:10.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:09 smithi037 ceph-mon[30631]: pgmap v601: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.4 MiB/s wr, 241 op/s 2024-09-21T06:00:12.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:11 smithi067 ceph-mon[34443]: pgmap v602: 129 pgs: 129 active+clean; 117 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 1.7 MiB/s wr, 279 op/s 2024-09-21T06:00:12.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:11 smithi144 ceph-mon[34351]: pgmap v602: 129 pgs: 129 active+clean; 117 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 1.7 MiB/s wr, 279 op/s 2024-09-21T06:00:12.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:11 smithi037 ceph-mon[30631]: pgmap v602: 129 pgs: 129 active+clean; 117 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 1.7 MiB/s wr, 279 op/s 2024-09-21T06:00:14.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:13 smithi067 ceph-mon[34443]: pgmap v603: 129 pgs: 129 active+clean; 117 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 1.9 MiB/s wr, 340 op/s 2024-09-21T06:00:14.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:13 smithi144 ceph-mon[34351]: pgmap v603: 129 pgs: 129 active+clean; 117 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 1.9 MiB/s wr, 340 op/s 2024-09-21T06:00:14.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:13 smithi037 ceph-mon[30631]: pgmap v603: 129 pgs: 129 active+clean; 117 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 1.9 MiB/s wr, 340 op/s 2024-09-21T06:00:14.683 INFO:tasks.workunit.client.0.smithi037.stdout:40000 mapwrite 0x1becad thru 0x1c6a92 (0x7de6 bytes) 2024-09-21T06:00:16.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:15 smithi067 ceph-mon[34443]: pgmap v604: 129 pgs: 129 active+clean; 117 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.7 MiB/s wr, 300 op/s 2024-09-21T06:00:16.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:15 smithi144 ceph-mon[34351]: pgmap v604: 129 pgs: 129 active+clean; 117 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.7 MiB/s wr, 300 op/s 2024-09-21T06:00:16.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:15 smithi037 ceph-mon[30631]: pgmap v604: 129 pgs: 129 active+clean; 117 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.7 MiB/s wr, 300 op/s 2024-09-21T06:00:18.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:17 smithi067 ceph-mon[34443]: pgmap v605: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 2.2 MiB/s wr, 402 op/s 2024-09-21T06:00:18.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:17 smithi144 ceph-mon[34351]: pgmap v605: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 2.2 MiB/s wr, 402 op/s 2024-09-21T06:00:18.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:17 smithi037 ceph-mon[30631]: pgmap v605: 129 pgs: 129 active+clean; 115 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 2.2 MiB/s wr, 402 op/s 2024-09-21T06:00:20.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:19 smithi067 ceph-mon[34443]: pgmap v606: 129 pgs: 129 active+clean; 117 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.6 MiB/s wr, 305 op/s 2024-09-21T06:00:20.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:19 smithi144 ceph-mon[34351]: pgmap v606: 129 pgs: 129 active+clean; 117 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.6 MiB/s wr, 305 op/s 2024-09-21T06:00:20.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:19 smithi037 ceph-mon[30631]: pgmap v606: 129 pgs: 129 active+clean; 117 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.6 MiB/s wr, 305 op/s 2024-09-21T06:00:22.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:21 smithi067 ceph-mon[34443]: pgmap v607: 129 pgs: 129 active+clean; 117 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.8 MiB/s wr, 323 op/s 2024-09-21T06:00:22.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:21 smithi144 ceph-mon[34351]: pgmap v607: 129 pgs: 129 active+clean; 117 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.8 MiB/s wr, 323 op/s 2024-09-21T06:00:22.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:21 smithi037 ceph-mon[30631]: pgmap v607: 129 pgs: 129 active+clean; 117 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.8 MiB/s wr, 323 op/s 2024-09-21T06:00:24.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:23 smithi067 ceph-mon[34443]: pgmap v608: 129 pgs: 129 active+clean; 118 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.9 MiB/s wr, 358 op/s 2024-09-21T06:00:24.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:23 smithi144 ceph-mon[34351]: pgmap v608: 129 pgs: 129 active+clean; 118 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.9 MiB/s wr, 358 op/s 2024-09-21T06:00:24.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:23 smithi037 ceph-mon[30631]: pgmap v608: 129 pgs: 129 active+clean; 118 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.9 MiB/s wr, 358 op/s 2024-09-21T06:00:26.259 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:25 smithi067 ceph-mon[34443]: pgmap v609: 129 pgs: 129 active+clean; 117 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 295 op/s 2024-09-21T06:00:26.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:25 smithi144 ceph-mon[34351]: pgmap v609: 129 pgs: 129 active+clean; 117 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 295 op/s 2024-09-21T06:00:26.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:25 smithi037 ceph-mon[30631]: pgmap v609: 129 pgs: 129 active+clean; 117 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 295 op/s 2024-09-21T06:00:28.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:27 smithi067 ceph-mon[34443]: pgmap v610: 129 pgs: 129 active+clean; 120 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.2 MiB/s wr, 383 op/s 2024-09-21T06:00:28.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:27 smithi144 ceph-mon[34351]: pgmap v610: 129 pgs: 129 active+clean; 120 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.2 MiB/s wr, 383 op/s 2024-09-21T06:00:28.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:27 smithi037 ceph-mon[30631]: pgmap v610: 129 pgs: 129 active+clean; 120 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.2 MiB/s wr, 383 op/s 2024-09-21T06:00:30.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:29 smithi067 ceph-mon[34443]: pgmap v611: 129 pgs: 129 active+clean; 120 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.7 MiB/s wr, 278 op/s 2024-09-21T06:00:30.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:29 smithi144 ceph-mon[34351]: pgmap v611: 129 pgs: 129 active+clean; 120 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.7 MiB/s wr, 278 op/s 2024-09-21T06:00:30.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:29 smithi037 ceph-mon[30631]: pgmap v611: 129 pgs: 129 active+clean; 120 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.7 MiB/s wr, 278 op/s 2024-09-21T06:00:32.230 INFO:tasks.workunit.client.0.smithi037.stdout:50000 write 0x5304f4 thru 0x53fa11 (0xf51e bytes) 2024-09-21T06:00:32.230 INFO:tasks.workunit.client.0.smithi037.stdout:All 50000 operations completed A-OK! 2024-09-21T06:00:32.236 INFO:tasks.workunit.client.0.smithi037.stderr:+ ./fsx -z 100MB -N 50000 -p 10000 -l 104857600 2024-09-21T06:00:32.242 INFO:tasks.workunit.client.0.smithi037.stdout:Seed set to 1 2024-09-21T06:00:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:31 smithi144 ceph-mon[34351]: pgmap v612: 129 pgs: 129 active+clean; 118 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.8 MiB/s wr, 295 op/s 2024-09-21T06:00:32.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:31 smithi037 ceph-mon[30631]: pgmap v612: 129 pgs: 129 active+clean; 118 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.8 MiB/s wr, 295 op/s 2024-09-21T06:00:32.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:31 smithi067 ceph-mon[34443]: pgmap v612: 129 pgs: 129 active+clean; 118 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.8 MiB/s wr, 295 op/s 2024-09-21T06:00:33.615 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-21T06:00:33.615 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-21T06:00:33.618 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-21T06:00:33.618 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-21T06:00:33.618 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support clone range, disabling! 2024-09-21T06:00:33.623 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-21T06:00:33.626 INFO:tasks.workunit.client.0.smithi037.stdout:skipping zero size read 2024-09-21T06:00:33.626 INFO:tasks.workunit.client.0.smithi037.stderr:main: filesystem does not support exchange range, disabling! 2024-09-21T06:00:33.643 INFO:tasks.workunit.client.0.smithi037.stdout:truncating to largest ever: 0x1c37b90 2024-09-21T06:00:33.652 INFO:tasks.workunit.client.0.smithi037.stdout:truncating to largest ever: 0x5bd330d 2024-09-21T06:00:33.684 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0x637bf99 2024-09-21T06:00:34.117 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0x63d9b9c 2024-09-21T06:00:34.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:33 smithi144 ceph-mon[34351]: pgmap v613: 129 pgs: 129 active+clean; 119 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 1.9 MiB/s wr, 333 op/s 2024-09-21T06:00:34.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:33 smithi037 ceph-mon[30631]: pgmap v613: 129 pgs: 129 active+clean; 119 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 1.9 MiB/s wr, 333 op/s 2024-09-21T06:00:34.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:33 smithi067 ceph-mon[34443]: pgmap v613: 129 pgs: 129 active+clean; 119 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 1.9 MiB/s wr, 333 op/s 2024-09-21T06:00:36.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:36 smithi144 ceph-mon[34351]: pgmap v614: 129 pgs: 129 active+clean; 119 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.6 MiB/s wr, 272 op/s 2024-09-21T06:00:36.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:36 smithi037 ceph-mon[30631]: pgmap v614: 129 pgs: 129 active+clean; 119 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.6 MiB/s wr, 272 op/s 2024-09-21T06:00:36.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:36 smithi067 ceph-mon[34443]: pgmap v614: 129 pgs: 129 active+clean; 119 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.6 MiB/s wr, 272 op/s 2024-09-21T06:00:38.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:38 smithi144 ceph-mon[34351]: pgmap v615: 129 pgs: 129 active+clean; 126 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 1.7 MiB/s wr, 320 op/s 2024-09-21T06:00:38.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:38 smithi037 ceph-mon[30631]: pgmap v615: 129 pgs: 129 active+clean; 126 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 1.7 MiB/s wr, 320 op/s 2024-09-21T06:00:38.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:38 smithi067 ceph-mon[34443]: pgmap v615: 129 pgs: 129 active+clean; 126 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 1.7 MiB/s wr, 320 op/s 2024-09-21T06:00:40.297 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:40 smithi067 ceph-mon[34443]: pgmap v616: 129 pgs: 129 active+clean; 128 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-09-21T06:00:40.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:40 smithi144 ceph-mon[34351]: pgmap v616: 129 pgs: 129 active+clean; 128 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-09-21T06:00:40.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:40 smithi037 ceph-mon[30631]: pgmap v616: 129 pgs: 129 active+clean; 128 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-09-21T06:00:42.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:42 smithi144 ceph-mon[34351]: pgmap v617: 129 pgs: 129 active+clean; 134 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.3 MiB/s wr, 302 op/s 2024-09-21T06:00:42.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:42 smithi037 ceph-mon[30631]: pgmap v617: 129 pgs: 129 active+clean; 134 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.3 MiB/s wr, 302 op/s 2024-09-21T06:00:42.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:42 smithi067 ceph-mon[34443]: pgmap v617: 129 pgs: 129 active+clean; 134 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.3 MiB/s wr, 302 op/s 2024-09-21T06:00:44.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:44 smithi144 ceph-mon[34351]: pgmap v618: 129 pgs: 129 active+clean; 134 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.2 MiB/s wr, 362 op/s 2024-09-21T06:00:44.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:44 smithi037 ceph-mon[30631]: pgmap v618: 129 pgs: 129 active+clean; 134 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.2 MiB/s wr, 362 op/s 2024-09-21T06:00:44.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:44 smithi067 ceph-mon[34443]: pgmap v618: 129 pgs: 129 active+clean; 134 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.2 MiB/s wr, 362 op/s 2024-09-21T06:00:46.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:46 smithi144 ceph-mon[34351]: pgmap v619: 129 pgs: 129 active+clean; 141 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 978 KiB/s wr, 311 op/s 2024-09-21T06:00:46.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:46 smithi037 ceph-mon[30631]: pgmap v619: 129 pgs: 129 active+clean; 141 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 978 KiB/s wr, 311 op/s 2024-09-21T06:00:46.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:46 smithi067 ceph-mon[34443]: pgmap v619: 129 pgs: 129 active+clean; 141 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 978 KiB/s wr, 311 op/s 2024-09-21T06:00:48.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:48 smithi144 ceph-mon[34351]: pgmap v620: 129 pgs: 129 active+clean; 134 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.1 MiB/s wr, 397 op/s 2024-09-21T06:00:48.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:48 smithi037 ceph-mon[30631]: pgmap v620: 129 pgs: 129 active+clean; 134 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.1 MiB/s wr, 397 op/s 2024-09-21T06:00:48.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:48 smithi067 ceph-mon[34443]: pgmap v620: 129 pgs: 129 active+clean; 134 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.1 MiB/s wr, 397 op/s 2024-09-21T06:00:50.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:50 smithi144 ceph-mon[34351]: pgmap v621: 129 pgs: 129 active+clean; 139 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 1.0 MiB/s wr, 425 op/s 2024-09-21T06:00:50.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:50 smithi037 ceph-mon[30631]: pgmap v621: 129 pgs: 129 active+clean; 139 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 1.0 MiB/s wr, 425 op/s 2024-09-21T06:00:50.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:50 smithi067 ceph-mon[34443]: pgmap v621: 129 pgs: 129 active+clean; 139 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 1.0 MiB/s wr, 425 op/s 2024-09-21T06:00:52.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:52 smithi144 ceph-mon[34351]: pgmap v622: 129 pgs: 129 active+clean; 139 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.1 MiB/s wr, 444 op/s 2024-09-21T06:00:52.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:52 smithi037 ceph-mon[30631]: pgmap v622: 129 pgs: 129 active+clean; 139 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.1 MiB/s wr, 444 op/s 2024-09-21T06:00:52.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:52 smithi067 ceph-mon[34443]: pgmap v622: 129 pgs: 129 active+clean; 139 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.1 MiB/s wr, 444 op/s 2024-09-21T06:00:54.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:54 smithi144 ceph-mon[34351]: pgmap v623: 129 pgs: 129 active+clean; 139 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1.1 MiB/s wr, 484 op/s 2024-09-21T06:00:54.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:54 smithi037 ceph-mon[30631]: pgmap v623: 129 pgs: 129 active+clean; 139 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1.1 MiB/s wr, 484 op/s 2024-09-21T06:00:54.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:54 smithi067 ceph-mon[34443]: pgmap v623: 129 pgs: 129 active+clean; 139 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1.1 MiB/s wr, 484 op/s 2024-09-21T06:00:56.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:56 smithi144 ceph-mon[34351]: pgmap v624: 129 pgs: 129 active+clean; 138 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1004 KiB/s wr, 412 op/s 2024-09-21T06:00:56.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:56 smithi037 ceph-mon[30631]: pgmap v624: 129 pgs: 129 active+clean; 138 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1004 KiB/s wr, 412 op/s 2024-09-21T06:00:56.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:56 smithi067 ceph-mon[34443]: pgmap v624: 129 pgs: 129 active+clean; 138 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1004 KiB/s wr, 412 op/s 2024-09-21T06:00:58.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:00:58 smithi144 ceph-mon[34351]: pgmap v625: 129 pgs: 129 active+clean; 135 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 478 op/s 2024-09-21T06:00:58.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:00:58 smithi037 ceph-mon[30631]: pgmap v625: 129 pgs: 129 active+clean; 135 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 478 op/s 2024-09-21T06:00:58.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:00:58 smithi067 ceph-mon[34443]: pgmap v625: 129 pgs: 129 active+clean; 135 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 478 op/s 2024-09-21T06:00:59.252 INFO:tasks.workunit.client.0.smithi037.stdout:10000 mapread 0x33cc4e3 thru 0x33cec16 (0x2734 bytes) 2024-09-21T06:01:00.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:00 smithi144 ceph-mon[34351]: pgmap v626: 129 pgs: 129 active+clean; 138 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 457 op/s 2024-09-21T06:01:00.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:00 smithi037 ceph-mon[30631]: pgmap v626: 129 pgs: 129 active+clean; 138 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 457 op/s 2024-09-21T06:01:00.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:00 smithi067 ceph-mon[34443]: pgmap v626: 129 pgs: 129 active+clean; 138 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 457 op/s 2024-09-21T06:01:02.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:02 smithi144 ceph-mon[34351]: pgmap v627: 129 pgs: 129 active+clean; 144 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.2 MiB/s wr, 422 op/s 2024-09-21T06:01:02.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:02 smithi037 ceph-mon[30631]: pgmap v627: 129 pgs: 129 active+clean; 144 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.2 MiB/s wr, 422 op/s 2024-09-21T06:01:02.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:02 smithi067 ceph-mon[34443]: pgmap v627: 129 pgs: 129 active+clean; 144 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.2 MiB/s wr, 422 op/s 2024-09-21T06:01:03.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:03 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:01:03.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:03 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:01:03.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:03 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:01:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:04 smithi144 ceph-mon[34351]: pgmap v628: 129 pgs: 129 active+clean; 147 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 1.3 MiB/s wr, 457 op/s 2024-09-21T06:01:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:04 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:01:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:04 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:01:04.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:04 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:01:04.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:04 smithi037 ceph-mon[30631]: pgmap v628: 129 pgs: 129 active+clean; 147 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 1.3 MiB/s wr, 457 op/s 2024-09-21T06:01:04.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:04 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:01:04.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:04 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:01:04.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:04 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:01:04.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:04 smithi067 ceph-mon[34443]: pgmap v628: 129 pgs: 129 active+clean; 147 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 1.3 MiB/s wr, 457 op/s 2024-09-21T06:01:04.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:04 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:01:04.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:04 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:01:04.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:04 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:01:06.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:06 smithi144 ceph-mon[34351]: pgmap v629: 129 pgs: 129 active+clean; 145 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 1.1 MiB/s wr, 377 op/s 2024-09-21T06:01:06.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:06 smithi037 ceph-mon[30631]: pgmap v629: 129 pgs: 129 active+clean; 145 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 1.1 MiB/s wr, 377 op/s 2024-09-21T06:01:06.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:06 smithi067 ceph-mon[34443]: pgmap v629: 129 pgs: 129 active+clean; 145 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 1.1 MiB/s wr, 377 op/s 2024-09-21T06:01:08.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:08 smithi144 ceph-mon[34351]: pgmap v630: 129 pgs: 129 active+clean; 135 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.2 MiB/s wr, 447 op/s 2024-09-21T06:01:08.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:08 smithi037 ceph-mon[30631]: pgmap v630: 129 pgs: 129 active+clean; 135 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.2 MiB/s wr, 447 op/s 2024-09-21T06:01:08.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:08 smithi067 ceph-mon[34443]: pgmap v630: 129 pgs: 129 active+clean; 135 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.2 MiB/s wr, 447 op/s 2024-09-21T06:01:09.610 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T06:01:09.611 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-09-21T06:01:09.611 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:01:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:10.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:10 smithi144 ceph-mon[34351]: pgmap v631: 129 pgs: 129 active+clean; 138 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.3 MiB/s wr, 458 op/s 2024-09-21T06:01:10.412 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:10 smithi037 ceph-mon[30631]: pgmap v631: 129 pgs: 129 active+clean; 138 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.3 MiB/s wr, 458 op/s 2024-09-21T06:01:10.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:10 smithi067 ceph-mon[34443]: pgmap v631: 129 pgs: 129 active+clean; 138 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 1.3 MiB/s wr, 458 op/s 2024-09-21T06:01:10.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.826+0000 7f4fdd200640 1 -- 172.21.15.37:0/667201158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fd810dc20 msgr2=0x7f4fd8110110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:10.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.826+0000 7f4fdd200640 1 --2- 172.21.15.37:0/667201158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fd810dc20 0x7f4fd8110110 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009ca0 tx=0x7f4fd002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:01:10.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.826+0000 7f4fdd200640 1 -- 172.21.15.37:0/667201158 shutdown_connections 2024-09-21T06:01:10.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.826+0000 7f4fdd200640 1 --2- 172.21.15.37:0/667201158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fd810dc20 0x7f4fd8110110 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:10.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.826+0000 7f4fdd200640 1 --2- 172.21.15.37:0/667201158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fd8105110 0x7f4fd810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.826+0000 7f4fdd200640 1 --2- 172.21.15.37:0/667201158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd81047c0 0x7f4fd8104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.826+0000 7f4fdd200640 1 -- 172.21.15.37:0/667201158 >> 172.21.15.37:0/667201158 conn(0x7f4fd80fe2c0 msgr2=0x7f4fd8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.826+0000 7f4fdd200640 1 -- 172.21.15.37:0/667201158 shutdown_connections 2024-09-21T06:01:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.826+0000 7f4fdd200640 1 -- 172.21.15.37:0/667201158 wait complete. 2024-09-21T06:01:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.828+0000 7f4fdd200640 1 Processor -- start 2024-09-21T06:01:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.828+0000 7f4fdd200640 1 -- start start 2024-09-21T06:01:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.829+0000 7f4fdd200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd81047c0 0x7f4fd8103f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.829+0000 7f4fdd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fd8105110 0x7f4fd8102500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.829+0000 7f4fdd200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fd810dc20 0x7f4fd8102a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.829+0000 7f4fdd200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd81138d0 con 0x7f4fd81047c0 2024-09-21T06:01:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.829+0000 7f4fdd200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd8113750 con 0x7f4fd810dc20 2024-09-21T06:01:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.829+0000 7f4fdd200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd8113a50 con 0x7f4fd8105110 2024-09-21T06:01:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.830+0000 7f4fd7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd81047c0 0x7f4fd8103f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.830+0000 7f4fd6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fd8105110 0x7f4fd8102500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.830+0000 7f4fd6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fd8105110 0x7f4fd8102500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:57580/0 (socket says 172.21.15.37:57580) 2024-09-21T06:01:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.830+0000 7f4fd7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fd810dc20 0x7f4fd8102a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.830+0000 7f4fd6a00640 1 -- 172.21.15.37:0/3634988244 learned_addr learned my addr 172.21.15.37:0/3634988244 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.830+0000 7f4fd6a00640 1 -- 172.21.15.37:0/3634988244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fd810dc20 msgr2=0x7f4fd8102a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.830+0000 7f4fd6a00640 1 --2- 172.21.15.37:0/3634988244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fd810dc20 0x7f4fd8102a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.830+0000 7f4fd6a00640 1 -- 172.21.15.37:0/3634988244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd81047c0 msgr2=0x7f4fd8103f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.831+0000 7f4fd6a00640 1 --2- 172.21.15.37:0/3634988244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd81047c0 0x7f4fd8103f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.831+0000 7f4fd6a00640 1 -- 172.21.15.37:0/3634988244 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd8103260 con 0x7f4fd8105110 2024-09-21T06:01:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.831+0000 7f4fd7400640 1 --2- 172.21.15.37:0/3634988244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd81047c0 0x7f4fd8103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.832+0000 7f4fd6a00640 1 --2- 172.21.15.37:0/3634988244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fd8105110 0x7f4fd8102500 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400e9f0 tx=0x7f4fc400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.832+0000 7f4fcfe00640 1 -- 172.21.15.37:0/3634988244 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400ccc0 con 0x7f4fd8105110 2024-09-21T06:01:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.832+0000 7f4fcfe00640 1 -- 172.21.15.37:0/3634988244 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fc40108e0 con 0x7f4fd8105110 2024-09-21T06:01:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.832+0000 7f4fdd200640 1 -- 172.21.15.37:0/3634988244 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd81acc00 con 0x7f4fd8105110 2024-09-21T06:01:10.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.833+0000 7f4fdd200640 1 -- 172.21.15.37:0/3634988244 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd81ad110 con 0x7f4fd8105110 2024-09-21T06:01:10.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.833+0000 7f4fcfe00640 1 -- 172.21.15.37:0/3634988244 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4018860 con 0x7f4fd8105110 2024-09-21T06:01:10.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.835+0000 7f4fdd200640 1 -- 172.21.15.37:0/3634988244 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb80052c0 con 0x7f4fd8105110 2024-09-21T06:01:10.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.843+0000 7f4fcfe00640 1 -- 172.21.15.37:0/3634988244 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f4fc4010430 con 0x7f4fd8105110 2024-09-21T06:01:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.846+0000 7f4fcfe00640 1 --2- 172.21.15.37:0/3634988244 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4fbc0b6660 0x7f4fbc0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.846+0000 7f4fcfe00640 1 -- 172.21.15.37:0/3634988244 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f4fc40e7760 con 0x7f4fd8105110 2024-09-21T06:01:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.846+0000 7f4fd7400640 1 --2- 172.21.15.37:0/3634988244 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4fbc0b6660 0x7f4fbc0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:10.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.847+0000 7f4fd7400640 1 --2- 172.21.15.37:0/3634988244 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4fbc0b6660 0x7f4fbc0b8b70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4fd819e110 tx=0x7f4fc8005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:10.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:10.849+0000 7f4fcfe00640 1 -- 172.21.15.37:0/3634988244 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4fc40adbc0 con 0x7f4fd8105110 2024-09-21T06:01:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.155+0000 7f4fdd200640 1 -- 172.21.15.37:0/3634988244 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fb80055b0 con 0x7f4fd8105110 2024-09-21T06:01:11.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.156+0000 7f4fcfe00640 1 -- 172.21.15.37:0/3634988244 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f4fc40b1fa0 con 0x7f4fd8105110 2024-09-21T06:01:11.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:01:11.158 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T06:01:11.159 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T06:01:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.158+0000 7f4fdd200640 1 -- 172.21.15.37:0/3634988244 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4fbc0b6660 msgr2=0x7f4fbc0b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.158+0000 7f4fdd200640 1 --2- 172.21.15.37:0/3634988244 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4fbc0b6660 0x7f4fbc0b8b70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4fd819e110 tx=0x7f4fc8005f90 comp rx=0 tx=0).stop 2024-09-21T06:01:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.158+0000 7f4fdd200640 1 -- 172.21.15.37:0/3634988244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fd8105110 msgr2=0x7f4fd8102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.158+0000 7f4fdd200640 1 --2- 172.21.15.37:0/3634988244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fd8105110 0x7f4fd8102500 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400e9f0 tx=0x7f4fc400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.158+0000 7f4fdd200640 1 -- 172.21.15.37:0/3634988244 shutdown_connections 2024-09-21T06:01:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.158+0000 7f4fdd200640 1 --2- 172.21.15.37:0/3634988244 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4fbc0b6660 0x7f4fbc0b8b70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.158+0000 7f4fdd200640 1 --2- 172.21.15.37:0/3634988244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fd810dc20 0x7f4fd8102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.159+0000 7f4fdd200640 1 --2- 172.21.15.37:0/3634988244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fd8105110 0x7f4fd8102500 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.159+0000 7f4fdd200640 1 --2- 172.21.15.37:0/3634988244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd81047c0 0x7f4fd8103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.159+0000 7f4fdd200640 1 -- 172.21.15.37:0/3634988244 >> 172.21.15.37:0/3634988244 conn(0x7f4fd80fe2c0 msgr2=0x7f4fd81076b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.159+0000 7f4fdd200640 1 -- 172.21.15.37:0/3634988244 shutdown_connections 2024-09-21T06:01:11.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:11.159+0000 7f4fdd200640 1 -- 172.21.15.37:0/3634988244 wait complete. 2024-09-21T06:01:11.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:11 smithi037 ceph-mon[30631]: pgmap v632: 129 pgs: 129 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.2 MiB/s wr, 440 op/s 2024-09-21T06:01:11.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:11 smithi067 ceph-mon[34443]: pgmap v632: 129 pgs: 129 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.2 MiB/s wr, 440 op/s 2024-09-21T06:01:11.622 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:11 smithi144 ceph-mon[34351]: pgmap v632: 129 pgs: 129 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 1.2 MiB/s wr, 440 op/s 2024-09-21T06:01:12.066 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0' 2024-09-21T06:01:12.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0 2024-09-21T06:01:12.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:12 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3634988244' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:12.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:12 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3634988244' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:12.575 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:12.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:12 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3634988244' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:13.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.311+0000 7f1149400640 1 -- 172.21.15.37:0/4017757279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1144105dc0 msgr2=0x7f11441061d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.311+0000 7f1149400640 1 --2- 172.21.15.37:0/4017757279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1144105dc0 0x7f11441061d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1134009900 tx=0x7f113402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.312+0000 7f1149400640 1 -- 172.21.15.37:0/4017757279 shutdown_connections 2024-09-21T06:01:13.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.312+0000 7f1149400640 1 --2- 172.21.15.37:0/4017757279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f114410c050 0x7f1144112880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.312+0000 7f1149400640 1 --2- 172.21.15.37:0/4017757279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f114410b700 0x7f114410bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.312+0000 7f1149400640 1 --2- 172.21.15.37:0/4017757279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1144105dc0 0x7f11441061d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.312+0000 7f1149400640 1 -- 172.21.15.37:0/4017757279 >> 172.21.15.37:0/4017757279 conn(0x7f11441017d0 msgr2=0x7f1144103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:13.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.312+0000 7f1149400640 1 -- 172.21.15.37:0/4017757279 shutdown_connections 2024-09-21T06:01:13.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.312+0000 7f1149400640 1 -- 172.21.15.37:0/4017757279 wait complete. 2024-09-21T06:01:13.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.313+0000 7f1149400640 1 Processor -- start 2024-09-21T06:01:13.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.313+0000 7f1149400640 1 -- start start 2024-09-21T06:01:13.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.313+0000 7f1149400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1144105dc0 0x7f114419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1149400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f114410b700 0x7f114419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1149400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f114410c050 0x7f11441a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1149400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1144115d60 con 0x7f114410b700 2024-09-21T06:01:13.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1149400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1144115be0 con 0x7f114410c050 2024-09-21T06:01:13.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1149400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1144115ee0 con 0x7f1144105dc0 2024-09-21T06:01:13.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1142800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1144105dc0 0x7f114419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1142800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1144105dc0 0x7f114419c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:57608/0 (socket says 172.21.15.37:57608) 2024-09-21T06:01:13.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1143200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f114410c050 0x7f11441a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1142800640 1 -- 172.21.15.37:0/2647785363 learned_addr learned my addr 172.21.15.37:0/2647785363 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:13.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1141e00640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f114410b700 0x7f114419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1142800640 1 -- 172.21.15.37:0/2647785363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f114410c050 msgr2=0x7f11441a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1142800640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f114410c050 0x7f11441a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1142800640 1 -- 172.21.15.37:0/2647785363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f114410b700 msgr2=0x7f114419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1142800640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f114410b700 0x7f114419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.314+0000 7f1142800640 1 -- 172.21.15.37:0/2647785363 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11441a2660 con 0x7f1144105dc0 2024-09-21T06:01:13.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.315+0000 7f1143200640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f114410c050 0x7f11441a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:13.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.315+0000 7f1142800640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1144105dc0 0x7f114419c6f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1134005ab0 tx=0x7f1134003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:13.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.315+0000 7f113b400640 1 -- 172.21.15.37:0/2647785363 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113403f070 con 0x7f1144105dc0 2024-09-21T06:01:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.315+0000 7f1149400640 1 -- 172.21.15.37:0/2647785363 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11441a28f0 con 0x7f1144105dc0 2024-09-21T06:01:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.315+0000 7f113b400640 1 -- 172.21.15.37:0/2647785363 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1134031b60 con 0x7f1144105dc0 2024-09-21T06:01:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.315+0000 7f113b400640 1 -- 172.21.15.37:0/2647785363 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134035030 con 0x7f1144105dc0 2024-09-21T06:01:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.315+0000 7f1149400640 1 -- 172.21.15.37:0/2647785363 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11441a90b0 con 0x7f1144105dc0 2024-09-21T06:01:13.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.320+0000 7f114ffdd740 1 Processor -- start 2024-09-21T06:01:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.320+0000 7f114ffdd740 1 -- start start 2024-09-21T06:01:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f114ffdd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1c16850 0x5585c1fbd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f114ffdd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1bed990 0x5585c1fbdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f114ffdd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bf5b70 0x5585c1fbe430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f114ffdd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5585c1f33a90 con 0x5585c1bf5b70 2024-09-21T06:01:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f114ffdd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5585c1f22ec0 con 0x5585c1c16850 2024-09-21T06:01:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f114ffdd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5585c1f26cd0 con 0x5585c1bed990 2024-09-21T06:01:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f113b400640 1 -- 172.21.15.37:0/2647785363 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f1134042070 con 0x7f1144105dc0 2024-09-21T06:01:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f1143200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1c16850 0x5585c1fbd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f1143200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1c16850 0x5585c1fbd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:53190/0 (socket says 172.21.15.37:53190) 2024-09-21T06:01:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f1143200640 1 -- 172.21.15.37:0/1576289747 learned_addr learned my addr 172.21.15.37:0/1576289747 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f1142800640 1 --2- 172.21.15.37:0/1576289747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1bed990 0x5585c1fbdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f1143200640 1 -- 172.21.15.37:0/1576289747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1bed990 msgr2=0x5585c1fbdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f1143200640 1 --2- 172.21.15.37:0/1576289747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1bed990 0x5585c1fbdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f1143200640 1 -- 172.21.15.37:0/1576289747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bf5b70 msgr2=0x5585c1fbe430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f1141e00640 1 --2- 172.21.15.37:0/1576289747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bf5b70 0x5585c1fbe430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f1143200640 1 --2- 172.21.15.37:0/1576289747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bf5b70 0x5585c1fbe430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.321+0000 7f1143200640 1 -- 172.21.15.37:0/1576289747 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c1ec89d0 con 0x5585c1c16850 2024-09-21T06:01:13.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.322+0000 7f1141e00640 1 --2- 172.21.15.37:0/1576289747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bf5b70 0x5585c1fbe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.322+0000 7f1143200640 1 --2- 172.21.15.37:0/1576289747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1c16850 0x5585c1fbd9b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f113c011810 tx=0x7f113c011cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3084bb1c721e60ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.323+0000 7f112f400640 1 -- 172.21.15.37:0/1576289747 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c011310 con 0x5585c1c16850 2024-09-21T06:01:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.323+0000 7f112f400640 1 -- 172.21.15.37:0/1576289747 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f113c00f9a0 con 0x5585c1c16850 2024-09-21T06:01:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.323+0000 7f112f400640 1 -- 172.21.15.37:0/1576289747 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c005650 con 0x5585c1c16850 2024-09-21T06:01:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.324+0000 7f114ffdd740 1 -- 172.21.15.37:0/1576289747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1c16850 msgr2=0x5585c1fbd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.324+0000 7f114ffdd740 1 --2- 172.21.15.37:0/1576289747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1c16850 0x5585c1fbd9b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f113c011810 tx=0x7f113c011cd0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.324+0000 7f113b400640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11280b6510 0x7f11280b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.324+0000 7f114ffdd740 1 -- 172.21.15.37:0/1576289747 shutdown_connections 2024-09-21T06:01:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.324+0000 7f114ffdd740 1 --2- 172.21.15.37:0/1576289747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bf5b70 0x5585c1fbe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.324+0000 7f114ffdd740 1 --2- 172.21.15.37:0/1576289747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1bed990 0x5585c1fbdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.324+0000 7f114ffdd740 1 --2- 172.21.15.37:0/1576289747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1c16850 0x5585c1fbd9b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.324+0000 7f114ffdd740 1 -- 172.21.15.37:0/1576289747 >> 172.21.15.37:0/1576289747 conn(0x5585c1c0ac40 msgr2=0x5585c1fbb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.324+0000 7f113b400640 1 -- 172.21.15.37:0/2647785363 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f1134107e20 con 0x7f1144105dc0 2024-09-21T06:01:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.324+0000 7f1143200640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11280b6510 0x7f11280b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.325+0000 7f114ffdd740 1 -- 172.21.15.37:0/1576289747 shutdown_connections 2024-09-21T06:01:13.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.325+0000 7f114ffdd740 1 -- 172.21.15.37:0/1576289747 wait complete. 2024-09-21T06:01:13.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.325+0000 7f1143200640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11280b6510 0x7f11280b8a20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f113c009b50 tx=0x7f113c005bd0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:13.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.325+0000 7f114ffdd740 1 -- start start 2024-09-21T06:01:13.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.326+0000 7f114ffdd740 1 Processor -- start 2024-09-21T06:01:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.326+0000 7f114ffdd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 0x5585c1fc9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.326+0000 7f114ffdd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1bf5b70 0x5585c1fca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.326+0000 7f114ffdd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1c16850 0x5585c1fcf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.326+0000 7f114ffdd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5585c1d847b0 con 0x5585c1bed990 2024-09-21T06:01:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.326+0000 7f114ffdd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5585c1ec7650 con 0x5585c1c16850 2024-09-21T06:01:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.326+0000 7f114ffdd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5585c1fc4060 con 0x5585c1bf5b70 2024-09-21T06:01:13.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.326+0000 7f114ffdd740 10 client.0 _ll_register_callbacks cb 0x5585c1c2e0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.327+0000 7f1142800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 0x5585c1fc9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.327+0000 7f1142800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 0x5585c1fc9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45268/0 (socket says 172.21.15.37:45268) 2024-09-21T06:01:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.327+0000 7f1142800640 1 -- 172.21.15.37:0/1333652808 learned_addr learned my addr 172.21.15.37:0/1333652808 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.327+0000 7f1142800640 1 -- 172.21.15.37:0/1333652808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1bf5b70 msgr2=0x5585c1fca130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:01:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.327+0000 7f1142800640 1 --2- 172.21.15.37:0/1333652808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1bf5b70 0x5585c1fca130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.327+0000 7f1142800640 1 -- 172.21.15.37:0/1333652808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1c16850 msgr2=0x5585c1fcf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.327+0000 7f1143200640 1 --2- 172.21.15.37:0/1333652808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1c16850 0x5585c1fcf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.327+0000 7f1142800640 1 --2- 172.21.15.37:0/1333652808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1c16850 0x5585c1fcf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.327+0000 7f1142800640 1 -- 172.21.15.37:0/1333652808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585c1c90ba0 con 0x5585c1bed990 2024-09-21T06:01:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.328+0000 7f1143200640 1 --2- 172.21.15.37:0/1333652808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1c16850 0x5585c1fcf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.328+0000 7f1142800640 1 --2- 172.21.15.37:0/1333652808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 0x5585c1fc9b70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f11340cd880 tx=0x7f1134009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ee2151c9e454d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.328+0000 7f1123e00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T06:01:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.328+0000 7f1123e00640 1 -- 172.21.15.37:0/1333652808 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134049070 con 0x5585c1bed990 2024-09-21T06:01:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.328+0000 7f1123e00640 1 -- 172.21.15.37:0/1333652808 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f11340c9df0 con 0x5585c1bed990 2024-09-21T06:01:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.328+0000 7f114ffdd740 1 -- 172.21.15.37:0/1333652808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f113c00f9a0 con 0x5585c1bed990 2024-09-21T06:01:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.329+0000 7f1123e00640 1 -- 172.21.15.37:0/1333652808 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f11340cd2f0 con 0x5585c1bed990 2024-09-21T06:01:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.329+0000 7f114ffdd740 10 client.15603 fetch_fsmap learned FSMap version 21 2024-09-21T06:01:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.329+0000 7f114ffdd740 1 -- 172.21.15.37:0/1333652808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5585c1fe9030 con 0x5585c1bed990 2024-09-21T06:01:13.333 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:13 smithi037 ceph-mon[30631]: pgmap v633: 129 pgs: 129 active+clean; 139 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.2 MiB/s wr, 471 op/s 2024-09-21T06:01:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.330+0000 7f1123e00640 1 -- 172.21.15.37:0/1333652808 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f113c00f9a0 con 0x5585c1bed990 2024-09-21T06:01:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.331+0000 7f1123e00640 1 -- 172.21.15.37:0/1333652808 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f11340efb90 con 0x5585c1bed990 2024-09-21T06:01:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.331+0000 7f114ffdd740 10 client.15603 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:01:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.331+0000 7f114ffdd740 10 client.15603 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:01:13.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.331+0000 7f114ffdd740 20 client.15603 populate_metadata read hostname 'smithi037' 2024-09-21T06:01:13.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.331+0000 7f114ffdd740 1 --2- 172.21.15.37:0/1333652808 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5585c1bd51d0 0x5585c1fec440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.331+0000 7f114ffdd740 4 client.15603 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:13.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.331+0000 7f114ffdd740 1 -- 172.21.15.37:0/1333652808 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585c1f359e0 con 0x5585c1bd51d0 2024-09-21T06:01:13.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.331+0000 7f1141e00640 1 --2- 172.21.15.37:0/1333652808 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5585c1bd51d0 0x5585c1fec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.332+0000 7f1141e00640 1 --2- 172.21.15.37:0/1333652808 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5585c1bd51d0 0x5585c1fec440 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=267435d715253fe4 server_cookie=5f7916a90f9ab207 in_seq=0 out_seq=0 2024-09-21T06:01:13.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.332+0000 7f1123e00640 10 client.15603 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:13.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.333+0000 7f1123e00640 1 -- 172.21.15.37:0/1333652808 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5585c1f359e0 con 0x5585c1bd51d0 2024-09-21T06:01:13.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.333+0000 7f1123e00640 10 client.15603 handle_command_reply: tid=0 2024-09-21T06:01:13.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.333+0000 7f114ffdd740 1 client.15603 shutdown 2024-09-21T06:01:13.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.334+0000 7f114ffdd740 1 -- 172.21.15.37:0/1333652808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 msgr2=0x5585c1fc9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.334+0000 7f114ffdd740 1 --2- 172.21.15.37:0/1333652808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 0x5585c1fc9b70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f11340cd880 tx=0x7f1134009260 comp rx=0 tx=0).stop 2024-09-21T06:01:13.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.334+0000 7f114ffdd740 1 -- 172.21.15.37:0/1333652808 shutdown_connections 2024-09-21T06:01:13.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.334+0000 7f114ffdd740 1 --2- 172.21.15.37:0/1333652808 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5585c1bd51d0 0x5585c1fec440 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.334+0000 7f114ffdd740 1 --2- 172.21.15.37:0/1333652808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1c16850 0x5585c1fcf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.334+0000 7f114ffdd740 1 --2- 172.21.15.37:0/1333652808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1bf5b70 0x5585c1fca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.334+0000 7f114ffdd740 1 --2- 172.21.15.37:0/1333652808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 0x5585c1fc9b70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.334+0000 7f114ffdd740 1 -- 172.21.15.37:0/1333652808 >> 172.21.15.37:0/1333652808 conn(0x5585c1c0ac40 msgr2=0x5585c1fb9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.334+0000 7f1123e00640 0 client.15603 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.334+0000 7f114ffdd740 1 -- 172.21.15.37:0/1333652808 shutdown_connections 2024-09-21T06:01:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.335+0000 7f114ffdd740 1 -- 172.21.15.37:0/1333652808 wait complete. 2024-09-21T06:01:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.335+0000 7f114ffdd740 20 client.15603 trim_cache size 0 max 16384 2024-09-21T06:01:13.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.369+0000 7f114ffdd740 1 Processor -- start 2024-09-21T06:01:13.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.370+0000 7f114ffdd740 1 -- start start 2024-09-21T06:01:13.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.370+0000 7f114ffdd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1bed990 0x5585c1fc7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.370+0000 7f114ffdd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bf5b70 0x5585c1ff1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.370+0000 7f114ffdd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1c16850 0x5585c1ff2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.370+0000 7f114ffdd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f11441acb40 con 0x5585c1bf5b70 2024-09-21T06:01:13.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.370+0000 7f114ffdd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f11441af3a0 con 0x5585c1bed990 2024-09-21T06:01:13.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.370+0000 7f114ffdd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f11441ad190 con 0x5585c1c16850 2024-09-21T06:01:13.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.370+0000 7f1142800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1bed990 0x5585c1fc7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.370+0000 7f1142800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1bed990 0x5585c1fc7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:53198/0 (socket says 172.21.15.37:53198) 2024-09-21T06:01:13.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.370+0000 7f1142800640 1 -- 172.21.15.37:0/229085564 learned_addr learned my addr 172.21.15.37:0/229085564 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:13.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.370+0000 7f1141e00640 1 --2- 172.21.15.37:0/229085564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bf5b70 0x5585c1ff1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.370+0000 7f1143200640 1 --2- 172.21.15.37:0/229085564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1c16850 0x5585c1ff2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.371+0000 7f1142800640 1 -- 172.21.15.37:0/229085564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1c16850 msgr2=0x5585c1ff2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.371+0000 7f1142800640 1 --2- 172.21.15.37:0/229085564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1c16850 0x5585c1ff2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.371+0000 7f1142800640 1 -- 172.21.15.37:0/229085564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bf5b70 msgr2=0x5585c1ff1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.371+0000 7f1142800640 1 --2- 172.21.15.37:0/229085564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bf5b70 0x5585c1ff1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.371+0000 7f1142800640 1 -- 172.21.15.37:0/229085564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c1fbc220 con 0x5585c1bed990 2024-09-21T06:01:13.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.371+0000 7f1143200640 1 --2- 172.21.15.37:0/229085564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1c16850 0x5585c1ff2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:13.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.371+0000 7f1142800640 1 --2- 172.21.15.37:0/229085564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1bed990 0x5585c1fc7480 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f11340eff60 tx=0x7f113402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a959302e977273d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:13.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.371+0000 7f112ea00640 1 -- 172.21.15.37:0/229085564 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134049070 con 0x5585c1bed990 2024-09-21T06:01:13.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.371+0000 7f112ea00640 1 -- 172.21.15.37:0/229085564 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11340cd690 con 0x5585c1bed990 2024-09-21T06:01:13.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.371+0000 7f112ea00640 1 -- 172.21.15.37:0/229085564 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134005e00 con 0x5585c1bed990 2024-09-21T06:01:13.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.372+0000 7f114ffdd740 1 -- 172.21.15.37:0/229085564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1bed990 msgr2=0x5585c1fc7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:13.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.372+0000 7f114ffdd740 1 --2- 172.21.15.37:0/229085564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1bed990 0x5585c1fc7480 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f11340eff60 tx=0x7f113402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.372+0000 7f114ffdd740 1 -- 172.21.15.37:0/229085564 shutdown_connections 2024-09-21T06:01:13.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.372+0000 7f114ffdd740 1 --2- 172.21.15.37:0/229085564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1c16850 0x5585c1ff2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.372+0000 7f114ffdd740 1 --2- 172.21.15.37:0/229085564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bf5b70 0x5585c1ff1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.372+0000 7f114ffdd740 1 --2- 172.21.15.37:0/229085564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1bed990 0x5585c1fc7480 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.372+0000 7f114ffdd740 1 -- 172.21.15.37:0/229085564 >> 172.21.15.37:0/229085564 conn(0x5585c1c0ac40 msgr2=0x5585c1fc6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:13.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.372+0000 7f114ffdd740 1 -- 172.21.15.37:0/229085564 shutdown_connections 2024-09-21T06:01:13.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.373+0000 7f114ffdd740 1 -- 172.21.15.37:0/229085564 wait complete. 2024-09-21T06:01:13.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.373+0000 7f114ffdd740 1 -- start start 2024-09-21T06:01:13.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.373+0000 7f114ffdd740 1 Processor -- start 2024-09-21T06:01:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.374+0000 7f114ffdd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 0x5585c1ffdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.374+0000 7f114ffdd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1bf5b70 0x5585c1ffe320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.374+0000 7f114ffdd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1c16850 0x5585c1ff8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.374+0000 7f114ffdd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f11441ad860 con 0x5585c1bed990 2024-09-21T06:01:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.374+0000 7f114ffdd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f11441aecd0 con 0x5585c1bf5b70 2024-09-21T06:01:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.374+0000 7f114ffdd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f11441adf30 con 0x5585c1c16850 2024-09-21T06:01:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.374+0000 7f114ffdd740 10 client.0 _ll_register_callbacks cb 0x7f113410b390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.374+0000 7f1142800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 0x5585c1ffdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.374+0000 7f1142800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 0x5585c1ffdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45284/0 (socket says 172.21.15.37:45284) 2024-09-21T06:01:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.374+0000 7f1142800640 1 -- 172.21.15.37:0/3475539709 learned_addr learned my addr 172.21.15.37:0/3475539709 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.374+0000 7f1141e00640 1 --2- 172.21.15.37:0/3475539709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1bf5b70 0x5585c1ffe320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.374+0000 7f1143200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1c16850 0x5585c1ff8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.375+0000 7f1141e00640 1 -- 172.21.15.37:0/3475539709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1c16850 msgr2=0x5585c1ff8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.375+0000 7f1141e00640 1 --2- 172.21.15.37:0/3475539709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1c16850 0x5585c1ff8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.375+0000 7f1141e00640 1 -- 172.21.15.37:0/3475539709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 msgr2=0x5585c1ffdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:13.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.375+0000 7f1141e00640 1 --2- 172.21.15.37:0/3475539709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 0x5585c1ffdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:13.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.375+0000 7f1141e00640 1 -- 172.21.15.37:0/3475539709 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585c1ff9200 con 0x5585c1bf5b70 2024-09-21T06:01:13.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.375+0000 7f1142800640 1 --2- 172.21.15.37:0/3475539709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 0x5585c1ffdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:13.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.375+0000 7f1141e00640 1 --2- 172.21.15.37:0/3475539709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1bf5b70 0x5585c1ffe320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5585c1fecb40 tx=0x7f1130014840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c73e283266a3a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:13.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.375+0000 7f1123e00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T06:01:13.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.380+0000 7f1123e00640 1 -- 172.21.15.37:0/3475539709 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130012650 con 0x5585c1bf5b70 2024-09-21T06:01:13.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.380+0000 7f1123e00640 1 -- 172.21.15.37:0/3475539709 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f11300127f0 con 0x5585c1bf5b70 2024-09-21T06:01:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.381+0000 7f114ffdd740 1 -- 172.21.15.37:0/3475539709 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11340cd690 con 0x5585c1bf5b70 2024-09-21T06:01:13.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.381+0000 7f1123e00640 1 -- 172.21.15.37:0/3475539709 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f11300129f0 con 0x5585c1bf5b70 2024-09-21T06:01:13.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.381+0000 7f114ffdd740 10 client.25658 fetch_fsmap learned FSMap version 21 2024-09-21T06:01:13.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.382+0000 7f114ffdd740 1 -- 172.21.15.37:0/3475539709 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5585c2057730 con 0x5585c1bf5b70 2024-09-21T06:01:13.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.382+0000 7f1123e00640 1 -- 172.21.15.37:0/3475539709 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11340cd690 con 0x5585c1bf5b70 2024-09-21T06:01:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.383+0000 7f1123e00640 1 -- 172.21.15.37:0/3475539709 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1130023070 con 0x5585c1bf5b70 2024-09-21T06:01:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.383+0000 7f114ffdd740 10 client.25658 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:01:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.383+0000 7f114ffdd740 10 client.25658 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:01:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.383+0000 7f114ffdd740 20 client.25658 populate_metadata read hostname 'smithi037' 2024-09-21T06:01:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.383+0000 7f114ffdd740 1 --2- 172.21.15.37:0/3475539709 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5585c1baa580 0x5585c2059f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:13.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.383+0000 7f114ffdd740 4 client.25658 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}] 2024-09-21T06:01:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.383+0000 7f114ffdd740 1 -- 172.21.15.37:0/3475539709 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}) -- 0x5585c1f31490 con 0x5585c1baa580 2024-09-21T06:01:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.384+0000 7f1142800640 1 --2- 172.21.15.37:0/3475539709 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5585c1baa580 0x5585c2059f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.385+0000 7f1142800640 1 --2- 172.21.15.37:0/3475539709 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5585c1baa580 0x5585c2059f40 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd0b2f201e5cb41f server_cookie=159bc26af3834bbf in_seq=0 out_seq=0 2024-09-21T06:01:13.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:13.385+0000 7f1123e00640 10 client.25658 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:13.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:13 smithi067 ceph-mon[34443]: pgmap v633: 129 pgs: 129 active+clean; 139 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.2 MiB/s wr, 471 op/s 2024-09-21T06:01:13.622 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:13 smithi144 ceph-mon[34351]: pgmap v633: 129 pgs: 129 active+clean; 139 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.2 MiB/s wr, 471 op/s 2024-09-21T06:01:14.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.327+0000 7f1123e00640 1 -- 172.21.15.37:0/3475539709 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5585c1f31490 con 0x5585c1baa580 2024-09-21T06:01:14.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.327+0000 7f1123e00640 10 client.25658 handle_command_reply: tid=0 2024-09-21T06:01:14.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.327+0000 7f114ffdd740 1 client.25658 shutdown 2024-09-21T06:01:14.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.327+0000 7f114ffdd740 1 -- 172.21.15.37:0/3475539709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1bf5b70 msgr2=0x5585c1ffe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:14.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.327+0000 7f114ffdd740 1 --2- 172.21.15.37:0/3475539709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1bf5b70 0x5585c1ffe320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5585c1fecb40 tx=0x7f1130014840 comp rx=0 tx=0).stop 2024-09-21T06:01:14.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.327+0000 7f114ffdd740 1 -- 172.21.15.37:0/3475539709 shutdown_connections 2024-09-21T06:01:14.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.327+0000 7f114ffdd740 1 --2- 172.21.15.37:0/3475539709 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5585c1baa580 0x5585c2059f40 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.327+0000 7f114ffdd740 1 --2- 172.21.15.37:0/3475539709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5585c1c16850 0x5585c1ff8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.327+0000 7f114ffdd740 1 --2- 172.21.15.37:0/3475539709 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585c1bf5b70 0x5585c1ffe320 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.327+0000 7f114ffdd740 1 --2- 172.21.15.37:0/3475539709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c1bed990 0x5585c1ffdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.327+0000 7f1123e00640 0 client.25658 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:14.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.327+0000 7f114ffdd740 1 -- 172.21.15.37:0/3475539709 >> 172.21.15.37:0/3475539709 conn(0x5585c1c0ac40 msgr2=0x5585c1fc7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:14.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.328+0000 7f114ffdd740 1 -- 172.21.15.37:0/3475539709 shutdown_connections 2024-09-21T06:01:14.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.328+0000 7f114ffdd740 1 -- 172.21.15.37:0/3475539709 wait complete. 2024-09-21T06:01:14.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.328+0000 7f114ffdd740 20 client.25658 trim_cache size 0 max 16384 2024-09-21T06:01:14.332 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:01:14.332 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T06:01:14.332 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T06:01:14.332 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 30, 2024-09-21T06:01:14.332 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T06:01:14.332 INFO:teuthology.orchestra.run.smithi037.stdout: "257757f8": { 2024-09-21T06:01:14.332 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 30, 2024-09-21T06:01:14.332 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 141.1, 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:14.333 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:14.334 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:14.334 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:14.334 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:01:14.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.329+0000 7f1149400640 1 -- 172.21.15.37:0/2647785363 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11280b6510 msgr2=0x7f11280b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:14.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.329+0000 7f1149400640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11280b6510 0x7f11280b8a20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f113c009b50 tx=0x7f113c005bd0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.329+0000 7f1149400640 1 -- 172.21.15.37:0/2647785363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1144105dc0 msgr2=0x7f114419c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.329+0000 7f1149400640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1144105dc0 0x7f114419c6f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1134005ab0 tx=0x7f1134003c10 comp rx=0 tx=0).stop 2024-09-21T06:01:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.329+0000 7f1149400640 1 -- 172.21.15.37:0/2647785363 shutdown_connections 2024-09-21T06:01:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.329+0000 7f1149400640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f11280b6510 0x7f11280b8a20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.329+0000 7f1149400640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f114410c050 0x7f11441a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.329+0000 7f1149400640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f114410b700 0x7f114419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.329+0000 7f1149400640 1 --2- 172.21.15.37:0/2647785363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1144105dc0 0x7f114419c6f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.329+0000 7f1149400640 1 -- 172.21.15.37:0/2647785363 >> 172.21.15.37:0/2647785363 conn(0x7f11441017d0 msgr2=0x7f1144104c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.329+0000 7f1149400640 1 -- 172.21.15.37:0/2647785363 shutdown_connections 2024-09-21T06:01:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:14.329+0000 7f1149400640 1 -- 172.21.15.37:0/2647785363 wait complete. 2024-09-21T06:01:15.089 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '257757f8', quiesce took 5.5 seconds. Will release after: 15.55 2024-09-21T06:01:15.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:15 smithi067 ceph-mon[34443]: pgmap v634: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.0 MiB/s wr, 395 op/s 2024-09-21T06:01:15.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:15 smithi144 ceph-mon[34351]: pgmap v634: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.0 MiB/s wr, 395 op/s 2024-09-21T06:01:15.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:15 smithi037 ceph-mon[30631]: pgmap v634: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.0 MiB/s wr, 395 op/s 2024-09-21T06:01:17.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:17 smithi067 ceph-mon[34443]: pgmap v635: 129 pgs: 129 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.0 MiB/s wr, 413 op/s 2024-09-21T06:01:17.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:17 smithi144 ceph-mon[34351]: pgmap v635: 129 pgs: 129 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.0 MiB/s wr, 413 op/s 2024-09-21T06:01:17.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:17 smithi037 ceph-mon[30631]: pgmap v635: 129 pgs: 129 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.0 MiB/s wr, 413 op/s 2024-09-21T06:01:19.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:19 smithi067 ceph-mon[34443]: pgmap v636: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 951 KiB/s wr, 343 op/s 2024-09-21T06:01:19.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:19 smithi144 ceph-mon[34351]: pgmap v636: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 951 KiB/s wr, 343 op/s 2024-09-21T06:01:19.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:19 smithi037 ceph-mon[30631]: pgmap v636: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 951 KiB/s wr, 343 op/s 2024-09-21T06:01:21.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:21 smithi067 ceph-mon[34443]: pgmap v637: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 649 KiB/s wr, 242 op/s 2024-09-21T06:01:21.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:21 smithi144 ceph-mon[34351]: pgmap v637: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 649 KiB/s wr, 242 op/s 2024-09-21T06:01:21.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:21 smithi037 ceph-mon[30631]: pgmap v637: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 649 KiB/s wr, 242 op/s 2024-09-21T06:01:23.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:23 smithi067 ceph-mon[34443]: pgmap v638: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 491 KiB/s wr, 182 op/s 2024-09-21T06:01:23.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:23 smithi144 ceph-mon[34351]: pgmap v638: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 491 KiB/s wr, 182 op/s 2024-09-21T06:01:23.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:23 smithi037 ceph-mon[30631]: pgmap v638: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 491 KiB/s wr, 182 op/s 2024-09-21T06:01:25.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:25 smithi067 ceph-mon[34443]: pgmap v639: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 264 KiB/s wr, 90 op/s 2024-09-21T06:01:25.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:25 smithi144 ceph-mon[34351]: pgmap v639: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 264 KiB/s wr, 90 op/s 2024-09-21T06:01:25.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:25 smithi037 ceph-mon[30631]: pgmap v639: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 264 KiB/s wr, 90 op/s 2024-09-21T06:01:27.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:27 smithi067 ceph-mon[34443]: pgmap v640: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 181 KiB/s wr, 66 op/s 2024-09-21T06:01:27.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:27 smithi144 ceph-mon[34351]: pgmap v640: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 181 KiB/s wr, 66 op/s 2024-09-21T06:01:27.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:27 smithi037 ceph-mon[30631]: pgmap v640: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 181 KiB/s wr, 66 op/s 2024-09-21T06:01:29.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:29 smithi067 ceph-mon[34443]: pgmap v641: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 84 KiB/s wr, 28 op/s 2024-09-21T06:01:29.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:29 smithi144 ceph-mon[34351]: pgmap v641: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 84 KiB/s wr, 28 op/s 2024-09-21T06:01:29.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:29 smithi037 ceph-mon[30631]: pgmap v641: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 84 KiB/s wr, 28 op/s 2024-09-21T06:01:30.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:01:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.658+0000 7fe918a00640 1 -- 172.21.15.37:0/2078924780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914109df0 msgr2=0x7fe914110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.658+0000 7fe918a00640 1 --2- 172.21.15.37:0/2078924780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914109df0 0x7fe914110620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009ca0 tx=0x7fe90c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:01:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.658+0000 7fe918a00640 1 -- 172.21.15.37:0/2078924780 shutdown_connections 2024-09-21T06:01:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.658+0000 7fe918a00640 1 --2- 172.21.15.37:0/2078924780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914109df0 0x7fe914110620 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.658+0000 7fe918a00640 1 --2- 172.21.15.37:0/2078924780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9141094a0 0x7fe9141098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.658+0000 7fe918a00640 1 --2- 172.21.15.37:0/2078924780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe914103b60 0x7fe914103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.658+0000 7fe918a00640 1 -- 172.21.15.37:0/2078924780 >> 172.21.15.37:0/2078924780 conn(0x7fe91407b850 msgr2=0x7fe91407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.658+0000 7fe918a00640 1 -- 172.21.15.37:0/2078924780 shutdown_connections 2024-09-21T06:01:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.658+0000 7fe918a00640 1 -- 172.21.15.37:0/2078924780 wait complete. 2024-09-21T06:01:31.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.659+0000 7fe918a00640 1 Processor -- start 2024-09-21T06:01:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.659+0000 7fe918a00640 1 -- start start 2024-09-21T06:01:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe918a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914103b60 0x7fe914075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe918a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9141094a0 0x7fe914075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe918a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe914109df0 0x7fe914076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe918a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe914113b00 con 0x7fe914103b60 2024-09-21T06:01:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe918a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe914113980 con 0x7fe914109df0 2024-09-21T06:01:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe918a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe914113c80 con 0x7fe9141094a0 2024-09-21T06:01:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe911e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914103b60 0x7fe914075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe911e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914103b60 0x7fe914075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50120/0 (socket says 172.21.15.37:50120) 2024-09-21T06:01:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe911e00640 1 -- 172.21.15.37:0/1406785072 learned_addr learned my addr 172.21.15.37:0/1406785072 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe912800640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe914109df0 0x7fe914076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe911400640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9141094a0 0x7fe914075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe911e00640 1 -- 172.21.15.37:0/1406785072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9141094a0 msgr2=0x7fe914075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe911e00640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9141094a0 0x7fe914075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe911e00640 1 -- 172.21.15.37:0/1406785072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe914109df0 msgr2=0x7fe914076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe911e00640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe914109df0 0x7fe914076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.660+0000 7fe911e00640 1 -- 172.21.15.37:0/1406785072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9141a8710 con 0x7fe914103b60 2024-09-21T06:01:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.661+0000 7fe911e00640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914103b60 0x7fe914075710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe90400e9f0 tx=0x7fe90400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.661+0000 7fe90aa00640 1 -- 172.21.15.37:0/1406785072 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90400cd80 con 0x7fe914103b60 2024-09-21T06:01:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.661+0000 7fe918a00640 1 -- 172.21.15.37:0/1406785072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9141a8a00 con 0x7fe914103b60 2024-09-21T06:01:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.661+0000 7fe90aa00640 1 -- 172.21.15.37:0/1406785072 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9040054d0 con 0x7fe914103b60 2024-09-21T06:01:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.661+0000 7fe90aa00640 1 -- 172.21.15.37:0/1406785072 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe904010690 con 0x7fe914103b60 2024-09-21T06:01:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.661+0000 7fe918a00640 1 -- 172.21.15.37:0/1406785072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9141a8ef0 con 0x7fe914103b60 2024-09-21T06:01:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.662+0000 7fe918a00640 1 -- 172.21.15.37:0/1406785072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe914103f70 con 0x7fe914103b60 2024-09-21T06:01:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.665+0000 7fe90aa00640 1 -- 172.21.15.37:0/1406785072 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fe904004e30 con 0x7fe914103b60 2024-09-21T06:01:31.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.666+0000 7fe90aa00640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe8f80b6510 0x7fe8f80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:31.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.666+0000 7fe90aa00640 1 -- 172.21.15.37:0/1406785072 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fe9040e7cd0 con 0x7fe914103b60 2024-09-21T06:01:31.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.667+0000 7fe911400640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe8f80b6510 0x7fe8f80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:31.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.667+0000 7fe911400640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe8f80b6510 0x7fe8f80b8a20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe9000095f0 tx=0x7fe900005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:31.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.669+0000 7fe90aa00640 1 -- 172.21.15.37:0/1406785072 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe9040ae130 con 0x7fe914103b60 2024-09-21T06:01:31.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:31 smithi067 ceph-mon[34443]: pgmap v642: 129 pgs: 129 active+clean; 154 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 20 KiB/s wr, 2 op/s 2024-09-21T06:01:31.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:31 smithi144 ceph-mon[34351]: pgmap v642: 129 pgs: 129 active+clean; 154 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 20 KiB/s wr, 2 op/s 2024-09-21T06:01:31.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.908+0000 7fe918a00640 1 -- 172.21.15.37:0/1406785072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe914076a10 con 0x7fe914103b60 2024-09-21T06:01:31.911 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:31 smithi037 ceph-mon[30631]: pgmap v642: 129 pgs: 129 active+clean; 154 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 20 KiB/s wr, 2 op/s 2024-09-21T06:01:31.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.909+0000 7fe90aa00640 1 -- 172.21.15.37:0/1406785072 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7fe914076a10 con 0x7fe914103b60 2024-09-21T06:01:31.912 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:01:31.912 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T06:01:31.912 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T06:01:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.912+0000 7fe918a00640 1 -- 172.21.15.37:0/1406785072 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe8f80b6510 msgr2=0x7fe8f80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.912+0000 7fe918a00640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe8f80b6510 0x7fe8f80b8a20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe9000095f0 tx=0x7fe900005f90 comp rx=0 tx=0).stop 2024-09-21T06:01:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.912+0000 7fe918a00640 1 -- 172.21.15.37:0/1406785072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914103b60 msgr2=0x7fe914075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:31.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.912+0000 7fe918a00640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914103b60 0x7fe914075710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe90400e9f0 tx=0x7fe90400edf0 comp rx=0 tx=0).stop 2024-09-21T06:01:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.912+0000 7fe918a00640 1 -- 172.21.15.37:0/1406785072 shutdown_connections 2024-09-21T06:01:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.912+0000 7fe918a00640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe8f80b6510 0x7fe8f80b8a20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.912+0000 7fe918a00640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe914109df0 0x7fe914076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.912+0000 7fe918a00640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9141094a0 0x7fe914075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.912+0000 7fe918a00640 1 --2- 172.21.15.37:0/1406785072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe914103b60 0x7fe914075710 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.912+0000 7fe918a00640 1 -- 172.21.15.37:0/1406785072 >> 172.21.15.37:0/1406785072 conn(0x7fe91407b850 msgr2=0x7fe914105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.912+0000 7fe918a00640 1 -- 172.21.15.37:0/1406785072 shutdown_connections 2024-09-21T06:01:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:31.912+0000 7fe918a00640 1 -- 172.21.15.37:0/1406785072 wait complete. 2024-09-21T06:01:32.739 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db --set-id 257757f8 --release --await' 2024-09-21T06:01:32.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db --set-id 257757f8 --release --await 2024-09-21T06:01:32.788 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:32 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1406785072' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:32.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:32 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1406785072' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:32.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:32 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1406785072' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:33.118 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:33.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:33 smithi037 ceph-mon[30631]: pgmap v643: 129 pgs: 129 active+clean; 154 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 20 KiB/s wr, 3 op/s 2024-09-21T06:01:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.750+0000 7f9d89c00640 1 -- 172.21.15.37:0/454629902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d841039b0 msgr2=0x7f9d84103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.750+0000 7f9d89c00640 1 --2- 172.21.15.37:0/454629902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d841039b0 0x7f9d84103dc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009900 tx=0x7f9d7402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.751+0000 7f9d89c00640 1 -- 172.21.15.37:0/454629902 shutdown_connections 2024-09-21T06:01:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.751+0000 7f9d89c00640 1 --2- 172.21.15.37:0/454629902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d84109c40 0x7f9d84110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.751+0000 7f9d89c00640 1 --2- 172.21.15.37:0/454629902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d841092f0 0x7f9d84109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.751+0000 7f9d89c00640 1 --2- 172.21.15.37:0/454629902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d841039b0 0x7f9d84103dc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.751+0000 7f9d89c00640 1 -- 172.21.15.37:0/454629902 >> 172.21.15.37:0/454629902 conn(0x7f9d840ff440 msgr2=0x7f9d84101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.751+0000 7f9d89c00640 1 -- 172.21.15.37:0/454629902 shutdown_connections 2024-09-21T06:01:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.751+0000 7f9d89c00640 1 -- 172.21.15.37:0/454629902 wait complete. 2024-09-21T06:01:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.752+0000 7f9d89c00640 1 Processor -- start 2024-09-21T06:01:33.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.752+0000 7f9d89c00640 1 -- start start 2024-09-21T06:01:33.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.753+0000 7f9d89c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d841039b0 0x7f9d8419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.753+0000 7f9d89c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d841092f0 0x7f9d8419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.753+0000 7f9d89c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d84109c40 0x7f9d841a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.753+0000 7f9d89c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d84113900 con 0x7f9d84109c40 2024-09-21T06:01:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.753+0000 7f9d89c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9d84113780 con 0x7f9d841092f0 2024-09-21T06:01:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.753+0000 7f9d89c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d84113a80 con 0x7f9d841039b0 2024-09-21T06:01:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.753+0000 7f9d7b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d841092f0 0x7f9d8419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.753+0000 7f9d7b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d841092f0 0x7f9d8419cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:50618/0 (socket says 172.21.15.37:50618) 2024-09-21T06:01:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.753+0000 7f9d7b400640 1 -- 172.21.15.37:0/1770817300 learned_addr learned my addr 172.21.15.37:0/1770817300 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.753+0000 7f9d89200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d84109c40 0x7f9d841a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.753+0000 7f9d83e00640 1 --2- 172.21.15.37:0/1770817300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d841039b0 0x7f9d8419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.754+0000 7f9d7b400640 1 -- 172.21.15.37:0/1770817300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d841039b0 msgr2=0x7f9d8419c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.754+0000 7f9d7b400640 1 --2- 172.21.15.37:0/1770817300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d841039b0 0x7f9d8419c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.754+0000 7f9d7b400640 1 -- 172.21.15.37:0/1770817300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d84109c40 msgr2=0x7f9d841a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.754+0000 7f9d7b400640 1 --2- 172.21.15.37:0/1770817300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d84109c40 0x7f9d841a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.754+0000 7f9d7b400640 1 -- 172.21.15.37:0/1770817300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d841a24a0 con 0x7f9d841092f0 2024-09-21T06:01:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.754+0000 7f9d7b400640 1 --2- 172.21.15.37:0/1770817300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d841092f0 0x7f9d8419cad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00e9f0 tx=0x7f9d6c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.754+0000 7f9d81600640 1 -- 172.21.15.37:0/1770817300 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c00ccc0 con 0x7f9d841092f0 2024-09-21T06:01:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.754+0000 7f9d81600640 1 -- 172.21.15.37:0/1770817300 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d6c0108e0 con 0x7f9d841092f0 2024-09-21T06:01:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.754+0000 7f9d81600640 1 -- 172.21.15.37:0/1770817300 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c018860 con 0x7f9d841092f0 2024-09-21T06:01:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.754+0000 7f9d89c00640 1 -- 172.21.15.37:0/1770817300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d841a2790 con 0x7f9d841092f0 2024-09-21T06:01:33.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.755+0000 7f9d89c00640 1 -- 172.21.15.37:0/1770817300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d841a8ef0 con 0x7f9d841092f0 2024-09-21T06:01:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.758+0000 7f9d91e4e740 1 Processor -- start 2024-09-21T06:01:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.758+0000 7f9d91e4e740 1 -- start start 2024-09-21T06:01:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.758+0000 7f9d91e4e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825e0b520 0x5638261b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.758+0000 7f9d91e4e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825de2660 0x5638261b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.758+0000 7f9d91e4e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dea840 0x5638261b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.758+0000 7f9d91e4e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563826129290 con 0x563825de2660 2024-09-21T06:01:33.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.758+0000 7f9d91e4e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5638261186c0 con 0x563825e0b520 2024-09-21T06:01:33.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.758+0000 7f9d91e4e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56382611c4d0 con 0x563825dea840 2024-09-21T06:01:33.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.758+0000 7f9d81600640 1 -- 172.21.15.37:0/1770817300 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9d6c010430 con 0x7f9d841092f0 2024-09-21T06:01:33.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.758+0000 7f9d83e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825de2660 0x5638261b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.759+0000 7f9d89200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825e0b520 0x5638261b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.759+0000 7f9d89200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825e0b520 0x5638261b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:50622/0 (socket says 172.21.15.37:50622) 2024-09-21T06:01:33.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.759+0000 7f9d89200640 1 -- 172.21.15.37:0/2347980163 learned_addr learned my addr 172.21.15.37:0/2347980163 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:33.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.759+0000 7f9d7b400640 1 --2- 172.21.15.37:0/2347980163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dea840 0x5638261b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.759+0000 7f9d89200640 1 -- 172.21.15.37:0/2347980163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dea840 msgr2=0x5638261b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.759+0000 7f9d89200640 1 --2- 172.21.15.37:0/2347980163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dea840 0x5638261b2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.759+0000 7f9d89200640 1 -- 172.21.15.37:0/2347980163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825de2660 msgr2=0x5638261b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.759+0000 7f9d89200640 1 --2- 172.21.15.37:0/2347980163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825de2660 0x5638261b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.759+0000 7f9d89200640 1 -- 172.21.15.37:0/2347980163 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638260a5460 con 0x563825e0b520 2024-09-21T06:01:33.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.759+0000 7f9d7b400640 1 --2- 172.21.15.37:0/2347980163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dea840 0x5638261b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:33.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.759+0000 7f9d89200640 1 --2- 172.21.15.37:0/2347980163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825e0b520 0x5638261b2340 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009fd0 tx=0x7f9d7c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeaecbfdf0efc5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.760+0000 7f9d79600640 1 -- 172.21.15.37:0/2347980163 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c004d20 con 0x563825e0b520 2024-09-21T06:01:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.760+0000 7f9d79600640 1 -- 172.21.15.37:0/2347980163 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d7c004050 con 0x563825e0b520 2024-09-21T06:01:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.760+0000 7f9d79600640 1 -- 172.21.15.37:0/2347980163 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c005280 con 0x563825e0b520 2024-09-21T06:01:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.760+0000 7f9d81600640 1 --2- 172.21.15.37:0/1770817300 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9d680b6590 0x7f9d680b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.760+0000 7f9d81600640 1 -- 172.21.15.37:0/1770817300 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f9d6c0e7910 con 0x7f9d841092f0 2024-09-21T06:01:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.760+0000 7f9d83e00640 1 --2- 172.21.15.37:0/1770817300 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9d680b6590 0x7f9d680b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.761+0000 7f9d91e4e740 1 -- 172.21.15.37:0/2347980163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825e0b520 msgr2=0x5638261b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.761+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/2347980163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825e0b520 0x5638261b2340 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009fd0 tx=0x7f9d7c0118d0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.761+0000 7f9d91e4e740 1 -- 172.21.15.37:0/2347980163 shutdown_connections 2024-09-21T06:01:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.761+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/2347980163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dea840 0x5638261b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.761+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/2347980163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825de2660 0x5638261b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.761+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/2347980163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825e0b520 0x5638261b2340 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.761+0000 7f9d91e4e740 1 -- 172.21.15.37:0/2347980163 >> 172.21.15.37:0/2347980163 conn(0x563825dff910 msgr2=0x5638261b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.761+0000 7f9d91e4e740 1 -- 172.21.15.37:0/2347980163 shutdown_connections 2024-09-21T06:01:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.761+0000 7f9d91e4e740 1 -- 172.21.15.37:0/2347980163 wait complete. 2024-09-21T06:01:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.761+0000 7f9d83e00640 1 --2- 172.21.15.37:0/1770817300 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9d680b6590 0x7f9d680b8aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9d74031440 tx=0x7f9d74009560 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.762+0000 7f9d91e4e740 1 -- start start 2024-09-21T06:01:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.762+0000 7f9d91e4e740 1 Processor -- start 2024-09-21T06:01:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.762+0000 7f9d91e4e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825de2660 0x5638261bdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.762+0000 7f9d91e4e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 0x5638261be440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.762+0000 7f9d91e4e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825e0b520 0x5638261c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.762+0000 7f9d91e4e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563825f79bb0 con 0x563825dea840 2024-09-21T06:01:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.762+0000 7f9d91e4e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5638260b36c0 con 0x563825e0b520 2024-09-21T06:01:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.762+0000 7f9d91e4e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5638261c0b20 con 0x563825de2660 2024-09-21T06:01:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.763+0000 7f9d91e4e740 10 client.0 _ll_register_callbacks cb 0x5638260ce490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.763+0000 7f9d7b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 0x5638261be440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.763+0000 7f9d83e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825de2660 0x5638261bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.763+0000 7f9d7b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 0x5638261be440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50158/0 (socket says 172.21.15.37:50158) 2024-09-21T06:01:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.763+0000 7f9d7b400640 1 -- 172.21.15.37:0/128743777 learned_addr learned my addr 172.21.15.37:0/128743777 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.763+0000 7f9d89200640 1 --2- 172.21.15.37:0/128743777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825e0b520 0x5638261c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.763+0000 7f9d7b400640 1 -- 172.21.15.37:0/128743777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825de2660 msgr2=0x5638261bdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.763+0000 7f9d7b400640 1 --2- 172.21.15.37:0/128743777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825de2660 0x5638261bdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.763+0000 7f9d7b400640 1 -- 172.21.15.37:0/128743777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825e0b520 msgr2=0x5638261c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.763+0000 7f9d7b400640 1 --2- 172.21.15.37:0/128743777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825e0b520 0x5638261c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.763+0000 7f9d7b400640 1 -- 172.21.15.37:0/128743777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563825e76b00 con 0x563825dea840 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.763+0000 7f9d89200640 1 --2- 172.21.15.37:0/128743777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825e0b520 0x5638261c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.764+0000 7f9d7b400640 1 --2- 172.21.15.37:0/128743777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 0x5638261be440 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0e4fe0 tx=0x7f9d6c00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be96ac0e33a7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.764+0000 7f9d72000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.764+0000 7f9d72000640 1 -- 172.21.15.37:0/128743777 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0ace90 con 0x563825dea840 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.764+0000 7f9d72000640 1 -- 172.21.15.37:0/128743777 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f9d6c0b6240 con 0x563825dea840 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.764+0000 7f9d91e4e740 1 -- 172.21.15.37:0/128743777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d7c004050 con 0x563825dea840 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.764+0000 7f9d72000640 1 -- 172.21.15.37:0/128743777 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9d6c010720 con 0x563825dea840 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.764+0000 7f9d91e4e740 10 client.15627 fetch_fsmap learned FSMap version 21 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.764+0000 7f9d91e4e740 1 -- 172.21.15.37:0/128743777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563825eed960 con 0x563825dea840 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.764+0000 7f9d72000640 1 -- 172.21.15.37:0/128743777 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d7c004050 con 0x563825dea840 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.765+0000 7f9d72000640 1 -- 172.21.15.37:0/128743777 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9d6c0ac480 con 0x563825dea840 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.765+0000 7f9d91e4e740 10 client.15627 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.765+0000 7f9d91e4e740 10 client.15627 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.765+0000 7f9d91e4e740 20 client.15627 populate_metadata read hostname 'smithi037' 2024-09-21T06:01:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.765+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/128743777 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x563825dc9ea0 0x5638261cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.765+0000 7f9d91e4e740 4 client.15627 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.765+0000 7f9d91e4e740 1 -- 172.21.15.37:0/128743777 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56382612b1e0 con 0x563825dc9ea0 2024-09-21T06:01:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.765+0000 7f9d83e00640 1 --2- 172.21.15.37:0/128743777 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x563825dc9ea0 0x5638261cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.766+0000 7f9d83e00640 1 --2- 172.21.15.37:0/128743777 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x563825dc9ea0 0x5638261cfd50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9259a0a7ab208894 server_cookie=92d45ac99bd9bce6 in_seq=0 out_seq=0 2024-09-21T06:01:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.766+0000 7f9d72000640 10 client.15627 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.767+0000 7f9d72000640 1 -- 172.21.15.37:0/128743777 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56382612b1e0 con 0x563825dc9ea0 2024-09-21T06:01:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.767+0000 7f9d72000640 10 client.15627 handle_command_reply: tid=0 2024-09-21T06:01:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.767+0000 7f9d91e4e740 1 client.15627 shutdown 2024-09-21T06:01:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.768+0000 7f9d91e4e740 1 -- 172.21.15.37:0/128743777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 msgr2=0x5638261be440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.768+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/128743777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 0x5638261be440 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0e4fe0 tx=0x7f9d6c00cef0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.768+0000 7f9d91e4e740 1 -- 172.21.15.37:0/128743777 shutdown_connections 2024-09-21T06:01:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.768+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/128743777 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x563825dc9ea0 0x5638261cfd50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.768+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/128743777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825e0b520 0x5638261c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.768+0000 7f9d72000640 0 client.15627 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.768+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/128743777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 0x5638261be440 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.768+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/128743777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825de2660 0x5638261bdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.768+0000 7f9d91e4e740 1 -- 172.21.15.37:0/128743777 >> 172.21.15.37:0/128743777 conn(0x563825dff910 msgr2=0x5638261b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.768+0000 7f9d91e4e740 1 -- 172.21.15.37:0/128743777 shutdown_connections 2024-09-21T06:01:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.768+0000 7f9d91e4e740 1 -- 172.21.15.37:0/128743777 wait complete. 2024-09-21T06:01:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.768+0000 7f9d91e4e740 20 client.15627 trim_cache size 0 max 16384 2024-09-21T06:01:33.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.786+0000 7f9d91e4e740 1 Processor -- start 2024-09-21T06:01:33.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.787+0000 7f9d91e4e740 1 -- start start 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.787+0000 7f9d91e4e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dc9ea0 0x5638261bf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.787+0000 7f9d91e4e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825de2660 0x5638261d54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.787+0000 7f9d91e4e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 0x5638261d5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.787+0000 7f9d91e4e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d841b0c30 con 0x563825dea840 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.787+0000 7f9d91e4e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9d841b34b0 con 0x563825de2660 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.787+0000 7f9d91e4e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d841b12a0 con 0x563825dc9ea0 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.787+0000 7f9d89200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 0x5638261d5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.787+0000 7f9d7b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825de2660 0x5638261d54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.787+0000 7f9d89200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 0x5638261d5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50162/0 (socket says 172.21.15.37:50162) 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.787+0000 7f9d89200640 1 -- 172.21.15.37:0/3365232666 learned_addr learned my addr 172.21.15.37:0/3365232666 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.787+0000 7f9d7b400640 1 --2- 172.21.15.37:0/3365232666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825de2660 0x5638261d54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:50648/0 (socket says 172.21.15.37:50648) 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.787+0000 7f9d83e00640 1 --2- 172.21.15.37:0/3365232666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dc9ea0 0x5638261bf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.788+0000 7f9d89200640 1 -- 172.21.15.37:0/3365232666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dc9ea0 msgr2=0x5638261bf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.788+0000 7f9d89200640 1 --2- 172.21.15.37:0/3365232666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dc9ea0 0x5638261bf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.788+0000 7f9d89200640 1 -- 172.21.15.37:0/3365232666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825de2660 msgr2=0x5638261d54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.788+0000 7f9d89200640 1 --2- 172.21.15.37:0/3365232666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825de2660 0x5638261d54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.788+0000 7f9d89200640 1 -- 172.21.15.37:0/3365232666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638261befc0 con 0x563825dea840 2024-09-21T06:01:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.788+0000 7f9d7b400640 1 --2- 172.21.15.37:0/3365232666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825de2660 0x5638261d54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.788+0000 7f9d89200640 1 --2- 172.21.15.37:0/3365232666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 0x5638261d5a20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c01b040 tx=0x7f9d7c003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2058baf8c189726 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.789+0000 7f9d78c00640 1 -- 172.21.15.37:0/3365232666 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0050b0 con 0x563825dea840 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.789+0000 7f9d78c00640 1 -- 172.21.15.37:0/3365232666 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d7c005700 con 0x563825dea840 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.789+0000 7f9d78c00640 1 -- 172.21.15.37:0/3365232666 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c00fba0 con 0x563825dea840 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.789+0000 7f9d91e4e740 1 -- 172.21.15.37:0/3365232666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 msgr2=0x5638261d5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.789+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/3365232666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 0x5638261d5a20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c01b040 tx=0x7f9d7c003ab0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.789+0000 7f9d91e4e740 1 -- 172.21.15.37:0/3365232666 shutdown_connections 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.789+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/3365232666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825dea840 0x5638261d5a20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.789+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/3365232666 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825de2660 0x5638261d54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.789+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/3365232666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dc9ea0 0x5638261bf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.789+0000 7f9d91e4e740 1 -- 172.21.15.37:0/3365232666 >> 172.21.15.37:0/3365232666 conn(0x563825dff910 msgr2=0x5638261bf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.789+0000 7f9d91e4e740 1 -- 172.21.15.37:0/3365232666 shutdown_connections 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.790+0000 7f9d91e4e740 1 -- 172.21.15.37:0/3365232666 wait complete. 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.790+0000 7f9d91e4e740 1 -- start start 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.790+0000 7f9d91e4e740 1 Processor -- start 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d91e4e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dc9ea0 0x5638261c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d91e4e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825de2660 0x5638261c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d91e4e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825dea840 0x5638261c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d91e4e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d841b1970 con 0x563825de2660 2024-09-21T06:01:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d91e4e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9d841b2de0 con 0x563825dea840 2024-09-21T06:01:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d91e4e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d841b2040 con 0x563825dc9ea0 2024-09-21T06:01:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d91e4e740 10 client.0 _ll_register_callbacks cb 0x7f9d6c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d7b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825de2660 0x5638261c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d7b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825de2660 0x5638261c32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50178/0 (socket says 172.21.15.37:50178) 2024-09-21T06:01:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d7b400640 1 -- 172.21.15.37:0/2884006105 learned_addr learned my addr 172.21.15.37:0/2884006105 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d89200640 1 --2- 172.21.15.37:0/2884006105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825dea840 0x5638261c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d83e00640 1 --2- 172.21.15.37:0/2884006105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dc9ea0 0x5638261c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d7b400640 1 -- 172.21.15.37:0/2884006105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dc9ea0 msgr2=0x5638261c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d7b400640 1 --2- 172.21.15.37:0/2884006105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dc9ea0 0x5638261c2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d7b400640 1 -- 172.21.15.37:0/2884006105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825dea840 msgr2=0x5638261c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:33.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d7b400640 1 --2- 172.21.15.37:0/2884006105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825dea840 0x5638261c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:33.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.791+0000 7f9d7b400640 1 -- 172.21.15.37:0/2884006105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56382623a6f0 con 0x563825de2660 2024-09-21T06:01:33.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.792+0000 7f9d7b400640 1 --2- 172.21.15.37:0/2884006105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825de2660 0x5638261c32b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0aa990 tx=0x7f9d6c0b6270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b011c7907e456310 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:33.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.792+0000 7f9d72000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T06:01:33.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.792+0000 7f9d72000640 1 -- 172.21.15.37:0/2884006105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0b7090 con 0x563825de2660 2024-09-21T06:01:33.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.792+0000 7f9d72000640 1 -- 172.21.15.37:0/2884006105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f9d6c0a9280 con 0x563825de2660 2024-09-21T06:01:33.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.792+0000 7f9d91e4e740 1 -- 172.21.15.37:0/2884006105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d7c005700 con 0x563825de2660 2024-09-21T06:01:33.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.792+0000 7f9d72000640 1 -- 172.21.15.37:0/2884006105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9d6c0ad230 con 0x563825de2660 2024-09-21T06:01:33.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.792+0000 7f9d91e4e740 10 client.15633 fetch_fsmap learned FSMap version 21 2024-09-21T06:01:33.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.792+0000 7f9d91e4e740 1 -- 172.21.15.37:0/2884006105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56382623b980 con 0x563825de2660 2024-09-21T06:01:33.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.793+0000 7f9d72000640 1 -- 172.21.15.37:0/2884006105 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d7c005700 con 0x563825de2660 2024-09-21T06:01:33.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.793+0000 7f9d72000640 1 -- 172.21.15.37:0/2884006105 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9d6c0ae9a0 con 0x563825de2660 2024-09-21T06:01:33.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.793+0000 7f9d91e4e740 10 client.15633 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:01:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.793+0000 7f9d91e4e740 10 client.15633 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:01:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.793+0000 7f9d91e4e740 20 client.15633 populate_metadata read hostname 'smithi037' 2024-09-21T06:01:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.793+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/2884006105 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x563825e0b520 0x56382623e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.793+0000 7f9d91e4e740 4 client.15633 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "257757f8", "release": true, "await": true}] 2024-09-21T06:01:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.793+0000 7f9d91e4e740 1 -- 172.21.15.37:0/2884006105 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "set_id": "257757f8", "release": true, "await": true}) -- 0x563826126c90 con 0x563825e0b520 2024-09-21T06:01:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.793+0000 7f9d83e00640 1 --2- 172.21.15.37:0/2884006105 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x563825e0b520 0x56382623e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.794+0000 7f9d83e00640 1 --2- 172.21.15.37:0/2884006105 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x563825e0b520 0x56382623e0e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9afb5de56dedd99 server_cookie=9a7fa9bafcc42b13 in_seq=0 out_seq=0 2024-09-21T06:01:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.794+0000 7f9d72000640 10 client.15633 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:33.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:33 smithi144 ceph-mon[34351]: pgmap v643: 129 pgs: 129 active+clean; 154 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 20 KiB/s wr, 3 op/s 2024-09-21T06:01:33.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:33 smithi067 ceph-mon[34443]: pgmap v643: 129 pgs: 129 active+clean; 154 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 20 KiB/s wr, 3 op/s 2024-09-21T06:01:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.999+0000 7f9d72000640 1 -- 172.21.15.37:0/2884006105 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563826126c90 con 0x563825e0b520 2024-09-21T06:01:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.999+0000 7f9d72000640 10 client.15633 handle_command_reply: tid=0 2024-09-21T06:01:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.999+0000 7f9d91e4e740 1 client.15633 shutdown 2024-09-21T06:01:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.999+0000 7f9d91e4e740 1 -- 172.21.15.37:0/2884006105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825de2660 msgr2=0x5638261c32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.999+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/2884006105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825de2660 0x5638261c32b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0aa990 tx=0x7f9d6c0b6270 comp rx=0 tx=0).stop 2024-09-21T06:01:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.999+0000 7f9d91e4e740 1 -- 172.21.15.37:0/2884006105 shutdown_connections 2024-09-21T06:01:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.999+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/2884006105 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x563825e0b520 0x56382623e0e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.999+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/2884006105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563825dea840 0x5638261c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.999+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/2884006105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563825de2660 0x5638261c32b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.999+0000 7f9d91e4e740 1 --2- 172.21.15.37:0/2884006105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563825dc9ea0 0x5638261c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.999+0000 7f9d72000640 0 client.15633 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:33.999+0000 7f9d91e4e740 1 -- 172.21.15.37:0/2884006105 >> 172.21.15.37:0/2884006105 conn(0x563825dff910 msgr2=0x5638261bc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.000+0000 7f9d91e4e740 1 -- 172.21.15.37:0/2884006105 shutdown_connections 2024-09-21T06:01:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.000+0000 7f9d91e4e740 1 -- 172.21.15.37:0/2884006105 wait complete. 2024-09-21T06:01:34.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.000+0000 7f9d91e4e740 20 client.15633 trim_cache size 0 max 16384 2024-09-21T06:01:34.003 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:01:34.003 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T06:01:34.003 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 32, 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "257757f8": { 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 32, 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 141.1, 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T06:01:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:01:34.005 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T06:01:34.005 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:01:34.005 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:34.005 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:34.005 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:34.005 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:34.005 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:34.005 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:01:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.001+0000 7f9d89c00640 1 -- 172.21.15.37:0/1770817300 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9d680b6590 msgr2=0x7f9d680b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.001+0000 7f9d89c00640 1 --2- 172.21.15.37:0/1770817300 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9d680b6590 0x7f9d680b8aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9d74031440 tx=0x7f9d74009560 comp rx=0 tx=0).stop 2024-09-21T06:01:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.001+0000 7f9d89c00640 1 -- 172.21.15.37:0/1770817300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d841092f0 msgr2=0x7f9d8419cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.001+0000 7f9d89c00640 1 --2- 172.21.15.37:0/1770817300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d841092f0 0x7f9d8419cad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00e9f0 tx=0x7f9d6c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:01:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.001+0000 7f9d89c00640 1 -- 172.21.15.37:0/1770817300 shutdown_connections 2024-09-21T06:01:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.001+0000 7f9d89c00640 1 --2- 172.21.15.37:0/1770817300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d84109c40 0x7f9d841a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.001+0000 7f9d89c00640 1 --2- 172.21.15.37:0/1770817300 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9d680b6590 0x7f9d680b8aa0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.001+0000 7f9d89c00640 1 --2- 172.21.15.37:0/1770817300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d841092f0 0x7f9d8419cad0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.001+0000 7f9d89c00640 1 --2- 172.21.15.37:0/1770817300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d841039b0 0x7f9d8419c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.001+0000 7f9d89c00640 1 -- 172.21.15.37:0/1770817300 >> 172.21.15.37:0/1770817300 conn(0x7f9d840ff440 msgr2=0x7f9d8410e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.001+0000 7f9d89c00640 1 -- 172.21.15.37:0/1770817300 shutdown_connections 2024-09-21T06:01:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:34.002+0000 7f9d89c00640 1 -- 172.21.15.37:0/1770817300 wait complete. 2024-09-21T06:01:34.863 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '257757f8', total seconds elapsed: 25.3 2024-09-21T06:01:34.863 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-09-21T06:01:34.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:01:35.373 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:35.631 INFO:tasks.workunit.client.0.smithi037.stdout:truncating to largest ever: 0x63e5d2a 2024-09-21T06:01:35.849 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:35 smithi037 ceph-mon[30631]: pgmap v644: 129 pgs: 129 active+clean; 157 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 46 KiB/s wr, 3 op/s 2024-09-21T06:01:35.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:35 smithi144 ceph-mon[34351]: pgmap v644: 129 pgs: 129 active+clean; 157 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 46 KiB/s wr, 3 op/s 2024-09-21T06:01:35.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:35 smithi067 ceph-mon[34443]: pgmap v644: 129 pgs: 129 active+clean; 157 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 46 KiB/s wr, 3 op/s 2024-09-21T06:01:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.066+0000 7f7e3de00640 1 -- 172.21.15.37:0/1716740728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e381094b0 msgr2=0x7f7e381098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:36.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.066+0000 7f7e3de00640 1 --2- 172.21.15.37:0/1716740728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e381094b0 0x7f7e381098c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7e24009900 tx=0x7f7e2402a410 comp rx=0 tx=0).stop 2024-09-21T06:01:36.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.066+0000 7f7e3de00640 1 -- 172.21.15.37:0/1716740728 shutdown_connections 2024-09-21T06:01:36.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.066+0000 7f7e3de00640 1 --2- 172.21.15.37:0/1716740728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e38109e00 0x7f7e38110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:36.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.066+0000 7f7e3de00640 1 --2- 172.21.15.37:0/1716740728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e381094b0 0x7f7e381098c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:36.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.066+0000 7f7e3de00640 1 --2- 172.21.15.37:0/1716740728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e38103b70 0x7f7e38103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:36.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.066+0000 7f7e3de00640 1 -- 172.21.15.37:0/1716740728 >> 172.21.15.37:0/1716740728 conn(0x7f7e380ff5e0 msgr2=0x7f7e38101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:36.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.067+0000 7f7e3de00640 1 -- 172.21.15.37:0/1716740728 shutdown_connections 2024-09-21T06:01:36.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.067+0000 7f7e3de00640 1 -- 172.21.15.37:0/1716740728 wait complete. 2024-09-21T06:01:36.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.069+0000 7f7e3de00640 1 Processor -- start 2024-09-21T06:01:36.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.069+0000 7f7e3de00640 1 -- start start 2024-09-21T06:01:36.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.070+0000 7f7e3de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e38103b70 0x7f7e38077140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:36.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.070+0000 7f7e3de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e38109e00 0x7f7e38075730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:36.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.070+0000 7f7e3de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e38075c70 0x7f7e38076150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:36.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.070+0000 7f7e3de00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7e38113b10 con 0x7f7e38075c70 2024-09-21T06:01:36.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.070+0000 7f7e3de00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7e38113990 con 0x7f7e38109e00 2024-09-21T06:01:36.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.070+0000 7f7e3de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7e38113c90 con 0x7f7e38103b70 2024-09-21T06:01:36.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.070+0000 7f7e36a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e38103b70 0x7f7e38077140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:36.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.070+0000 7f7e37400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e38075c70 0x7f7e38076150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:36.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.071+0000 7f7e36a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e38103b70 0x7f7e38077140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45612/0 (socket says 172.21.15.37:45612) 2024-09-21T06:01:36.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.071+0000 7f7e36a00640 1 -- 172.21.15.37:0/2994806097 learned_addr learned my addr 172.21.15.37:0/2994806097 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:36.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.071+0000 7f7e36000640 1 --2- 172.21.15.37:0/2994806097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e38109e00 0x7f7e38075730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:36.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.071+0000 7f7e36a00640 1 -- 172.21.15.37:0/2994806097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e38109e00 msgr2=0x7f7e38075730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:36.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.071+0000 7f7e36a00640 1 --2- 172.21.15.37:0/2994806097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e38109e00 0x7f7e38075730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:36.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.071+0000 7f7e36a00640 1 -- 172.21.15.37:0/2994806097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e38075c70 msgr2=0x7f7e38076150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:36.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.071+0000 7f7e36a00640 1 --2- 172.21.15.37:0/2994806097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e38075c70 0x7f7e38076150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:36.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.071+0000 7f7e36a00640 1 -- 172.21.15.37:0/2994806097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e381ad0c0 con 0x7f7e38103b70 2024-09-21T06:01:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.072+0000 7f7e36a00640 1 --2- 172.21.15.37:0/2994806097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e38103b70 0x7f7e38077140 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800ea60 tx=0x7f7e2800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.072+0000 7f7e3ca00640 1 -- 172.21.15.37:0/2994806097 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2800cde0 con 0x7f7e38103b70 2024-09-21T06:01:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.072+0000 7f7e3ca00640 1 -- 172.21.15.37:0/2994806097 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e280035f0 con 0x7f7e38103b70 2024-09-21T06:01:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.072+0000 7f7e3de00640 1 -- 172.21.15.37:0/2994806097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e381ad3b0 con 0x7f7e38103b70 2024-09-21T06:01:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.072+0000 7f7e3ca00640 1 -- 172.21.15.37:0/2994806097 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28010690 con 0x7f7e38103b70 2024-09-21T06:01:36.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.072+0000 7f7e3de00640 1 -- 172.21.15.37:0/2994806097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e381ad910 con 0x7f7e38103b70 2024-09-21T06:01:36.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.074+0000 7f7e3de00640 1 -- 172.21.15.37:0/2994806097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e381098c0 con 0x7f7e38103b70 2024-09-21T06:01:36.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.077+0000 7f7e3ca00640 1 -- 172.21.15.37:0/2994806097 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7e280037a0 con 0x7f7e38103b70 2024-09-21T06:01:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.078+0000 7f7e3ca00640 1 --2- 172.21.15.37:0/2994806097 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7e1c0b6590 0x7f7e1c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.079+0000 7f7e3ca00640 1 -- 172.21.15.37:0/2994806097 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7e280e7e40 con 0x7f7e38103b70 2024-09-21T06:01:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.079+0000 7f7e36000640 1 --2- 172.21.15.37:0/2994806097 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7e1c0b6590 0x7f7e1c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.079+0000 7f7e3ca00640 1 -- 172.21.15.37:0/2994806097 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7e280ae300 con 0x7f7e38103b70 2024-09-21T06:01:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.080+0000 7f7e36000640 1 --2- 172.21.15.37:0/2994806097 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7e1c0b6590 0x7f7e1c0b8aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7e24008000 tx=0x7f7e24005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:36.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.416+0000 7f7e3de00640 1 -- 172.21.15.37:0/2994806097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e38076a30 con 0x7f7e38103b70 2024-09-21T06:01:36.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.417+0000 7f7e3ca00640 1 -- 172.21.15.37:0/2994806097 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f7e280b26e0 con 0x7f7e38103b70 2024-09-21T06:01:36.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:01:36.420 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T06:01:36.421 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T06:01:36.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.423+0000 7f7e3de00640 1 -- 172.21.15.37:0/2994806097 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7e1c0b6590 msgr2=0x7f7e1c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:36.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.423+0000 7f7e3de00640 1 --2- 172.21.15.37:0/2994806097 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7e1c0b6590 0x7f7e1c0b8aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7e24008000 tx=0x7f7e24005a20 comp rx=0 tx=0).stop 2024-09-21T06:01:36.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.423+0000 7f7e3de00640 1 -- 172.21.15.37:0/2994806097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e38103b70 msgr2=0x7f7e38077140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:36.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.423+0000 7f7e3de00640 1 --2- 172.21.15.37:0/2994806097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e38103b70 0x7f7e38077140 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800ea60 tx=0x7f7e2800ef20 comp rx=0 tx=0).stop 2024-09-21T06:01:36.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.423+0000 7f7e3de00640 1 -- 172.21.15.37:0/2994806097 shutdown_connections 2024-09-21T06:01:36.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.423+0000 7f7e3de00640 1 --2- 172.21.15.37:0/2994806097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e38075c70 0x7f7e38076150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:36.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.423+0000 7f7e3de00640 1 --2- 172.21.15.37:0/2994806097 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7e1c0b6590 0x7f7e1c0b8aa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:36.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.423+0000 7f7e3de00640 1 --2- 172.21.15.37:0/2994806097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e38109e00 0x7f7e38075730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:36.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.423+0000 7f7e3de00640 1 --2- 172.21.15.37:0/2994806097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e38103b70 0x7f7e38077140 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:36.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.423+0000 7f7e3de00640 1 -- 172.21.15.37:0/2994806097 >> 172.21.15.37:0/2994806097 conn(0x7f7e380ff5e0 msgr2=0x7f7e38101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:36.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.423+0000 7f7e3de00640 1 -- 172.21.15.37:0/2994806097 shutdown_connections 2024-09-21T06:01:36.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:36.423+0000 7f7e3de00640 1 -- 172.21.15.37:0/2994806097 wait complete. 2024-09-21T06:01:36.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:36 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2994806097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:36.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:36 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2994806097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:36.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:36 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2994806097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:37.287 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0' 2024-09-21T06:01:37.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0 2024-09-21T06:01:37.803 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:37.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:37 smithi144 ceph-mon[34351]: pgmap v645: 129 pgs: 129 active+clean; 153 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 112 KiB/s wr, 20 op/s 2024-09-21T06:01:37.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:37 smithi037 ceph-mon[30631]: pgmap v645: 129 pgs: 129 active+clean; 153 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 112 KiB/s wr, 20 op/s 2024-09-21T06:01:37.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:37 smithi067 ceph-mon[34443]: pgmap v645: 129 pgs: 129 active+clean; 153 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 112 KiB/s wr, 20 op/s 2024-09-21T06:01:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.532+0000 7fdcff200640 1 -- 172.21.15.37:0/3268215260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd00109300 msgr2=0x7fdd00109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.532+0000 7fdcff200640 1 --2- 172.21.15.37:0/3268215260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd00109300 0x7fdd00109710 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009900 tx=0x7fdcec02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.532+0000 7fdcff200640 1 -- 172.21.15.37:0/3268215260 shutdown_connections 2024-09-21T06:01:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.532+0000 7fdcff200640 1 --2- 172.21.15.37:0/3268215260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd00109c50 0x7fdd00110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.532+0000 7fdcff200640 1 --2- 172.21.15.37:0/3268215260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd00109300 0x7fdd00109710 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.532+0000 7fdcff200640 1 --2- 172.21.15.37:0/3268215260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd001039c0 0x7fdd00103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.532+0000 7fdcff200640 1 -- 172.21.15.37:0/3268215260 >> 172.21.15.37:0/3268215260 conn(0x7fdd000ff430 msgr2=0x7fdd00101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.532+0000 7fdcff200640 1 -- 172.21.15.37:0/3268215260 shutdown_connections 2024-09-21T06:01:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.532+0000 7fdcff200640 1 -- 172.21.15.37:0/3268215260 wait complete. 2024-09-21T06:01:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.533+0000 7fdcff200640 1 Processor -- start 2024-09-21T06:01:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.534+0000 7fdcff200640 1 -- start start 2024-09-21T06:01:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.534+0000 7fdcff200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd001039c0 0x7fdd0019c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.534+0000 7fdcff200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd00109300 0x7fdd0019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.534+0000 7fdcff200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd00109c50 0x7fdd001a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.534+0000 7fdcff200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd00113960 con 0x7fdd001039c0 2024-09-21T06:01:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.534+0000 7fdcff200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdd001137e0 con 0x7fdd00109300 2024-09-21T06:01:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.534+0000 7fdcff200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdd00113ae0 con 0x7fdd00109c50 2024-09-21T06:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.534+0000 7fdcfde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd001039c0 0x7fdd0019c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.534+0000 7fdcfd400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd00109300 0x7fdd0019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.534+0000 7fdcfd400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd00109300 0x7fdd0019cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:50692/0 (socket says 172.21.15.37:50692) 2024-09-21T06:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.534+0000 7fdcfde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd001039c0 0x7fdd0019c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50216/0 (socket says 172.21.15.37:50216) 2024-09-21T06:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.534+0000 7fdcfd400640 1 -- 172.21.15.37:0/2675307294 learned_addr learned my addr 172.21.15.37:0/2675307294 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.535+0000 7fdcfe800640 1 --2- 172.21.15.37:0/2675307294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd00109c50 0x7fdd001a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.535+0000 7fdcfd400640 1 -- 172.21.15.37:0/2675307294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd00109c50 msgr2=0x7fdd001a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.535+0000 7fdcfd400640 1 --2- 172.21.15.37:0/2675307294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd00109c50 0x7fdd001a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.535+0000 7fdcfd400640 1 -- 172.21.15.37:0/2675307294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd001039c0 msgr2=0x7fdd0019c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.535+0000 7fdcfd400640 1 --2- 172.21.15.37:0/2675307294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd001039c0 0x7fdd0019c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.535+0000 7fdcfd400640 1 -- 172.21.15.37:0/2675307294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd001a24e0 con 0x7fdd00109300 2024-09-21T06:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.535+0000 7fdcfd400640 1 --2- 172.21.15.37:0/2675307294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd00109300 0x7fdd0019cb10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdcec005ab0 tx=0x7fdcec003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.536+0000 7fdcf6a00640 1 -- 172.21.15.37:0/2675307294 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec03f070 con 0x7fdd00109300 2024-09-21T06:01:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.536+0000 7fdcf6a00640 1 -- 172.21.15.37:0/2675307294 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcec031b50 con 0x7fdd00109300 2024-09-21T06:01:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.536+0000 7fdcf6a00640 1 -- 172.21.15.37:0/2675307294 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec035030 con 0x7fdd00109300 2024-09-21T06:01:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.536+0000 7fdcff200640 1 -- 172.21.15.37:0/2675307294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd001a2770 con 0x7fdd00109300 2024-09-21T06:01:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.536+0000 7fdcff200640 1 -- 172.21.15.37:0/2675307294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd001a8f30 con 0x7fdd00109300 2024-09-21T06:01:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.539+0000 7fdcf6a00640 1 -- 172.21.15.37:0/2675307294 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdcec042070 con 0x7fdd00109300 2024-09-21T06:01:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.539+0000 7fdd0be7b740 1 Processor -- start 2024-09-21T06:01:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.540+0000 7fdd0be7b740 1 -- start start 2024-09-21T06:01:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.540+0000 7fdd0be7b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b7b850 0x565056f22b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.541+0000 7fdd0be7b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b52990 0x565056f230d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.541+0000 7fdd0be7b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f23610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.541+0000 7fdd0be7b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x565056e98a90 con 0x565056b7b850 2024-09-21T06:01:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.541+0000 7fdd0be7b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x565056e87ec0 con 0x565056b5ab70 2024-09-21T06:01:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.541+0000 7fdd0be7b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x565056e8bcd0 con 0x565056b52990 2024-09-21T06:01:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.541+0000 7fdcfe800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b7b850 0x565056f22b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.541+0000 7fdcfe800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b7b850 0x565056f22b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50220/0 (socket says 172.21.15.37:50220) 2024-09-21T06:01:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.541+0000 7fdcfe800640 1 -- 172.21.15.37:0/2542342554 learned_addr learned my addr 172.21.15.37:0/2542342554 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.541+0000 7fdcfde00640 1 --2- 172.21.15.37:0/2542342554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b52990 0x565056f230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.541+0000 7fdcfd400640 1 --2- 172.21.15.37:0/2542342554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f23610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.541+0000 7fdcfd400640 1 -- 172.21.15.37:0/2542342554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b52990 msgr2=0x565056f230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.541+0000 7fdcfd400640 1 --2- 172.21.15.37:0/2542342554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b52990 0x565056f230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.541+0000 7fdcfd400640 1 -- 172.21.15.37:0/2542342554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b7b850 msgr2=0x565056f22b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.542+0000 7fdcfd400640 1 --2- 172.21.15.37:0/2542342554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b7b850 0x565056f22b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.542+0000 7fdcfd400640 1 -- 172.21.15.37:0/2542342554 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565056e2d9d0 con 0x565056b5ab70 2024-09-21T06:01:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.542+0000 7fdcfe800640 1 --2- 172.21.15.37:0/2542342554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b7b850 0x565056f22b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.542+0000 7fdcf6a00640 1 --2- 172.21.15.37:0/2675307294 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdce40b6500 0x7fdce40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.542+0000 7fdcfe800640 1 --2- 172.21.15.37:0/2675307294 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdce40b6500 0x7fdce40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.542+0000 7fdcf6a00640 1 -- 172.21.15.37:0/2675307294 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fdcec107c80 con 0x7fdd00109300 2024-09-21T06:01:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.542+0000 7fdcfd400640 1 --2- 172.21.15.37:0/2542342554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f23610 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdcec1052f0 tx=0x7fdcec10be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcf160976238b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.543+0000 7fdceb400640 1 -- 172.21.15.37:0/2542342554 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec049070 con 0x565056b5ab70 2024-09-21T06:01:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.543+0000 7fdceb400640 1 -- 172.21.15.37:0/2542342554 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcec0c91f0 con 0x565056b5ab70 2024-09-21T06:01:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.543+0000 7fdceb400640 1 -- 172.21.15.37:0/2542342554 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0c9930 con 0x565056b5ab70 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.544+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2542342554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 msgr2=0x565056f23610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.544+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2542342554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f23610 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdcec1052f0 tx=0x7fdcec10be40 comp rx=0 tx=0).stop 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.544+0000 7fdcfe800640 1 --2- 172.21.15.37:0/2675307294 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdce40b6500 0x7fdce40b8a10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009fd0 tx=0x7fdcf8009500 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.544+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2542342554 shutdown_connections 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.544+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2542342554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f23610 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.544+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2542342554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b52990 0x565056f230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.544+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2542342554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b7b850 0x565056f22b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.544+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2542342554 >> 172.21.15.37:0/2542342554 conn(0x565056b6fc40 msgr2=0x565056f20a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.544+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2542342554 shutdown_connections 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.544+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2542342554 wait complete. 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.545+0000 7fdd0be7b740 1 -- start start 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.545+0000 7fdd0be7b740 1 Processor -- start 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdd0be7b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b52990 0x565056f2e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdd0be7b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b5ab70 0x565056f2ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdd0be7b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 0x565056f3a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdd0be7b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x565056ce97b0 con 0x565056b5ab70 2024-09-21T06:01:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdd0be7b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x565056e2c650 con 0x565056b52990 2024-09-21T06:01:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdd0be7b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x565056f31130 con 0x565056b7b850 2024-09-21T06:01:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdd0be7b740 10 client.0 _ll_register_callbacks cb 0x565056b930a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdcfd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b5ab70 0x565056f2ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdcfe800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 0x565056f3a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdcfde00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b52990 0x565056f2e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdcfd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b5ab70 0x565056f2ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50236/0 (socket says 172.21.15.37:50236) 2024-09-21T06:01:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdcfd400640 1 -- 172.21.15.37:0/2960301270 learned_addr learned my addr 172.21.15.37:0/2960301270 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdcfde00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b52990 0x565056f2e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:50700/0 (socket says 172.21.15.37:50700) 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.546+0000 7fdcfe800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 0x565056f3a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45648/0 (socket says 172.21.15.37:45648) 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.547+0000 7fdcfde00640 1 -- 172.21.15.37:0/2960301270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 msgr2=0x565056f3a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.547+0000 7fdcfde00640 1 --2- 172.21.15.37:0/2960301270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 0x565056f3a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.547+0000 7fdcfde00640 1 -- 172.21.15.37:0/2960301270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b5ab70 msgr2=0x565056f2ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.547+0000 7fdcfde00640 1 --2- 172.21.15.37:0/2960301270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b5ab70 0x565056f2ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.547+0000 7fdcfde00640 1 -- 172.21.15.37:0/2960301270 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565056bf5ba0 con 0x565056b52990 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.547+0000 7fdcfde00640 1 --2- 172.21.15.37:0/2960301270 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b52990 0x565056f2e700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00126d0 tx=0x7fdcf0012b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab378941e94d2fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.547+0000 7fdcdfe00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.547+0000 7fdcdfe00640 1 -- 172.21.15.37:0/2960301270 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0004050 con 0x565056b52990 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.548+0000 7fdcdfe00640 1 -- 172.21.15.37:0/2960301270 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fdcf00041f0 con 0x565056b52990 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.548+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2960301270 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcec0c91f0 con 0x565056b52990 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.548+0000 7fdcdfe00640 1 -- 172.21.15.37:0/2960301270 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdcf0004430 con 0x565056b52990 2024-09-21T06:01:38.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.548+0000 7fdd0be7b740 10 client.25700 fetch_fsmap learned FSMap version 21 2024-09-21T06:01:38.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.548+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2960301270 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x565056f3d060 con 0x565056b52990 2024-09-21T06:01:38.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.549+0000 7fdcdfe00640 1 -- 172.21.15.37:0/2960301270 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcec0c91f0 con 0x565056b52990 2024-09-21T06:01:38.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.549+0000 7fdcdfe00640 1 -- 172.21.15.37:0/2960301270 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdcf0003a50 con 0x565056b52990 2024-09-21T06:01:38.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.549+0000 7fdd0be7b740 10 client.25700 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:01:38.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.549+0000 7fdd0be7b740 10 client.25700 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:01:38.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.549+0000 7fdd0be7b740 20 client.25700 populate_metadata read hostname 'smithi037' 2024-09-21T06:01:38.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.549+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2960301270 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x565056b3a1d0 0x565056f40600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.549+0000 7fdd0be7b740 4 client.25700 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:38.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.549+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2960301270 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565056e9a9e0 con 0x565056b3a1d0 2024-09-21T06:01:38.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.550+0000 7fdcfd400640 1 --2- 172.21.15.37:0/2960301270 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x565056b3a1d0 0x565056f40600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.550+0000 7fdcfd400640 1 --2- 172.21.15.37:0/2960301270 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x565056b3a1d0 0x565056f40600 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d790104587fbb231 server_cookie=382dd2eeb0300303 in_seq=0 out_seq=0 2024-09-21T06:01:38.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.550+0000 7fdcdfe00640 10 client.25700 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:38.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.551+0000 7fdcdfe00640 1 -- 172.21.15.37:0/2960301270 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565056e9a9e0 con 0x565056b3a1d0 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.551+0000 7fdcdfe00640 10 client.25700 handle_command_reply: tid=0 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.551+0000 7fdd0be7b740 1 client.25700 shutdown 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.551+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2960301270 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b52990 msgr2=0x565056f2e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.551+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2960301270 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b52990 0x565056f2e700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00126d0 tx=0x7fdcf0012b90 comp rx=0 tx=0).stop 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.551+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2960301270 shutdown_connections 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.551+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2960301270 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x565056b3a1d0 0x565056f40600 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.551+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2960301270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 0x565056f3a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.551+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2960301270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b5ab70 0x565056f2ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.551+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2960301270 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b52990 0x565056f2e700 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.551+0000 7fdcdfe00640 0 client.25700 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.551+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2960301270 >> 172.21.15.37:0/2960301270 conn(0x565056b6fc40 msgr2=0x565056f25d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.552+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2960301270 shutdown_connections 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.552+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2960301270 wait complete. 2024-09-21T06:01:38.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.552+0000 7fdd0be7b740 20 client.25700 trim_cache size 0 max 16384 2024-09-21T06:01:38.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.572+0000 7fdd0be7b740 1 Processor -- start 2024-09-21T06:01:38.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.572+0000 7fdd0be7b740 1 -- start start 2024-09-21T06:01:38.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.573+0000 7fdd0be7b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b52990 0x565056f1fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.573+0000 7fdd0be7b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f3a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.573+0000 7fdd0be7b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 0x565056f3a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.573+0000 7fdd0be7b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd001b0ce0 con 0x565056b52990 2024-09-21T06:01:38.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.573+0000 7fdd0be7b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdd001b3560 con 0x565056b5ab70 2024-09-21T06:01:38.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.573+0000 7fdd0be7b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdd001b1350 con 0x565056b7b850 2024-09-21T06:01:38.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.573+0000 7fdcfde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b52990 0x565056f1fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.573+0000 7fdcfd400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f3a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.573+0000 7fdcfde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b52990 0x565056f1fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50238/0 (socket says 172.21.15.37:50238) 2024-09-21T06:01:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.573+0000 7fdcfd400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f3a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:50714/0 (socket says 172.21.15.37:50714) 2024-09-21T06:01:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.573+0000 7fdcfde00640 1 -- 172.21.15.37:0/2865261890 learned_addr learned my addr 172.21.15.37:0/2865261890 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.573+0000 7fdcfe800640 1 --2- 172.21.15.37:0/2865261890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 0x565056f3a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.574+0000 7fdcfde00640 1 -- 172.21.15.37:0/2865261890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 msgr2=0x565056f3a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.574+0000 7fdcfde00640 1 --2- 172.21.15.37:0/2865261890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 0x565056f3a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.574+0000 7fdcfde00640 1 -- 172.21.15.37:0/2865261890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 msgr2=0x565056f3a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.574+0000 7fdcfde00640 1 --2- 172.21.15.37:0/2865261890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f3a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.574+0000 7fdcfde00640 1 -- 172.21.15.37:0/2865261890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565056f2f5a0 con 0x565056b52990 2024-09-21T06:01:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.574+0000 7fdcfd400640 1 --2- 172.21.15.37:0/2865261890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f3a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.574+0000 7fdcfde00640 1 --2- 172.21.15.37:0/2865261890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b52990 0x565056f1fa20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00058c0 tx=0x7fdcf00107e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c758642bdd62cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.575+0000 7fdceaa00640 1 -- 172.21.15.37:0/2865261890 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf002d020 con 0x565056b52990 2024-09-21T06:01:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.575+0000 7fdceaa00640 1 -- 172.21.15.37:0/2865261890 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcf0010dd0 con 0x565056b52990 2024-09-21T06:01:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.575+0000 7fdceaa00640 1 -- 172.21.15.37:0/2865261890 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf000fcc0 con 0x565056b52990 2024-09-21T06:01:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.576+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2865261890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b52990 msgr2=0x565056f1fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.576+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2865261890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b52990 0x565056f1fa20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00058c0 tx=0x7fdcf00107e0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.576+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2865261890 shutdown_connections 2024-09-21T06:01:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.576+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2865261890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 0x565056f3a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.576+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2865261890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f3a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.576+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/2865261890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b52990 0x565056f1fa20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.576+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2865261890 >> 172.21.15.37:0/2865261890 conn(0x565056b6fc40 msgr2=0x565056f20a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:38.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.576+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2865261890 shutdown_connections 2024-09-21T06:01:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.576+0000 7fdd0be7b740 1 -- 172.21.15.37:0/2865261890 wait complete. 2024-09-21T06:01:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.577+0000 7fdd0be7b740 1 -- start start 2024-09-21T06:01:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.577+0000 7fdd0be7b740 1 Processor -- start 2024-09-21T06:01:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.578+0000 7fdd0be7b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b52990 0x565056f36620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.578+0000 7fdd0be7b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f36be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.578+0000 7fdd0be7b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 0x565056f312a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.578+0000 7fdd0be7b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd001b1a20 con 0x565056b52990 2024-09-21T06:01:38.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.578+0000 7fdd0be7b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdd001b2e90 con 0x565056b5ab70 2024-09-21T06:01:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.578+0000 7fdd0be7b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdd001b20f0 con 0x565056b7b850 2024-09-21T06:01:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.578+0000 7fdd0be7b740 10 client.0 _ll_register_callbacks cb 0x7fdcf0009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.578+0000 7fdcfd400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f36be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.578+0000 7fdcfde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b52990 0x565056f36620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.578+0000 7fdcfd400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f36be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:50718/0 (socket says 172.21.15.37:50718) 2024-09-21T06:01:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.578+0000 7fdcfd400640 1 -- 172.21.15.37:0/643781000 learned_addr learned my addr 172.21.15.37:0/643781000 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.578+0000 7fdcfe800640 1 --2- 172.21.15.37:0/643781000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 0x565056f312a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdcfd400640 1 -- 172.21.15.37:0/643781000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 msgr2=0x565056f312a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdcfd400640 1 --2- 172.21.15.37:0/643781000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 0x565056f312a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdcfd400640 1 -- 172.21.15.37:0/643781000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b52990 msgr2=0x565056f36620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdcfd400640 1 --2- 172.21.15.37:0/643781000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b52990 0x565056f36620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:38.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdcfd400640 1 -- 172.21.15.37:0/643781000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565056f31a30 con 0x565056b5ab70 2024-09-21T06:01:38.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdcfde00640 1 --2- 172.21.15.37:0/643781000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b52990 0x565056f36620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:38.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdcfd400640 1 --2- 172.21.15.37:0/643781000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f36be0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdcec005d00 tx=0x7fdcec003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2c81c30b4484fce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:38.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdcdfe00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T06:01:38.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdcdfe00640 1 -- 172.21.15.37:0/643781000 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec049040 con 0x565056b5ab70 2024-09-21T06:01:38.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdcdfe00640 1 -- 172.21.15.37:0/643781000 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fdcec03b460 con 0x565056b5ab70 2024-09-21T06:01:38.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdd0be7b740 1 -- 172.21.15.37:0/643781000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf0010dd0 con 0x565056b5ab70 2024-09-21T06:01:38.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdcdfe00640 1 -- 172.21.15.37:0/643781000 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdcec0cd200 con 0x565056b5ab70 2024-09-21T06:01:38.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdd0be7b740 10 client.25706 fetch_fsmap learned FSMap version 21 2024-09-21T06:01:38.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.579+0000 7fdd0be7b740 1 -- 172.21.15.37:0/643781000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x565056faba60 con 0x565056b5ab70 2024-09-21T06:01:38.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.580+0000 7fdcdfe00640 1 -- 172.21.15.37:0/643781000 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcf0010dd0 con 0x565056b5ab70 2024-09-21T06:01:38.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.580+0000 7fdcdfe00640 1 -- 172.21.15.37:0/643781000 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdcec0b8020 con 0x565056b5ab70 2024-09-21T06:01:38.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.580+0000 7fdd0be7b740 10 client.25706 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:01:38.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.580+0000 7fdd0be7b740 10 client.25706 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:01:38.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.580+0000 7fdd0be7b740 20 client.25706 populate_metadata read hostname 'smithi037' 2024-09-21T06:01:38.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.580+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/643781000 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x565056b0f580 0x565056fae130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:38.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.580+0000 7fdd0be7b740 4 client.25706 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}] 2024-09-21T06:01:38.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.580+0000 7fdd0be7b740 1 -- 172.21.15.37:0/643781000 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}) -- 0x565056e96490 con 0x565056b0f580 2024-09-21T06:01:38.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.580+0000 7fdcfde00640 1 --2- 172.21.15.37:0/643781000 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x565056b0f580 0x565056fae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:38.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.581+0000 7fdcfde00640 1 --2- 172.21.15.37:0/643781000 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x565056b0f580 0x565056fae130 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4a4af219d3c1e61 server_cookie=9c94090003680627 in_seq=0 out_seq=0 2024-09-21T06:01:38.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:38.581+0000 7fdcdfe00640 10 client.25706 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdcdfe00640 1 -- 172.21.15.37:0/643781000 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x565056e96490 con 0x565056b0f580 2024-09-21T06:01:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdcdfe00640 10 client.25706 handle_command_reply: tid=0 2024-09-21T06:01:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdd0be7b740 1 client.25706 shutdown 2024-09-21T06:01:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdd0be7b740 1 -- 172.21.15.37:0/643781000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 msgr2=0x565056f36be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/643781000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f36be0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdcec005d00 tx=0x7fdcec003f90 comp rx=0 tx=0).stop 2024-09-21T06:01:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdd0be7b740 1 -- 172.21.15.37:0/643781000 shutdown_connections 2024-09-21T06:01:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/643781000 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x565056b0f580 0x565056fae130 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/643781000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565056b7b850 0x565056f312a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/643781000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x565056b5ab70 0x565056f36be0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdcdfe00640 0 client.25706 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdd0be7b740 1 --2- 172.21.15.37:0/643781000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565056b52990 0x565056f36620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdd0be7b740 1 -- 172.21.15.37:0/643781000 >> 172.21.15.37:0/643781000 conn(0x565056b6fc40 msgr2=0x565056f20a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdd0be7b740 1 -- 172.21.15.37:0/643781000 shutdown_connections 2024-09-21T06:01:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.564+0000 7fdd0be7b740 1 -- 172.21.15.37:0/643781000 wait complete. 2024-09-21T06:01:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.565+0000 7fdd0be7b740 20 client.25706 trim_cache size 0 max 16384 2024-09-21T06:01:39.568 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:01:39.568 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T06:01:39.568 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T06:01:39.568 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 34, 2024-09-21T06:01:39.569 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T06:01:39.569 INFO:teuthology.orchestra.run.smithi037.stdout: "c7aa1d22": { 2024-09-21T06:01:39.569 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 34, 2024-09-21T06:01:39.569 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T06:01:39.569 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:01:39.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T06:01:39.569 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:01:39.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:01:39.569 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T06:01:39.569 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 141.1, 2024-09-21T06:01:39.569 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T06:01:39.569 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T06:01:39.569 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T06:01:39.570 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:01:39.570 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T06:01:39.570 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:01:39.570 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:39.570 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:39.570 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:39.570 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:39.570 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:39.570 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:01:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.565+0000 7fdcff200640 1 -- 172.21.15.37:0/2675307294 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdce40b6500 msgr2=0x7fdce40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.565+0000 7fdcff200640 1 --2- 172.21.15.37:0/2675307294 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdce40b6500 0x7fdce40b8a10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009fd0 tx=0x7fdcf8009500 comp rx=0 tx=0).stop 2024-09-21T06:01:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.565+0000 7fdcff200640 1 -- 172.21.15.37:0/2675307294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd00109300 msgr2=0x7fdd0019cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.565+0000 7fdcff200640 1 --2- 172.21.15.37:0/2675307294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd00109300 0x7fdd0019cb10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdcec005ab0 tx=0x7fdcec003b90 comp rx=0 tx=0).stop 2024-09-21T06:01:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.565+0000 7fdcff200640 1 -- 172.21.15.37:0/2675307294 shutdown_connections 2024-09-21T06:01:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.566+0000 7fdcff200640 1 --2- 172.21.15.37:0/2675307294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd00109c50 0x7fdd001a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.566+0000 7fdcff200640 1 --2- 172.21.15.37:0/2675307294 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdce40b6500 0x7fdce40b8a10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.566+0000 7fdcff200640 1 --2- 172.21.15.37:0/2675307294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd00109300 0x7fdd0019cb10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.566+0000 7fdcff200640 1 --2- 172.21.15.37:0/2675307294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd001039c0 0x7fdd0019c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.566+0000 7fdcff200640 1 -- 172.21.15.37:0/2675307294 >> 172.21.15.37:0/2675307294 conn(0x7fdd000ff430 msgr2=0x7fdd00108970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.566+0000 7fdcff200640 1 -- 172.21.15.37:0/2675307294 shutdown_connections 2024-09-21T06:01:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:39.566+0000 7fdcff200640 1 -- 172.21.15.37:0/2675307294 wait complete. 2024-09-21T06:01:39.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:39 smithi144 ceph-mon[34351]: pgmap v646: 129 pgs: 129 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 260 KiB/s wr, 87 op/s 2024-09-21T06:01:39.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:39 smithi037 ceph-mon[30631]: pgmap v646: 129 pgs: 129 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 260 KiB/s wr, 87 op/s 2024-09-21T06:01:39.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:39 smithi067 ceph-mon[34443]: pgmap v646: 129 pgs: 129 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 260 KiB/s wr, 87 op/s 2024-09-21T06:01:40.357 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c7aa1d22', quiesce took 5.5 seconds. Will release after: 15.55 2024-09-21T06:01:41.798 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:41 smithi067 ceph-mon[34443]: pgmap v647: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 357 KiB/s wr, 125 op/s 2024-09-21T06:01:41.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:41 smithi144 ceph-mon[34351]: pgmap v647: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 357 KiB/s wr, 125 op/s 2024-09-21T06:01:41.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:41 smithi037 ceph-mon[30631]: pgmap v647: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 357 KiB/s wr, 125 op/s 2024-09-21T06:01:43.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:43 smithi144 ceph-mon[34351]: pgmap v648: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 420 KiB/s wr, 158 op/s 2024-09-21T06:01:43.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:43 smithi037 ceph-mon[30631]: pgmap v648: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 420 KiB/s wr, 158 op/s 2024-09-21T06:01:43.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:43 smithi067 ceph-mon[34443]: pgmap v648: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 420 KiB/s wr, 158 op/s 2024-09-21T06:01:45.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:45 smithi144 ceph-mon[34351]: pgmap v649: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 428 KiB/s wr, 161 op/s 2024-09-21T06:01:45.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:45 smithi037 ceph-mon[30631]: pgmap v649: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 428 KiB/s wr, 161 op/s 2024-09-21T06:01:45.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:45 smithi067 ceph-mon[34443]: pgmap v649: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 428 KiB/s wr, 161 op/s 2024-09-21T06:01:47.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:47 smithi144 ceph-mon[34351]: pgmap v650: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 402 KiB/s wr, 161 op/s 2024-09-21T06:01:47.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:47 smithi037 ceph-mon[30631]: pgmap v650: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 402 KiB/s wr, 161 op/s 2024-09-21T06:01:47.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:47 smithi067 ceph-mon[34443]: pgmap v650: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 402 KiB/s wr, 161 op/s 2024-09-21T06:01:49.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:49 smithi144 ceph-mon[34351]: pgmap v651: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 336 KiB/s wr, 144 op/s 2024-09-21T06:01:49.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:49 smithi037 ceph-mon[30631]: pgmap v651: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 336 KiB/s wr, 144 op/s 2024-09-21T06:01:49.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:49 smithi067 ceph-mon[34443]: pgmap v651: 129 pgs: 129 active+clean; 140 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 336 KiB/s wr, 144 op/s 2024-09-21T06:01:51.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:51 smithi144 ceph-mon[34351]: pgmap v652: 129 pgs: 129 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 201 KiB/s wr, 77 op/s 2024-09-21T06:01:51.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:51 smithi037 ceph-mon[30631]: pgmap v652: 129 pgs: 129 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 201 KiB/s wr, 77 op/s 2024-09-21T06:01:51.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:51 smithi067 ceph-mon[34443]: pgmap v652: 129 pgs: 129 active+clean; 141 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 201 KiB/s wr, 77 op/s 2024-09-21T06:01:53.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:53 smithi144 ceph-mon[34351]: pgmap v653: 129 pgs: 129 active+clean; 144 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 107 KiB/s wr, 39 op/s 2024-09-21T06:01:53.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:53 smithi037 ceph-mon[30631]: pgmap v653: 129 pgs: 129 active+clean; 144 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 107 KiB/s wr, 39 op/s 2024-09-21T06:01:53.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:53 smithi067 ceph-mon[34443]: pgmap v653: 129 pgs: 129 active+clean; 144 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 107 KiB/s wr, 39 op/s 2024-09-21T06:01:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:55 smithi144 ceph-mon[34351]: pgmap v654: 129 pgs: 129 active+clean; 148 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-21T06:01:55.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:01:55.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:55 smithi037 ceph-mon[30631]: pgmap v654: 129 pgs: 129 active+clean; 148 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-21T06:01:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:55 smithi067 ceph-mon[34443]: pgmap v654: 129 pgs: 129 active+clean; 148 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-21T06:01:56.301 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.929+0000 7f54b1a00640 1 -- 172.21.15.37:0/1514082364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac10ff10 msgr2=0x7f54ac112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.929+0000 7f54b1a00640 1 --2- 172.21.15.37:0/1514082364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac10ff10 0x7f54ac112350 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009ca0 tx=0x7f54a402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:01:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.929+0000 7f54b1a00640 1 -- 172.21.15.37:0/1514082364 shutdown_connections 2024-09-21T06:01:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.929+0000 7f54b1a00640 1 --2- 172.21.15.37:0/1514082364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac10ff10 0x7f54ac112350 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.929+0000 7f54b1a00640 1 --2- 172.21.15.37:0/1514082364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54ac076100 0x7f54ac10f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.929+0000 7f54b1a00640 1 --2- 172.21.15.37:0/1514082364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54ac0757b0 0x7f54ac075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.929+0000 7f54b1a00640 1 -- 172.21.15.37:0/1514082364 >> 172.21.15.37:0/1514082364 conn(0x7f54ac0ff440 msgr2=0x7f54ac101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.930+0000 7f54b1a00640 1 -- 172.21.15.37:0/1514082364 shutdown_connections 2024-09-21T06:01:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.930+0000 7f54b1a00640 1 -- 172.21.15.37:0/1514082364 wait complete. 2024-09-21T06:01:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.931+0000 7f54b1a00640 1 Processor -- start 2024-09-21T06:01:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.931+0000 7f54b1a00640 1 -- start start 2024-09-21T06:01:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.931+0000 7f54b1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54ac0757b0 0x7f54ac19c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.931+0000 7f54b1a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54ac076100 0x7f54ac19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.931+0000 7f54b1a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac10ff10 0x7f54ac1a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.931+0000 7f54b1a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac115ac0 con 0x7f54ac10ff10 2024-09-21T06:01:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.931+0000 7f54b1a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac115940 con 0x7f54ac076100 2024-09-21T06:01:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.931+0000 7f54b1a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac115c40 con 0x7f54ac0757b0 2024-09-21T06:01:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.932+0000 7f54b1000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac10ff10 0x7f54ac1a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.932+0000 7f54b1000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac10ff10 0x7f54ac1a1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57714/0 (socket says 172.21.15.37:57714) 2024-09-21T06:01:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.932+0000 7f54b1000640 1 -- 172.21.15.37:0/2080540007 learned_addr learned my addr 172.21.15.37:0/2080540007 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.932+0000 7f54a3e00640 1 --2- 172.21.15.37:0/2080540007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54ac076100 0x7f54ac19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.932+0000 7f54b1000640 1 -- 172.21.15.37:0/2080540007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54ac0757b0 msgr2=0x7f54ac19c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.932+0000 7f54b1000640 1 --2- 172.21.15.37:0/2080540007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54ac0757b0 0x7f54ac19c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.932+0000 7f54b1000640 1 -- 172.21.15.37:0/2080540007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54ac076100 msgr2=0x7f54ac19ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.932+0000 7f54b1000640 1 --2- 172.21.15.37:0/2080540007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54ac076100 0x7f54ac19ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.932+0000 7f54b1000640 1 -- 172.21.15.37:0/2080540007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac1a2420 con 0x7f54ac10ff10 2024-09-21T06:01:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.933+0000 7f54b1000640 1 --2- 172.21.15.37:0/2080540007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac10ff10 0x7f54ac1a1cf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f54a40098d0 tx=0x7f54a40317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.933+0000 7f54a9600640 1 -- 172.21.15.37:0/2080540007 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4003b70 con 0x7f54ac10ff10 2024-09-21T06:01:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.933+0000 7f54b1a00640 1 -- 172.21.15.37:0/2080540007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac1a26b0 con 0x7f54ac10ff10 2024-09-21T06:01:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.933+0000 7f54a9600640 1 -- 172.21.15.37:0/2080540007 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54a4003d10 con 0x7f54ac10ff10 2024-09-21T06:01:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.933+0000 7f54a9600640 1 -- 172.21.15.37:0/2080540007 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a402fa20 con 0x7f54ac10ff10 2024-09-21T06:01:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.933+0000 7f54b1a00640 1 -- 172.21.15.37:0/2080540007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ac1a8e70 con 0x7f54ac10ff10 2024-09-21T06:01:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.934+0000 7f54b1a00640 1 -- 172.21.15.37:0/2080540007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ac075bc0 con 0x7f54ac10ff10 2024-09-21T06:01:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.937+0000 7f54a9600640 1 -- 172.21.15.37:0/2080540007 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f54a402fbc0 con 0x7f54ac10ff10 2024-09-21T06:01:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.938+0000 7f54a9600640 1 --2- 172.21.15.37:0/2080540007 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54900b6510 0x7f54900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.938+0000 7f54a9600640 1 -- 172.21.15.37:0/2080540007 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f54a4108bf0 con 0x7f54ac10ff10 2024-09-21T06:01:56.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.938+0000 7f54abe00640 1 --2- 172.21.15.37:0/2080540007 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54900b6510 0x7f54900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:56.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.939+0000 7f54abe00640 1 --2- 172.21.15.37:0/2080540007 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54900b6510 0x7f54900b8a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f549c005fd0 tx=0x7f549c005c70 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:56.940+0000 7f54a9600640 1 -- 172.21.15.37:0/2080540007 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f54a40cf050 con 0x7f54ac10ff10 2024-09-21T06:01:57.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.177+0000 7f54b1a00640 1 -- 172.21.15.37:0/2080540007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54ac1a91a0 con 0x7f54ac10ff10 2024-09-21T06:01:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.177+0000 7f54a9600640 1 -- 172.21.15.37:0/2080540007 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f54a40d3430 con 0x7f54ac10ff10 2024-09-21T06:01:57.180 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:01:57.180 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T06:01:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T06:01:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.180+0000 7f54b1a00640 1 -- 172.21.15.37:0/2080540007 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54900b6510 msgr2=0x7f54900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.180+0000 7f54b1a00640 1 --2- 172.21.15.37:0/2080540007 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54900b6510 0x7f54900b8a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f549c005fd0 tx=0x7f549c005c70 comp rx=0 tx=0).stop 2024-09-21T06:01:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.180+0000 7f54b1a00640 1 -- 172.21.15.37:0/2080540007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac10ff10 msgr2=0x7f54ac1a1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.180+0000 7f54b1a00640 1 --2- 172.21.15.37:0/2080540007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac10ff10 0x7f54ac1a1cf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f54a40098d0 tx=0x7f54a40317b0 comp rx=0 tx=0).stop 2024-09-21T06:01:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.180+0000 7f54b1a00640 1 -- 172.21.15.37:0/2080540007 shutdown_connections 2024-09-21T06:01:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.180+0000 7f54b1a00640 1 --2- 172.21.15.37:0/2080540007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ac10ff10 0x7f54ac1a1cf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.180+0000 7f54b1a00640 1 --2- 172.21.15.37:0/2080540007 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54900b6510 0x7f54900b8a20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.180+0000 7f54b1a00640 1 --2- 172.21.15.37:0/2080540007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54ac076100 0x7f54ac19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.180+0000 7f54b1a00640 1 --2- 172.21.15.37:0/2080540007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54ac0757b0 0x7f54ac19c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.180+0000 7f54b1a00640 1 -- 172.21.15.37:0/2080540007 >> 172.21.15.37:0/2080540007 conn(0x7f54ac0ff440 msgr2=0x7f54ac109a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.180+0000 7f54b1a00640 1 -- 172.21.15.37:0/2080540007 shutdown_connections 2024-09-21T06:01:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:57.180+0000 7f54b1a00640 1 -- 172.21.15.37:0/2080540007 wait complete. 2024-09-21T06:01:57.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:57 smithi144 ceph-mon[34351]: pgmap v655: 129 pgs: 129 active+clean; 148 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 20 KiB/s wr, 2 op/s 2024-09-21T06:01:57.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:57 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2080540007' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:57.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:57 smithi037 ceph-mon[30631]: pgmap v655: 129 pgs: 129 active+clean; 148 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 20 KiB/s wr, 2 op/s 2024-09-21T06:01:57.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:57 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2080540007' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:57 smithi067 ceph-mon[34443]: pgmap v655: 129 pgs: 129 active+clean; 148 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 20 KiB/s wr, 2 op/s 2024-09-21T06:01:57.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:57 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2080540007' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:01:58.038 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db --set-id c7aa1d22 --release --await' 2024-09-21T06:01:58.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db --set-id c7aa1d22 --release --await 2024-09-21T06:01:58.457 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:01:59.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.097+0000 7f548b200640 1 -- 172.21.15.37:0/3679853894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f548c105110 msgr2=0x7f548c10d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.097+0000 7f548b200640 1 --2- 172.21.15.37:0/3679853894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f548c105110 0x7f548c10d660 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5478009900 tx=0x7f547802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.097+0000 7f548b200640 1 -- 172.21.15.37:0/3679853894 shutdown_connections 2024-09-21T06:01:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.097+0000 7f548b200640 1 --2- 172.21.15.37:0/3679853894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f548c10dc20 0x7f548c110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.097+0000 7f548b200640 1 --2- 172.21.15.37:0/3679853894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f548c105110 0x7f548c10d660 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.097+0000 7f548b200640 1 --2- 172.21.15.37:0/3679853894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f548c1047c0 0x7f548c104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.097+0000 7f548b200640 1 -- 172.21.15.37:0/3679853894 >> 172.21.15.37:0/3679853894 conn(0x7f548c0fe2c0 msgr2=0x7f548c100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.097+0000 7f548b200640 1 -- 172.21.15.37:0/3679853894 shutdown_connections 2024-09-21T06:01:59.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.097+0000 7f548b200640 1 -- 172.21.15.37:0/3679853894 wait complete. 2024-09-21T06:01:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.098+0000 7f548b200640 1 Processor -- start 2024-09-21T06:01:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.098+0000 7f548b200640 1 -- start start 2024-09-21T06:01:59.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.098+0000 7f548b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f548c1047c0 0x7f548c19c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f548b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f548c105110 0x7f548c19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f548b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f548c10dc20 0x7f548c1a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f548b200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f548c113880 con 0x7f548c105110 2024-09-21T06:01:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f548b200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f548c113700 con 0x7f548c10dc20 2024-09-21T06:01:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f548b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f548c113a00 con 0x7f548c1047c0 2024-09-21T06:01:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f5489400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f548c105110 0x7f548c19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f5489e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f548c1047c0 0x7f548c19c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f5489400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f548c105110 0x7f548c19ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57738/0 (socket says 172.21.15.37:57738) 2024-09-21T06:01:59.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f5489400640 1 -- 172.21.15.37:0/3592494727 learned_addr learned my addr 172.21.15.37:0/3592494727 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:59.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f548a800640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f548c10dc20 0x7f548c1a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f5489e00640 1 -- 172.21.15.37:0/3592494727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f548c10dc20 msgr2=0x7f548c1a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:59.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f5489e00640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f548c10dc20 0x7f548c1a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f5489e00640 1 -- 172.21.15.37:0/3592494727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f548c105110 msgr2=0x7f548c19ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:59.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f5489e00640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f548c105110 0x7f548c19ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f5489e00640 1 -- 172.21.15.37:0/3592494727 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548c1a2420 con 0x7f548c1047c0 2024-09-21T06:01:59.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.099+0000 7f5489400640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f548c105110 0x7f548c19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:59.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.100+0000 7f5489e00640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f548c1047c0 0x7f548c19c4b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f547c00e9f0 tx=0x7f547c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:59.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.100+0000 7f5482a00640 1 -- 172.21.15.37:0/3592494727 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547c00ccc0 con 0x7f548c1047c0 2024-09-21T06:01:59.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.100+0000 7f5482a00640 1 -- 172.21.15.37:0/3592494727 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f547c0108e0 con 0x7f548c1047c0 2024-09-21T06:01:59.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.100+0000 7f548b200640 1 -- 172.21.15.37:0/3592494727 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548c1a2710 con 0x7f548c1047c0 2024-09-21T06:01:59.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.100+0000 7f5482a00640 1 -- 172.21.15.37:0/3592494727 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547c018880 con 0x7f548c1047c0 2024-09-21T06:01:59.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.100+0000 7f548b200640 1 -- 172.21.15.37:0/3592494727 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548c1a8e70 con 0x7f548c1047c0 2024-09-21T06:01:59.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.103+0000 7f5497df7740 1 Processor -- start 2024-09-21T06:01:59.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.104+0000 7f5497df7740 1 -- start start 2024-09-21T06:01:59.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.104+0000 7f5497df7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.104+0000 7f5497df7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977cfd660 0x55f9780cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.104+0000 7f5497df7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977d05840 0x55f9780cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.104+0000 7f5497df7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f978044290 con 0x55f977cfd660 2024-09-21T06:01:59.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.104+0000 7f5497df7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f9780336c0 con 0x55f977d05840 2024-09-21T06:01:59.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.104+0000 7f5497df7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f9780374d0 con 0x55f977d26520 2024-09-21T06:01:59.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.104+0000 7f5482a00640 1 -- 172.21.15.37:0/3592494727 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f547c010430 con 0x7f548c1047c0 2024-09-21T06:01:59.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.104+0000 7f5489400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977d05840 0x55f9780cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.104+0000 7f5489400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977d05840 0x55f9780cddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:60268/0 (socket says 172.21.15.37:60268) 2024-09-21T06:01:59.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.104+0000 7f5489400640 1 -- 172.21.15.37:0/4122545576 learned_addr learned my addr 172.21.15.37:0/4122545576 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:59.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.104+0000 7f548a800640 1 --2- 172.21.15.37:0/4122545576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.105+0000 7f5489e00640 1 --2- 172.21.15.37:0/4122545576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977cfd660 0x55f9780cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.105+0000 7f548a800640 1 -- 172.21.15.37:0/4122545576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977d05840 msgr2=0x55f9780cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:59.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.105+0000 7f548a800640 1 --2- 172.21.15.37:0/4122545576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977d05840 0x55f9780cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.105+0000 7f548a800640 1 -- 172.21.15.37:0/4122545576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977cfd660 msgr2=0x55f9780cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:59.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.105+0000 7f548a800640 1 --2- 172.21.15.37:0/4122545576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977cfd660 0x55f9780cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.105+0000 7f548a800640 1 -- 172.21.15.37:0/4122545576 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f977fc0460 con 0x55f977d26520 2024-09-21T06:01:59.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.105+0000 7f5489400640 1 --2- 172.21.15.37:0/4122545576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977d05840 0x55f9780cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:59.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.105+0000 7f5489e00640 1 --2- 172.21.15.37:0/4122545576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977cfd660 0x55f9780cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:01:59.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.105+0000 7f548a800640 1 --2- 172.21.15.37:0/4122545576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780cd340 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5484009f00 tx=0x7f5484011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a4cfffcc1423bd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:59.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.105+0000 7f5477400640 1 -- 172.21.15.37:0/4122545576 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484004d20 con 0x55f977d26520 2024-09-21T06:01:59.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.106+0000 7f5477400640 1 -- 172.21.15.37:0/4122545576 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5484004030 con 0x55f977d26520 2024-09-21T06:01:59.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.106+0000 7f5477400640 1 -- 172.21.15.37:0/4122545576 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484005280 con 0x55f977d26520 2024-09-21T06:01:59.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.106+0000 7f5482a00640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54700b6590 0x7f54700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.106+0000 7f5497df7740 1 -- 172.21.15.37:0/4122545576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 msgr2=0x55f9780cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:59.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.106+0000 7f5497df7740 1 --2- 172.21.15.37:0/4122545576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780cd340 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5484009f00 tx=0x7f5484011810 comp rx=0 tx=0).stop 2024-09-21T06:01:59.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.106+0000 7f5497df7740 1 -- 172.21.15.37:0/4122545576 shutdown_connections 2024-09-21T06:01:59.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.106+0000 7f5497df7740 1 --2- 172.21.15.37:0/4122545576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977d05840 0x55f9780cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.106+0000 7f5497df7740 1 --2- 172.21.15.37:0/4122545576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977cfd660 0x55f9780cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.106+0000 7f5497df7740 1 --2- 172.21.15.37:0/4122545576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780cd340 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.106+0000 7f5482a00640 1 -- 172.21.15.37:0/3592494727 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f547c0e79d0 con 0x7f548c1047c0 2024-09-21T06:01:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.106+0000 7f5497df7740 1 -- 172.21.15.37:0/4122545576 >> 172.21.15.37:0/4122545576 conn(0x55f977d1a910 msgr2=0x55f9780cb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.107+0000 7f5489e00640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54700b6590 0x7f54700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.107+0000 7f5497df7740 1 -- 172.21.15.37:0/4122545576 shutdown_connections 2024-09-21T06:01:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.107+0000 7f5497df7740 1 -- 172.21.15.37:0/4122545576 wait complete. 2024-09-21T06:01:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.107+0000 7f5489e00640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54700b6590 0x7f54700b8aa0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f547c0e50a0 tx=0x7f547c009700 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.107+0000 7f5497df7740 1 -- start start 2024-09-21T06:01:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.108+0000 7f5497df7740 1 Processor -- start 2024-09-21T06:01:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.108+0000 7f5497df7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977cfd660 0x55f9780d8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.108+0000 7f5497df7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 0x55f9780d93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.108+0000 7f5497df7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780e4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.108+0000 7f5497df7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f977e94bb0 con 0x55f977d05840 2024-09-21T06:01:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.108+0000 7f5497df7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f977fce6c0 con 0x55f977cfd660 2024-09-21T06:01:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.108+0000 7f5497df7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f9780dbb20 con 0x55f977d26520 2024-09-21T06:01:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.108+0000 7f5497df7740 10 client.0 _ll_register_callbacks cb 0x55f977fe9490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.109+0000 7f5489400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 0x55f9780d93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.109+0000 7f548a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977cfd660 0x55f9780d8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.109+0000 7f548a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977cfd660 0x55f9780d8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:60282/0 (socket says 172.21.15.37:60282) 2024-09-21T06:01:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.109+0000 7f5489400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 0x55f9780d93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57754/0 (socket says 172.21.15.37:57754) 2024-09-21T06:01:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.109+0000 7f548a800640 1 -- 172.21.15.37:0/2658741661 learned_addr learned my addr 172.21.15.37:0/2658741661 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:59.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.109+0000 7f548a800640 1 --2- 172.21.15.37:0/2658741661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780e4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.109+0000 7f5489400640 1 -- 172.21.15.37:0/2658741661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 msgr2=0x55f9780e4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:59.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.109+0000 7f5489400640 1 --2- 172.21.15.37:0/2658741661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780e4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.109+0000 7f5489400640 1 -- 172.21.15.37:0/2658741661 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977cfd660 msgr2=0x55f9780d8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:59.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.109+0000 7f5489400640 1 --2- 172.21.15.37:0/2658741661 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977cfd660 0x55f9780d8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.109+0000 7f5489400640 1 -- 172.21.15.37:0/2658741661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f977d91b00 con 0x55f977d05840 2024-09-21T06:01:59.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.109+0000 7f548a800640 1 --2- 172.21.15.37:0/2658741661 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977cfd660 0x55f9780d8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:01:59.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.110+0000 7f5489400640 1 --2- 172.21.15.37:0/2658741661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 0x55f9780d93f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5478009230 tx=0x7f54780316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c40aacde240f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:59.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.110+0000 7f546be00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T06:01:59.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.110+0000 7f546be00640 1 -- 172.21.15.37:0/2658741661 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478035040 con 0x55f977d05840 2024-09-21T06:01:59.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.110+0000 7f5497df7740 1 -- 172.21.15.37:0/2658741661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5484004030 con 0x55f977d05840 2024-09-21T06:01:59.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.110+0000 7f546be00640 1 -- 172.21.15.37:0/2658741661 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f5478004050 con 0x55f977d05840 2024-09-21T06:01:59.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.110+0000 7f546be00640 1 -- 172.21.15.37:0/2658741661 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5478004250 con 0x55f977d05840 2024-09-21T06:01:59.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.110+0000 7f5497df7740 10 client.15675 fetch_fsmap learned FSMap version 21 2024-09-21T06:01:59.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.110+0000 7f5497df7740 1 -- 172.21.15.37:0/2658741661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f977e08960 con 0x55f977d05840 2024-09-21T06:01:59.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.111+0000 7f546be00640 1 -- 172.21.15.37:0/2658741661 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5484004030 con 0x55f977d05840 2024-09-21T06:01:59.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.111+0000 7f546be00640 1 -- 172.21.15.37:0/2658741661 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5478004b40 con 0x55f977d05840 2024-09-21T06:01:59.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.111+0000 7f5497df7740 10 client.15675 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:01:59.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.111+0000 7f5497df7740 10 client.15675 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:01:59.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.111+0000 7f5497df7740 20 client.15675 populate_metadata read hostname 'smithi037' 2024-09-21T06:01:59.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.111+0000 7f5497df7740 1 --2- 172.21.15.37:0/2658741661 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f977ce4ea0 0x55f9780eade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.111+0000 7f5497df7740 4 client.15675 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:01:59.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.111+0000 7f5497df7740 1 -- 172.21.15.37:0/2658741661 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9780461e0 con 0x55f977ce4ea0 2024-09-21T06:01:59.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.111+0000 7f548a800640 1 --2- 172.21.15.37:0/2658741661 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f977ce4ea0 0x55f9780eade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.112+0000 7f548a800640 1 --2- 172.21.15.37:0/2658741661 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f977ce4ea0 0x55f9780eade0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c8e28633fc358ad server_cookie=275a33cf08969280 in_seq=0 out_seq=0 2024-09-21T06:01:59.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.112+0000 7f546be00640 10 client.15675 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:59.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f546be00640 1 -- 172.21.15.37:0/2658741661 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9780461e0 con 0x55f977ce4ea0 2024-09-21T06:01:59.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f546be00640 10 client.15675 handle_command_reply: tid=0 2024-09-21T06:01:59.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f5497df7740 1 client.15675 shutdown 2024-09-21T06:01:59.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f5497df7740 1 -- 172.21.15.37:0/2658741661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 msgr2=0x55f9780d93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f5497df7740 1 --2- 172.21.15.37:0/2658741661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 0x55f9780d93f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5478009230 tx=0x7f54780316d0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f5497df7740 1 -- 172.21.15.37:0/2658741661 shutdown_connections 2024-09-21T06:01:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f5497df7740 1 --2- 172.21.15.37:0/2658741661 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f977ce4ea0 0x55f9780eade0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f5497df7740 1 --2- 172.21.15.37:0/2658741661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780e4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f5497df7740 1 --2- 172.21.15.37:0/2658741661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 0x55f9780d93f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f546be00640 0 client.15675 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f5497df7740 1 --2- 172.21.15.37:0/2658741661 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977cfd660 0x55f9780d8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f5497df7740 1 -- 172.21.15.37:0/2658741661 >> 172.21.15.37:0/2658741661 conn(0x55f977d1a910 msgr2=0x55f9780d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f5497df7740 1 -- 172.21.15.37:0/2658741661 shutdown_connections 2024-09-21T06:01:59.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f5497df7740 1 -- 172.21.15.37:0/2658741661 wait complete. 2024-09-21T06:01:59.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.113+0000 7f5497df7740 20 client.15675 trim_cache size 0 max 16384 2024-09-21T06:01:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.131+0000 7f5497df7740 1 Processor -- start 2024-09-21T06:01:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.132+0000 7f5497df7740 1 -- start start 2024-09-21T06:01:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.132+0000 7f5497df7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977cfd660 0x55f9780d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.132+0000 7f5497df7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 0x55f9780d23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.132+0000 7f5497df7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.132+0000 7f5497df7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f548c1b0bf0 con 0x55f977d05840 2024-09-21T06:01:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.132+0000 7f5497df7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f548c1b3470 con 0x55f977cfd660 2024-09-21T06:01:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.132+0000 7f5497df7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f548c1b1260 con 0x55f977d26520 2024-09-21T06:01:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.132+0000 7f5489400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 0x55f9780d23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.132+0000 7f5489400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 0x55f9780d23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57758/0 (socket says 172.21.15.37:57758) 2024-09-21T06:01:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.132+0000 7f5489400640 1 -- 172.21.15.37:0/4001132537 learned_addr learned my addr 172.21.15.37:0/4001132537 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.132+0000 7f548a800640 1 --2- 172.21.15.37:0/4001132537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977cfd660 0x55f9780d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.132+0000 7f548a800640 1 --2- 172.21.15.37:0/4001132537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.133+0000 7f5489400640 1 -- 172.21.15.37:0/4001132537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 msgr2=0x55f9780d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.133+0000 7f5489400640 1 --2- 172.21.15.37:0/4001132537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.133+0000 7f5489400640 1 -- 172.21.15.37:0/4001132537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977cfd660 msgr2=0x55f9780d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.133+0000 7f5489400640 1 --2- 172.21.15.37:0/4001132537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977cfd660 0x55f9780d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.133+0000 7f5489400640 1 -- 172.21.15.37:0/4001132537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9780d4540 con 0x55f977d05840 2024-09-21T06:01:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.133+0000 7f548a800640 1 --2- 172.21.15.37:0/4001132537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.133+0000 7f5489400640 1 --2- 172.21.15.37:0/4001132537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 0x55f9780d23d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5478006010 tx=0x7f54780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c09409d36be58f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.133+0000 7f5476a00640 1 -- 172.21.15.37:0/4001132537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478059020 con 0x55f977d05840 2024-09-21T06:01:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.133+0000 7f5476a00640 1 -- 172.21.15.37:0/4001132537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5478004c20 con 0x55f977d05840 2024-09-21T06:01:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.133+0000 7f5476a00640 1 -- 172.21.15.37:0/4001132537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478035070 con 0x55f977d05840 2024-09-21T06:01:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.134+0000 7f5497df7740 1 -- 172.21.15.37:0/4001132537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 msgr2=0x55f9780d23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.134+0000 7f5497df7740 1 --2- 172.21.15.37:0/4001132537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 0x55f9780d23d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5478006010 tx=0x7f54780046c0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.134+0000 7f5497df7740 1 -- 172.21.15.37:0/4001132537 shutdown_connections 2024-09-21T06:01:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.134+0000 7f5497df7740 1 --2- 172.21.15.37:0/4001132537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9780d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.134+0000 7f5497df7740 1 --2- 172.21.15.37:0/4001132537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977d05840 0x55f9780d23d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.134+0000 7f5497df7740 1 --2- 172.21.15.37:0/4001132537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977cfd660 0x55f9780d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.134+0000 7f5497df7740 1 -- 172.21.15.37:0/4001132537 >> 172.21.15.37:0/4001132537 conn(0x55f977d1a910 msgr2=0x55f9780d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.134+0000 7f5497df7740 1 -- 172.21.15.37:0/4001132537 shutdown_connections 2024-09-21T06:01:59.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.134+0000 7f5497df7740 1 -- 172.21.15.37:0/4001132537 wait complete. 2024-09-21T06:01:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.135+0000 7f5497df7740 1 -- start start 2024-09-21T06:01:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.135+0000 7f5497df7740 1 Processor -- start 2024-09-21T06:01:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.135+0000 7f5497df7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977cfd660 0x55f9780dd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.135+0000 7f5497df7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977d05840 0x55f9780dd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.135+0000 7f5497df7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9781547a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.135+0000 7f5497df7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f548c1b1930 con 0x55f977cfd660 2024-09-21T06:01:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.135+0000 7f5497df7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f548c1b2da0 con 0x55f977d05840 2024-09-21T06:01:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.135+0000 7f5497df7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f548c1b2000 con 0x55f977d26520 2024-09-21T06:01:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.136+0000 7f5497df7740 10 client.0 _ll_register_callbacks cb 0x7f5478009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:01:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.136+0000 7f548a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977cfd660 0x55f9780dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.136+0000 7f548a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977cfd660 0x55f9780dd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57768/0 (socket says 172.21.15.37:57768) 2024-09-21T06:01:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.136+0000 7f548a800640 1 -- 172.21.15.37:0/973362346 learned_addr learned my addr 172.21.15.37:0/973362346 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:01:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.136+0000 7f5489400640 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977d05840 0x55f9780dd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.136+0000 7f548a800640 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9781547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.136+0000 7f5489400640 1 -- 172.21.15.37:0/973362346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 msgr2=0x55f9781547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.136+0000 7f5489400640 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9781547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.136+0000 7f5489400640 1 -- 172.21.15.37:0/973362346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977cfd660 msgr2=0x55f9780dd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.136+0000 7f5489400640 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977cfd660 0x55f9780dd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.136+0000 7f5489400640 1 -- 172.21.15.37:0/973362346 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9780ddd50 con 0x55f977d05840 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.136+0000 7f548a800640 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9781547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.137+0000 7f5489400640 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977d05840 0x55f9780dd540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5478009230 tx=0x7f54780038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=304cfaa8da85a4b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.137+0000 7f546be00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.137+0000 7f546be00640 1 -- 172.21.15.37:0/973362346 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478059070 con 0x55f977d05840 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.137+0000 7f5497df7740 1 -- 172.21.15.37:0/973362346 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5478004c20 con 0x55f977d05840 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.137+0000 7f546be00640 1 -- 172.21.15.37:0/973362346 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f5478004770 con 0x55f977d05840 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.137+0000 7f546be00640 1 -- 172.21.15.37:0/973362346 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f547806b050 con 0x55f977d05840 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.137+0000 7f5497df7740 10 client.25730 fetch_fsmap learned FSMap version 21 2024-09-21T06:01:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.137+0000 7f5497df7740 1 -- 172.21.15.37:0/973362346 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f978155c50 con 0x55f977d05840 2024-09-21T06:01:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.137+0000 7f546be00640 1 -- 172.21.15.37:0/973362346 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5478004c20 con 0x55f977d05840 2024-09-21T06:01:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.138+0000 7f546be00640 1 -- 172.21.15.37:0/973362346 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5478005410 con 0x55f977d05840 2024-09-21T06:01:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.138+0000 7f5497df7740 10 client.25730 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:01:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.138+0000 7f5497df7740 10 client.25730 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:01:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.138+0000 7f5497df7740 20 client.25730 populate_metadata read hostname 'smithi037' 2024-09-21T06:01:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.138+0000 7f5497df7740 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f977cba250 0x55f978158190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:01:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.138+0000 7f5497df7740 4 client.25730 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c7aa1d22", "release": true, "await": true}] 2024-09-21T06:01:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.138+0000 7f5497df7740 1 -- 172.21.15.37:0/973362346 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c7aa1d22", "release": true, "await": true}) -- 0x55f978041c90 con 0x55f977cba250 2024-09-21T06:01:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.138+0000 7f548a800640 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f977cba250 0x55f978158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:01:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.139+0000 7f548a800640 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f977cba250 0x55f978158190 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db127a7dc80953a0 server_cookie=5db1ca430fe668b8 in_seq=0 out_seq=0 2024-09-21T06:01:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.139+0000 7f546be00640 10 client.25730 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:59.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f546be00640 1 -- 172.21.15.37:0/973362346 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f978041c90 con 0x55f977cba250 2024-09-21T06:01:59.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f546be00640 10 client.25730 handle_command_reply: tid=0 2024-09-21T06:01:59.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f5497df7740 1 client.25730 shutdown 2024-09-21T06:01:59.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f5497df7740 1 -- 172.21.15.37:0/973362346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977d05840 msgr2=0x55f9780dd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:59.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f5497df7740 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977d05840 0x55f9780dd540 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5478009230 tx=0x7f54780038a0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f5497df7740 1 -- 172.21.15.37:0/973362346 shutdown_connections 2024-09-21T06:01:59.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f5497df7740 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55f977cba250 0x55f978158190 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f5497df7740 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f977d26520 0x55f9781547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f5497df7740 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f977d05840 0x55f9780dd540 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f5497df7740 1 --2- 172.21.15.37:0/973362346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f977cfd660 0x55f9780dd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f546be00640 0 client.25730 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:01:59.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f5497df7740 1 -- 172.21.15.37:0/973362346 >> 172.21.15.37:0/973362346 conn(0x55f977d1a910 msgr2=0x55f9780ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:59.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f5497df7740 1 -- 172.21.15.37:0/973362346 shutdown_connections 2024-09-21T06:01:59.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.340+0000 7f5497df7740 1 -- 172.21.15.37:0/973362346 wait complete. 2024-09-21T06:01:59.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.341+0000 7f5497df7740 20 client.25730 trim_cache size 0 max 16384 2024-09-21T06:01:59.344 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:01:59.344 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T06:01:59.344 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T06:01:59.344 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 36, 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: "c7aa1d22": { 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 36, 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 141.1, 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T06:01:59.345 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:01:59.346 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T06:01:59.346 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:01:59.346 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:59.346 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:59.346 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:59.346 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:59.346 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:01:59.346 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:01:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.341+0000 7f548b200640 1 -- 172.21.15.37:0/3592494727 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54700b6590 msgr2=0x7f54700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.341+0000 7f548b200640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54700b6590 0x7f54700b8aa0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f547c0e50a0 tx=0x7f547c009700 comp rx=0 tx=0).stop 2024-09-21T06:01:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.341+0000 7f548b200640 1 -- 172.21.15.37:0/3592494727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f548c1047c0 msgr2=0x7f548c19c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:01:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.341+0000 7f548b200640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f548c1047c0 0x7f548c19c4b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f547c00e9f0 tx=0x7f547c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.341+0000 7f548b200640 1 -- 172.21.15.37:0/3592494727 shutdown_connections 2024-09-21T06:01:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.342+0000 7f548b200640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f54700b6590 0x7f54700b8aa0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.342+0000 7f548b200640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f548c10dc20 0x7f548c1a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.342+0000 7f548b200640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f548c105110 0x7f548c19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.342+0000 7f548b200640 1 --2- 172.21.15.37:0/3592494727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f548c1047c0 0x7f548c19c4b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:01:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.342+0000 7f548b200640 1 -- 172.21.15.37:0/3592494727 >> 172.21.15.37:0/3592494727 conn(0x7f548c0fe2c0 msgr2=0x7f548c1024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:01:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.342+0000 7f548b200640 1 -- 172.21.15.37:0/3592494727 shutdown_connections 2024-09-21T06:01:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:01:59.342+0000 7f548b200640 1 -- 172.21.15.37:0/3592494727 wait complete. 2024-09-21T06:01:59.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:01:59 smithi037 ceph-mon[30631]: pgmap v656: 129 pgs: 129 active+clean; 148 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 20 KiB/s wr, 2 op/s 2024-09-21T06:01:59.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:01:59 smithi144 ceph-mon[34351]: pgmap v656: 129 pgs: 129 active+clean; 148 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 20 KiB/s wr, 2 op/s 2024-09-21T06:01:59.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:01:59 smithi067 ceph-mon[34443]: pgmap v656: 129 pgs: 129 active+clean; 148 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 20 KiB/s wr, 2 op/s 2024-09-21T06:02:00.181 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c7aa1d22', total seconds elapsed: 25.3 2024-09-21T06:02:01.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:01 smithi144 ceph-mon[34351]: pgmap v657: 129 pgs: 129 active+clean; 143 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 62 KiB/s wr, 10 op/s 2024-09-21T06:02:01.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:01 smithi037 ceph-mon[30631]: pgmap v657: 129 pgs: 129 active+clean; 143 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 62 KiB/s wr, 10 op/s 2024-09-21T06:02:01.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:01 smithi067 ceph-mon[34443]: pgmap v657: 129 pgs: 129 active+clean; 143 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 62 KiB/s wr, 10 op/s 2024-09-21T06:02:02.841 INFO:tasks.workunit.client.0.smithi037.stdout:truncating to largest ever: 0x63e9b52 2024-09-21T06:02:03.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:03 smithi144 ceph-mon[34351]: pgmap v658: 129 pgs: 129 active+clean; 143 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 149 KiB/s wr, 50 op/s 2024-09-21T06:02:03.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:03 smithi037 ceph-mon[30631]: pgmap v658: 129 pgs: 129 active+clean; 143 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 149 KiB/s wr, 50 op/s 2024-09-21T06:02:03.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:03 smithi067 ceph-mon[34443]: pgmap v658: 129 pgs: 129 active+clean; 143 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 149 KiB/s wr, 50 op/s 2024-09-21T06:02:04.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:04 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:02:04.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:04 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:02:04.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:04 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:02:05.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:05 smithi144 ceph-mon[34351]: pgmap v659: 129 pgs: 129 active+clean; 142 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 212 KiB/s wr, 65 op/s 2024-09-21T06:02:05.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:02:05.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:02:05.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:02:05.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:05 smithi037 ceph-mon[30631]: pgmap v659: 129 pgs: 129 active+clean; 142 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 212 KiB/s wr, 65 op/s 2024-09-21T06:02:05.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:02:05.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:02:05.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:02:05.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:05 smithi067 ceph-mon[34443]: pgmap v659: 129 pgs: 129 active+clean; 142 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 212 KiB/s wr, 65 op/s 2024-09-21T06:02:05.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:02:05.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:02:05.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:02:07.750 INFO:tasks.workunit.client.0.smithi037.stdout:20000 read 0xa6cbf1 thru 0xa6e358 (0x1768 bytes) 2024-09-21T06:02:07.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:07 smithi144 ceph-mon[34351]: pgmap v660: 129 pgs: 129 active+clean; 147 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 367 KiB/s wr, 125 op/s 2024-09-21T06:02:07.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:07 smithi037 ceph-mon[30631]: pgmap v660: 129 pgs: 129 active+clean; 147 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 367 KiB/s wr, 125 op/s 2024-09-21T06:02:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:07 smithi067 ceph-mon[34443]: pgmap v660: 129 pgs: 129 active+clean; 147 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 367 KiB/s wr, 125 op/s 2024-09-21T06:02:09.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:09 smithi144 ceph-mon[34351]: pgmap v661: 129 pgs: 129 active+clean; 147 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 641 KiB/s wr, 233 op/s 2024-09-21T06:02:09.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:09 smithi037 ceph-mon[30631]: pgmap v661: 129 pgs: 129 active+clean; 147 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 641 KiB/s wr, 233 op/s 2024-09-21T06:02:09.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:09 smithi067 ceph-mon[34443]: pgmap v661: 129 pgs: 129 active+clean; 147 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 641 KiB/s wr, 233 op/s 2024-09-21T06:02:11.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:11 smithi144 ceph-mon[34351]: pgmap v662: 129 pgs: 129 active+clean; 142 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 772 KiB/s wr, 289 op/s 2024-09-21T06:02:11.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:11 smithi037 ceph-mon[30631]: pgmap v662: 129 pgs: 129 active+clean; 142 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 772 KiB/s wr, 289 op/s 2024-09-21T06:02:11.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:11 smithi067 ceph-mon[34443]: pgmap v662: 129 pgs: 129 active+clean; 142 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 772 KiB/s wr, 289 op/s 2024-09-21T06:02:12.216 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0x63ed6b9 2024-09-21T06:02:13.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:13 smithi144 ceph-mon[34351]: pgmap v663: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 947 KiB/s wr, 375 op/s 2024-09-21T06:02:13.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:13 smithi037 ceph-mon[30631]: pgmap v663: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 947 KiB/s wr, 375 op/s 2024-09-21T06:02:13.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:13 smithi067 ceph-mon[34443]: pgmap v663: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 947 KiB/s wr, 375 op/s 2024-09-21T06:02:15.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:15 smithi144 ceph-mon[34351]: pgmap v664: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 956 KiB/s wr, 358 op/s 2024-09-21T06:02:15.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:15 smithi037 ceph-mon[30631]: pgmap v664: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 956 KiB/s wr, 358 op/s 2024-09-21T06:02:15.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:15 smithi067 ceph-mon[34443]: pgmap v664: 129 pgs: 129 active+clean; 146 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 956 KiB/s wr, 358 op/s 2024-09-21T06:02:17.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:17 smithi144 ceph-mon[34351]: pgmap v665: 129 pgs: 129 active+clean; 145 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.1 MiB/s wr, 432 op/s 2024-09-21T06:02:17.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:17 smithi037 ceph-mon[30631]: pgmap v665: 129 pgs: 129 active+clean; 145 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.1 MiB/s wr, 432 op/s 2024-09-21T06:02:17.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:17 smithi067 ceph-mon[34443]: pgmap v665: 129 pgs: 129 active+clean; 145 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.1 MiB/s wr, 432 op/s 2024-09-21T06:02:19.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:19 smithi144 ceph-mon[34351]: pgmap v666: 129 pgs: 129 active+clean; 147 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.2 MiB/s wr, 447 op/s 2024-09-21T06:02:19.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:19 smithi037 ceph-mon[30631]: pgmap v666: 129 pgs: 129 active+clean; 147 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.2 MiB/s wr, 447 op/s 2024-09-21T06:02:19.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:19 smithi067 ceph-mon[34443]: pgmap v666: 129 pgs: 129 active+clean; 147 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.2 MiB/s wr, 447 op/s 2024-09-21T06:02:21.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:21 smithi144 ceph-mon[34351]: pgmap v667: 129 pgs: 129 active+clean; 150 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 1.1 MiB/s wr, 391 op/s 2024-09-21T06:02:21.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:21 smithi037 ceph-mon[30631]: pgmap v667: 129 pgs: 129 active+clean; 150 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 1.1 MiB/s wr, 391 op/s 2024-09-21T06:02:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:21 smithi067 ceph-mon[34443]: pgmap v667: 129 pgs: 129 active+clean; 150 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 1.1 MiB/s wr, 391 op/s 2024-09-21T06:02:23.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:23 smithi037 ceph-mon[30631]: pgmap v668: 129 pgs: 129 active+clean; 147 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.2 MiB/s wr, 420 op/s 2024-09-21T06:02:23.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:23 smithi067 ceph-mon[34443]: pgmap v668: 129 pgs: 129 active+clean; 147 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.2 MiB/s wr, 420 op/s 2024-09-21T06:02:24.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:23 smithi144 ceph-mon[34351]: pgmap v668: 129 pgs: 129 active+clean; 147 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.2 MiB/s wr, 420 op/s 2024-09-21T06:02:25.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:25 smithi037 ceph-mon[30631]: pgmap v669: 129 pgs: 129 active+clean; 146 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.1 MiB/s wr, 348 op/s 2024-09-21T06:02:25.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:25 smithi067 ceph-mon[34443]: pgmap v669: 129 pgs: 129 active+clean; 146 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.1 MiB/s wr, 348 op/s 2024-09-21T06:02:26.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:25 smithi144 ceph-mon[34351]: pgmap v669: 129 pgs: 129 active+clean; 146 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.1 MiB/s wr, 348 op/s 2024-09-21T06:02:27.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:27 smithi037 ceph-mon[30631]: pgmap v670: 129 pgs: 129 active+clean; 137 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 1.2 MiB/s wr, 448 op/s 2024-09-21T06:02:27.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:27 smithi067 ceph-mon[34443]: pgmap v670: 129 pgs: 129 active+clean; 137 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 1.2 MiB/s wr, 448 op/s 2024-09-21T06:02:28.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:27 smithi144 ceph-mon[34351]: pgmap v670: 129 pgs: 129 active+clean; 137 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 1.2 MiB/s wr, 448 op/s 2024-09-21T06:02:29.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:29 smithi037 ceph-mon[30631]: pgmap v671: 129 pgs: 129 active+clean; 139 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 1.1 MiB/s wr, 416 op/s 2024-09-21T06:02:29.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:29 smithi067 ceph-mon[34443]: pgmap v671: 129 pgs: 129 active+clean; 139 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 1.1 MiB/s wr, 416 op/s 2024-09-21T06:02:30.127 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:29 smithi144 ceph-mon[34351]: pgmap v671: 129 pgs: 129 active+clean; 139 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 1.1 MiB/s wr, 416 op/s 2024-09-21T06:02:31.918 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:31 smithi037 ceph-mon[30631]: pgmap v672: 129 pgs: 129 active+clean; 140 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 1022 KiB/s wr, 399 op/s 2024-09-21T06:02:31.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:31 smithi067 ceph-mon[34443]: pgmap v672: 129 pgs: 129 active+clean; 140 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 1022 KiB/s wr, 399 op/s 2024-09-21T06:02:32.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:31 smithi144 ceph-mon[34351]: pgmap v672: 129 pgs: 129 active+clean; 140 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 1022 KiB/s wr, 399 op/s 2024-09-21T06:02:33.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:33 smithi037 ceph-mon[30631]: pgmap v673: 129 pgs: 129 active+clean; 141 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 1.1 MiB/s wr, 441 op/s 2024-09-21T06:02:33.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:33 smithi067 ceph-mon[34443]: pgmap v673: 129 pgs: 129 active+clean; 141 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 1.1 MiB/s wr, 441 op/s 2024-09-21T06:02:34.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:33 smithi144 ceph-mon[34351]: pgmap v673: 129 pgs: 129 active+clean; 141 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 1.1 MiB/s wr, 441 op/s 2024-09-21T06:02:35.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:35 smithi037 ceph-mon[30631]: pgmap v674: 129 pgs: 129 active+clean; 144 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 953 KiB/s wr, 381 op/s 2024-09-21T06:02:35.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:35 smithi067 ceph-mon[34443]: pgmap v674: 129 pgs: 129 active+clean; 144 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 953 KiB/s wr, 381 op/s 2024-09-21T06:02:36.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:35 smithi144 ceph-mon[34351]: pgmap v674: 129 pgs: 129 active+clean; 144 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 953 KiB/s wr, 381 op/s 2024-09-21T06:02:36.813 INFO:tasks.workunit.client.0.smithi037.stdout:copying to largest ever: 0x63ef9ee 2024-09-21T06:02:37.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:37 smithi037 ceph-mon[30631]: pgmap v675: 129 pgs: 129 active+clean; 150 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.1 MiB/s wr, 472 op/s 2024-09-21T06:02:37.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:37 smithi067 ceph-mon[34443]: pgmap v675: 129 pgs: 129 active+clean; 150 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.1 MiB/s wr, 472 op/s 2024-09-21T06:02:38.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:37 smithi144 ceph-mon[34351]: pgmap v675: 129 pgs: 129 active+clean; 150 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.1 MiB/s wr, 472 op/s 2024-09-21T06:02:39.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:39 smithi037 ceph-mon[30631]: pgmap v676: 129 pgs: 129 active+clean; 148 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.0 MiB/s wr, 403 op/s 2024-09-21T06:02:39.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:39 smithi144 ceph-mon[34351]: pgmap v676: 129 pgs: 129 active+clean; 148 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.0 MiB/s wr, 403 op/s 2024-09-21T06:02:39.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:39 smithi067 ceph-mon[34443]: pgmap v676: 129 pgs: 129 active+clean; 148 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.0 MiB/s wr, 403 op/s 2024-09-21T06:02:41.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:41 smithi067 ceph-mon[34443]: pgmap v677: 129 pgs: 129 active+clean; 153 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.1 MiB/s wr, 401 op/s 2024-09-21T06:02:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:41 smithi144 ceph-mon[34351]: pgmap v677: 129 pgs: 129 active+clean; 153 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.1 MiB/s wr, 401 op/s 2024-09-21T06:02:42.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:41 smithi037 ceph-mon[30631]: pgmap v677: 129 pgs: 129 active+clean; 153 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.1 MiB/s wr, 401 op/s 2024-09-21T06:02:43.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:43 smithi067 ceph-mon[34443]: pgmap v678: 129 pgs: 129 active+clean; 152 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1.1 MiB/s wr, 438 op/s 2024-09-21T06:02:44.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:43 smithi144 ceph-mon[34351]: pgmap v678: 129 pgs: 129 active+clean; 152 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1.1 MiB/s wr, 438 op/s 2024-09-21T06:02:44.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:43 smithi037 ceph-mon[30631]: pgmap v678: 129 pgs: 129 active+clean; 152 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1.1 MiB/s wr, 438 op/s 2024-09-21T06:02:45.966 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:45 smithi037 ceph-mon[30631]: pgmap v679: 129 pgs: 129 active+clean; 158 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 991 KiB/s wr, 365 op/s 2024-09-21T06:02:45.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:45 smithi067 ceph-mon[34443]: pgmap v679: 129 pgs: 129 active+clean; 158 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 991 KiB/s wr, 365 op/s 2024-09-21T06:02:46.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:45 smithi144 ceph-mon[34351]: pgmap v679: 129 pgs: 129 active+clean; 158 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 991 KiB/s wr, 365 op/s 2024-09-21T06:02:47.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:47 smithi067 ceph-mon[34443]: pgmap v680: 129 pgs: 129 active+clean; 155 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.2 MiB/s wr, 452 op/s 2024-09-21T06:02:48.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:47 smithi144 ceph-mon[34351]: pgmap v680: 129 pgs: 129 active+clean; 155 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.2 MiB/s wr, 452 op/s 2024-09-21T06:02:48.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:47 smithi037 ceph-mon[30631]: pgmap v680: 129 pgs: 129 active+clean; 155 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.2 MiB/s wr, 452 op/s 2024-09-21T06:02:49.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:49 smithi067 ceph-mon[34443]: pgmap v681: 129 pgs: 129 active+clean; 150 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.0 MiB/s wr, 387 op/s 2024-09-21T06:02:50.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:49 smithi144 ceph-mon[34351]: pgmap v681: 129 pgs: 129 active+clean; 150 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.0 MiB/s wr, 387 op/s 2024-09-21T06:02:50.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:49 smithi037 ceph-mon[30631]: pgmap v681: 129 pgs: 129 active+clean; 150 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.0 MiB/s wr, 387 op/s 2024-09-21T06:02:51.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:51 smithi067 ceph-mon[34443]: pgmap v682: 129 pgs: 129 active+clean; 152 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.0 MiB/s wr, 387 op/s 2024-09-21T06:02:52.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:51 smithi144 ceph-mon[34351]: pgmap v682: 129 pgs: 129 active+clean; 152 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.0 MiB/s wr, 387 op/s 2024-09-21T06:02:52.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:51 smithi037 ceph-mon[30631]: pgmap v682: 129 pgs: 129 active+clean; 152 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.0 MiB/s wr, 387 op/s 2024-09-21T06:02:53.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:53 smithi067 ceph-mon[34443]: pgmap v683: 129 pgs: 129 active+clean; 146 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.0 MiB/s wr, 419 op/s 2024-09-21T06:02:54.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:53 smithi144 ceph-mon[34351]: pgmap v683: 129 pgs: 129 active+clean; 146 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.0 MiB/s wr, 419 op/s 2024-09-21T06:02:54.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:53 smithi037 ceph-mon[30631]: pgmap v683: 129 pgs: 129 active+clean; 146 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.0 MiB/s wr, 419 op/s 2024-09-21T06:02:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:55 smithi067 ceph-mon[34443]: pgmap v684: 129 pgs: 129 active+clean; 150 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 946 KiB/s wr, 348 op/s 2024-09-21T06:02:56.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:55 smithi144 ceph-mon[34351]: pgmap v684: 129 pgs: 129 active+clean; 150 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 946 KiB/s wr, 348 op/s 2024-09-21T06:02:56.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:55 smithi037 ceph-mon[30631]: pgmap v684: 129 pgs: 129 active+clean; 150 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 946 KiB/s wr, 348 op/s 2024-09-21T06:02:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:57 smithi067 ceph-mon[34443]: pgmap v685: 129 pgs: 129 active+clean; 152 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.1 MiB/s wr, 445 op/s 2024-09-21T06:02:58.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:57 smithi144 ceph-mon[34351]: pgmap v685: 129 pgs: 129 active+clean; 152 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.1 MiB/s wr, 445 op/s 2024-09-21T06:02:58.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:57 smithi037 ceph-mon[30631]: pgmap v685: 129 pgs: 129 active+clean; 152 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.1 MiB/s wr, 445 op/s 2024-09-21T06:02:59.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:02:59 smithi067 ceph-mon[34443]: pgmap v686: 129 pgs: 129 active+clean; 159 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 1014 KiB/s wr, 390 op/s 2024-09-21T06:03:00.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:02:59 smithi144 ceph-mon[34351]: pgmap v686: 129 pgs: 129 active+clean; 159 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 1014 KiB/s wr, 390 op/s 2024-09-21T06:03:00.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:02:59 smithi037 ceph-mon[30631]: pgmap v686: 129 pgs: 129 active+clean; 159 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 1014 KiB/s wr, 390 op/s 2024-09-21T06:03:01.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:01 smithi067 ceph-mon[34443]: pgmap v687: 129 pgs: 129 active+clean; 151 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 1.0 MiB/s wr, 396 op/s 2024-09-21T06:03:02.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:01 smithi144 ceph-mon[34351]: pgmap v687: 129 pgs: 129 active+clean; 151 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 1.0 MiB/s wr, 396 op/s 2024-09-21T06:03:02.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:01 smithi037 ceph-mon[30631]: pgmap v687: 129 pgs: 129 active+clean; 151 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 1.0 MiB/s wr, 396 op/s 2024-09-21T06:03:03.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:03 smithi067 ceph-mon[34443]: pgmap v688: 129 pgs: 129 active+clean; 148 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.1 MiB/s wr, 433 op/s 2024-09-21T06:03:04.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:03 smithi144 ceph-mon[34351]: pgmap v688: 129 pgs: 129 active+clean; 148 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.1 MiB/s wr, 433 op/s 2024-09-21T06:03:04.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:03 smithi037 ceph-mon[30631]: pgmap v688: 129 pgs: 129 active+clean; 148 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.1 MiB/s wr, 433 op/s 2024-09-21T06:03:05.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:05 smithi144 ceph-mon[34351]: pgmap v689: 129 pgs: 129 active+clean; 142 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1008 KiB/s wr, 368 op/s 2024-09-21T06:03:05.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:05.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:05.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:05 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:05.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:05 smithi067 ceph-mon[34443]: pgmap v689: 129 pgs: 129 active+clean; 142 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1008 KiB/s wr, 368 op/s 2024-09-21T06:03:05.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:05.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:05.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:05 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:06.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:05 smithi037 ceph-mon[30631]: pgmap v689: 129 pgs: 129 active+clean; 142 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1008 KiB/s wr, 368 op/s 2024-09-21T06:03:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:06.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:05 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:07 smithi067 ceph-mon[34443]: pgmap v690: 129 pgs: 129 active+clean; 148 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.2 MiB/s wr, 460 op/s 2024-09-21T06:03:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:07 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:08.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:07 smithi144 ceph-mon[34351]: pgmap v690: 129 pgs: 129 active+clean; 148 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.2 MiB/s wr, 460 op/s 2024-09-21T06:03:08.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:08.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:08.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:08.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:07 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:08.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:07 smithi037 ceph-mon[30631]: pgmap v690: 129 pgs: 129 active+clean; 148 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.2 MiB/s wr, 460 op/s 2024-09-21T06:03:08.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:08.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:08.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:08.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:07 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:09.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:09.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:09.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:09.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:09.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:09.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:09.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:09.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:09.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:09.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:09.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:09.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:09.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:09.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:09.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:03:10.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:10 smithi144 ceph-mon[34351]: pgmap v691: 129 pgs: 129 active+clean; 150 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 1.0 MiB/s wr, 397 op/s 2024-09-21T06:03:10.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:10 smithi037 ceph-mon[30631]: pgmap v691: 129 pgs: 129 active+clean; 150 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 1.0 MiB/s wr, 397 op/s 2024-09-21T06:03:10.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:10 smithi067 ceph-mon[34443]: pgmap v691: 129 pgs: 129 active+clean; 150 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 1.0 MiB/s wr, 397 op/s 2024-09-21T06:03:12.298 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:12 smithi067 ceph-mon[34443]: pgmap v692: 129 pgs: 129 active+clean; 148 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 1.0 MiB/s wr, 389 op/s 2024-09-21T06:03:12.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:12 smithi144 ceph-mon[34351]: pgmap v692: 129 pgs: 129 active+clean; 148 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 1.0 MiB/s wr, 389 op/s 2024-09-21T06:03:12.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:12 smithi037 ceph-mon[30631]: pgmap v692: 129 pgs: 129 active+clean; 148 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 1.0 MiB/s wr, 389 op/s 2024-09-21T06:03:14.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:14 smithi144 ceph-mon[34351]: pgmap v693: 129 pgs: 129 active+clean; 147 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.1 MiB/s wr, 416 op/s 2024-09-21T06:03:14.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:14 smithi037 ceph-mon[30631]: pgmap v693: 129 pgs: 129 active+clean; 147 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.1 MiB/s wr, 416 op/s 2024-09-21T06:03:14.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:14 smithi067 ceph-mon[34443]: pgmap v693: 129 pgs: 129 active+clean; 147 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.1 MiB/s wr, 416 op/s 2024-09-21T06:03:16.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:16 smithi144 ceph-mon[34351]: pgmap v694: 129 pgs: 129 active+clean; 155 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 984 KiB/s wr, 344 op/s 2024-09-21T06:03:16.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:16 smithi037 ceph-mon[30631]: pgmap v694: 129 pgs: 129 active+clean; 155 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 984 KiB/s wr, 344 op/s 2024-09-21T06:03:16.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:16 smithi067 ceph-mon[34443]: pgmap v694: 129 pgs: 129 active+clean; 155 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 984 KiB/s wr, 344 op/s 2024-09-21T06:03:18.368 INFO:tasks.quiescer.fs.[cephfs]:Total duration (49.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T06:03:18.368 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-21T06:03:18.369 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:03:18.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:18 smithi144 ceph-mon[34351]: pgmap v695: 129 pgs: 129 active+clean; 157 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.1 MiB/s wr, 427 op/s 2024-09-21T06:03:18.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:18 smithi037 ceph-mon[30631]: pgmap v695: 129 pgs: 129 active+clean; 157 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.1 MiB/s wr, 427 op/s 2024-09-21T06:03:18.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:18 smithi067 ceph-mon[34443]: pgmap v695: 129 pgs: 129 active+clean; 157 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 1.1 MiB/s wr, 427 op/s 2024-09-21T06:03:18.869 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:20.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.786+0000 7f9c49600640 1 -- 172.21.15.37:0/2163606678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c441052d0 msgr2=0x7f9c4410d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:20.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.786+0000 7f9c49600640 1 --2- 172.21.15.37:0/2163606678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c441052d0 0x7f9c4410d910 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009900 tx=0x7f9c3002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.786+0000 7f9c49600640 1 -- 172.21.15.37:0/2163606678 shutdown_connections 2024-09-21T06:03:20.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.786+0000 7f9c49600640 1 --2- 172.21.15.37:0/2163606678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c4410de50 0x7f9c44110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.786+0000 7f9c49600640 1 --2- 172.21.15.37:0/2163606678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c441052d0 0x7f9c4410d910 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.786+0000 7f9c49600640 1 --2- 172.21.15.37:0/2163606678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c441048a0 0x7f9c44104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.786+0000 7f9c49600640 1 -- 172.21.15.37:0/2163606678 >> 172.21.15.37:0/2163606678 conn(0x7f9c44079740 msgr2=0x7f9c44079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:20.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.786+0000 7f9c49600640 1 -- 172.21.15.37:0/2163606678 shutdown_connections 2024-09-21T06:03:20.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.786+0000 7f9c49600640 1 -- 172.21.15.37:0/2163606678 wait complete. 2024-09-21T06:03:20.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.787+0000 7f9c49600640 1 Processor -- start 2024-09-21T06:03:20.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.787+0000 7f9c49600640 1 -- start start 2024-09-21T06:03:20.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.788+0000 7f9c49600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c441048a0 0x7f9c4419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:20.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.788+0000 7f9c49600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c441052d0 0x7f9c4419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:20.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.788+0000 7f9c49600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c4410de50 0x7f9c4419fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:20.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.788+0000 7f9c49600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c44113b20 con 0x7f9c4410de50 2024-09-21T06:03:20.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.788+0000 7f9c49600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c441139a0 con 0x7f9c441052d0 2024-09-21T06:03:20.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.788+0000 7f9c49600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9c44113ca0 con 0x7f9c441048a0 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.788+0000 7f9c42a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c441048a0 0x7f9c4419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.788+0000 7f9c42000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c441052d0 0x7f9c4419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.788+0000 7f9c42a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c441048a0 0x7f9c4419a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:44682/0 (socket says 172.21.15.37:44682) 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.788+0000 7f9c42a00640 1 -- 172.21.15.37:0/3697659682 learned_addr learned my addr 172.21.15.37:0/3697659682 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.788+0000 7f9c43400640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c4410de50 0x7f9c4419fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.789+0000 7f9c42a00640 1 -- 172.21.15.37:0/3697659682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c441052d0 msgr2=0x7f9c4419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.789+0000 7f9c42a00640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c441052d0 0x7f9c4419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.789+0000 7f9c42a00640 1 -- 172.21.15.37:0/3697659682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c4410de50 msgr2=0x7f9c4419fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.789+0000 7f9c42a00640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c4410de50 0x7f9c4419fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.789+0000 7f9c42a00640 1 -- 172.21.15.37:0/3697659682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c441a0520 con 0x7f9c441048a0 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.789+0000 7f9c42000640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c441052d0 0x7f9c4419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.789+0000 7f9c42a00640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c441048a0 0x7f9c4419a5b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400e9c0 tx=0x7f9c3400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.790+0000 7f9c3b400640 1 -- 172.21.15.37:0/3697659682 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3400cde0 con 0x7f9c441048a0 2024-09-21T06:03:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.790+0000 7f9c3b400640 1 -- 172.21.15.37:0/3697659682 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c340108e0 con 0x7f9c441048a0 2024-09-21T06:03:20.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.790+0000 7f9c49600640 1 -- 172.21.15.37:0/3697659682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c441a0810 con 0x7f9c441048a0 2024-09-21T06:03:20.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.790+0000 7f9c3b400640 1 -- 172.21.15.37:0/3697659682 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c34018960 con 0x7f9c441048a0 2024-09-21T06:03:20.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.790+0000 7f9c49600640 1 -- 172.21.15.37:0/3697659682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c441a6f70 con 0x7f9c441048a0 2024-09-21T06:03:20.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.791+0000 7f9c49600640 1 -- 172.21.15.37:0/3697659682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c4406c1a0 con 0x7f9c441048a0 2024-09-21T06:03:20.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.793+0000 7f9c3b400640 1 -- 172.21.15.37:0/3697659682 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9c3401f020 con 0x7f9c441048a0 2024-09-21T06:03:20.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.794+0000 7f9c3b400640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9c280b6590 0x7f9c280b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:20.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.795+0000 7f9c3b400640 1 -- 172.21.15.37:0/3697659682 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f9c340e78d0 con 0x7f9c441048a0 2024-09-21T06:03:20.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.795+0000 7f9c42000640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9c280b6590 0x7f9c280b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:20.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.795+0000 7f9c42000640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9c280b6590 0x7f9c280b8aa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9c30031440 tx=0x7f9c30005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:20.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:19.799+0000 7f9c3b400640 1 -- 172.21.15.37:0/3697659682 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9c34056710 con 0x7f9c441048a0 2024-09-21T06:03:20.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.124+0000 7f9c49600640 1 -- 172.21.15.37:0/3697659682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c44104cb0 con 0x7f9c441048a0 2024-09-21T06:03:20.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.125+0000 7f9c3b400640 1 -- 172.21.15.37:0/3697659682 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f9c340add30 con 0x7f9c441048a0 2024-09-21T06:03:20.128 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:03:20.128 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T06:03:20.128 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T06:03:20.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.128+0000 7f9c49600640 1 -- 172.21.15.37:0/3697659682 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9c280b6590 msgr2=0x7f9c280b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:20.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.128+0000 7f9c49600640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9c280b6590 0x7f9c280b8aa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9c30031440 tx=0x7f9c30005a20 comp rx=0 tx=0).stop 2024-09-21T06:03:20.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.128+0000 7f9c49600640 1 -- 172.21.15.37:0/3697659682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c441048a0 msgr2=0x7f9c4419a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.128+0000 7f9c49600640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c441048a0 0x7f9c4419a5b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400e9c0 tx=0x7f9c3400ee80 comp rx=0 tx=0).stop 2024-09-21T06:03:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.128+0000 7f9c49600640 1 -- 172.21.15.37:0/3697659682 shutdown_connections 2024-09-21T06:03:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.128+0000 7f9c49600640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c4410de50 0x7f9c4419fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.128+0000 7f9c49600640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9c280b6590 0x7f9c280b8aa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.128+0000 7f9c49600640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c441052d0 0x7f9c4419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.128+0000 7f9c49600640 1 --2- 172.21.15.37:0/3697659682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c441048a0 0x7f9c4419a5b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.128+0000 7f9c49600640 1 -- 172.21.15.37:0/3697659682 >> 172.21.15.37:0/3697659682 conn(0x7f9c44079740 msgr2=0x7f9c441069c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.128+0000 7f9c49600640 1 -- 172.21.15.37:0/3697659682 shutdown_connections 2024-09-21T06:03:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:20.128+0000 7f9c49600640 1 -- 172.21.15.37:0/3697659682 wait complete. 2024-09-21T06:03:20.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:20 smithi144 ceph-mon[34351]: pgmap v696: 129 pgs: 129 active+clean; 150 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 984 KiB/s wr, 363 op/s 2024-09-21T06:03:20.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:20 smithi037 ceph-mon[30631]: pgmap v696: 129 pgs: 129 active+clean; 150 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 984 KiB/s wr, 363 op/s 2024-09-21T06:03:20.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:20 smithi067 ceph-mon[34443]: pgmap v696: 129 pgs: 129 active+clean; 150 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 984 KiB/s wr, 363 op/s 2024-09-21T06:03:20.953 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-21T06:03:20.954 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-21T06:03:21.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:21 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3697659682' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:21.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:21 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3697659682' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:21.486 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:21.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:21 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3697659682' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:22.272 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:22 smithi037 ceph-mon[30631]: pgmap v697: 129 pgs: 129 active+clean; 155 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 1001 KiB/s wr, 360 op/s 2024-09-21T06:03:22.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:22 smithi144 ceph-mon[34351]: pgmap v697: 129 pgs: 129 active+clean; 155 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 1001 KiB/s wr, 360 op/s 2024-09-21T06:03:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.388+0000 7f16bfc00640 1 -- 172.21.15.37:0/862852021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b80760a0 msgr2=0x7f16b810fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.388+0000 7f16bfc00640 1 --2- 172.21.15.37:0/862852021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b80760a0 0x7f16b810fbf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009860 tx=0x7f16a402a340 comp rx=0 tx=0).stop 2024-09-21T06:03:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.388+0000 7f16bfc00640 1 -- 172.21.15.37:0/862852021 shutdown_connections 2024-09-21T06:03:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.388+0000 7f16bfc00640 1 --2- 172.21.15.37:0/862852021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16b8110130 0x7f16b8112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.388+0000 7f16bfc00640 1 --2- 172.21.15.37:0/862852021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b80760a0 0x7f16b810fbf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.388+0000 7f16bfc00640 1 --2- 172.21.15.37:0/862852021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b8075750 0x7f16b8075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.388+0000 7f16bfc00640 1 -- 172.21.15.37:0/862852021 >> 172.21.15.37:0/862852021 conn(0x7f16b80ff5a0 msgr2=0x7f16b81019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.388+0000 7f16bfc00640 1 -- 172.21.15.37:0/862852021 shutdown_connections 2024-09-21T06:03:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.388+0000 7f16bfc00640 1 -- 172.21.15.37:0/862852021 wait complete. 2024-09-21T06:03:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.389+0000 7f16bfc00640 1 Processor -- start 2024-09-21T06:03:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.389+0000 7f16bfc00640 1 -- start start 2024-09-21T06:03:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.389+0000 7f16bfc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16b8075750 0x7f16b819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.389+0000 7f16bfc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b80760a0 0x7f16b819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.389+0000 7f16bfc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b8110130 0x7f16b81a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16bfc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f16b8115ca0 con 0x7f16b8075750 2024-09-21T06:03:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16bfc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f16b8115b20 con 0x7f16b80760a0 2024-09-21T06:03:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16bfc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f16b8115e20 con 0x7f16b8110130 2024-09-21T06:03:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16bd200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16b8075750 0x7f16b819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16b7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b80760a0 0x7f16b819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16bd200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16b8075750 0x7f16b819c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53884/0 (socket says 172.21.15.37:53884) 2024-09-21T06:03:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16bd200640 1 -- 172.21.15.37:0/3818843028 learned_addr learned my addr 172.21.15.37:0/3818843028 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16bdc00640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b8110130 0x7f16b81a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16b7e00640 1 -- 172.21.15.37:0/3818843028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b8110130 msgr2=0x7f16b81a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16b7e00640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b8110130 0x7f16b81a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16b7e00640 1 -- 172.21.15.37:0/3818843028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16b8075750 msgr2=0x7f16b819c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16b7e00640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16b8075750 0x7f16b819c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16b7e00640 1 -- 172.21.15.37:0/3818843028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b81a2660 con 0x7f16b80760a0 2024-09-21T06:03:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.390+0000 7f16bd200640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16b8075750 0x7f16b819c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.391+0000 7f16b7e00640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b80760a0 0x7f16b819cc90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f16a402a860 tx=0x7f16a4032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.391+0000 7f16b5600640 1 -- 172.21.15.37:0/3818843028 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a4040020 con 0x7f16b80760a0 2024-09-21T06:03:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.391+0000 7f16b5600640 1 -- 172.21.15.37:0/3818843028 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16a4030e10 con 0x7f16b80760a0 2024-09-21T06:03:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.391+0000 7f16b5600640 1 -- 172.21.15.37:0/3818843028 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a4037040 con 0x7f16b80760a0 2024-09-21T06:03:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.391+0000 7f16bfc00640 1 -- 172.21.15.37:0/3818843028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b81a28f0 con 0x7f16b80760a0 2024-09-21T06:03:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.391+0000 7f16bfc00640 1 -- 172.21.15.37:0/3818843028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b81a90b0 con 0x7f16b80760a0 2024-09-21T06:03:22.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.395+0000 7f16c67bf740 1 Processor -- start 2024-09-21T06:03:22.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.396+0000 7f16c67bf740 1 -- start start 2024-09-21T06:03:22.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.396+0000 7f16c67bf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742fe840 0x5629746a6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.396+0000 7f16c67bf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742d5980 0x5629746a6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.396+0000 7f16c67bf740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.396+0000 7f16c67bf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56297461bca0 con 0x5629742d5980 2024-09-21T06:03:22.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.396+0000 7f16c67bf740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56297460b0d0 con 0x5629742ddb60 2024-09-21T06:03:22.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.396+0000 7f16c67bf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56297460eee0 con 0x5629742fe840 2024-09-21T06:03:22.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.397+0000 7f16bdc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742fe840 0x5629746a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.397+0000 7f16bdc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742fe840 0x5629746a6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:39100/0 (socket says 172.21.15.37:39100) 2024-09-21T06:03:22.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.397+0000 7f16bdc00640 1 -- 172.21.15.37:0/621036689 learned_addr learned my addr 172.21.15.37:0/621036689 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:22.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.397+0000 7f16bd200640 1 --2- 172.21.15.37:0/621036689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742d5980 0x5629746a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.397+0000 7f16b5600640 1 -- 172.21.15.37:0/3818843028 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f16a4043020 con 0x7f16b80760a0 2024-09-21T06:03:22.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.397+0000 7f16bdc00640 1 -- 172.21.15.37:0/621036689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 msgr2=0x5629746a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.397+0000 7f16bdc00640 1 --2- 172.21.15.37:0/621036689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.397+0000 7f16bdc00640 1 -- 172.21.15.37:0/621036689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742d5980 msgr2=0x5629746a6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.397+0000 7f16bdc00640 1 --2- 172.21.15.37:0/621036689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742d5980 0x5629746a6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.397+0000 7f16bdc00640 1 -- 172.21.15.37:0/621036689 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629745bd400 con 0x5629742fe840 2024-09-21T06:03:22.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.397+0000 7f16bd200640 1 --2- 172.21.15.37:0/621036689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742d5980 0x5629746a6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:22.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.398+0000 7f16bdc00640 1 --2- 172.21.15.37:0/621036689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742fe840 0x5629746a6350 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f16b000e450 tx=0x7f16b00095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc5ba995da4a9c5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:22.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.398+0000 7f16aa000640 1 -- 172.21.15.37:0/621036689 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b000d910 con 0x5629742fe840 2024-09-21T06:03:22.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.398+0000 7f16aa000640 1 -- 172.21.15.37:0/621036689 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16b001c070 con 0x5629742fe840 2024-09-21T06:03:22.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.398+0000 7f16aa000640 1 -- 172.21.15.37:0/621036689 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b0017e30 con 0x5629742fe840 2024-09-21T06:03:22.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.399+0000 7f16b5600640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f16a00b6610 0x7f16a00b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.399+0000 7f16b5600640 1 -- 172.21.15.37:0/3818843028 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f16a4107110 con 0x7f16b80760a0 2024-09-21T06:03:22.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.399+0000 7f16c67bf740 1 -- 172.21.15.37:0/621036689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742fe840 msgr2=0x5629746a6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.399+0000 7f16c67bf740 1 --2- 172.21.15.37:0/621036689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742fe840 0x5629746a6350 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f16b000e450 tx=0x7f16b00095c0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.399+0000 7f16bd200640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f16a00b6610 0x7f16a00b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.399+0000 7f16c67bf740 1 -- 172.21.15.37:0/621036689 shutdown_connections 2024-09-21T06:03:22.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.399+0000 7f16c67bf740 1 --2- 172.21.15.37:0/621036689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.399+0000 7f16c67bf740 1 --2- 172.21.15.37:0/621036689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742d5980 0x5629746a6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.399+0000 7f16c67bf740 1 --2- 172.21.15.37:0/621036689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742fe840 0x5629746a6350 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.399+0000 7f16c67bf740 1 -- 172.21.15.37:0/621036689 >> 172.21.15.37:0/621036689 conn(0x5629742f2990 msgr2=0x5629746a4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:22.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.400+0000 7f16c67bf740 1 -- 172.21.15.37:0/621036689 shutdown_connections 2024-09-21T06:03:22.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.400+0000 7f16c67bf740 1 -- 172.21.15.37:0/621036689 wait complete. 2024-09-21T06:03:22.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.400+0000 7f16bd200640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f16a00b6610 0x7f16a00b8b20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f16ac009fd0 tx=0x7f16ac005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:22.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.401+0000 7f16c67bf740 1 -- start start 2024-09-21T06:03:22.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.401+0000 7f16c67bf740 1 Processor -- start 2024-09-21T06:03:22.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.402+0000 7f16c67bf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742d5980 0x5629746b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.402+0000 7f16c67bf740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.402+0000 7f16c67bf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742fe840 0x5629746bde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.402+0000 7f16c67bf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56297446c7a0 con 0x5629742fe840 2024-09-21T06:03:22.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.402+0000 7f16c67bf740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5629745b0a10 con 0x5629742ddb60 2024-09-21T06:03:22.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.402+0000 7f16c67bf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5629746b4b30 con 0x5629742d5980 2024-09-21T06:03:22.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.402+0000 7f16c67bf740 10 client.0 _ll_register_callbacks cb 0x5629745c0be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.402+0000 7f16bd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742d5980 0x5629746b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.402+0000 7f16b7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.402+0000 7f16b7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:40402/0 (socket says 172.21.15.37:40402) 2024-09-21T06:03:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.402+0000 7f16b7e00640 1 -- 172.21.15.37:0/4098058382 learned_addr learned my addr 172.21.15.37:0/4098058382 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.402+0000 7f16bd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742d5980 0x5629746b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:39110/0 (socket says 172.21.15.37:39110) 2024-09-21T06:03:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.402+0000 7f16bdc00640 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742fe840 0x5629746bde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.403+0000 7f16b7e00640 1 -- 172.21.15.37:0/4098058382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742d5980 msgr2=0x5629746b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.403+0000 7f16b7e00640 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742d5980 0x5629746b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.403+0000 7f16b7e00640 1 -- 172.21.15.37:0/4098058382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742fe840 msgr2=0x5629746bde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.403+0000 7f16b7e00640 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742fe840 0x5629746bde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.403+0000 7f16b7e00640 1 -- 172.21.15.37:0/4098058382 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562974378b90 con 0x5629742ddb60 2024-09-21T06:03:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.403+0000 7f16bd200640 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742d5980 0x5629746b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:22.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.403+0000 7f16bdc00640 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742fe840 0x5629746bde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:22.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.403+0000 7f16b7e00640 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746b1f50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f16a40ca0e0 tx=0x7f16a40c8d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8201eb82906222 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:22.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.403+0000 7f169ea00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T06:03:22.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.403+0000 7f169ea00640 1 -- 172.21.15.37:0/4098058382 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a40cc5e0 con 0x5629742ddb60 2024-09-21T06:03:22.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.403+0000 7f169ea00640 1 -- 172.21.15.37:0/4098058382 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f16a40f4170 con 0x5629742ddb60 2024-09-21T06:03:22.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.403+0000 7f16c67bf740 1 -- 172.21.15.37:0/4098058382 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16b001c070 con 0x5629742ddb60 2024-09-21T06:03:22.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.404+0000 7f169ea00640 1 -- 172.21.15.37:0/4098058382 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f16a40e7020 con 0x5629742ddb60 2024-09-21T06:03:22.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.404+0000 7f16c67bf740 10 client.25745 fetch_fsmap learned FSMap version 21 2024-09-21T06:03:22.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.404+0000 7f16c67bf740 1 -- 172.21.15.37:0/4098058382 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5629746c0840 con 0x5629742ddb60 2024-09-21T06:03:22.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.404+0000 7f169ea00640 1 -- 172.21.15.37:0/4098058382 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16b001c070 con 0x5629742ddb60 2024-09-21T06:03:22.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.404+0000 7f169ea00640 1 -- 172.21.15.37:0/4098058382 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f16a40cbb40 con 0x5629742ddb60 2024-09-21T06:03:22.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.404+0000 7f16c67bf740 10 client.25745 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:03:22.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.404+0000 7f16c67bf740 10 client.25745 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:03:22.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.404+0000 7f16c67bf740 20 client.25745 populate_metadata read hostname 'smithi037' 2024-09-21T06:03:22.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.404+0000 7f16c67bf740 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5629742bd1c0 0x5629746c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.404+0000 7f16c67bf740 4 client.25745 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:22.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.404+0000 7f16c67bf740 1 -- 172.21.15.37:0/4098058382 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56297461dbf0 con 0x5629742bd1c0 2024-09-21T06:03:22.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.405+0000 7f16bd200640 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5629742bd1c0 0x5629746c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.405+0000 7f16bd200640 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5629742bd1c0 0x5629746c3c90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbfa360a1ffe70ab server_cookie=8b18bd9e5e31458a in_seq=0 out_seq=0 2024-09-21T06:03:22.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.405+0000 7f169ea00640 10 client.25745 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:03:22.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.406+0000 7f169ea00640 1 -- 172.21.15.37:0/4098058382 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56297461dbf0 con 0x5629742bd1c0 2024-09-21T06:03:22.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.406+0000 7f169ea00640 10 client.25745 handle_command_reply: tid=0 2024-09-21T06:03:22.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.406+0000 7f16c67bf740 1 client.25745 shutdown 2024-09-21T06:03:22.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.406+0000 7f16c67bf740 1 -- 172.21.15.37:0/4098058382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 msgr2=0x5629746b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.406+0000 7f16c67bf740 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746b1f50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f16a40ca0e0 tx=0x7f16a40c8d10 comp rx=0 tx=0).stop 2024-09-21T06:03:22.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.407+0000 7f16c67bf740 1 -- 172.21.15.37:0/4098058382 shutdown_connections 2024-09-21T06:03:22.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.407+0000 7f16c67bf740 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x5629742bd1c0 0x5629746c3c90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.407+0000 7f16c67bf740 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742fe840 0x5629746bde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.407+0000 7f16c67bf740 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746b1f50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.407+0000 7f169ea00640 0 client.25745 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:03:22.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.407+0000 7f16c67bf740 1 --2- 172.21.15.37:0/4098058382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742d5980 0x5629746b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.407+0000 7f16c67bf740 1 -- 172.21.15.37:0/4098058382 >> 172.21.15.37:0/4098058382 conn(0x5629742f2990 msgr2=0x5629746a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:22.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.407+0000 7f16c67bf740 1 -- 172.21.15.37:0/4098058382 shutdown_connections 2024-09-21T06:03:22.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.407+0000 7f16c67bf740 1 -- 172.21.15.37:0/4098058382 wait complete. 2024-09-21T06:03:22.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.407+0000 7f16c67bf740 20 client.25745 trim_cache size 0 max 16384 2024-09-21T06:03:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.428+0000 7f16c67bf740 1 Processor -- start 2024-09-21T06:03:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.428+0000 7f16c67bf740 1 -- start start 2024-09-21T06:03:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16c67bf740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742d5980 0x5629746bdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16c67bf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742ddb60 0x5629746a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16c67bf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742fe840 0x5629746a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16c67bf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f16b81b0dc0 con 0x5629742fe840 2024-09-21T06:03:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16c67bf740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f16b81b3640 con 0x5629742d5980 2024-09-21T06:03:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16c67bf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f16b81b1430 con 0x5629742ddb60 2024-09-21T06:03:22.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16b7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742ddb60 0x5629746a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16bd200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742d5980 0x5629746bdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16b7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742ddb60 0x5629746a39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:39122/0 (socket says 172.21.15.37:39122) 2024-09-21T06:03:22.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16bd200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742d5980 0x5629746bdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:40406/0 (socket says 172.21.15.37:40406) 2024-09-21T06:03:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16b7e00640 1 -- 172.21.15.37:0/2228879055 learned_addr learned my addr 172.21.15.37:0/2228879055 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16bdc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742fe840 0x5629746a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16bd200640 1 -- 172.21.15.37:0/2228879055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742ddb60 msgr2=0x5629746a39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.429+0000 7f16bd200640 1 --2- 172.21.15.37:0/2228879055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742ddb60 0x5629746a39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.430+0000 7f16bd200640 1 -- 172.21.15.37:0/2228879055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742fe840 msgr2=0x5629746a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.430+0000 7f16bd200640 1 --2- 172.21.15.37:0/2228879055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742fe840 0x5629746a3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.430+0000 7f16bd200640 1 -- 172.21.15.37:0/2228879055 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629746a4430 con 0x5629742d5980 2024-09-21T06:03:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.430+0000 7f16bd200640 1 --2- 172.21.15.37:0/2228879055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742d5980 0x5629746bdde0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x5629746c4360 tx=0x7f16ac01a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b45b69ffe9ad6a31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.430+0000 7f16a9600640 1 -- 172.21.15.37:0/2228879055 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00fdf0 con 0x5629742d5980 2024-09-21T06:03:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.430+0000 7f16a9600640 1 -- 172.21.15.37:0/2228879055 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16ac011d40 con 0x5629742d5980 2024-09-21T06:03:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.430+0000 7f16a9600640 1 -- 172.21.15.37:0/2228879055 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac004a00 con 0x5629742d5980 2024-09-21T06:03:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.431+0000 7f16c67bf740 1 -- 172.21.15.37:0/2228879055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742d5980 msgr2=0x5629746bdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.431+0000 7f16c67bf740 1 --2- 172.21.15.37:0/2228879055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742d5980 0x5629746bdde0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x5629746c4360 tx=0x7f16ac01a000 comp rx=0 tx=0).stop 2024-09-21T06:03:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.431+0000 7f16c67bf740 1 -- 172.21.15.37:0/2228879055 shutdown_connections 2024-09-21T06:03:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.431+0000 7f16c67bf740 1 --2- 172.21.15.37:0/2228879055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742fe840 0x5629746a3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.431+0000 7f16c67bf740 1 --2- 172.21.15.37:0/2228879055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742ddb60 0x5629746a39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.431+0000 7f16c67bf740 1 --2- 172.21.15.37:0/2228879055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742d5980 0x5629746bdde0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.431+0000 7f16c67bf740 1 -- 172.21.15.37:0/2228879055 >> 172.21.15.37:0/2228879055 conn(0x5629742f2990 msgr2=0x5629746bd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.431+0000 7f16c67bf740 1 -- 172.21.15.37:0/2228879055 shutdown_connections 2024-09-21T06:03:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.431+0000 7f16c67bf740 1 -- 172.21.15.37:0/2228879055 wait complete. 2024-09-21T06:03:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.432+0000 7f16c67bf740 1 -- start start 2024-09-21T06:03:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.432+0000 7f16c67bf740 1 Processor -- start 2024-09-21T06:03:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16c67bf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742d5980 0x5629746b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16c67bf740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16c67bf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742fe840 0x5629747265c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16c67bf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f16b81b1b00 con 0x5629742d5980 2024-09-21T06:03:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16c67bf740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f16b81b2f70 con 0x5629742ddb60 2024-09-21T06:03:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16c67bf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f16b81b21d0 con 0x5629742fe840 2024-09-21T06:03:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16c67bf740 10 client.0 _ll_register_callbacks cb 0x7f16a40097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16bd200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742d5980 0x5629746b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16b7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16bd200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742d5980 0x5629746b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53914/0 (socket says 172.21.15.37:53914) 2024-09-21T06:03:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16bd200640 1 -- 172.21.15.37:0/2620402980 learned_addr learned my addr 172.21.15.37:0/2620402980 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16bdc00640 1 --2- 172.21.15.37:0/2620402980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742fe840 0x5629747265c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16b7e00640 1 -- 172.21.15.37:0/2620402980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742fe840 msgr2=0x5629747265c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16b7e00640 1 --2- 172.21.15.37:0/2620402980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742fe840 0x5629747265c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16b7e00640 1 -- 172.21.15.37:0/2620402980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742d5980 msgr2=0x5629746b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16b7e00640 1 --2- 172.21.15.37:0/2620402980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742d5980 0x5629746b87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.433+0000 7f16b7e00640 1 -- 172.21.15.37:0/2620402980 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562974726c30 con 0x5629742ddb60 2024-09-21T06:03:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.434+0000 7f16b7e00640 1 --2- 172.21.15.37:0/2620402980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746b8dd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f16a4035040 tx=0x7f16a4004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c28fc5ab4fb8fc7d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.434+0000 7f169ea00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T06:03:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.434+0000 7f169ea00640 1 -- 172.21.15.37:0/2620402980 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a40cc5e0 con 0x5629742ddb60 2024-09-21T06:03:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.434+0000 7f169ea00640 1 -- 172.21.15.37:0/2620402980 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f16a40f4370 con 0x5629742ddb60 2024-09-21T06:03:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.434+0000 7f16c67bf740 1 -- 172.21.15.37:0/2620402980 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16ac011d40 con 0x5629742ddb60 2024-09-21T06:03:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.434+0000 7f169ea00640 1 -- 172.21.15.37:0/2620402980 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f16a40cc980 con 0x5629742ddb60 2024-09-21T06:03:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.434+0000 7f16c67bf740 10 client.25751 fetch_fsmap learned FSMap version 21 2024-09-21T06:03:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.434+0000 7f16c67bf740 1 -- 172.21.15.37:0/2620402980 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562974726c30 con 0x5629742ddb60 2024-09-21T06:03:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.435+0000 7f169ea00640 1 -- 172.21.15.37:0/2620402980 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16ac011d40 con 0x5629742ddb60 2024-09-21T06:03:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.435+0000 7f169ea00640 1 -- 172.21.15.37:0/2620402980 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f16a40c89c0 con 0x5629742ddb60 2024-09-21T06:03:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.435+0000 7f16c67bf740 10 client.25751 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:03:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.435+0000 7f16c67bf740 10 client.25751 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:03:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.435+0000 7f16c67bf740 20 client.25751 populate_metadata read hostname 'smithi037' 2024-09-21T06:03:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.435+0000 7f16c67bf740 1 --2- 172.21.15.37:0/2620402980 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562974292570 0x562974731550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.435+0000 7f16c67bf740 4 client.25751 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-21T06:03:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.435+0000 7f16c67bf740 1 -- 172.21.15.37:0/2620402980 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x5629746196a0 con 0x562974292570 2024-09-21T06:03:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.435+0000 7f16bd200640 1 --2- 172.21.15.37:0/2620402980 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562974292570 0x562974731550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.436+0000 7f16bd200640 1 --2- 172.21.15.37:0/2620402980 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562974292570 0x562974731550 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=517178d11ba1398d server_cookie=3f49bdbe876a5a6e in_seq=0 out_seq=0 2024-09-21T06:03:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:22.436+0000 7f169ea00640 10 client.25751 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:03:22.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:22 smithi067 ceph-mon[34443]: pgmap v697: 129 pgs: 129 active+clean; 155 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 1001 KiB/s wr, 360 op/s 2024-09-21T06:03:23.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.387+0000 7f169ea00640 1 -- 172.21.15.37:0/2620402980 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5629746196a0 con 0x562974292570 2024-09-21T06:03:23.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.387+0000 7f169ea00640 10 client.25751 handle_command_reply: tid=0 2024-09-21T06:03:23.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.387+0000 7f16c67bf740 1 client.25751 shutdown 2024-09-21T06:03:23.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.388+0000 7f16c67bf740 1 -- 172.21.15.37:0/2620402980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 msgr2=0x5629746b8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.388+0000 7f16c67bf740 1 --2- 172.21.15.37:0/2620402980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746b8dd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f16a4035040 tx=0x7f16a4004610 comp rx=0 tx=0).stop 2024-09-21T06:03:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.388+0000 7f16c67bf740 1 -- 172.21.15.37:0/2620402980 shutdown_connections 2024-09-21T06:03:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.388+0000 7f16c67bf740 1 --2- 172.21.15.37:0/2620402980 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562974292570 0x562974731550 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.388+0000 7f16c67bf740 1 --2- 172.21.15.37:0/2620402980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629742fe840 0x5629747265c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.388+0000 7f16c67bf740 1 --2- 172.21.15.37:0/2620402980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5629742ddb60 0x5629746b8dd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.388+0000 7f16c67bf740 1 --2- 172.21.15.37:0/2620402980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629742d5980 0x5629746b87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.388+0000 7f169ea00640 0 client.25751 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:03:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.388+0000 7f16c67bf740 1 -- 172.21.15.37:0/2620402980 >> 172.21.15.37:0/2620402980 conn(0x5629742f2990 msgr2=0x5629746a3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.388+0000 7f16c67bf740 1 -- 172.21.15.37:0/2620402980 shutdown_connections 2024-09-21T06:03:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.388+0000 7f16c67bf740 1 -- 172.21.15.37:0/2620402980 wait complete. 2024-09-21T06:03:23.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.388+0000 7f16c67bf740 20 client.25751 trim_cache size 0 max 16384 2024-09-21T06:03:23.392 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:03:23.392 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T06:03:23.392 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T06:03:23.392 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 38, 2024-09-21T06:03:23.392 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T06:03:23.392 INFO:teuthology.orchestra.run.smithi037.stdout: "4f1ba5d4": { 2024-09-21T06:03:23.392 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 38, 2024-09-21T06:03:23.392 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 144.5, 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:23.393 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:23.394 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:23.394 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:23.394 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:23.394 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:03:23.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.389+0000 7f16bfc00640 1 -- 172.21.15.37:0/3818843028 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f16a00b6610 msgr2=0x7f16a00b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:23.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.389+0000 7f16bfc00640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f16a00b6610 0x7f16a00b8b20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f16ac009fd0 tx=0x7f16ac005f90 comp rx=0 tx=0).stop 2024-09-21T06:03:23.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.389+0000 7f16bfc00640 1 -- 172.21.15.37:0/3818843028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b80760a0 msgr2=0x7f16b819cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:23.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.389+0000 7f16bfc00640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b80760a0 0x7f16b819cc90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f16a402a860 tx=0x7f16a4032d50 comp rx=0 tx=0).stop 2024-09-21T06:03:23.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.389+0000 7f16bfc00640 1 -- 172.21.15.37:0/3818843028 shutdown_connections 2024-09-21T06:03:23.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.389+0000 7f16bfc00640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b8110130 0x7f16b81a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.389+0000 7f16bfc00640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f16a00b6610 0x7f16a00b8b20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.389+0000 7f16bfc00640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f16b80760a0 0x7f16b819cc90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.389+0000 7f16bfc00640 1 --2- 172.21.15.37:0/3818843028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16b8075750 0x7f16b819c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:23.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.389+0000 7f16bfc00640 1 -- 172.21.15.37:0/3818843028 >> 172.21.15.37:0/3818843028 conn(0x7f16b80ff5a0 msgr2=0x7f16b8108be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:23.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.390+0000 7f16bfc00640 1 -- 172.21.15.37:0/3818843028 shutdown_connections 2024-09-21T06:03:23.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:23.390+0000 7f16bfc00640 1 -- 172.21.15.37:0/3818843028 wait complete. 2024-09-21T06:03:24.169 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4f1ba5d4', quiesce took 5.8 seconds. Will release after: 18.7 2024-09-21T06:03:24.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:24 smithi144 ceph-mon[34351]: pgmap v698: 129 pgs: 129 active+clean; 148 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 1.1 MiB/s wr, 392 op/s 2024-09-21T06:03:24.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:24 smithi037 ceph-mon[30631]: pgmap v698: 129 pgs: 129 active+clean; 148 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 1.1 MiB/s wr, 392 op/s 2024-09-21T06:03:24.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:24 smithi067 ceph-mon[34443]: pgmap v698: 129 pgs: 129 active+clean; 148 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 1.1 MiB/s wr, 392 op/s 2024-09-21T06:03:26.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:26 smithi144 ceph-mon[34351]: pgmap v699: 129 pgs: 129 active+clean; 153 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 914 KiB/s wr, 327 op/s 2024-09-21T06:03:26.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:26 smithi037 ceph-mon[30631]: pgmap v699: 129 pgs: 129 active+clean; 153 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 914 KiB/s wr, 327 op/s 2024-09-21T06:03:26.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:26 smithi067 ceph-mon[34443]: pgmap v699: 129 pgs: 129 active+clean; 153 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 914 KiB/s wr, 327 op/s 2024-09-21T06:03:28.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:28 smithi144 ceph-mon[34351]: pgmap v700: 129 pgs: 129 active+clean; 173 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 944 KiB/s wr, 344 op/s 2024-09-21T06:03:28.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:28 smithi037 ceph-mon[30631]: pgmap v700: 129 pgs: 129 active+clean; 173 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 944 KiB/s wr, 344 op/s 2024-09-21T06:03:28.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:28 smithi067 ceph-mon[34443]: pgmap v700: 129 pgs: 129 active+clean; 173 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 944 KiB/s wr, 344 op/s 2024-09-21T06:03:30.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:30 smithi144 ceph-mon[34351]: pgmap v701: 129 pgs: 129 active+clean; 179 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 695 KiB/s wr, 240 op/s 2024-09-21T06:03:30.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:30 smithi037 ceph-mon[30631]: pgmap v701: 129 pgs: 129 active+clean; 179 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 695 KiB/s wr, 240 op/s 2024-09-21T06:03:30.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:30 smithi067 ceph-mon[34443]: pgmap v701: 129 pgs: 129 active+clean; 179 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 695 KiB/s wr, 240 op/s 2024-09-21T06:03:32.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:32 smithi144 ceph-mon[34351]: pgmap v702: 129 pgs: 129 active+clean; 179 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 542 KiB/s wr, 188 op/s 2024-09-21T06:03:32.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:32 smithi037 ceph-mon[30631]: pgmap v702: 129 pgs: 129 active+clean; 179 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 542 KiB/s wr, 188 op/s 2024-09-21T06:03:32.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:32 smithi067 ceph-mon[34443]: pgmap v702: 129 pgs: 129 active+clean; 179 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 542 KiB/s wr, 188 op/s 2024-09-21T06:03:34.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:34 smithi144 ceph-mon[34351]: pgmap v703: 129 pgs: 129 active+clean; 180 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 394 KiB/s wr, 138 op/s 2024-09-21T06:03:34.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:34 smithi037 ceph-mon[30631]: pgmap v703: 129 pgs: 129 active+clean; 180 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 394 KiB/s wr, 138 op/s 2024-09-21T06:03:34.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:34 smithi067 ceph-mon[34443]: pgmap v703: 129 pgs: 129 active+clean; 180 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 394 KiB/s wr, 138 op/s 2024-09-21T06:03:36.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:36 smithi144 ceph-mon[34351]: pgmap v704: 129 pgs: 129 active+clean; 185 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 203 KiB/s wr, 56 op/s 2024-09-21T06:03:36.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:36 smithi037 ceph-mon[30631]: pgmap v704: 129 pgs: 129 active+clean; 185 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 203 KiB/s wr, 56 op/s 2024-09-21T06:03:36.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:36 smithi067 ceph-mon[34443]: pgmap v704: 129 pgs: 129 active+clean; 185 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 203 KiB/s wr, 56 op/s 2024-09-21T06:03:38.373 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:38 smithi144 ceph-mon[34351]: pgmap v705: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 176 KiB/s wr, 41 op/s 2024-09-21T06:03:38.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:38 smithi037 ceph-mon[30631]: pgmap v705: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 176 KiB/s wr, 41 op/s 2024-09-21T06:03:38.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:38 smithi067 ceph-mon[34443]: pgmap v705: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 176 KiB/s wr, 41 op/s 2024-09-21T06:03:40.372 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:40 smithi144 ceph-mon[34351]: pgmap v706: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 79 KiB/s wr, 5 op/s 2024-09-21T06:03:40.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:40 smithi037 ceph-mon[30631]: pgmap v706: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 79 KiB/s wr, 5 op/s 2024-09-21T06:03:40.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:40 smithi067 ceph-mon[34443]: pgmap v706: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 79 KiB/s wr, 5 op/s 2024-09-21T06:03:42.374 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:42 smithi144 ceph-mon[34351]: pgmap v707: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 58 KiB/s wr, 3 op/s 2024-09-21T06:03:42.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:42 smithi037 ceph-mon[30631]: pgmap v707: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 58 KiB/s wr, 3 op/s 2024-09-21T06:03:42.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:42 smithi067 ceph-mon[34443]: pgmap v707: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 58 KiB/s wr, 3 op/s 2024-09-21T06:03:42.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:03:43.263 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:43.402 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:43 smithi037 ceph-mon[30631]: pgmap v708: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 58 KiB/s wr, 4 op/s 2024-09-21T06:03:43.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:43 smithi067 ceph-mon[34443]: pgmap v708: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 58 KiB/s wr, 4 op/s 2024-09-21T06:03:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:43 smithi144 ceph-mon[34351]: pgmap v708: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 58 KiB/s wr, 4 op/s 2024-09-21T06:03:43.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.881+0000 7f5162000640 1 -- 172.21.15.37:0/2824400187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515c114740 msgr2=0x7f515c116b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:43.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.881+0000 7f5162000640 1 --2- 172.21.15.37:0/2824400187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515c114740 0x7f515c116b60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5154009ca0 tx=0x7f515402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:03:43.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.881+0000 7f5162000640 1 -- 172.21.15.37:0/2824400187 shutdown_connections 2024-09-21T06:03:43.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.881+0000 7f5162000640 1 --2- 172.21.15.37:0/2824400187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515c114740 0x7f515c116b60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:43.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.881+0000 7f5162000640 1 --2- 172.21.15.37:0/2824400187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515c078290 0x7f515c114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:43.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.881+0000 7f5162000640 1 --2- 172.21.15.37:0/2824400187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515c077940 0x7f515c077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:43.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.881+0000 7f5162000640 1 -- 172.21.15.37:0/2824400187 >> 172.21.15.37:0/2824400187 conn(0x7f515c1017d0 msgr2=0x7f515c103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:43.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.881+0000 7f5162000640 1 -- 172.21.15.37:0/2824400187 shutdown_connections 2024-09-21T06:03:43.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.881+0000 7f5162000640 1 -- 172.21.15.37:0/2824400187 wait complete. 2024-09-21T06:03:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.882+0000 7f5162000640 1 Processor -- start 2024-09-21T06:03:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.882+0000 7f5162000640 1 -- start start 2024-09-21T06:03:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.883+0000 7f5162000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515c077940 0x7f515c1a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.883+0000 7f5162000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515c078290 0x7f515c1a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.883+0000 7f5162000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515c114740 0x7f515c1a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.883+0000 7f5162000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f515c11a0b0 con 0x7f515c114740 2024-09-21T06:03:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.883+0000 7f5162000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f515c119f30 con 0x7f515c077940 2024-09-21T06:03:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.883+0000 7f5162000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f515c11a230 con 0x7f515c078290 2024-09-21T06:03:43.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.883+0000 7f515be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515c114740 0x7f515c1a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.883+0000 7f515b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515c077940 0x7f515c1a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.883+0000 7f5153e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515c078290 0x7f515c1a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.883+0000 7f515b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515c077940 0x7f515c1a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:39984/0 (socket says 172.21.15.37:39984) 2024-09-21T06:03:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.883+0000 7f515b400640 1 -- 172.21.15.37:0/3853952446 learned_addr learned my addr 172.21.15.37:0/3853952446 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.884+0000 7f515b400640 1 -- 172.21.15.37:0/3853952446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515c078290 msgr2=0x7f515c1a0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.884+0000 7f515b400640 1 --2- 172.21.15.37:0/3853952446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515c078290 0x7f515c1a0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.884+0000 7f515b400640 1 -- 172.21.15.37:0/3853952446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515c114740 msgr2=0x7f515c1a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.884+0000 7f515b400640 1 --2- 172.21.15.37:0/3853952446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515c114740 0x7f515c1a6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.884+0000 7f515b400640 1 -- 172.21.15.37:0/3853952446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515c1a69b0 con 0x7f515c077940 2024-09-21T06:03:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.884+0000 7f5153e00640 1 --2- 172.21.15.37:0/3853952446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515c078290 0x7f515c1a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.884+0000 7f515b400640 1 --2- 172.21.15.37:0/3853952446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515c077940 0x7f515c1a0a40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f514c00e9f0 tx=0x7f514c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:43.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.884+0000 7f5158c00640 1 -- 172.21.15.37:0/3853952446 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c00cd80 con 0x7f515c077940 2024-09-21T06:03:43.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.884+0000 7f5158c00640 1 -- 172.21.15.37:0/3853952446 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f514c0108e0 con 0x7f515c077940 2024-09-21T06:03:43.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.884+0000 7f5162000640 1 -- 172.21.15.37:0/3853952446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515c1a6ca0 con 0x7f515c077940 2024-09-21T06:03:43.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.884+0000 7f5158c00640 1 -- 172.21.15.37:0/3853952446 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c018980 con 0x7f515c077940 2024-09-21T06:03:43.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.884+0000 7f5162000640 1 -- 172.21.15.37:0/3853952446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f515c1ad400 con 0x7f515c077940 2024-09-21T06:03:43.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.885+0000 7f5162000640 1 -- 172.21.15.37:0/3853952446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f515c077d50 con 0x7f515c077940 2024-09-21T06:03:43.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.888+0000 7f5158c00640 1 -- 172.21.15.37:0/3853952446 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f514c010430 con 0x7f515c077940 2024-09-21T06:03:43.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.890+0000 7f5158c00640 1 --2- 172.21.15.37:0/3853952446 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f51400b6510 0x7f51400b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:43.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.890+0000 7f5158c00640 1 -- 172.21.15.37:0/3853952446 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f514c0e7ed0 con 0x7f515c077940 2024-09-21T06:03:43.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.890+0000 7f5153e00640 1 --2- 172.21.15.37:0/3853952446 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f51400b6510 0x7f51400b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:43.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.890+0000 7f5153e00640 1 --2- 172.21.15.37:0/3853952446 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f51400b6510 0x7f51400b8a20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f515c07b240 tx=0x7f5144005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:43.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:43.892+0000 7f5158c00640 1 -- 172.21.15.37:0/3853952446 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f514c0b2710 con 0x7f515c077940 2024-09-21T06:03:44.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.134+0000 7f5162000640 1 -- 172.21.15.37:0/3853952446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f515c02e640 con 0x7f515c077940 2024-09-21T06:03:44.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.135+0000 7f5158c00640 1 -- 172.21.15.37:0/3853952446 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f514c0b7650 con 0x7f515c077940 2024-09-21T06:03:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:03:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T06:03:44.138 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T06:03:44.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.137+0000 7f5162000640 1 -- 172.21.15.37:0/3853952446 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f51400b6510 msgr2=0x7f51400b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.137+0000 7f5162000640 1 --2- 172.21.15.37:0/3853952446 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f51400b6510 0x7f51400b8a20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f515c07b240 tx=0x7f5144005f90 comp rx=0 tx=0).stop 2024-09-21T06:03:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.137+0000 7f5162000640 1 -- 172.21.15.37:0/3853952446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515c077940 msgr2=0x7f515c1a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.137+0000 7f5162000640 1 --2- 172.21.15.37:0/3853952446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515c077940 0x7f515c1a0a40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f514c00e9f0 tx=0x7f514c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.137+0000 7f5162000640 1 -- 172.21.15.37:0/3853952446 shutdown_connections 2024-09-21T06:03:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.137+0000 7f5162000640 1 --2- 172.21.15.37:0/3853952446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f515c114740 0x7f515c1a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.137+0000 7f5162000640 1 --2- 172.21.15.37:0/3853952446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f515c078290 0x7f515c1a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.137+0000 7f5162000640 1 --2- 172.21.15.37:0/3853952446 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f51400b6510 0x7f51400b8a20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.137+0000 7f5162000640 1 --2- 172.21.15.37:0/3853952446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f515c077940 0x7f515c1a0a40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.137+0000 7f5162000640 1 -- 172.21.15.37:0/3853952446 >> 172.21.15.37:0/3853952446 conn(0x7f515c1017d0 msgr2=0x7f515c1167b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.138+0000 7f5162000640 1 -- 172.21.15.37:0/3853952446 shutdown_connections 2024-09-21T06:03:44.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:44.138+0000 7f5162000640 1 -- 172.21.15.37:0/3853952446 wait complete. 2024-09-21T06:03:44.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:44 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3853952446' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:44.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:44 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3853952446' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:44.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:44 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3853952446' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:45.115 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db --set-id 4f1ba5d4 --release --await' 2024-09-21T06:03:45.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db --set-id 4f1ba5d4 --release --await 2024-09-21T06:03:45.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:45 smithi037 ceph-mon[30631]: pgmap v709: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 51 KiB/s wr, 3 op/s 2024-09-21T06:03:45.495 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:45.496 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:45 smithi067 ceph-mon[34443]: pgmap v709: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 51 KiB/s wr, 3 op/s 2024-09-21T06:03:45.622 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:45 smithi144 ceph-mon[34351]: pgmap v709: 129 pgs: 129 active+clean; 195 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 51 KiB/s wr, 3 op/s 2024-09-21T06:03:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.123+0000 7f9c07e00640 1 -- 172.21.15.37:0/2129447430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c08103990 msgr2=0x7f9c08103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.123+0000 7f9c07e00640 1 --2- 172.21.15.37:0/2129447430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c08103990 0x7f9c08103da0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009900 tx=0x7f9bf802a400 comp rx=0 tx=0).stop 2024-09-21T06:03:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.123+0000 7f9c07e00640 1 -- 172.21.15.37:0/2129447430 shutdown_connections 2024-09-21T06:03:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.123+0000 7f9c07e00640 1 --2- 172.21.15.37:0/2129447430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c08109c20 0x7f9c08110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.123+0000 7f9c07e00640 1 --2- 172.21.15.37:0/2129447430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c081092d0 0x7f9c081096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.123+0000 7f9c07e00640 1 --2- 172.21.15.37:0/2129447430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c08103990 0x7f9c08103da0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.123+0000 7f9c07e00640 1 -- 172.21.15.37:0/2129447430 >> 172.21.15.37:0/2129447430 conn(0x7f9c080ff3e0 msgr2=0x7f9c08101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.123+0000 7f9c07e00640 1 -- 172.21.15.37:0/2129447430 shutdown_connections 2024-09-21T06:03:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.123+0000 7f9c07e00640 1 -- 172.21.15.37:0/2129447430 wait complete. 2024-09-21T06:03:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.124+0000 7f9c07e00640 1 Processor -- start 2024-09-21T06:03:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.124+0000 7f9c07e00640 1 -- start start 2024-09-21T06:03:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c07e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c08103990 0x7f9c0819c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c07e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c081092d0 0x7f9c0819cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c07e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c08109c20 0x7f9c081a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c07e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c08113930 con 0x7f9c08103990 2024-09-21T06:03:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c07e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081137b0 con 0x7f9c08109c20 2024-09-21T06:03:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c07e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9c08113ab0 con 0x7f9c081092d0 2024-09-21T06:03:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c06a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c08103990 0x7f9c0819c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c06a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c08103990 0x7f9c0819c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51410/0 (socket says 172.21.15.37:51410) 2024-09-21T06:03:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c06a00640 1 -- 172.21.15.37:0/4147488482 learned_addr learned my addr 172.21.15.37:0/4147488482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c07400640 1 --2- 172.21.15.37:0/4147488482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c08109c20 0x7f9c081a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c06a00640 1 -- 172.21.15.37:0/4147488482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c081092d0 msgr2=0x7f9c0819cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c06a00640 1 --2- 172.21.15.37:0/4147488482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c081092d0 0x7f9c0819cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c06a00640 1 -- 172.21.15.37:0/4147488482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c08109c20 msgr2=0x7f9c081a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c06a00640 1 --2- 172.21.15.37:0/4147488482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c08109c20 0x7f9c081a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.125+0000 7f9c06a00640 1 -- 172.21.15.37:0/4147488482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c081a24b0 con 0x7f9c08103990 2024-09-21T06:03:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.126+0000 7f9c06a00640 1 --2- 172.21.15.37:0/4147488482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c08103990 0x7f9c0819c540 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8005ab0 tx=0x7f9bf8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.126+0000 7f9bff400640 1 -- 172.21.15.37:0/4147488482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf803f070 con 0x7f9c08103990 2024-09-21T06:03:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.126+0000 7f9bff400640 1 -- 172.21.15.37:0/4147488482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bf8031d60 con 0x7f9c08103990 2024-09-21T06:03:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.126+0000 7f9c07e00640 1 -- 172.21.15.37:0/4147488482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c081a2740 con 0x7f9c08103990 2024-09-21T06:03:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.126+0000 7f9bff400640 1 -- 172.21.15.37:0/4147488482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8035030 con 0x7f9c08103990 2024-09-21T06:03:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.126+0000 7f9c07e00640 1 -- 172.21.15.37:0/4147488482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c081a8f00 con 0x7f9c08103990 2024-09-21T06:03:46.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.129+0000 7f9c1463a740 1 Processor -- start 2024-09-21T06:03:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.130+0000 7f9c1463a740 1 -- start start 2024-09-21T06:03:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.130+0000 7f9c1463a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x562995ffa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.130+0000 7f9c1463a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 0x562995ffa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.130+0000 7f9c1463a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c32840 0x562995ffadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.130+0000 7f9c1463a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562995f71290 con 0x562995c32840 2024-09-21T06:03:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.130+0000 7f9c1463a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562995f606c0 con 0x562995c53520 2024-09-21T06:03:46.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.130+0000 7f9c1463a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562995f644d0 con 0x562995c2a660 2024-09-21T06:03:46.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.130+0000 7f9bff400640 1 -- 172.21.15.37:0/4147488482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9bf8042070 con 0x7f9c08103990 2024-09-21T06:03:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.130+0000 7f9c07400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x562995ffa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.130+0000 7f9c06000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c32840 0x562995ffadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.130+0000 7f9c07400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x562995ffa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:40020/0 (socket says 172.21.15.37:40020) 2024-09-21T06:03:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.130+0000 7f9c07400640 1 -- 172.21.15.37:0/4056568564 learned_addr learned my addr 172.21.15.37:0/4056568564 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.130+0000 7f9c06a00640 1 --2- 172.21.15.37:0/4056568564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 0x562995ffa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.131+0000 7f9c07400640 1 -- 172.21.15.37:0/4056568564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 msgr2=0x562995ffa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.131+0000 7f9c07400640 1 --2- 172.21.15.37:0/4056568564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 0x562995ffa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.131+0000 7f9c07400640 1 -- 172.21.15.37:0/4056568564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c32840 msgr2=0x562995ffadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.131+0000 7f9c07400640 1 --2- 172.21.15.37:0/4056568564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c32840 0x562995ffadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.131+0000 7f9c07400640 1 -- 172.21.15.37:0/4056568564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562995eed460 con 0x562995c53520 2024-09-21T06:03:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.131+0000 7f9c07400640 1 --2- 172.21.15.37:0/4056568564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x562995ffa340 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9c00010370 tx=0x7f9c00010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14c5a1dea2f5fcc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:46.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.132+0000 7f9bf3e00640 1 -- 172.21.15.37:0/4056568564 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00016070 con 0x562995c53520 2024-09-21T06:03:46.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.132+0000 7f9bf3e00640 1 -- 172.21.15.37:0/4056568564 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c00004d20 con 0x562995c53520 2024-09-21T06:03:46.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.132+0000 7f9bf3e00640 1 -- 172.21.15.37:0/4056568564 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00005350 con 0x562995c53520 2024-09-21T06:03:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.132+0000 7f9bff400640 1 --2- 172.21.15.37:0/4147488482 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9bec0b6590 0x7f9bec0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.132+0000 7f9bff400640 1 -- 172.21.15.37:0/4147488482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f9bf8107fe0 con 0x7f9c08103990 2024-09-21T06:03:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.132+0000 7f9c06a00640 1 --2- 172.21.15.37:0/4147488482 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9bec0b6590 0x7f9bec0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.133+0000 7f9c1463a740 1 -- 172.21.15.37:0/4056568564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 msgr2=0x562995ffa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.133+0000 7f9c1463a740 1 --2- 172.21.15.37:0/4056568564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x562995ffa340 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9c00010370 tx=0x7f9c00010830 comp rx=0 tx=0).stop 2024-09-21T06:03:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.133+0000 7f9c1463a740 1 -- 172.21.15.37:0/4056568564 shutdown_connections 2024-09-21T06:03:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.133+0000 7f9c1463a740 1 --2- 172.21.15.37:0/4056568564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c32840 0x562995ffadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.133+0000 7f9c1463a740 1 --2- 172.21.15.37:0/4056568564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 0x562995ffa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.133+0000 7f9c1463a740 1 --2- 172.21.15.37:0/4056568564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x562995ffa340 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.133+0000 7f9c1463a740 1 -- 172.21.15.37:0/4056568564 >> 172.21.15.37:0/4056568564 conn(0x562995c47910 msgr2=0x562995ff8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.133+0000 7f9c1463a740 1 -- 172.21.15.37:0/4056568564 shutdown_connections 2024-09-21T06:03:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.133+0000 7f9c06a00640 1 --2- 172.21.15.37:0/4147488482 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9bec0b6590 0x7f9bec0b8aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80caff0 tx=0x7f9bf810ba60 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.133+0000 7f9c1463a740 1 -- 172.21.15.37:0/4056568564 wait complete. 2024-09-21T06:03:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.134+0000 7f9c1463a740 1 -- start start 2024-09-21T06:03:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.134+0000 7f9c1463a740 1 Processor -- start 2024-09-21T06:03:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.134+0000 7f9c1463a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 0x562996005e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.134+0000 7f9c1463a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c32840 0x5629960063c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.134+0000 7f9c1463a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c53520 0x562996011e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.134+0000 7f9c1463a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562995dc1bb0 con 0x562995c53520 2024-09-21T06:03:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.134+0000 7f9c1463a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562995efb6c0 con 0x562995c32840 2024-09-21T06:03:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.134+0000 7f9c1463a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562996008b20 con 0x562995c2a660 2024-09-21T06:03:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.135+0000 7f9c1463a740 10 client.0 _ll_register_callbacks cb 0x562995f16490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.135+0000 7f9c07400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c53520 0x562996011e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.135+0000 7f9c06000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c32840 0x5629960063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.135+0000 7f9c06000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c32840 0x5629960063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:40034/0 (socket says 172.21.15.37:40034) 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.135+0000 7f9c06000640 1 -- 172.21.15.37:0/1161031249 learned_addr learned my addr 172.21.15.37:0/1161031249 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.135+0000 7f9c06000640 1 -- 172.21.15.37:0/1161031249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 msgr2=0x562996005e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.135+0000 7f9c06000640 1 --2- 172.21.15.37:0/1161031249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 0x562996005e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.135+0000 7f9c06000640 1 -- 172.21.15.37:0/1161031249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c53520 msgr2=0x562996011e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.135+0000 7f9c06000640 1 --2- 172.21.15.37:0/1161031249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c53520 0x562996011e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.135+0000 7f9c06000640 1 -- 172.21.15.37:0/1161031249 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562995cbeb00 con 0x562995c32840 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.135+0000 7f9c07400640 1 --2- 172.21.15.37:0/1161031249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c53520 0x562996011e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.136+0000 7f9c06000640 1 --2- 172.21.15.37:0/1161031249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c32840 0x5629960063c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4003920 tx=0x7f9bf4003de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2bd9382ed4c1586 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.136+0000 7f9bf0c00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.136+0000 7f9bf0c00640 1 -- 172.21.15.37:0/1161031249 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf401a470 con 0x562995c32840 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.136+0000 7f9bf0c00640 1 -- 172.21.15.37:0/1161031249 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f9bf401a610 con 0x562995c32840 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.136+0000 7f9c1463a740 1 -- 172.21.15.37:0/1161031249 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c00004d20 con 0x562995c32840 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.136+0000 7f9bf0c00640 1 -- 172.21.15.37:0/1161031249 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9bf4023050 con 0x562995c32840 2024-09-21T06:03:46.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.136+0000 7f9c1463a740 10 client.25769 fetch_fsmap learned FSMap version 21 2024-09-21T06:03:46.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.136+0000 7f9c1463a740 1 -- 172.21.15.37:0/1161031249 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562995d35960 con 0x562995c32840 2024-09-21T06:03:46.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.137+0000 7f9bf0c00640 1 -- 172.21.15.37:0/1161031249 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c00004d20 con 0x562995c32840 2024-09-21T06:03:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.137+0000 7f9bf0c00640 1 -- 172.21.15.37:0/1161031249 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9bf40118e0 con 0x562995c32840 2024-09-21T06:03:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.137+0000 7f9c1463a740 10 client.25769 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:03:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.137+0000 7f9c1463a740 10 client.25769 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:03:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.137+0000 7f9c1463a740 20 client.25769 populate_metadata read hostname 'smithi037' 2024-09-21T06:03:46.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.137+0000 7f9c1463a740 1 --2- 172.21.15.37:0/1161031249 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562995c11ea0 0x562996017f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.137+0000 7f9c1463a740 4 client.25769 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.137+0000 7f9c1463a740 1 -- 172.21.15.37:0/1161031249 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562995f731e0 con 0x562995c11ea0 2024-09-21T06:03:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.138+0000 7f9c07400640 1 --2- 172.21.15.37:0/1161031249 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562995c11ea0 0x562996017f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.138+0000 7f9c07400640 1 --2- 172.21.15.37:0/1161031249 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562995c11ea0 0x562996017f00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a04b461adac0fbc server_cookie=c510f6eda54643c8 in_seq=0 out_seq=0 2024-09-21T06:03:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.138+0000 7f9bf0c00640 10 client.25769 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:03:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.139+0000 7f9bf0c00640 1 -- 172.21.15.37:0/1161031249 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562995f731e0 con 0x562995c11ea0 2024-09-21T06:03:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.139+0000 7f9bf0c00640 10 client.25769 handle_command_reply: tid=0 2024-09-21T06:03:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.139+0000 7f9c1463a740 1 client.25769 shutdown 2024-09-21T06:03:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.139+0000 7f9c1463a740 1 -- 172.21.15.37:0/1161031249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c32840 msgr2=0x5629960063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.139+0000 7f9c1463a740 1 --2- 172.21.15.37:0/1161031249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c32840 0x5629960063c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4003920 tx=0x7f9bf4003de0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.139+0000 7f9c1463a740 1 -- 172.21.15.37:0/1161031249 shutdown_connections 2024-09-21T06:03:46.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.139+0000 7f9c1463a740 1 --2- 172.21.15.37:0/1161031249 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562995c11ea0 0x562996017f00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.139+0000 7f9c1463a740 1 --2- 172.21.15.37:0/1161031249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c53520 0x562996011e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.139+0000 7f9c1463a740 1 --2- 172.21.15.37:0/1161031249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c32840 0x5629960063c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.139+0000 7f9bf0c00640 0 client.25769 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:03:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.139+0000 7f9c1463a740 1 --2- 172.21.15.37:0/1161031249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 0x562996005e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.139+0000 7f9c1463a740 1 -- 172.21.15.37:0/1161031249 >> 172.21.15.37:0/1161031249 conn(0x562995c47910 msgr2=0x562995ffd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.139+0000 7f9c1463a740 1 -- 172.21.15.37:0/1161031249 shutdown_connections 2024-09-21T06:03:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.140+0000 7f9c1463a740 1 -- 172.21.15.37:0/1161031249 wait complete. 2024-09-21T06:03:46.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.140+0000 7f9c1463a740 20 client.25769 trim_cache size 0 max 16384 2024-09-21T06:03:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.158+0000 7f9c1463a740 1 Processor -- start 2024-09-21T06:03:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.158+0000 7f9c1463a740 1 -- start start 2024-09-21T06:03:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c1463a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 0x562995ffdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c1463a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c32840 0x562995fff3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c1463a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x562995fff910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c1463a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081b0c80 con 0x562995c32840 2024-09-21T06:03:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c1463a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081b3500 con 0x562995c53520 2024-09-21T06:03:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c1463a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081b12f0 con 0x562995c2a660 2024-09-21T06:03:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c06000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c32840 0x562995fff3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c06000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c32840 0x562995fff3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51450/0 (socket says 172.21.15.37:51450) 2024-09-21T06:03:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c06000640 1 -- 172.21.15.37:0/3007920945 learned_addr learned my addr 172.21.15.37:0/3007920945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c07400640 1 --2- 172.21.15.37:0/3007920945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 0x562995ffdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c07400640 1 --2- 172.21.15.37:0/3007920945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x562995fff910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c06000640 1 -- 172.21.15.37:0/3007920945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 msgr2=0x562995ffdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c06000640 1 --2- 172.21.15.37:0/3007920945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 0x562995ffdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c06000640 1 -- 172.21.15.37:0/3007920945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 msgr2=0x562995fff910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.159+0000 7f9c06000640 1 --2- 172.21.15.37:0/3007920945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x562995fff910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.160+0000 7f9c06000640 1 -- 172.21.15.37:0/3007920945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562996001510 con 0x562995c32840 2024-09-21T06:03:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.160+0000 7f9c07400640 1 --2- 172.21.15.37:0/3007920945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x562995fff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:46.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.160+0000 7f9c06000640 1 --2- 172.21.15.37:0/3007920945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c32840 0x562995fff3d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4000c00 tx=0x7f9bf400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5711d39a4a709a12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.160+0000 7f9bf3400640 1 -- 172.21.15.37:0/3007920945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400b960 con 0x562995c32840 2024-09-21T06:03:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.160+0000 7f9bf3400640 1 -- 172.21.15.37:0/3007920945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bf4015070 con 0x562995c32840 2024-09-21T06:03:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.160+0000 7f9bf3400640 1 -- 172.21.15.37:0/3007920945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4010730 con 0x562995c32840 2024-09-21T06:03:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.161+0000 7f9c1463a740 1 -- 172.21.15.37:0/3007920945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c32840 msgr2=0x562995fff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.161+0000 7f9c1463a740 1 --2- 172.21.15.37:0/3007920945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c32840 0x562995fff3d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4000c00 tx=0x7f9bf400b4a0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.161+0000 7f9c1463a740 1 -- 172.21.15.37:0/3007920945 shutdown_connections 2024-09-21T06:03:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.161+0000 7f9c1463a740 1 --2- 172.21.15.37:0/3007920945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x562995fff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.161+0000 7f9c1463a740 1 --2- 172.21.15.37:0/3007920945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c32840 0x562995fff3d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.161+0000 7f9c1463a740 1 --2- 172.21.15.37:0/3007920945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c2a660 0x562995ffdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.161+0000 7f9c1463a740 1 -- 172.21.15.37:0/3007920945 >> 172.21.15.37:0/3007920945 conn(0x562995c47910 msgr2=0x562995ffd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.161+0000 7f9c1463a740 1 -- 172.21.15.37:0/3007920945 shutdown_connections 2024-09-21T06:03:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.161+0000 7f9c1463a740 1 -- 172.21.15.37:0/3007920945 wait complete. 2024-09-21T06:03:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.162+0000 7f9c1463a740 1 -- start start 2024-09-21T06:03:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.162+0000 7f9c1463a740 1 Processor -- start 2024-09-21T06:03:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.162+0000 7f9c1463a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c2a660 0x56299600a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.162+0000 7f9c1463a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c32840 0x56299600a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.162+0000 7f9c1463a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x5629960818c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.162+0000 7f9c1463a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081b19c0 con 0x562995c2a660 2024-09-21T06:03:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.162+0000 7f9c1463a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081b2e30 con 0x562995c53520 2024-09-21T06:03:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.162+0000 7f9c1463a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9c081b2090 con 0x562995c32840 2024-09-21T06:03:46.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.163+0000 7f9c1463a740 10 client.0 _ll_register_callbacks cb 0x7f9bf4004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:46.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.163+0000 7f9c07400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c2a660 0x56299600a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.163+0000 7f9c07400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c2a660 0x56299600a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51462/0 (socket says 172.21.15.37:51462) 2024-09-21T06:03:46.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.163+0000 7f9c07400640 1 -- 172.21.15.37:0/3486546401 learned_addr learned my addr 172.21.15.37:0/3486546401 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:46.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.163+0000 7f9c07400640 1 --2- 172.21.15.37:0/3486546401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x5629960818c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.163+0000 7f9c07400640 1 -- 172.21.15.37:0/3486546401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c32840 msgr2=0x56299600a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:46.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.163+0000 7f9c07400640 1 --2- 172.21.15.37:0/3486546401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c32840 0x56299600a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.163+0000 7f9c07400640 1 -- 172.21.15.37:0/3486546401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 msgr2=0x5629960818c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:46.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.163+0000 7f9c07400640 1 --2- 172.21.15.37:0/3486546401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x5629960818c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.163+0000 7f9c07400640 1 -- 172.21.15.37:0/3486546401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56299600af00 con 0x562995c2a660 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.163+0000 7f9c07400640 1 --2- 172.21.15.37:0/3486546401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c2a660 0x56299600a0d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9c00005fd0 tx=0x7f9bf4004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda224f689cc883b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.163+0000 7f9bf0c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.164+0000 7f9bf0c00640 1 -- 172.21.15.37:0/3486546401 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0002b070 con 0x562995c2a660 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.164+0000 7f9c1463a740 1 -- 172.21.15.37:0/3486546401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bf4015070 con 0x562995c2a660 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.164+0000 7f9bf0c00640 1 -- 172.21.15.37:0/3486546401 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f9c00012510 con 0x562995c2a660 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.164+0000 7f9bf0c00640 1 -- 172.21.15.37:0/3486546401 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9c0003b050 con 0x562995c2a660 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.164+0000 7f9c1463a740 10 client.15729 fetch_fsmap learned FSMap version 21 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.164+0000 7f9c1463a740 1 -- 172.21.15.37:0/3486546401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562996082ef0 con 0x562995c2a660 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.164+0000 7f9bf0c00640 1 -- 172.21.15.37:0/3486546401 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bf4015070 con 0x562995c2a660 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.165+0000 7f9bf0c00640 1 -- 172.21.15.37:0/3486546401 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9c0000f040 con 0x562995c2a660 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.165+0000 7f9c1463a740 10 client.15729 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.165+0000 7f9c1463a740 10 client.15729 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.165+0000 7f9c1463a740 20 client.15729 populate_metadata read hostname 'smithi037' 2024-09-21T06:03:46.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.165+0000 7f9c1463a740 1 --2- 172.21.15.37:0/3486546401 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562995be7250 0x562996085550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:46.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.165+0000 7f9c1463a740 4 client.15729 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4f1ba5d4", "release": true, "await": true}] 2024-09-21T06:03:46.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.165+0000 7f9c1463a740 1 -- 172.21.15.37:0/3486546401 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4f1ba5d4", "release": true, "await": true}) -- 0x562995f6ec90 con 0x562995be7250 2024-09-21T06:03:46.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.165+0000 7f9c06000640 1 --2- 172.21.15.37:0/3486546401 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562995be7250 0x562996085550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:46.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.166+0000 7f9c06000640 1 --2- 172.21.15.37:0/3486546401 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562995be7250 0x562996085550 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76aa1f07db0fd247 server_cookie=7d8d431f94309048 in_seq=0 out_seq=0 2024-09-21T06:03:46.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.166+0000 7f9bf0c00640 10 client.15729 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:03:46.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9bf0c00640 1 -- 172.21.15.37:0/3486546401 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562995f6ec90 con 0x562995be7250 2024-09-21T06:03:46.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9bf0c00640 10 client.15729 handle_command_reply: tid=0 2024-09-21T06:03:46.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9c1463a740 1 client.15729 shutdown 2024-09-21T06:03:46.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9c1463a740 1 -- 172.21.15.37:0/3486546401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c2a660 msgr2=0x56299600a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:46.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9c1463a740 1 --2- 172.21.15.37:0/3486546401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c2a660 0x56299600a0d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9c00005fd0 tx=0x7f9bf4004360 comp rx=0 tx=0).stop 2024-09-21T06:03:46.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9c1463a740 1 -- 172.21.15.37:0/3486546401 shutdown_connections 2024-09-21T06:03:46.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9c1463a740 1 --2- 172.21.15.37:0/3486546401 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562995be7250 0x562996085550 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9c1463a740 1 --2- 172.21.15.37:0/3486546401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562995c53520 0x5629960818c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9c1463a740 1 --2- 172.21.15.37:0/3486546401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562995c32840 0x56299600a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9c1463a740 1 --2- 172.21.15.37:0/3486546401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562995c2a660 0x56299600a0d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9c1463a740 1 -- 172.21.15.37:0/3486546401 >> 172.21.15.37:0/3486546401 conn(0x562995c47910 msgr2=0x562995ffb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:46.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9bf0c00640 0 client.15729 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:03:46.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9c1463a740 1 -- 172.21.15.37:0/3486546401 shutdown_connections 2024-09-21T06:03:46.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.365+0000 7f9c1463a740 1 -- 172.21.15.37:0/3486546401 wait complete. 2024-09-21T06:03:46.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.366+0000 7f9c1463a740 20 client.15729 trim_cache size 0 max 16384 2024-09-21T06:03:46.369 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:03:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T06:03:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T06:03:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 40, 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "4f1ba5d4": { 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 40, 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 144.5, 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T06:03:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:03:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T06:03:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:03:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:46.371 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:03:46.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.366+0000 7f9c07e00640 1 -- 172.21.15.37:0/4147488482 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9bec0b6590 msgr2=0x7f9bec0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:46.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.366+0000 7f9c07e00640 1 --2- 172.21.15.37:0/4147488482 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9bec0b6590 0x7f9bec0b8aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80caff0 tx=0x7f9bf810ba60 comp rx=0 tx=0).stop 2024-09-21T06:03:46.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.366+0000 7f9c07e00640 1 -- 172.21.15.37:0/4147488482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c08103990 msgr2=0x7f9c0819c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:46.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.366+0000 7f9c07e00640 1 --2- 172.21.15.37:0/4147488482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c08103990 0x7f9c0819c540 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8005ab0 tx=0x7f9bf8003cd0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.370+0000 7f9c07e00640 1 -- 172.21.15.37:0/4147488482 shutdown_connections 2024-09-21T06:03:46.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.370+0000 7f9c07e00640 1 --2- 172.21.15.37:0/4147488482 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9bec0b6590 0x7f9bec0b8aa0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.370+0000 7f9c07e00640 1 --2- 172.21.15.37:0/4147488482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c08109c20 0x7f9c081a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.370+0000 7f9c07e00640 1 --2- 172.21.15.37:0/4147488482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c081092d0 0x7f9c0819cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.370+0000 7f9c07e00640 1 --2- 172.21.15.37:0/4147488482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c08103990 0x7f9c0819c540 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:46.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.370+0000 7f9c07e00640 1 -- 172.21.15.37:0/4147488482 >> 172.21.15.37:0/4147488482 conn(0x7f9c080ff3e0 msgr2=0x7f9c081089d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:46.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.370+0000 7f9c07e00640 1 -- 172.21.15.37:0/4147488482 shutdown_connections 2024-09-21T06:03:46.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:46.374+0000 7f9c07e00640 1 -- 172.21.15.37:0/4147488482 wait complete. 2024-09-21T06:03:47.155 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4f1ba5d4', total seconds elapsed: 28.8 2024-09-21T06:03:47.156 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-21T06:03:47.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:03:47.698 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:47.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:47 smithi037 ceph-mon[30631]: pgmap v710: 129 pgs: 129 active+clean; 185 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 29 KiB/s wr, 4 op/s 2024-09-21T06:03:47.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:47 smithi144 ceph-mon[34351]: pgmap v710: 129 pgs: 129 active+clean; 185 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 29 KiB/s wr, 4 op/s 2024-09-21T06:03:47.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:47 smithi067 ceph-mon[34443]: pgmap v710: 129 pgs: 129 active+clean; 185 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 29 KiB/s wr, 4 op/s 2024-09-21T06:03:48.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.452+0000 7fc1dfe00640 1 -- 172.21.15.37:0/2040988817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e0075750 msgr2=0x7fc1e0075b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:48.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.452+0000 7fc1dfe00640 1 --2- 172.21.15.37:0/2040988817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e0075750 0x7fc1e0075b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009860 tx=0x7fc1d002a340 comp rx=0 tx=0).stop 2024-09-21T06:03:48.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.452+0000 7fc1dfe00640 1 -- 172.21.15.37:0/2040988817 shutdown_connections 2024-09-21T06:03:48.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.452+0000 7fc1dfe00640 1 --2- 172.21.15.37:0/2040988817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e010ff70 0x7fc1e0112390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.452+0000 7fc1dfe00640 1 --2- 172.21.15.37:0/2040988817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e00760a0 0x7fc1e010fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.452+0000 7fc1dfe00640 1 --2- 172.21.15.37:0/2040988817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e0075750 0x7fc1e0075b60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.452+0000 7fc1dfe00640 1 -- 172.21.15.37:0/2040988817 >> 172.21.15.37:0/2040988817 conn(0x7fc1e00ff400 msgr2=0x7fc1e0101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:48.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.452+0000 7fc1dfe00640 1 -- 172.21.15.37:0/2040988817 shutdown_connections 2024-09-21T06:03:48.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.453+0000 7fc1dfe00640 1 -- 172.21.15.37:0/2040988817 wait complete. 2024-09-21T06:03:48.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.454+0000 7fc1dfe00640 1 Processor -- start 2024-09-21T06:03:48.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.454+0000 7fc1dfe00640 1 -- start start 2024-09-21T06:03:48.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.455+0000 7fc1dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e0075750 0x7fc1e0106a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:48.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.455+0000 7fc1dfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e00760a0 0x7fc1e0106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:48.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.455+0000 7fc1dfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e010ff70 0x7fc1e01074d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:48.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.455+0000 7fc1dfe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e0115ae0 con 0x7fc1e0075750 2024-09-21T06:03:48.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.455+0000 7fc1dfe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e0115960 con 0x7fc1e010ff70 2024-09-21T06:03:48.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.455+0000 7fc1dfe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e0115c60 con 0x7fc1e00760a0 2024-09-21T06:03:48.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.455+0000 7fc1df400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e010ff70 0x7fc1e01074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:48.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.455+0000 7fc1df400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e010ff70 0x7fc1e01074d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:40066/0 (socket says 172.21.15.37:40066) 2024-09-21T06:03:48.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.455+0000 7fc1df400640 1 -- 172.21.15.37:0/1810061409 learned_addr learned my addr 172.21.15.37:0/1810061409 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:48.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.455+0000 7fc1de000640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e00760a0 0x7fc1e0106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:48.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.455+0000 7fc1dea00640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e0075750 0x7fc1e0106a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:48.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.456+0000 7fc1df400640 1 -- 172.21.15.37:0/1810061409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e00760a0 msgr2=0x7fc1e0106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:48.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.456+0000 7fc1df400640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e00760a0 0x7fc1e0106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.456+0000 7fc1df400640 1 -- 172.21.15.37:0/1810061409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e0075750 msgr2=0x7fc1e0106a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:48.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.456+0000 7fc1df400640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e0075750 0x7fc1e0106a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.456+0000 7fc1df400640 1 -- 172.21.15.37:0/1810061409 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e01ac990 con 0x7fc1e010ff70 2024-09-21T06:03:48.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.456+0000 7fc1df400640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e010ff70 0x7fc1e01074d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800eb10 tx=0x7fc1d800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:48.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.456+0000 7fc1d7400640 1 -- 172.21.15.37:0/1810061409 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d800ce20 con 0x7fc1e010ff70 2024-09-21T06:03:48.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.457+0000 7fc1d7400640 1 -- 172.21.15.37:0/1810061409 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1d8005020 con 0x7fc1e010ff70 2024-09-21T06:03:48.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.457+0000 7fc1dfe00640 1 -- 172.21.15.37:0/1810061409 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e01acc80 con 0x7fc1e010ff70 2024-09-21T06:03:48.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.457+0000 7fc1dfe00640 1 -- 172.21.15.37:0/1810061409 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e01ad1c0 con 0x7fc1e010ff70 2024-09-21T06:03:48.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.457+0000 7fc1d7400640 1 -- 172.21.15.37:0/1810061409 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8018630 con 0x7fc1e010ff70 2024-09-21T06:03:48.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.458+0000 7fc1dfe00640 1 -- 172.21.15.37:0/1810061409 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e0075b60 con 0x7fc1e010ff70 2024-09-21T06:03:48.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.462+0000 7fc1d7400640 1 -- 172.21.15.37:0/1810061409 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc1d8005510 con 0x7fc1e010ff70 2024-09-21T06:03:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.464+0000 7fc1d7400640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc1c40b6510 0x7fc1c40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.464+0000 7fc1d7400640 1 -- 172.21.15.37:0/1810061409 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fc1d80e8170 con 0x7fc1e010ff70 2024-09-21T06:03:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.464+0000 7fc1dea00640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc1c40b6510 0x7fc1c40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.464+0000 7fc1d7400640 1 -- 172.21.15.37:0/1810061409 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1d80ae5d0 con 0x7fc1e010ff70 2024-09-21T06:03:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.465+0000 7fc1dea00640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc1c40b6510 0x7fc1c40b8a20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009830 tx=0x7fc1d0030d10 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:48.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.778+0000 7fc1dfe00640 1 -- 172.21.15.37:0/1810061409 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1e0107d50 con 0x7fc1e010ff70 2024-09-21T06:03:48.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.778+0000 7fc1d7400640 1 -- 172.21.15.37:0/1810061409 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7fc1e0107d50 con 0x7fc1e010ff70 2024-09-21T06:03:48.781 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:03:48.781 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T06:03:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T06:03:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.781+0000 7fc1dfe00640 1 -- 172.21.15.37:0/1810061409 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc1c40b6510 msgr2=0x7fc1c40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.781+0000 7fc1dfe00640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc1c40b6510 0x7fc1c40b8a20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009830 tx=0x7fc1d0030d10 comp rx=0 tx=0).stop 2024-09-21T06:03:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.781+0000 7fc1dfe00640 1 -- 172.21.15.37:0/1810061409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e010ff70 msgr2=0x7fc1e01074d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.781+0000 7fc1dfe00640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e010ff70 0x7fc1e01074d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800eb10 tx=0x7fc1d800ef10 comp rx=0 tx=0).stop 2024-09-21T06:03:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.782+0000 7fc1dfe00640 1 -- 172.21.15.37:0/1810061409 shutdown_connections 2024-09-21T06:03:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.782+0000 7fc1dfe00640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc1c40b6510 0x7fc1c40b8a20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.782+0000 7fc1dfe00640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e010ff70 0x7fc1e01074d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.782+0000 7fc1dfe00640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1e00760a0 0x7fc1e0106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.782+0000 7fc1dfe00640 1 --2- 172.21.15.37:0/1810061409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1e0075750 0x7fc1e0106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.782+0000 7fc1dfe00640 1 -- 172.21.15.37:0/1810061409 >> 172.21.15.37:0/1810061409 conn(0x7fc1e00ff400 msgr2=0x7fc1e0109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.782+0000 7fc1dfe00640 1 -- 172.21.15.37:0/1810061409 shutdown_connections 2024-09-21T06:03:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:48.782+0000 7fc1dfe00640 1 -- 172.21.15.37:0/1810061409 wait complete. 2024-09-21T06:03:49.636 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-21T06:03:49.637 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-21T06:03:49.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:49 smithi144 ceph-mon[34351]: pgmap v711: 129 pgs: 129 active+clean; 165 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:03:49.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:49 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/1810061409' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:49.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:49 smithi037 ceph-mon[30631]: pgmap v711: 129 pgs: 129 active+clean; 165 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:03:49.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:49 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/1810061409' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:49.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:49 smithi067 ceph-mon[34443]: pgmap v711: 129 pgs: 129 active+clean; 165 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:03:49.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:49 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/1810061409' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:03:50.121 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.004+0000 7f5eefa00640 1 -- 172.21.15.37:0/605292556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee810ad10 msgr2=0x7f5ee811cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.004+0000 7f5eefa00640 1 --2- 172.21.15.37:0/605292556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee810ad10 0x7f5ee811cba0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009900 tx=0x7f5ed402a400 comp rx=0 tx=0).stop 2024-09-21T06:03:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.004+0000 7f5eefa00640 1 -- 172.21.15.37:0/605292556 shutdown_connections 2024-09-21T06:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.004+0000 7f5eefa00640 1 --2- 172.21.15.37:0/605292556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee811d0e0 0x7f5ee811f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.004+0000 7f5eefa00640 1 --2- 172.21.15.37:0/605292556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee810ad10 0x7f5ee811cba0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.004+0000 7f5eefa00640 1 --2- 172.21.15.37:0/605292556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee810a3c0 0x7f5ee810a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.004+0000 7f5eefa00640 1 -- 172.21.15.37:0/605292556 >> 172.21.15.37:0/605292556 conn(0x7f5ee8070e80 msgr2=0x7f5ee8071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.004+0000 7f5eefa00640 1 -- 172.21.15.37:0/605292556 shutdown_connections 2024-09-21T06:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.004+0000 7f5eefa00640 1 -- 172.21.15.37:0/605292556 wait complete. 2024-09-21T06:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.005+0000 7f5eefa00640 1 Processor -- start 2024-09-21T06:03:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.005+0000 7f5eefa00640 1 -- start start 2024-09-21T06:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eefa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee810a3c0 0x7f5ee81a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eefa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee810ad10 0x7f5ee81a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eefa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee811d0e0 0x7f5ee81aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eefa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8122910 con 0x7f5ee810a3c0 2024-09-21T06:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eefa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8122790 con 0x7f5ee811d0e0 2024-09-21T06:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eefa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8122a90 con 0x7f5ee810ad10 2024-09-21T06:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eed000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee810a3c0 0x7f5ee81a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eed000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee810a3c0 0x7f5ee81a92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53460/0 (socket says 172.21.15.37:53460) 2024-09-21T06:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eed000640 1 -- 172.21.15.37:0/2620275113 learned_addr learned my addr 172.21.15.37:0/2620275113 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5ee7e00640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee810ad10 0x7f5ee81a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eeda00640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee811d0e0 0x7f5ee81aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eed000640 1 -- 172.21.15.37:0/2620275113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee810ad10 msgr2=0x7f5ee81a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eed000640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee810ad10 0x7f5ee81a9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eed000640 1 -- 172.21.15.37:0/2620275113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee811d0e0 msgr2=0x7f5ee81aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eed000640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee811d0e0 0x7f5ee81aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eed000640 1 -- 172.21.15.37:0/2620275113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee81af210 con 0x7f5ee810a3c0 2024-09-21T06:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.006+0000 7f5eeda00640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee811d0e0 0x7f5ee81aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.007+0000 7f5eed000640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee810a3c0 0x7f5ee81a92a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00e9c0 tx=0x7f5edc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.007+0000 7f5ee5600640 1 -- 172.21.15.37:0/2620275113 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00ccc0 con 0x7f5ee810a3c0 2024-09-21T06:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.007+0000 7f5ee5600640 1 -- 172.21.15.37:0/2620275113 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5edc0035f0 con 0x7f5ee810a3c0 2024-09-21T06:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.007+0000 7f5eefa00640 1 -- 172.21.15.37:0/2620275113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee81af500 con 0x7f5ee810a3c0 2024-09-21T06:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.007+0000 7f5eefa00640 1 -- 172.21.15.37:0/2620275113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee81b5c60 con 0x7f5ee810a3c0 2024-09-21T06:03:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.007+0000 7f5ee5600640 1 -- 172.21.15.37:0/2620275113 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00ce60 con 0x7f5ee810a3c0 2024-09-21T06:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.012+0000 7f5ef66cb740 1 Processor -- start 2024-09-21T06:03:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.012+0000 7f5ef66cb740 1 -- start start 2024-09-21T06:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.013+0000 7f5ef66cb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c96840 0x562cf103e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.013+0000 7f5ef66cb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c6d980 0x562cf103e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.013+0000 7f5ef66cb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c75b60 0x562cf103edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.013+0000 7f5ef66cb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562cf0fb3ca0 con 0x562cf0c75b60 2024-09-21T06:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.013+0000 7f5ef66cb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562cf0fa30d0 con 0x562cf0c6d980 2024-09-21T06:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.013+0000 7f5ef66cb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562cf0fa6ee0 con 0x562cf0c96840 2024-09-21T06:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.013+0000 7f5ee5600640 1 -- 172.21.15.37:0/2620275113 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f5edc0037a0 con 0x7f5ee810a3c0 2024-09-21T06:03:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.013+0000 7f5eeda00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c96840 0x562cf103e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.013+0000 7f5eeda00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c96840 0x562cf103e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:51416/0 (socket says 172.21.15.37:51416) 2024-09-21T06:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.013+0000 7f5eeda00640 1 -- 172.21.15.37:0/359006811 learned_addr learned my addr 172.21.15.37:0/359006811 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.013+0000 7f5eed000640 1 --2- 172.21.15.37:0/359006811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c6d980 0x562cf103e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.013+0000 7f5ee7e00640 1 --2- 172.21.15.37:0/359006811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c75b60 0x562cf103edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.014+0000 7f5eeda00640 1 -- 172.21.15.37:0/359006811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c6d980 msgr2=0x562cf103e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.014+0000 7f5eeda00640 1 --2- 172.21.15.37:0/359006811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c6d980 0x562cf103e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.014+0000 7f5eeda00640 1 -- 172.21.15.37:0/359006811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c75b60 msgr2=0x562cf103edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.014+0000 7f5eeda00640 1 --2- 172.21.15.37:0/359006811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c75b60 0x562cf103edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.014+0000 7f5eeda00640 1 -- 172.21.15.37:0/359006811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cf0f55400 con 0x562cf0c96840 2024-09-21T06:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.014+0000 7f5ee7e00640 1 --2- 172.21.15.37:0/359006811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c75b60 0x562cf103edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.014+0000 7f5eeda00640 1 --2- 172.21.15.37:0/359006811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c96840 0x562cf103e350 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0011810 tx=0x7f5ee0011cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8c14f3f13719409 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.014+0000 7f5eda000640 1 -- 172.21.15.37:0/359006811 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0011310 con 0x562cf0c96840 2024-09-21T06:03:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.015+0000 7f5eda000640 1 -- 172.21.15.37:0/359006811 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ee000f9a0 con 0x562cf0c96840 2024-09-21T06:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.015+0000 7f5eda000640 1 -- 172.21.15.37:0/359006811 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0005670 con 0x562cf0c96840 2024-09-21T06:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.015+0000 7f5ee5600640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5ed00b6590 0x7f5ed00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.016+0000 7f5eed000640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5ed00b6590 0x7f5ed00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.016+0000 7f5ef66cb740 1 -- 172.21.15.37:0/359006811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c96840 msgr2=0x562cf103e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.016+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/359006811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c96840 0x562cf103e350 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0011810 tx=0x7f5ee0011cd0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.016+0000 7f5ee5600640 1 -- 172.21.15.37:0/2620275113 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f5edc0e7ae0 con 0x7f5ee810a3c0 2024-09-21T06:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.016+0000 7f5ef66cb740 1 -- 172.21.15.37:0/359006811 shutdown_connections 2024-09-21T06:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.016+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/359006811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c75b60 0x562cf103edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.016+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/359006811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c6d980 0x562cf103e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.016+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/359006811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c96840 0x562cf103e350 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.016+0000 7f5ef66cb740 1 -- 172.21.15.37:0/359006811 >> 172.21.15.37:0/359006811 conn(0x562cf0c8a990 msgr2=0x562cf103c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.016+0000 7f5ef66cb740 1 -- 172.21.15.37:0/359006811 shutdown_connections 2024-09-21T06:03:51.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.016+0000 7f5ef66cb740 1 -- 172.21.15.37:0/359006811 wait complete. 2024-09-21T06:03:51.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.017+0000 7f5eed000640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5ed00b6590 0x7f5ed00b8aa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009830 tx=0x7f5edc000bc0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:51.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.017+0000 7f5ef66cb740 1 -- start start 2024-09-21T06:03:51.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.017+0000 7f5ef66cb740 1 Processor -- start 2024-09-21T06:03:51.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.018+0000 7f5ef66cb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c6d980 0x562cf1049980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.018+0000 7f5ef66cb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c75b60 0x562cf1049ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.018+0000 7f5ef66cb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c96840 0x562cf104a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.018+0000 7f5ef66cb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562cf0e047a0 con 0x562cf0c6d980 2024-09-21T06:03:51.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.018+0000 7f5ef66cb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562cf0f48a10 con 0x562cf0c96840 2024-09-21T06:03:51.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.018+0000 7f5ef66cb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562cf104cb30 con 0x562cf0c75b60 2024-09-21T06:03:51.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.018+0000 7f5ef66cb740 10 client.0 _ll_register_callbacks cb 0x562cf0f58be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:51.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.018+0000 7f5eeda00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c6d980 0x562cf1049980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.018+0000 7f5eeda00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c6d980 0x562cf1049980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53488/0 (socket says 172.21.15.37:53488) 2024-09-21T06:03:51.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.018+0000 7f5eeda00640 1 -- 172.21.15.37:0/4259011834 learned_addr learned my addr 172.21.15.37:0/4259011834 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:51.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.019+0000 7f5eeda00640 1 --2- 172.21.15.37:0/4259011834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c96840 0x562cf104a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.019+0000 7f5ee7e00640 1 --2- 172.21.15.37:0/4259011834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c75b60 0x562cf1049ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.019+0000 7f5eeda00640 1 -- 172.21.15.37:0/4259011834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c75b60 msgr2=0x562cf1049ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:51.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.019+0000 7f5eeda00640 1 --2- 172.21.15.37:0/4259011834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c75b60 0x562cf1049ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.019+0000 7f5eeda00640 1 -- 172.21.15.37:0/4259011834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c96840 msgr2=0x562cf104a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:51.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.019+0000 7f5eeda00640 1 --2- 172.21.15.37:0/4259011834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c96840 0x562cf104a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.019+0000 7f5eeda00640 1 -- 172.21.15.37:0/4259011834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cf0d10b90 con 0x562cf0c6d980 2024-09-21T06:03:51.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.019+0000 7f5eeda00640 1 --2- 172.21.15.37:0/4259011834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c6d980 0x562cf1049980 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0011550 tx=0x7f5ee0005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58b5e17ab71f04a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:51.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.019+0000 7f5ecea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T06:03:51.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.020+0000 7f5ecea00640 1 -- 172.21.15.37:0/4259011834 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee002e060 con 0x562cf0c6d980 2024-09-21T06:03:51.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.020+0000 7f5ecea00640 1 -- 172.21.15.37:0/4259011834 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f5ee00053d0 con 0x562cf0c6d980 2024-09-21T06:03:51.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.020+0000 7f5ef66cb740 1 -- 172.21.15.37:0/4259011834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ee000f9a0 con 0x562cf0c6d980 2024-09-21T06:03:51.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.020+0000 7f5ecea00640 1 -- 172.21.15.37:0/4259011834 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5ee0035050 con 0x562cf0c6d980 2024-09-21T06:03:51.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.020+0000 7f5ef66cb740 10 client.15744 fetch_fsmap learned FSMap version 21 2024-09-21T06:03:51.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.020+0000 7f5ef66cb740 1 -- 172.21.15.37:0/4259011834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562cf10587a0 con 0x562cf0c6d980 2024-09-21T06:03:51.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.021+0000 7f5ecea00640 1 -- 172.21.15.37:0/4259011834 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ee000f9a0 con 0x562cf0c6d980 2024-09-21T06:03:51.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.021+0000 7f5ecea00640 1 -- 172.21.15.37:0/4259011834 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5ee0018070 con 0x562cf0c6d980 2024-09-21T06:03:51.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.021+0000 7f5ef66cb740 10 client.15744 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:03:51.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.021+0000 7f5ef66cb740 10 client.15744 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:03:51.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.021+0000 7f5ef66cb740 20 client.15744 populate_metadata read hostname 'smithi037' 2024-09-21T06:03:51.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.022+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/4259011834 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562cf0c551c0 0x562cf105bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.022+0000 7f5ef66cb740 4 client.15744 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:03:51.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.022+0000 7f5ef66cb740 1 -- 172.21.15.37:0/4259011834 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cf0fb5bf0 con 0x562cf0c551c0 2024-09-21T06:03:51.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.022+0000 7f5ee7e00640 1 --2- 172.21.15.37:0/4259011834 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562cf0c551c0 0x562cf105bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.022+0000 7f5ee7e00640 1 --2- 172.21.15.37:0/4259011834 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562cf0c551c0 0x562cf105bbb0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f2640abd4288063 server_cookie=2260b218eb16ab24 in_seq=0 out_seq=0 2024-09-21T06:03:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.022+0000 7f5ecea00640 10 client.15744 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:03:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.023+0000 7f5ecea00640 1 -- 172.21.15.37:0/4259011834 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562cf0fb5bf0 con 0x562cf0c551c0 2024-09-21T06:03:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.023+0000 7f5ecea00640 10 client.15744 handle_command_reply: tid=0 2024-09-21T06:03:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.023+0000 7f5ef66cb740 1 client.15744 shutdown 2024-09-21T06:03:51.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.023+0000 7f5ef66cb740 1 -- 172.21.15.37:0/4259011834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c6d980 msgr2=0x562cf1049980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:51.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.023+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/4259011834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c6d980 0x562cf1049980 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0011550 tx=0x7f5ee0005230 comp rx=0 tx=0).stop 2024-09-21T06:03:51.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.024+0000 7f5ef66cb740 1 -- 172.21.15.37:0/4259011834 shutdown_connections 2024-09-21T06:03:51.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.024+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/4259011834 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562cf0c551c0 0x562cf105bbb0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.024+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/4259011834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c96840 0x562cf104a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.024+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/4259011834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c75b60 0x562cf1049ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.024+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/4259011834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c6d980 0x562cf1049980 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.024+0000 7f5ef66cb740 1 -- 172.21.15.37:0/4259011834 >> 172.21.15.37:0/4259011834 conn(0x562cf0c8a990 msgr2=0x562cf103a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.024+0000 7f5ecea00640 0 client.15744 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:03:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.024+0000 7f5ef66cb740 1 -- 172.21.15.37:0/4259011834 shutdown_connections 2024-09-21T06:03:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.024+0000 7f5ef66cb740 1 -- 172.21.15.37:0/4259011834 wait complete. 2024-09-21T06:03:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.024+0000 7f5ef66cb740 20 client.15744 trim_cache size 0 max 16384 2024-09-21T06:03:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.043+0000 7f5ef66cb740 1 Processor -- start 2024-09-21T06:03:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.043+0000 7f5ef66cb740 1 -- start start 2024-09-21T06:03:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.044+0000 7f5ef66cb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c6d980 0x562cf104b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.044+0000 7f5ef66cb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c75b60 0x562cf103b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.044+0000 7f5ef66cb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c96840 0x562cf103bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.044+0000 7f5ef66cb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81bdab0 con 0x562cf0c96840 2024-09-21T06:03:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.044+0000 7f5ef66cb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81c0330 con 0x562cf0c75b60 2024-09-21T06:03:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.044+0000 7f5ef66cb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81be120 con 0x562cf0c6d980 2024-09-21T06:03:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.044+0000 7f5ee7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c75b60 0x562cf103b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.044+0000 7f5eeda00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c6d980 0x562cf104b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.044+0000 7f5ee7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c75b60 0x562cf103b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:60660/0 (socket says 172.21.15.37:60660) 2024-09-21T06:03:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.044+0000 7f5ee7e00640 1 -- 172.21.15.37:0/3758892738 learned_addr learned my addr 172.21.15.37:0/3758892738 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.045+0000 7f5eeda00640 1 --2- 172.21.15.37:0/3758892738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c96840 0x562cf103bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.045+0000 7f5ee7e00640 1 -- 172.21.15.37:0/3758892738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c6d980 msgr2=0x562cf104b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.045+0000 7f5ee7e00640 1 --2- 172.21.15.37:0/3758892738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c6d980 0x562cf104b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.045+0000 7f5ee7e00640 1 -- 172.21.15.37:0/3758892738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c96840 msgr2=0x562cf103bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.045+0000 7f5ee7e00640 1 --2- 172.21.15.37:0/3758892738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c96840 0x562cf103bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.045+0000 7f5ee7e00640 1 -- 172.21.15.37:0/3758892738 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cf1037c50 con 0x562cf0c75b60 2024-09-21T06:03:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.045+0000 7f5eeda00640 1 --2- 172.21.15.37:0/3758892738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c96840 0x562cf103bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:03:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.045+0000 7f5ee7e00640 1 --2- 172.21.15.37:0/3758892738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c75b60 0x562cf103b9b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4031440 tx=0x7f5ed4005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee54e92458122f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.046+0000 7f5ed9600640 1 -- 172.21.15.37:0/3758892738 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4048020 con 0x562cf0c75b60 2024-09-21T06:03:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.046+0000 7f5ed9600640 1 -- 172.21.15.37:0/3758892738 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ed40043a0 con 0x562cf0c75b60 2024-09-21T06:03:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.046+0000 7f5ed9600640 1 -- 172.21.15.37:0/3758892738 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4035040 con 0x562cf0c75b60 2024-09-21T06:03:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.047+0000 7f5ef66cb740 1 -- 172.21.15.37:0/3758892738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c75b60 msgr2=0x562cf103b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.047+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/3758892738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c75b60 0x562cf103b9b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4031440 tx=0x7f5ed4005a20 comp rx=0 tx=0).stop 2024-09-21T06:03:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.047+0000 7f5ef66cb740 1 -- 172.21.15.37:0/3758892738 shutdown_connections 2024-09-21T06:03:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.047+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/3758892738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c96840 0x562cf103bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.047+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/3758892738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c75b60 0x562cf103b9b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.047+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/3758892738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c6d980 0x562cf104b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.047+0000 7f5ef66cb740 1 -- 172.21.15.37:0/3758892738 >> 172.21.15.37:0/3758892738 conn(0x562cf0c8a990 msgr2=0x562cf103f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:51.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.047+0000 7f5ef66cb740 1 -- 172.21.15.37:0/3758892738 shutdown_connections 2024-09-21T06:03:51.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.047+0000 7f5ef66cb740 1 -- 172.21.15.37:0/3758892738 wait complete. 2024-09-21T06:03:51.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.048+0000 7f5ef66cb740 1 -- start start 2024-09-21T06:03:51.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.048+0000 7f5ef66cb740 1 Processor -- start 2024-09-21T06:03:51.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.048+0000 7f5ef66cb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c6d980 0x562cf104de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.048+0000 7f5ef66cb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c75b60 0x562cf104e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.048+0000 7f5ef66cb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c96840 0x562cf104e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.048+0000 7f5ef66cb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81be7f0 con 0x562cf0c96840 2024-09-21T06:03:51.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.048+0000 7f5ef66cb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81bfc60 con 0x562cf0c6d980 2024-09-21T06:03:51.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.048+0000 7f5ef66cb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81beec0 con 0x562cf0c75b60 2024-09-21T06:03:51.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.049+0000 7f5ef66cb740 10 client.0 _ll_register_callbacks cb 0x7f5edc0ed3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:03:51.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.049+0000 7f5eeda00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c6d980 0x562cf104de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.049+0000 7f5eeda00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c96840 0x562cf104e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.049+0000 7f5eeda00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c96840 0x562cf104e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53498/0 (socket says 172.21.15.37:53498) 2024-09-21T06:03:51.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.049+0000 7f5eeda00640 1 -- 172.21.15.37:0/699643209 learned_addr learned my addr 172.21.15.37:0/699643209 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:03:51.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.049+0000 7f5eeda00640 1 -- 172.21.15.37:0/699643209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c75b60 msgr2=0x562cf104e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:51.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.049+0000 7f5eeda00640 1 --2- 172.21.15.37:0/699643209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c75b60 0x562cf104e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.049+0000 7f5eeda00640 1 -- 172.21.15.37:0/699643209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c6d980 msgr2=0x562cf104de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:03:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.049+0000 7f5eeda00640 1 --2- 172.21.15.37:0/699643209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c6d980 0x562cf104de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.049+0000 7f5eeda00640 1 -- 172.21.15.37:0/699643209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cf10c5430 con 0x562cf0c96840 2024-09-21T06:03:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.050+0000 7f5eeda00640 1 --2- 172.21.15.37:0/699643209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c96840 0x562cf104e8c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0002230 tx=0x7f5ee000fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a33aadd43873b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.050+0000 7f5ecea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T06:03:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.051+0000 7f5ecea00640 1 -- 172.21.15.37:0/699643209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee002e070 con 0x562cf0c96840 2024-09-21T06:03:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.051+0000 7f5ecea00640 1 -- 172.21.15.37:0/699643209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f5ee0003b70 con 0x562cf0c96840 2024-09-21T06:03:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.051+0000 7f5ef66cb740 1 -- 172.21.15.37:0/699643209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ed40043a0 con 0x562cf0c96840 2024-09-21T06:03:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.051+0000 7f5ecea00640 1 -- 172.21.15.37:0/699643209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5ee000f790 con 0x562cf0c96840 2024-09-21T06:03:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.051+0000 7f5ef66cb740 10 client.15750 fetch_fsmap learned FSMap version 21 2024-09-21T06:03:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.051+0000 7f5ef66cb740 1 -- 172.21.15.37:0/699643209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562cf10c6600 con 0x562cf0c96840 2024-09-21T06:03:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.051+0000 7f5ecea00640 1 -- 172.21.15.37:0/699643209 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ed40043a0 con 0x562cf0c96840 2024-09-21T06:03:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.052+0000 7f5ecea00640 1 -- 172.21.15.37:0/699643209 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5ee0018040 con 0x562cf0c96840 2024-09-21T06:03:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.052+0000 7f5ef66cb740 10 client.15750 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:03:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.052+0000 7f5ef66cb740 10 client.15750 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:03:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.052+0000 7f5ef66cb740 20 client.15750 populate_metadata read hostname 'smithi037' 2024-09-21T06:03:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.052+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/699643209 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562cf0c2a570 0x562cf10c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.052+0000 7f5ef66cb740 4 client.15750 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-21T06:03:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.052+0000 7f5ef66cb740 1 -- 172.21.15.37:0/699643209 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x562cf0fb16a0 con 0x562cf0c2a570 2024-09-21T06:03:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.052+0000 7f5ee7e00640 1 --2- 172.21.15.37:0/699643209 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562cf0c2a570 0x562cf10c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.053+0000 7f5ecea00640 10 client.15750 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:03:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:51.053+0000 7f5ee7e00640 1 --2- 172.21.15.37:0/699643209 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562cf0c2a570 0x562cf10c8c80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67e5bc2f97b6670c server_cookie=15d473db06b2e659 in_seq=0 out_seq=0 2024-09-21T06:03:51.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:51 smithi144 ceph-mon[34351]: pgmap v712: 129 pgs: 129 active+clean; 148 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 130 KiB/s wr, 53 op/s 2024-09-21T06:03:51.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:51 smithi037 ceph-mon[30631]: pgmap v712: 129 pgs: 129 active+clean; 148 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 130 KiB/s wr, 53 op/s 2024-09-21T06:03:51.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:51 smithi067 ceph-mon[34443]: pgmap v712: 129 pgs: 129 active+clean; 148 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 130 KiB/s wr, 53 op/s 2024-09-21T06:03:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.001+0000 7f5ecea00640 1 -- 172.21.15.37:0/699643209 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562cf0fb16a0 con 0x562cf0c2a570 2024-09-21T06:03:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.001+0000 7f5ecea00640 10 client.15750 handle_command_reply: tid=0 2024-09-21T06:03:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.001+0000 7f5ef66cb740 1 client.15750 shutdown 2024-09-21T06:03:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.001+0000 7f5ef66cb740 1 -- 172.21.15.37:0/699643209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c96840 msgr2=0x562cf104e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.001+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/699643209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c96840 0x562cf104e8c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0002230 tx=0x7f5ee000fee0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.001+0000 7f5ef66cb740 1 -- 172.21.15.37:0/699643209 shutdown_connections 2024-09-21T06:03:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.001+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/699643209 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x562cf0c2a570 0x562cf10c8c80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.001+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/699643209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cf0c96840 0x562cf104e8c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.001+0000 7f5ecea00640 0 client.15750 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:03:52.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.001+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/699643209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf0c75b60 0x562cf104e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.001+0000 7f5ef66cb740 1 --2- 172.21.15.37:0/699643209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562cf0c6d980 0x562cf104de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.001+0000 7f5ef66cb740 1 -- 172.21.15.37:0/699643209 >> 172.21.15.37:0/699643209 conn(0x562cf0c8a990 msgr2=0x562cf1054d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:52.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.002+0000 7f5ef66cb740 1 -- 172.21.15.37:0/699643209 shutdown_connections 2024-09-21T06:03:52.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.002+0000 7f5ef66cb740 1 -- 172.21.15.37:0/699643209 wait complete. 2024-09-21T06:03:52.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.002+0000 7f5ef66cb740 20 client.15750 trim_cache size 0 max 16384 2024-09-21T06:03:52.005 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:03:52.005 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T06:03:52.005 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T06:03:52.006 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 42, 2024-09-21T06:03:52.006 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T06:03:52.006 INFO:teuthology.orchestra.run.smithi037.stdout: "192ba68e": { 2024-09-21T06:03:52.006 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 42, 2024-09-21T06:03:52.006 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T06:03:52.006 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:03:52.006 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T06:03:52.006 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:03:52.006 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:03:52.006 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T06:03:52.006 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 144.5, 2024-09-21T06:03:52.006 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T06:03:52.006 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T06:03:52.007 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T06:03:52.007 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:03:52.007 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-21T06:03:52.007 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:03:52.007 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:52.007 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:52.007 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:52.007 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:52.007 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:03:52.007 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:03:52.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.003+0000 7f5eefa00640 1 -- 172.21.15.37:0/2620275113 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5ed00b6590 msgr2=0x7f5ed00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:52.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.003+0000 7f5eefa00640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5ed00b6590 0x7f5ed00b8aa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009830 tx=0x7f5edc000bc0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.003+0000 7f5eefa00640 1 -- 172.21.15.37:0/2620275113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee810a3c0 msgr2=0x7f5ee81a92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:52.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.003+0000 7f5eefa00640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee810a3c0 0x7f5ee81a92a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00e9c0 tx=0x7f5edc00edc0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.003+0000 7f5eefa00640 1 -- 172.21.15.37:0/2620275113 shutdown_connections 2024-09-21T06:03:52.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.003+0000 7f5eefa00640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f5ed00b6590 0x7f5ed00b8aa0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.003+0000 7f5eefa00640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee811d0e0 0x7f5ee81aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.003+0000 7f5eefa00640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee810ad10 0x7f5ee81a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.003+0000 7f5eefa00640 1 --2- 172.21.15.37:0/2620275113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ee810a3c0 0x7f5ee81a92a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.003+0000 7f5eefa00640 1 -- 172.21.15.37:0/2620275113 >> 172.21.15.37:0/2620275113 conn(0x7f5ee8070e80 msgr2=0x7f5ee8071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:52.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.003+0000 7f5eefa00640 1 -- 172.21.15.37:0/2620275113 shutdown_connections 2024-09-21T06:03:52.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:03:52.003+0000 7f5eefa00640 1 -- 172.21.15.37:0/2620275113 wait complete. 2024-09-21T06:03:52.842 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '192ba68e', quiesce took 5.7 seconds. Will release after: 18.8 2024-09-21T06:03:53.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:53 smithi144 ceph-mon[34351]: pgmap v713: 129 pgs: 129 active+clean; 157 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 305 KiB/s wr, 122 op/s 2024-09-21T06:03:53.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:53 smithi037 ceph-mon[30631]: pgmap v713: 129 pgs: 129 active+clean; 157 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 305 KiB/s wr, 122 op/s 2024-09-21T06:03:53.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:53 smithi067 ceph-mon[34443]: pgmap v713: 129 pgs: 129 active+clean; 157 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 305 KiB/s wr, 122 op/s 2024-09-21T06:03:55.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:55 smithi144 ceph-mon[34351]: pgmap v714: 129 pgs: 129 active+clean; 160 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 343 KiB/s wr, 133 op/s 2024-09-21T06:03:55.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:55 smithi037 ceph-mon[30631]: pgmap v714: 129 pgs: 129 active+clean; 160 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 343 KiB/s wr, 133 op/s 2024-09-21T06:03:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:55 smithi067 ceph-mon[34443]: pgmap v714: 129 pgs: 129 active+clean; 160 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 343 KiB/s wr, 133 op/s 2024-09-21T06:03:57.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:57 smithi144 ceph-mon[34351]: pgmap v715: 129 pgs: 129 active+clean; 158 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 367 KiB/s wr, 143 op/s 2024-09-21T06:03:57.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:57 smithi037 ceph-mon[30631]: pgmap v715: 129 pgs: 129 active+clean; 158 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 367 KiB/s wr, 143 op/s 2024-09-21T06:03:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:57 smithi067 ceph-mon[34443]: pgmap v715: 129 pgs: 129 active+clean; 158 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 367 KiB/s wr, 143 op/s 2024-09-21T06:03:59.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:03:59 smithi144 ceph-mon[34351]: pgmap v716: 129 pgs: 129 active+clean; 158 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 367 KiB/s wr, 142 op/s 2024-09-21T06:03:59.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:03:59 smithi037 ceph-mon[30631]: pgmap v716: 129 pgs: 129 active+clean; 158 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 367 KiB/s wr, 142 op/s 2024-09-21T06:03:59.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:03:59 smithi067 ceph-mon[34443]: pgmap v716: 129 pgs: 129 active+clean; 158 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 367 KiB/s wr, 142 op/s 2024-09-21T06:04:01.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:01 smithi144 ceph-mon[34351]: pgmap v717: 129 pgs: 129 active+clean; 158 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 340 KiB/s wr, 130 op/s 2024-09-21T06:04:01.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:01 smithi037 ceph-mon[30631]: pgmap v717: 129 pgs: 129 active+clean; 158 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 340 KiB/s wr, 130 op/s 2024-09-21T06:04:01.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:01 smithi067 ceph-mon[34443]: pgmap v717: 129 pgs: 129 active+clean; 158 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 340 KiB/s wr, 130 op/s 2024-09-21T06:04:03.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:03 smithi144 ceph-mon[34351]: pgmap v718: 129 pgs: 129 active+clean; 158 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 238 KiB/s wr, 92 op/s 2024-09-21T06:04:03.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:03 smithi037 ceph-mon[30631]: pgmap v718: 129 pgs: 129 active+clean; 158 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 238 KiB/s wr, 92 op/s 2024-09-21T06:04:03.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:03 smithi067 ceph-mon[34443]: pgmap v718: 129 pgs: 129 active+clean; 158 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 238 KiB/s wr, 92 op/s 2024-09-21T06:04:05.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:05 smithi144 ceph-mon[34351]: pgmap v719: 129 pgs: 129 active+clean; 163 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 73 KiB/s wr, 23 op/s 2024-09-21T06:04:05.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:05 smithi037 ceph-mon[30631]: pgmap v719: 129 pgs: 129 active+clean; 163 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 73 KiB/s wr, 23 op/s 2024-09-21T06:04:05.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:05 smithi067 ceph-mon[34443]: pgmap v719: 129 pgs: 129 active+clean; 163 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 73 KiB/s wr, 23 op/s 2024-09-21T06:04:07.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:07 smithi144 ceph-mon[34351]: pgmap v720: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-21T06:04:07.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:07 smithi037 ceph-mon[30631]: pgmap v720: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-21T06:04:07.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:07 smithi067 ceph-mon[34443]: pgmap v720: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-21T06:04:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:09 smithi144 ceph-mon[34351]: pgmap v721: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 28 KiB/s wr, 2 op/s 2024-09-21T06:04:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:09.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:09.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:09 smithi037 ceph-mon[30631]: pgmap v721: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 28 KiB/s wr, 2 op/s 2024-09-21T06:04:09.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:09.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:09.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:09.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:09.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:09.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:09 smithi067 ceph-mon[34443]: pgmap v721: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 28 KiB/s wr, 2 op/s 2024-09-21T06:04:09.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:09.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:09.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:09.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:09.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:10.872 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:10.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:10.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:10.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:10.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:10.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:10.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:10.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:10.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:04:11.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:04:11.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:11 smithi037 ceph-mon[30631]: pgmap v722: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 28 KiB/s wr, 2 op/s 2024-09-21T06:04:11.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:11 smithi067 ceph-mon[34443]: pgmap v722: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 28 KiB/s wr, 2 op/s 2024-09-21T06:04:12.037 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:12.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:11 smithi144 ceph-mon[34351]: pgmap v722: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 28 KiB/s wr, 2 op/s 2024-09-21T06:04:12.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.818+0000 7fe006800640 1 -- 172.21.15.37:0/2888988447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe000114740 msgr2=0x7fe000116b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:12.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.818+0000 7fe006800640 1 --2- 172.21.15.37:0/2888988447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe000114740 0x7fe000116b60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009ca0 tx=0x7fdff802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:04:12.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.818+0000 7fe006800640 1 -- 172.21.15.37:0/2888988447 shutdown_connections 2024-09-21T06:04:12.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.818+0000 7fe006800640 1 --2- 172.21.15.37:0/2888988447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe000114740 0x7fe000116b60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:12.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.818+0000 7fe006800640 1 --2- 172.21.15.37:0/2888988447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe000078290 0x7fe000114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:12.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.818+0000 7fe006800640 1 --2- 172.21.15.37:0/2888988447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077940 0x7fe000077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:12.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.818+0000 7fe006800640 1 -- 172.21.15.37:0/2888988447 >> 172.21.15.37:0/2888988447 conn(0x7fe000101810 msgr2=0x7fe000103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:12.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.818+0000 7fe006800640 1 -- 172.21.15.37:0/2888988447 shutdown_connections 2024-09-21T06:04:12.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.818+0000 7fe006800640 1 -- 172.21.15.37:0/2888988447 wait complete. 2024-09-21T06:04:12.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.819+0000 7fe006800640 1 Processor -- start 2024-09-21T06:04:12.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.819+0000 7fe006800640 1 -- start start 2024-09-21T06:04:12.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.820+0000 7fe006800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077940 0x7fe0001a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:12.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.820+0000 7fe006800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe000078290 0x7fe0001a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:12.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.820+0000 7fe006800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe000114740 0x7fe0001a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:12.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.820+0000 7fe006800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe00011a0b0 con 0x7fe000078290 2024-09-21T06:04:12.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.820+0000 7fe006800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe000119f30 con 0x7fe000077940 2024-09-21T06:04:12.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.820+0000 7fe006800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe00011a230 con 0x7fe000114740 2024-09-21T06:04:12.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.820+0000 7fdff6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe000078290 0x7fe0001a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:12.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.820+0000 7fdff6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe000078290 0x7fe0001a0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53748/0 (socket says 172.21.15.37:53748) 2024-09-21T06:04:12.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.820+0000 7fdff6a00640 1 -- 172.21.15.37:0/2198865247 learned_addr learned my addr 172.21.15.37:0/2198865247 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:12.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.820+0000 7fdfff400640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077940 0x7fe0001a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.820+0000 7fdff6a00640 1 -- 172.21.15.37:0/2198865247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe000114740 msgr2=0x7fe0001a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.820+0000 7fdfffe00640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe000114740 0x7fe0001a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.820+0000 7fdff6a00640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe000114740 0x7fe0001a6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.821+0000 7fdff6a00640 1 -- 172.21.15.37:0/2198865247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077940 msgr2=0x7fe0001a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.821+0000 7fdff6a00640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077940 0x7fe0001a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.821+0000 7fdff6a00640 1 -- 172.21.15.37:0/2198865247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0001a69b0 con 0x7fe000078290 2024-09-21T06:04:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.821+0000 7fdff6a00640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe000078290 0x7fe0001a0fe0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800d950 tx=0x7fdfe800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.821+0000 7fdffcc00640 1 -- 172.21.15.37:0/2198865247 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8017070 con 0x7fe000078290 2024-09-21T06:04:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.821+0000 7fdffcc00640 1 -- 172.21.15.37:0/2198865247 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfe8009c30 con 0x7fe000078290 2024-09-21T06:04:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.821+0000 7fdffcc00640 1 -- 172.21.15.37:0/2198865247 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe80047a0 con 0x7fe000078290 2024-09-21T06:04:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.821+0000 7fe006800640 1 -- 172.21.15.37:0/2198865247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0001a6ca0 con 0x7fe000078290 2024-09-21T06:04:12.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.821+0000 7fe006800640 1 -- 172.21.15.37:0/2198865247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0001ad400 con 0x7fe000078290 2024-09-21T06:04:12.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.823+0000 7fe006800640 1 -- 172.21.15.37:0/2198865247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe000077d50 con 0x7fe000078290 2024-09-21T06:04:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.825+0000 7fdffcc00640 1 -- 172.21.15.37:0/2198865247 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fdfe8004020 con 0x7fe000078290 2024-09-21T06:04:12.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.827+0000 7fdffcc00640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdfe40b6510 0x7fdfe40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.827+0000 7fdffcc00640 1 -- 172.21.15.37:0/2198865247 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fdfe80e77c0 con 0x7fe000078290 2024-09-21T06:04:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.828+0000 7fdfff400640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdfe40b6510 0x7fdfe40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.828+0000 7fdfff400640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdfe40b6510 0x7fdfe40b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009bd0 tx=0x7fdff0005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:12.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:12.829+0000 7fdffcc00640 1 -- 172.21.15.37:0/2198865247 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdfe8020020 con 0x7fe000078290 2024-09-21T06:04:13.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.066+0000 7fe006800640 1 -- 172.21.15.37:0/2198865247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe00002e640 con 0x7fe000078290 2024-09-21T06:04:13.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.067+0000 7fdffcc00640 1 -- 172.21.15.37:0/2198865247 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7fdfe80adc20 con 0x7fe000078290 2024-09-21T06:04:13.070 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:04:13.070 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T06:04:13.071 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T06:04:13.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.070+0000 7fe006800640 1 -- 172.21.15.37:0/2198865247 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdfe40b6510 msgr2=0x7fdfe40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:13.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.070+0000 7fe006800640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdfe40b6510 0x7fdfe40b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009bd0 tx=0x7fdff0005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:13.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.070+0000 7fe006800640 1 -- 172.21.15.37:0/2198865247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe000078290 msgr2=0x7fe0001a0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:13.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.070+0000 7fe006800640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe000078290 0x7fe0001a0fe0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800d950 tx=0x7fdfe800de10 comp rx=0 tx=0).stop 2024-09-21T06:04:13.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.070+0000 7fe006800640 1 -- 172.21.15.37:0/2198865247 shutdown_connections 2024-09-21T06:04:13.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.070+0000 7fe006800640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe000114740 0x7fe0001a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:13.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.070+0000 7fe006800640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe000078290 0x7fe0001a0fe0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:13.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.070+0000 7fe006800640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fdfe40b6510 0x7fdfe40b8a20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:13.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.070+0000 7fe006800640 1 --2- 172.21.15.37:0/2198865247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077940 0x7fe0001a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:13.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.070+0000 7fe006800640 1 -- 172.21.15.37:0/2198865247 >> 172.21.15.37:0/2198865247 conn(0x7fe000101810 msgr2=0x7fe000116780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:13.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.071+0000 7fe006800640 1 -- 172.21.15.37:0/2198865247 shutdown_connections 2024-09-21T06:04:13.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:13.071+0000 7fe006800640 1 -- 172.21.15.37:0/2198865247 wait complete. 2024-09-21T06:04:13.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:13 smithi037 ceph-mon[30631]: pgmap v723: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 28 KiB/s wr, 3 op/s 2024-09-21T06:04:13.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:13 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2198865247' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:13.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:13 smithi067 ceph-mon[34443]: pgmap v723: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 28 KiB/s wr, 3 op/s 2024-09-21T06:04:13.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:13 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2198865247' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:14.065 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db --set-id 192ba68e --release --await' 2024-09-21T06:04:14.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db --set-id 192ba68e --release --await 2024-09-21T06:04:14.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:13 smithi144 ceph-mon[34351]: pgmap v723: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 28 KiB/s wr, 3 op/s 2024-09-21T06:04:14.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:13 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2198865247' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.225+0000 7f6a12e00640 1 -- 172.21.15.37:0/273763925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c109df0 msgr2=0x7f6a0c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.225+0000 7f6a12e00640 1 --2- 172.21.15.37:0/273763925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c109df0 0x7f6a0c110620 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009ca0 tx=0x7f6a0402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.225+0000 7f6a12e00640 1 -- 172.21.15.37:0/273763925 shutdown_connections 2024-09-21T06:04:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.225+0000 7f6a12e00640 1 --2- 172.21.15.37:0/273763925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c109df0 0x7f6a0c110620 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.225+0000 7f6a12e00640 1 --2- 172.21.15.37:0/273763925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c1094a0 0x7f6a0c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.225+0000 7f6a12e00640 1 --2- 172.21.15.37:0/273763925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a0c103b60 0x7f6a0c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.225+0000 7f6a12e00640 1 -- 172.21.15.37:0/273763925 >> 172.21.15.37:0/273763925 conn(0x7f6a0c07b850 msgr2=0x7f6a0c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.225+0000 7f6a12e00640 1 -- 172.21.15.37:0/273763925 shutdown_connections 2024-09-21T06:04:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.225+0000 7f6a12e00640 1 -- 172.21.15.37:0/273763925 wait complete. 2024-09-21T06:04:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.226+0000 7f6a12e00640 1 Processor -- start 2024-09-21T06:04:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.226+0000 7f6a12e00640 1 -- start start 2024-09-21T06:04:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.227+0000 7f6a12e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a0c103b60 0x7f6a0c19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.227+0000 7f6a12e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c1094a0 0x7f6a0c19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.227+0000 7f6a12e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c109df0 0x7f6a0c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.227+0000 7f6a12e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c113ab0 con 0x7f6a0c109df0 2024-09-21T06:04:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.227+0000 7f6a12e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c113930 con 0x7f6a0c103b60 2024-09-21T06:04:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.227+0000 7f6a12e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c113c30 con 0x7f6a0c1094a0 2024-09-21T06:04:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.227+0000 7f6a10e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c109df0 0x7f6a0c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.227+0000 7f6a10e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c109df0 0x7f6a0c19fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53760/0 (socket says 172.21.15.37:53760) 2024-09-21T06:04:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.227+0000 7f6a0be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a0c103b60 0x7f6a0c19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.227+0000 7f6a10e00640 1 -- 172.21.15.37:0/2622872072 learned_addr learned my addr 172.21.15.37:0/2622872072 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.227+0000 7f6a03400640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c1094a0 0x7f6a0c19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.228+0000 7f6a0be00640 1 -- 172.21.15.37:0/2622872072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c1094a0 msgr2=0x7f6a0c19a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.228+0000 7f6a0be00640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c1094a0 0x7f6a0c19a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.228+0000 7f6a0be00640 1 -- 172.21.15.37:0/2622872072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c109df0 msgr2=0x7f6a0c19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.228+0000 7f6a0be00640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c109df0 0x7f6a0c19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.228+0000 7f6a0be00640 1 -- 172.21.15.37:0/2622872072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c1a0370 con 0x7f6a0c103b60 2024-09-21T06:04:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.228+0000 7f6a10e00640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c109df0 0x7f6a0c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.228+0000 7f6a0be00640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a0c103b60 0x7f6a0c19a400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e9f0 tx=0x7f69fc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.228+0000 7f6a09600640 1 -- 172.21.15.37:0/2622872072 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00ccc0 con 0x7f6a0c103b60 2024-09-21T06:04:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.228+0000 7f6a12e00640 1 -- 172.21.15.37:0/2622872072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0c1a0660 con 0x7f6a0c103b60 2024-09-21T06:04:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.229+0000 7f6a09600640 1 -- 172.21.15.37:0/2622872072 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69fc0108e0 con 0x7f6a0c103b60 2024-09-21T06:04:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.229+0000 7f6a12e00640 1 -- 172.21.15.37:0/2622872072 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0c1a6dc0 con 0x7f6a0c103b60 2024-09-21T06:04:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.229+0000 7f6a09600640 1 -- 172.21.15.37:0/2622872072 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc018750 con 0x7f6a0c103b60 2024-09-21T06:04:15.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.232+0000 7f6a19aa1740 1 Processor -- start 2024-09-21T06:04:15.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.232+0000 7f6a19aa1740 1 -- start start 2024-09-21T06:04:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.232+0000 7f6a19aa1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943f1c520 0x5579442c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.232+0000 7f6a19aa1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442c3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.232+0000 7f6a09600640 1 -- 172.21.15.37:0/2622872072 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f69fc010430 con 0x7f6a0c103b60 2024-09-21T06:04:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.232+0000 7f6a19aa1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943efb840 0x5579442c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.232+0000 7f6a19aa1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55794423a290 con 0x557943ef3660 2024-09-21T06:04:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.232+0000 7f6a19aa1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5579442296c0 con 0x557943efb840 2024-09-21T06:04:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.232+0000 7f6a19aa1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55794422d4d0 con 0x557943f1c520 2024-09-21T06:04:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.233+0000 7f6a0be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.233+0000 7f6a0be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442c3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53774/0 (socket says 172.21.15.37:53774) 2024-09-21T06:04:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.233+0000 7f6a0be00640 1 -- 172.21.15.37:0/3729592637 learned_addr learned my addr 172.21.15.37:0/3729592637 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.233+0000 7f6a10e00640 1 --2- 172.21.15.37:0/3729592637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943f1c520 0x5579442c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.233+0000 7f6a03400640 1 --2- 172.21.15.37:0/3729592637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943efb840 0x5579442c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.233+0000 7f6a0be00640 1 -- 172.21.15.37:0/3729592637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943f1c520 msgr2=0x5579442c31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.233+0000 7f6a0be00640 1 --2- 172.21.15.37:0/3729592637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943f1c520 0x5579442c31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.233+0000 7f6a0be00640 1 -- 172.21.15.37:0/3729592637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943efb840 msgr2=0x5579442c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.233+0000 7f6a0be00640 1 --2- 172.21.15.37:0/3729592637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943efb840 0x5579442c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.233+0000 7f6a0be00640 1 -- 172.21.15.37:0/3729592637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579441b6460 con 0x557943ef3660 2024-09-21T06:04:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.233+0000 7f6a03400640 1 --2- 172.21.15.37:0/3729592637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943efb840 0x5579442c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:15.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.234+0000 7f6a0be00640 1 --2- 172.21.15.37:0/3729592637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442c3700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0edc50 tx=0x7f69fc0ef670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b56b3ac6524421 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:15.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.234+0000 7f6a01600640 1 -- 172.21.15.37:0/3729592637 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0f6070 con 0x557943ef3660 2024-09-21T06:04:15.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.234+0000 7f6a01600640 1 -- 172.21.15.37:0/3729592637 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69fc0f2ad0 con 0x557943ef3660 2024-09-21T06:04:15.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.234+0000 7f6a01600640 1 -- 172.21.15.37:0/3729592637 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0f1920 con 0x557943ef3660 2024-09-21T06:04:15.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.234+0000 7f6a09600640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f69f00b6590 0x7f69f00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.235+0000 7f6a09600640 1 -- 172.21.15.37:0/2622872072 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f69fc0e79f0 con 0x7f6a0c103b60 2024-09-21T06:04:15.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.235+0000 7f6a10e00640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f69f00b6590 0x7f69f00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.235+0000 7f6a19aa1740 1 -- 172.21.15.37:0/3729592637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 msgr2=0x5579442c3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:15.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.235+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/3729592637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442c3700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0edc50 tx=0x7f69fc0ef670 comp rx=0 tx=0).stop 2024-09-21T06:04:15.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.235+0000 7f6a19aa1740 1 -- 172.21.15.37:0/3729592637 shutdown_connections 2024-09-21T06:04:15.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.235+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/3729592637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943efb840 0x5579442c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.235+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/3729592637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442c3700 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.235+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/3729592637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943f1c520 0x5579442c31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.235+0000 7f6a19aa1740 1 -- 172.21.15.37:0/3729592637 >> 172.21.15.37:0/3729592637 conn(0x557943f10910 msgr2=0x5579442c10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:15.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.236+0000 7f6a19aa1740 1 -- 172.21.15.37:0/3729592637 shutdown_connections 2024-09-21T06:04:15.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.236+0000 7f6a10e00640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f69f00b6590 0x7f69f00b8aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6a04005e30 tx=0x7f6a04005c50 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:15.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.236+0000 7f6a19aa1740 1 -- 172.21.15.37:0/3729592637 wait complete. 2024-09-21T06:04:15.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.236+0000 7f6a19aa1740 1 -- start start 2024-09-21T06:04:15.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.237+0000 7f6a19aa1740 1 Processor -- start 2024-09-21T06:04:15.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.237+0000 7f6a19aa1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442d3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.237+0000 7f6a19aa1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943efb840 0x5579442d35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.237+0000 7f6a19aa1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943f1c520 0x5579442df0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.237+0000 7f6a19aa1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55794408abb0 con 0x557943ef3660 2024-09-21T06:04:15.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.237+0000 7f6a19aa1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5579441c46c0 con 0x557943f1c520 2024-09-21T06:04:15.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.237+0000 7f6a19aa1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5579442d5d20 con 0x557943efb840 2024-09-21T06:04:15.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.237+0000 7f6a19aa1740 10 client.0 _ll_register_callbacks cb 0x5579441df490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.238+0000 7f6a0be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.238+0000 7f6a03400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943efb840 0x5579442d35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.238+0000 7f6a10e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943f1c520 0x5579442df0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.238+0000 7f6a03400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943efb840 0x5579442d35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:58982/0 (socket says 172.21.15.37:58982) 2024-09-21T06:04:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.238+0000 7f6a0be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442d3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53790/0 (socket says 172.21.15.37:53790) 2024-09-21T06:04:15.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.238+0000 7f6a03400640 1 -- 172.21.15.37:0/3870901063 learned_addr learned my addr 172.21.15.37:0/3870901063 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.238+0000 7f6a03400640 1 -- 172.21.15.37:0/3870901063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943f1c520 msgr2=0x5579442df0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.238+0000 7f6a03400640 1 --2- 172.21.15.37:0/3870901063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943f1c520 0x5579442df0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.238+0000 7f6a03400640 1 -- 172.21.15.37:0/3870901063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 msgr2=0x5579442d3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.238+0000 7f6a03400640 1 --2- 172.21.15.37:0/3870901063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442d3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.238+0000 7f6a03400640 1 -- 172.21.15.37:0/3870901063 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557943f87b00 con 0x557943efb840 2024-09-21T06:04:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.238+0000 7f6a03400640 1 --2- 172.21.15.37:0/3870901063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943efb840 0x5579442d35a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f69f40126e0 tx=0x7f69f4012ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10a27537f0f5b5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.238+0000 7f69fa000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T06:04:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.239+0000 7f69fa000640 1 -- 172.21.15.37:0/3870901063 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4012190 con 0x557943efb840 2024-09-21T06:04:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.239+0000 7f6a19aa1740 1 -- 172.21.15.37:0/3870901063 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69fc0f2ad0 con 0x557943efb840 2024-09-21T06:04:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.239+0000 7f69fa000640 1 -- 172.21.15.37:0/3870901063 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f69f400f920 con 0x557943efb840 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.239+0000 7f69fa000640 1 -- 172.21.15.37:0/3870901063 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f69f400fb60 con 0x557943efb840 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.239+0000 7f6a19aa1740 10 client.25807 fetch_fsmap learned FSMap version 21 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.239+0000 7f6a19aa1740 1 -- 172.21.15.37:0/3870901063 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557943ffe960 con 0x557943efb840 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.239+0000 7f69fa000640 1 -- 172.21.15.37:0/3870901063 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69fc0f2ad0 con 0x557943efb840 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.240+0000 7f69fa000640 1 -- 172.21.15.37:0/3870901063 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f69f4025420 con 0x557943efb840 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.240+0000 7f6a19aa1740 10 client.25807 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.240+0000 7f6a19aa1740 10 client.25807 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.240+0000 7f6a19aa1740 20 client.25807 populate_metadata read hostname 'smithi037' 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.240+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/3870901063 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x557943edaea0 0x5579442e50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.240+0000 7f6a19aa1740 4 client.25807 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.240+0000 7f6a19aa1740 1 -- 172.21.15.37:0/3870901063 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55794423c1e0 con 0x557943edaea0 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.240+0000 7f6a0be00640 1 --2- 172.21.15.37:0/3870901063 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x557943edaea0 0x5579442e50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.241+0000 7f6a0be00640 1 --2- 172.21.15.37:0/3870901063 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x557943edaea0 0x5579442e50c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4017aa12a308af5 server_cookie=3154d92b2da87d54 in_seq=0 out_seq=0 2024-09-21T06:04:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.241+0000 7f69fa000640 10 client.25807 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:04:15.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f69fa000640 1 -- 172.21.15.37:0/3870901063 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55794423c1e0 con 0x557943edaea0 2024-09-21T06:04:15.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f69fa000640 10 client.25807 handle_command_reply: tid=0 2024-09-21T06:04:15.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f6a19aa1740 1 client.25807 shutdown 2024-09-21T06:04:15.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f6a19aa1740 1 -- 172.21.15.37:0/3870901063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943efb840 msgr2=0x5579442d35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:15.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/3870901063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943efb840 0x5579442d35a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f69f40126e0 tx=0x7f69f4012ba0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f6a19aa1740 1 -- 172.21.15.37:0/3870901063 shutdown_connections 2024-09-21T06:04:15.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/3870901063 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x557943edaea0 0x5579442e50c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/3870901063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943f1c520 0x5579442df0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/3870901063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943efb840 0x5579442d35a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/3870901063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442d3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f6a19aa1740 1 -- 172.21.15.37:0/3870901063 >> 172.21.15.37:0/3870901063 conn(0x557943f10910 msgr2=0x5579442c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:15.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f69fa000640 0 client.25807 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:04:15.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f6a19aa1740 1 -- 172.21.15.37:0/3870901063 shutdown_connections 2024-09-21T06:04:15.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f6a19aa1740 1 -- 172.21.15.37:0/3870901063 wait complete. 2024-09-21T06:04:15.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.242+0000 7f6a19aa1740 20 client.25807 trim_cache size 0 max 16384 2024-09-21T06:04:15.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.260+0000 7f6a19aa1740 1 Processor -- start 2024-09-21T06:04:15.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.261+0000 7f6a19aa1740 1 -- start start 2024-09-21T06:04:15.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.261+0000 7f6a19aa1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943ef3660 0x5579442d4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.261+0000 7f6a19aa1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943efb840 0x5579442d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.261+0000 7f6a19aa1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943f1c520 0x5579442d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.261+0000 7f6a19aa1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1ac990 con 0x557943efb840 2024-09-21T06:04:15.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.261+0000 7f6a19aa1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1af210 con 0x557943f1c520 2024-09-21T06:04:15.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.261+0000 7f6a19aa1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1ad000 con 0x557943ef3660 2024-09-21T06:04:15.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.261+0000 7f6a03400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943efb840 0x5579442d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.261+0000 7f6a10e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943f1c520 0x5579442d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.261+0000 7f6a03400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943efb840 0x5579442d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53796/0 (socket says 172.21.15.37:53796) 2024-09-21T06:04:15.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.261+0000 7f6a03400640 1 -- 172.21.15.37:0/790706293 learned_addr learned my addr 172.21.15.37:0/790706293 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:15.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.261+0000 7f6a0be00640 1 --2- 172.21.15.37:0/790706293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943ef3660 0x5579442d4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.262+0000 7f6a03400640 1 -- 172.21.15.37:0/790706293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943ef3660 msgr2=0x5579442d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:15.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.262+0000 7f6a03400640 1 --2- 172.21.15.37:0/790706293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943ef3660 0x5579442d4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.262+0000 7f6a03400640 1 -- 172.21.15.37:0/790706293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943f1c520 msgr2=0x5579442d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.262+0000 7f6a03400640 1 --2- 172.21.15.37:0/790706293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943f1c520 0x5579442d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.262+0000 7f6a03400640 1 -- 172.21.15.37:0/790706293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579442c5fc0 con 0x557943efb840 2024-09-21T06:04:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.262+0000 7f6a0be00640 1 --2- 172.21.15.37:0/790706293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943ef3660 0x5579442d4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.262+0000 7f6a03400640 1 --2- 172.21.15.37:0/790706293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943efb840 0x5579442d0050 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f69f400f810 tx=0x7f69f400f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919e8876b7aa76aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.262+0000 7f6a00c00640 1 -- 172.21.15.37:0/790706293 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f402a070 con 0x557943efb840 2024-09-21T06:04:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.262+0000 7f6a00c00640 1 -- 172.21.15.37:0/790706293 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69f4005520 con 0x557943efb840 2024-09-21T06:04:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.262+0000 7f6a00c00640 1 -- 172.21.15.37:0/790706293 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4025ab0 con 0x557943efb840 2024-09-21T06:04:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.263+0000 7f6a19aa1740 1 -- 172.21.15.37:0/790706293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943efb840 msgr2=0x5579442d0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.263+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/790706293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943efb840 0x5579442d0050 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f69f400f810 tx=0x7f69f400f840 comp rx=0 tx=0).stop 2024-09-21T06:04:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.263+0000 7f6a19aa1740 1 -- 172.21.15.37:0/790706293 shutdown_connections 2024-09-21T06:04:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.263+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/790706293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943f1c520 0x5579442d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.263+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/790706293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943efb840 0x5579442d0050 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.263+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/790706293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943ef3660 0x5579442d4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.263+0000 7f6a19aa1740 1 -- 172.21.15.37:0/790706293 >> 172.21.15.37:0/790706293 conn(0x557943f10910 msgr2=0x5579442d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:15.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.263+0000 7f6a19aa1740 1 -- 172.21.15.37:0/790706293 shutdown_connections 2024-09-21T06:04:15.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.263+0000 7f6a19aa1740 1 -- 172.21.15.37:0/790706293 wait complete. 2024-09-21T06:04:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.264+0000 7f6a19aa1740 1 -- start start 2024-09-21T06:04:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.264+0000 7f6a19aa1740 1 Processor -- start 2024-09-21T06:04:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.264+0000 7f6a19aa1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442db020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a19aa1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943efb840 0x5579442db560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a19aa1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943f1c520 0x5579442d5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a19aa1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1ad6d0 con 0x557943ef3660 2024-09-21T06:04:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a19aa1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1aeb40 con 0x557943efb840 2024-09-21T06:04:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a19aa1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c1adda0 con 0x557943f1c520 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a19aa1740 10 client.0 _ll_register_callbacks cb 0x7f69f4009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a0be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442db020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a0be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442db020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53810/0 (socket says 172.21.15.37:53810) 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a0be00640 1 -- 172.21.15.37:0/1563050549 learned_addr learned my addr 172.21.15.37:0/1563050549 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a03400640 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943efb840 0x5579442db560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a10e00640 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943f1c520 0x5579442d5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a0be00640 1 -- 172.21.15.37:0/1563050549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943f1c520 msgr2=0x5579442d5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a0be00640 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943f1c520 0x5579442d5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a0be00640 1 -- 172.21.15.37:0/1563050549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943efb840 msgr2=0x5579442db560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a0be00640 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943efb840 0x5579442db560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a0be00640 1 -- 172.21.15.37:0/1563050549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579442dbcd0 con 0x557943ef3660 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.265+0000 7f6a03400640 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943efb840 0x5579442db560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.266+0000 7f6a0be00640 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442db020 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e9c0 tx=0x7f69fc0f1420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945856be95eef246 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:15.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.266+0000 7f69fa000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.266+0000 7f69fa000640 1 -- 172.21.15.37:0/1563050549 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0f6070 con 0x557943ef3660 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.266+0000 7f69fa000640 1 -- 172.21.15.37:0/1563050549 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f69fc0e5140 con 0x557943ef3660 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.266+0000 7f6a19aa1740 1 -- 172.21.15.37:0/1563050549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69f4005520 con 0x557943ef3660 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.266+0000 7f69fa000640 1 -- 172.21.15.37:0/1563050549 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f69fc0a9e50 con 0x557943ef3660 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.266+0000 7f6a19aa1740 10 client.15774 fetch_fsmap learned FSMap version 21 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.266+0000 7f6a19aa1740 1 -- 172.21.15.37:0/1563050549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55794434ffc0 con 0x557943ef3660 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.267+0000 7f69fa000640 1 -- 172.21.15.37:0/1563050549 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69f4005520 con 0x557943ef3660 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.267+0000 7f69fa000640 1 -- 172.21.15.37:0/1563050549 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f69fc0a9a70 con 0x557943ef3660 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.267+0000 7f6a19aa1740 10 client.15774 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.267+0000 7f6a19aa1740 10 client.15774 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.267+0000 7f6a19aa1740 20 client.15774 populate_metadata read hostname 'smithi037' 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.267+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x557943eb0250 0x557944352250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.267+0000 7f6a19aa1740 4 client.15774 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "192ba68e", "release": true, "await": true}] 2024-09-21T06:04:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.267+0000 7f6a19aa1740 1 -- 172.21.15.37:0/1563050549 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "set_id": "192ba68e", "release": true, "await": true}) -- 0x5579442df990 con 0x557943eb0250 2024-09-21T06:04:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.267+0000 7f6a03400640 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x557943eb0250 0x557944352250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.268+0000 7f6a03400640 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x557943eb0250 0x557944352250 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aed0fd797a213221 server_cookie=d008f8e5b9f8c8b8 in_seq=0 out_seq=0 2024-09-21T06:04:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.268+0000 7f69fa000640 10 client.15774 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:04:15.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f69fa000640 1 -- 172.21.15.37:0/1563050549 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5579442df990 con 0x557943eb0250 2024-09-21T06:04:15.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f69fa000640 10 client.15774 handle_command_reply: tid=0 2024-09-21T06:04:15.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f6a19aa1740 1 client.15774 shutdown 2024-09-21T06:04:15.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f6a19aa1740 1 -- 172.21.15.37:0/1563050549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 msgr2=0x5579442db020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:15.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442db020 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e9c0 tx=0x7f69fc0f1420 comp rx=0 tx=0).stop 2024-09-21T06:04:15.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f6a19aa1740 1 -- 172.21.15.37:0/1563050549 shutdown_connections 2024-09-21T06:04:15.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x557943eb0250 0x557944352250 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557943f1c520 0x5579442d5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557943efb840 0x5579442db560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f6a19aa1740 1 --2- 172.21.15.37:0/1563050549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557943ef3660 0x5579442db020 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f6a19aa1740 1 -- 172.21.15.37:0/1563050549 >> 172.21.15.37:0/1563050549 conn(0x557943f10910 msgr2=0x5579442c1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:15.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f69fa000640 0 client.15774 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:04:15.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f6a19aa1740 1 -- 172.21.15.37:0/1563050549 shutdown_connections 2024-09-21T06:04:15.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.469+0000 7f6a19aa1740 1 -- 172.21.15.37:0/1563050549 wait complete. 2024-09-21T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.470+0000 7f6a19aa1740 20 client.15774 trim_cache size 0 max 16384 2024-09-21T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 44, 2024-09-21T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-21T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stdout: "192ba68e": { 2024-09-21T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 44, 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 144.5, 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-21T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:15.475 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:15.475 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:15.475 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:15.475 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:15.475 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:04:15.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.470+0000 7f6a12e00640 1 -- 172.21.15.37:0/2622872072 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f69f00b6590 msgr2=0x7f69f00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:15.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.470+0000 7f6a12e00640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f69f00b6590 0x7f69f00b8aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6a04005e30 tx=0x7f6a04005c50 comp rx=0 tx=0).stop 2024-09-21T06:04:15.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.470+0000 7f6a12e00640 1 -- 172.21.15.37:0/2622872072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a0c103b60 msgr2=0x7f6a0c19a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:15.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.470+0000 7f6a12e00640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a0c103b60 0x7f6a0c19a400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e9f0 tx=0x7f69fc00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.470+0000 7f6a12e00640 1 -- 172.21.15.37:0/2622872072 shutdown_connections 2024-09-21T06:04:15.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.470+0000 7f6a12e00640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a0c109df0 0x7f6a0c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.470+0000 7f6a12e00640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0c1094a0 0x7f6a0c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.470+0000 7f6a12e00640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f69f00b6590 0x7f69f00b8aa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.470+0000 7f6a12e00640 1 --2- 172.21.15.37:0/2622872072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a0c103b60 0x7f6a0c19a400 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:15.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.470+0000 7f6a12e00640 1 -- 172.21.15.37:0/2622872072 >> 172.21.15.37:0/2622872072 conn(0x7f6a0c07b850 msgr2=0x7f6a0c107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:15.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.471+0000 7f6a12e00640 1 -- 172.21.15.37:0/2622872072 shutdown_connections 2024-09-21T06:04:15.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:15.471+0000 7f6a12e00640 1 -- 172.21.15.37:0/2622872072 wait complete. 2024-09-21T06:04:15.881 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:15 smithi037 ceph-mon[30631]: pgmap v724: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 27 KiB/s wr, 2 op/s 2024-09-21T06:04:15.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:15 smithi067 ceph-mon[34443]: pgmap v724: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 27 KiB/s wr, 2 op/s 2024-09-21T06:04:16.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:15 smithi144 ceph-mon[34351]: pgmap v724: 129 pgs: 129 active+clean; 171 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 27 KiB/s wr, 2 op/s 2024-09-21T06:04:16.393 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '192ba68e', total seconds elapsed: 29.2 2024-09-21T06:04:17.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:17 smithi037 ceph-mon[30631]: pgmap v725: 129 pgs: 129 active+clean; 167 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-21T06:04:17.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:17 smithi067 ceph-mon[34443]: pgmap v725: 129 pgs: 129 active+clean; 167 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-21T06:04:18.124 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:17 smithi144 ceph-mon[34351]: pgmap v725: 129 pgs: 129 active+clean; 167 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-21T06:04:19.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:19 smithi037 ceph-mon[30631]: pgmap v726: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 65 KiB/s wr, 31 op/s 2024-09-21T06:04:19.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:19 smithi067 ceph-mon[34443]: pgmap v726: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 65 KiB/s wr, 31 op/s 2024-09-21T06:04:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:19 smithi144 ceph-mon[34351]: pgmap v726: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 65 KiB/s wr, 31 op/s 2024-09-21T06:04:21.459 INFO:tasks.workunit.client.0.smithi037.stdout:All 50000 operations completed A-OK! 2024-09-21T06:04:21.493 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T06:04:21.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T06:04:21.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:21 smithi037 ceph-mon[30631]: pgmap v727: 129 pgs: 129 active+clean; 162 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 165 KiB/s wr, 81 op/s 2024-09-21T06:04:21.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:21 smithi067 ceph-mon[34443]: pgmap v727: 129 pgs: 129 active+clean; 162 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 165 KiB/s wr, 81 op/s 2024-09-21T06:04:22.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:21 smithi144 ceph-mon[34351]: pgmap v727: 129 pgs: 129 active+clean; 162 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 165 KiB/s wr, 81 op/s 2024-09-21T06:04:23.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:23 smithi067 ceph-mon[34443]: pgmap v728: 129 pgs: 129 active+clean; 153 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 387 KiB/s wr, 162 op/s 2024-09-21T06:04:24.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:23 smithi144 ceph-mon[34351]: pgmap v728: 129 pgs: 129 active+clean; 153 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 387 KiB/s wr, 162 op/s 2024-09-21T06:04:24.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:23 smithi037 ceph-mon[30631]: pgmap v728: 129 pgs: 129 active+clean; 153 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 387 KiB/s wr, 162 op/s 2024-09-21T06:04:25.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:25 smithi067 ceph-mon[34443]: pgmap v729: 129 pgs: 129 active+clean; 151 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 447 KiB/s wr, 178 op/s 2024-09-21T06:04:26.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:25 smithi144 ceph-mon[34351]: pgmap v729: 129 pgs: 129 active+clean; 151 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 447 KiB/s wr, 178 op/s 2024-09-21T06:04:26.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:25 smithi037 ceph-mon[30631]: pgmap v729: 129 pgs: 129 active+clean; 151 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 447 KiB/s wr, 178 op/s 2024-09-21T06:04:27.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:27 smithi067 ceph-mon[34443]: pgmap v730: 129 pgs: 129 active+clean; 139 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 807 KiB/s wr, 225 op/s 2024-09-21T06:04:28.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:27 smithi144 ceph-mon[34351]: pgmap v730: 129 pgs: 129 active+clean; 139 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 807 KiB/s wr, 225 op/s 2024-09-21T06:04:28.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:27 smithi037 ceph-mon[30631]: pgmap v730: 129 pgs: 129 active+clean; 139 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 807 KiB/s wr, 225 op/s 2024-09-21T06:04:29.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:29 smithi067 ceph-mon[34443]: pgmap v731: 129 pgs: 129 active+clean; 141 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.1 MiB/s wr, 270 op/s 2024-09-21T06:04:30.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:29 smithi144 ceph-mon[34351]: pgmap v731: 129 pgs: 129 active+clean; 141 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.1 MiB/s wr, 270 op/s 2024-09-21T06:04:30.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:29 smithi037 ceph-mon[30631]: pgmap v731: 129 pgs: 129 active+clean; 141 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.1 MiB/s wr, 270 op/s 2024-09-21T06:04:31.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:31 smithi067 ceph-mon[34443]: pgmap v732: 129 pgs: 129 active+clean; 143 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.4 MiB/s wr, 332 op/s 2024-09-21T06:04:32.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:31 smithi144 ceph-mon[34351]: pgmap v732: 129 pgs: 129 active+clean; 143 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.4 MiB/s wr, 332 op/s 2024-09-21T06:04:32.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:31 smithi037 ceph-mon[30631]: pgmap v732: 129 pgs: 129 active+clean; 143 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.4 MiB/s wr, 332 op/s 2024-09-21T06:04:33.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:33 smithi067 ceph-mon[34443]: pgmap v733: 129 pgs: 129 active+clean; 143 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.4 MiB/s wr, 367 op/s 2024-09-21T06:04:34.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:33 smithi144 ceph-mon[34351]: pgmap v733: 129 pgs: 129 active+clean; 143 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.4 MiB/s wr, 367 op/s 2024-09-21T06:04:34.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:33 smithi037 ceph-mon[30631]: pgmap v733: 129 pgs: 129 active+clean; 143 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.4 MiB/s wr, 367 op/s 2024-09-21T06:04:34.367 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-09-21T06:04:34.367 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T06:04:35.548 DEBUG:teuthology.parallel:result is None 2024-09-21T06:04:35.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T06:04:35.612 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T06:04:35.612 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-21T06:04:35.622 INFO:tasks.quiescer:joining Quiescers 2024-09-21T06:04:35.622 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-21T06:04:35.622 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:04:35.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:35 smithi037 ceph-mon[30631]: pgmap v734: 129 pgs: 129 active+clean; 143 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 306 op/s 2024-09-21T06:04:35.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:35 smithi067 ceph-mon[34443]: pgmap v734: 129 pgs: 129 active+clean; 143 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 306 op/s 2024-09-21T06:04:36.018 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:36.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:35 smithi144 ceph-mon[34351]: pgmap v734: 129 pgs: 129 active+clean; 143 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 306 op/s 2024-09-21T06:04:37.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.297+0000 7fefa0800640 1 -- 172.21.15.37:0/819875605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef98075dd0 msgr2=0x7fef980761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.297+0000 7fefa0800640 1 --2- 172.21.15.37:0/819875605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef98075dd0 0x7fef980761e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fef88009900 tx=0x7fef8802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.297+0000 7fefa0800640 1 -- 172.21.15.37:0/819875605 shutdown_connections 2024-09-21T06:04:37.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.297+0000 7fefa0800640 1 --2- 172.21.15.37:0/819875605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef98114450 0x7fef98116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.297+0000 7fefa0800640 1 --2- 172.21.15.37:0/819875605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef98075dd0 0x7fef980761e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.297+0000 7fefa0800640 1 --2- 172.21.15.37:0/819875605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef98077380 0x7fef980757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.297+0000 7fefa0800640 1 -- 172.21.15.37:0/819875605 >> 172.21.15.37:0/819875605 conn(0x7fef980ff5d0 msgr2=0x7fef98101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.297+0000 7fefa0800640 1 -- 172.21.15.37:0/819875605 shutdown_connections 2024-09-21T06:04:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.297+0000 7fefa0800640 1 -- 172.21.15.37:0/819875605 wait complete. 2024-09-21T06:04:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.298+0000 7fefa0800640 1 Processor -- start 2024-09-21T06:04:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.299+0000 7fefa0800640 1 -- start start 2024-09-21T06:04:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.299+0000 7fefa0800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef98075dd0 0x7fef981a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.299+0000 7fefa0800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef98077380 0x7fef981a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.299+0000 7fefa0800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef98114450 0x7fef981a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.299+0000 7fefa0800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef9811a0c0 con 0x7fef98114450 2024-09-21T06:04:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.299+0000 7fefa0800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fef98119f40 con 0x7fef98075dd0 2024-09-21T06:04:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.299+0000 7fefa0800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fef9811a240 con 0x7fef98077380 2024-09-21T06:04:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.299+0000 7fef9e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef98114450 0x7fef981a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.299+0000 7fef9de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef98075dd0 0x7fef981a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.299+0000 7fef9de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef98075dd0 0x7fef981a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:43652/0 (socket says 172.21.15.37:43652) 2024-09-21T06:04:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.299+0000 7fef9d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef98077380 0x7fef981a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.299+0000 7fef9de00640 1 -- 172.21.15.37:0/305459934 learned_addr learned my addr 172.21.15.37:0/305459934 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:37.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.300+0000 7fef9e800640 1 -- 172.21.15.37:0/305459934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef98077380 msgr2=0x7fef981a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.300+0000 7fef9e800640 1 --2- 172.21.15.37:0/305459934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef98077380 0x7fef981a1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.300+0000 7fef9e800640 1 -- 172.21.15.37:0/305459934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef98075dd0 msgr2=0x7fef981a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.300+0000 7fef9e800640 1 --2- 172.21.15.37:0/305459934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef98075dd0 0x7fef981a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.300+0000 7fef9e800640 1 -- 172.21.15.37:0/305459934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef981a6a40 con 0x7fef98114450 2024-09-21T06:04:37.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.300+0000 7fef9de00640 1 --2- 172.21.15.37:0/305459934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef98075dd0 0x7fef981a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:37.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.300+0000 7fef9e800640 1 --2- 172.21.15.37:0/305459934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef98114450 0x7fef981a6310 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fef9400ec50 tx=0x7fef9400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:37.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.301+0000 7fef92a00640 1 -- 172.21.15.37:0/305459934 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94003b70 con 0x7fef98114450 2024-09-21T06:04:37.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.301+0000 7fef92a00640 1 -- 172.21.15.37:0/305459934 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef94003d10 con 0x7fef98114450 2024-09-21T06:04:37.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.301+0000 7fefa0800640 1 -- 172.21.15.37:0/305459934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef981a6d30 con 0x7fef98114450 2024-09-21T06:04:37.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.301+0000 7fef92a00640 1 -- 172.21.15.37:0/305459934 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94010830 con 0x7fef98114450 2024-09-21T06:04:37.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.301+0000 7fefa0800640 1 -- 172.21.15.37:0/305459934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef981ad490 con 0x7fef98114450 2024-09-21T06:04:37.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.302+0000 7fefa0800640 1 -- 172.21.15.37:0/305459934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef980761e0 con 0x7fef98114450 2024-09-21T06:04:37.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.304+0000 7fef92a00640 1 -- 172.21.15.37:0/305459934 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fef94003ec0 con 0x7fef98114450 2024-09-21T06:04:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.307+0000 7fef92a00640 1 --2- 172.21.15.37:0/305459934 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fef800b6590 0x7fef800b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.307+0000 7fef92a00640 1 -- 172.21.15.37:0/305459934 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fef940e7bf0 con 0x7fef98114450 2024-09-21T06:04:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.307+0000 7fef9de00640 1 --2- 172.21.15.37:0/305459934 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fef800b6590 0x7fef800b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.308+0000 7fef9de00640 1 --2- 172.21.15.37:0/305459934 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fef800b6590 0x7fef800b8aa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fef8c011500 tx=0x7fef8c005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:37.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.311+0000 7fef92a00640 1 -- 172.21.15.37:0/305459934 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef940ae050 con 0x7fef98114450 2024-09-21T06:04:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.545+0000 7fefa0800640 1 -- 172.21.15.37:0/305459934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef98112bf0 con 0x7fef98114450 2024-09-21T06:04:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.546+0000 7fef92a00640 1 -- 172.21.15.37:0/305459934 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7fef940b2430 con 0x7fef98114450 2024-09-21T06:04:37.548 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:04:37.549 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T06:04:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T06:04:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.548+0000 7fefa0800640 1 -- 172.21.15.37:0/305459934 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fef800b6590 msgr2=0x7fef800b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.548+0000 7fefa0800640 1 --2- 172.21.15.37:0/305459934 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fef800b6590 0x7fef800b8aa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fef8c011500 tx=0x7fef8c005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.548+0000 7fefa0800640 1 -- 172.21.15.37:0/305459934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef98114450 msgr2=0x7fef981a6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.548+0000 7fefa0800640 1 --2- 172.21.15.37:0/305459934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef98114450 0x7fef981a6310 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fef9400ec50 tx=0x7fef9400c6a0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.548+0000 7fefa0800640 1 -- 172.21.15.37:0/305459934 shutdown_connections 2024-09-21T06:04:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.548+0000 7fefa0800640 1 --2- 172.21.15.37:0/305459934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef98114450 0x7fef981a6310 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.548+0000 7fefa0800640 1 --2- 172.21.15.37:0/305459934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef98077380 0x7fef981a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.548+0000 7fefa0800640 1 --2- 172.21.15.37:0/305459934 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fef800b6590 0x7fef800b8aa0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.549+0000 7fefa0800640 1 --2- 172.21.15.37:0/305459934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef98075dd0 0x7fef981a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.549+0000 7fefa0800640 1 -- 172.21.15.37:0/305459934 >> 172.21.15.37:0/305459934 conn(0x7fef980ff5d0 msgr2=0x7fef98110350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.549+0000 7fefa0800640 1 -- 172.21.15.37:0/305459934 shutdown_connections 2024-09-21T06:04:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:37.549+0000 7fefa0800640 1 -- 172.21.15.37:0/305459934 wait complete. 2024-09-21T06:04:37.894 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:37 smithi037 ceph-mon[30631]: pgmap v735: 129 pgs: 129 active+clean; 144 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 392 op/s 2024-09-21T06:04:37.894 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:37 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/305459934' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:37.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:37 smithi067 ceph-mon[34443]: pgmap v735: 129 pgs: 129 active+clean; 144 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 392 op/s 2024-09-21T06:04:37.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:37 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/305459934' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:38.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:37 smithi144 ceph-mon[34351]: pgmap v735: 129 pgs: 129 active+clean; 144 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 392 op/s 2024-09-21T06:04:38.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:37 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/305459934' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:04:38.435 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24731 quiesce db --cancel --all' 2024-09-21T06:04:38.435 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24731 quiesce db --cancel --all 2024-09-21T06:04:38.819 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.434+0000 7f623c800640 1 -- 172.21.15.37:0/2796150267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6234103b70 msgr2=0x7f6234103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.434+0000 7f623c800640 1 --2- 172.21.15.37:0/2796150267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6234103b70 0x7f6234103f80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6228009900 tx=0x7f622802a410 comp rx=0 tx=0).stop 2024-09-21T06:04:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.434+0000 7f623c800640 1 -- 172.21.15.37:0/2796150267 shutdown_connections 2024-09-21T06:04:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.434+0000 7f623c800640 1 --2- 172.21.15.37:0/2796150267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6234109e00 0x7f6234110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.434+0000 7f623c800640 1 --2- 172.21.15.37:0/2796150267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62341094b0 0x7f62341098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.434+0000 7f623c800640 1 --2- 172.21.15.37:0/2796150267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6234103b70 0x7f6234103f80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.434+0000 7f623c800640 1 -- 172.21.15.37:0/2796150267 >> 172.21.15.37:0/2796150267 conn(0x7f62340ff5e0 msgr2=0x7f6234101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.434+0000 7f623c800640 1 -- 172.21.15.37:0/2796150267 shutdown_connections 2024-09-21T06:04:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.434+0000 7f623c800640 1 -- 172.21.15.37:0/2796150267 wait complete. 2024-09-21T06:04:39.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.435+0000 7f623c800640 1 Processor -- start 2024-09-21T06:04:39.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.435+0000 7f623c800640 1 -- start start 2024-09-21T06:04:39.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.436+0000 7f623c800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6234103b70 0x7f6234075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.436+0000 7f623c800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341094b0 0x7f6234075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.436+0000 7f623c800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6234109e00 0x7f6234076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.436+0000 7f623c800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6234113b10 con 0x7f6234109e00 2024-09-21T06:04:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.436+0000 7f623c800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6234113990 con 0x7f6234103b70 2024-09-21T06:04:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.436+0000 7f623c800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6234113c90 con 0x7f62341094b0 2024-09-21T06:04:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.436+0000 7f6239e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6234103b70 0x7f6234075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.436+0000 7f6239400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341094b0 0x7f6234075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.436+0000 7f6239400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341094b0 0x7f6234075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:48704/0 (socket says 172.21.15.37:48704) 2024-09-21T06:04:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.436+0000 7f6239400640 1 -- 172.21.15.37:0/290870699 learned_addr learned my addr 172.21.15.37:0/290870699 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.436+0000 7f623a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6234109e00 0x7f6234076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.436+0000 7f6239e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6234103b70 0x7f6234075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:43660/0 (socket says 172.21.15.37:43660) 2024-09-21T06:04:39.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.437+0000 7f6239400640 1 -- 172.21.15.37:0/290870699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6234103b70 msgr2=0x7f6234075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.437+0000 7f6239400640 1 --2- 172.21.15.37:0/290870699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6234103b70 0x7f6234075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.437+0000 7f6239400640 1 -- 172.21.15.37:0/290870699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6234109e00 msgr2=0x7f6234076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.437+0000 7f6239400640 1 --2- 172.21.15.37:0/290870699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6234109e00 0x7f6234076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.437+0000 7f6239400640 1 -- 172.21.15.37:0/290870699 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62341a8740 con 0x7f62341094b0 2024-09-21T06:04:39.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.437+0000 7f623a800640 1 --2- 172.21.15.37:0/290870699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6234109e00 0x7f6234076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:39.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.437+0000 7f6239400640 1 --2- 172.21.15.37:0/290870699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341094b0 0x7f6234075c50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f622400e9f0 tx=0x7f622400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:39.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.437+0000 7f622ea00640 1 -- 172.21.15.37:0/290870699 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622400ccc0 con 0x7f62341094b0 2024-09-21T06:04:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.438+0000 7f623c800640 1 -- 172.21.15.37:0/290870699 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62341a8a30 con 0x7f62341094b0 2024-09-21T06:04:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.438+0000 7f623c800640 1 -- 172.21.15.37:0/290870699 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62341a8f90 con 0x7f62341094b0 2024-09-21T06:04:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.438+0000 7f622ea00640 1 -- 172.21.15.37:0/290870699 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62240108e0 con 0x7f62341094b0 2024-09-21T06:04:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.438+0000 7f622ea00640 1 -- 172.21.15.37:0/290870699 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62240187a0 con 0x7f62341094b0 2024-09-21T06:04:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.441+0000 7f6243419740 1 Processor -- start 2024-09-21T06:04:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.441+0000 7f6243419740 1 -- start start 2024-09-21T06:04:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.441+0000 7f6243419740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8e4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.441+0000 7f6243419740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8e47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.441+0000 7f6243419740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8e4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.441+0000 7f6243419740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55633d85bff0 con 0x55633d515410 2024-09-21T06:04:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.441+0000 7f6243419740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55633d84b420 con 0x55633d51d5f0 2024-09-21T06:04:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.441+0000 7f6243419740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55633d84f230 con 0x55633d53e2d0 2024-09-21T06:04:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.442+0000 7f623a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8e4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.442+0000 7f623a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8e4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:48716/0 (socket says 172.21.15.37:48716) 2024-09-21T06:04:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.442+0000 7f6239e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8e47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.442+0000 7f623a800640 1 -- 172.21.15.37:0/3043600 learned_addr learned my addr 172.21.15.37:0/3043600 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.442+0000 7f622ea00640 1 -- 172.21.15.37:0/290870699 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f6224018940 con 0x7f62341094b0 2024-09-21T06:04:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.442+0000 7f6239400640 1 --2- 172.21.15.37:0/3043600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8e4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.443+0000 7f623a800640 1 -- 172.21.15.37:0/3043600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 msgr2=0x55633d8e4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.443+0000 7f623a800640 1 --2- 172.21.15.37:0/3043600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8e4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.443+0000 7f623a800640 1 -- 172.21.15.37:0/3043600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 msgr2=0x55633d8e47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.443+0000 7f623a800640 1 --2- 172.21.15.37:0/3043600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8e47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.443+0000 7f623a800640 1 -- 172.21.15.37:0/3043600 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55633d5a98b0 con 0x55633d53e2d0 2024-09-21T06:04:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.443+0000 7f6239e00640 1 --2- 172.21.15.37:0/3043600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8e47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.443+0000 7f623a800640 1 --2- 172.21.15.37:0/3043600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8e4290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f62300117e0 tx=0x7f6230011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e4dca60b10c9430 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.443+0000 7f6223000640 1 -- 172.21.15.37:0/3043600 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230011310 con 0x55633d53e2d0 2024-09-21T06:04:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.444+0000 7f6223000640 1 -- 172.21.15.37:0/3043600 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6230003e20 con 0x55633d53e2d0 2024-09-21T06:04:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.444+0000 7f6223000640 1 -- 172.21.15.37:0/3043600 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62300044f0 con 0x55633d53e2d0 2024-09-21T06:04:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.444+0000 7f622ea00640 1 --2- 172.21.15.37:0/290870699 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f621c0b6590 0x7f621c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.444+0000 7f622ea00640 1 -- 172.21.15.37:0/290870699 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f62240e7740 con 0x7f62341094b0 2024-09-21T06:04:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.444+0000 7f6239e00640 1 --2- 172.21.15.37:0/290870699 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f621c0b6590 0x7f621c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.445+0000 7f6243419740 1 -- 172.21.15.37:0/3043600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 msgr2=0x55633d8e4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.445+0000 7f6243419740 1 --2- 172.21.15.37:0/3043600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8e4290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f62300117e0 tx=0x7f6230011ca0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.445+0000 7f6243419740 1 -- 172.21.15.37:0/3043600 shutdown_connections 2024-09-21T06:04:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.445+0000 7f6243419740 1 --2- 172.21.15.37:0/3043600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8e4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.445+0000 7f6243419740 1 --2- 172.21.15.37:0/3043600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8e47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.445+0000 7f6243419740 1 --2- 172.21.15.37:0/3043600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8e4290 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.445+0000 7f6243419740 1 -- 172.21.15.37:0/3043600 >> 172.21.15.37:0/3043600 conn(0x55633d5326c0 msgr2=0x55633d8e2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.445+0000 7f6239e00640 1 --2- 172.21.15.37:0/290870699 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f621c0b6590 0x7f621c0b8aa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6228005ab0 tx=0x7f6228005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.445+0000 7f6243419740 1 -- 172.21.15.37:0/3043600 shutdown_connections 2024-09-21T06:04:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.445+0000 7f6243419740 1 -- 172.21.15.37:0/3043600 wait complete. 2024-09-21T06:04:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.446+0000 7f6243419740 1 -- start start 2024-09-21T06:04:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.446+0000 7f6243419740 1 Processor -- start 2024-09-21T06:04:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.447+0000 7f6243419740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8ef990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.447+0000 7f6243419740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8efed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.447+0000 7f6243419740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8fbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.447+0000 7f6243419740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55633d6ac810 con 0x55633d515410 2024-09-21T06:04:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.447+0000 7f6243419740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55633d7e6550 con 0x55633d51d5f0 2024-09-21T06:04:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.447+0000 7f6243419740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55633d8f2a70 con 0x55633d53e2d0 2024-09-21T06:04:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.447+0000 7f6243419740 10 client.0 _ll_register_callbacks cb 0x55633d7f6040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.447+0000 7f6239e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8ef990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.447+0000 7f6239400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8efed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.447+0000 7f6239400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8efed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:43680/0 (socket says 172.21.15.37:43680) 2024-09-21T06:04:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.447+0000 7f6239400640 1 -- 172.21.15.37:0/1294991668 learned_addr learned my addr 172.21.15.37:0/1294991668 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.447+0000 7f623a800640 1 --2- 172.21.15.37:0/1294991668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8fbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.448+0000 7f6239400640 1 -- 172.21.15.37:0/1294991668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 msgr2=0x55633d8fbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.448+0000 7f6239400640 1 --2- 172.21.15.37:0/1294991668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8fbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.448+0000 7f6239400640 1 -- 172.21.15.37:0/1294991668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 msgr2=0x55633d8ef990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.448+0000 7f6239400640 1 --2- 172.21.15.37:0/1294991668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8ef990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.448+0000 7f6239400640 1 -- 172.21.15.37:0/1294991668 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55633d7d8200 con 0x55633d51d5f0 2024-09-21T06:04:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.448+0000 7f623a800640 1 --2- 172.21.15.37:0/1294991668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8fbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.448+0000 7f6239400640 1 --2- 172.21.15.37:0/1294991668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8efed0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f62240ad4e0 tx=0x7f62240b6df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95ed3abb3ba35208 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.449+0000 7f6217400640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-21T06:04:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.449+0000 7f6217400640 1 -- 172.21.15.37:0/1294991668 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62240acea0 con 0x55633d51d5f0 2024-09-21T06:04:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.449+0000 7f6243419740 1 -- 172.21.15.37:0/1294991668 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6230003e20 con 0x55633d51d5f0 2024-09-21T06:04:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.449+0000 7f6217400640 1 -- 172.21.15.37:0/1294991668 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f62240e73c0 con 0x55633d51d5f0 2024-09-21T06:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.449+0000 7f6217400640 1 -- 172.21.15.37:0/1294991668 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f622400ce60 con 0x55633d51d5f0 2024-09-21T06:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.449+0000 7f6243419740 10 client.25841 fetch_fsmap learned FSMap version 21 2024-09-21T06:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.449+0000 7f6243419740 1 -- 172.21.15.37:0/1294991668 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55633d8fe810 con 0x55633d51d5f0 2024-09-21T06:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.449+0000 7f6217400640 1 -- 172.21.15.37:0/1294991668 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6230003e20 con 0x55633d51d5f0 2024-09-21T06:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.450+0000 7f6217400640 1 -- 172.21.15.37:0/1294991668 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f62240a8f30 con 0x55633d51d5f0 2024-09-21T06:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.450+0000 7f6243419740 10 client.25841 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.450+0000 7f6243419740 10 client.25841 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.450+0000 7f6243419740 20 client.25841 populate_metadata read hostname 'smithi037' 2024-09-21T06:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.450+0000 7f6243419740 1 --2- 172.21.15.37:0/1294991668 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55633d4fcc50 0x55633d901cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.450+0000 7f6243419740 4 client.25841 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.450+0000 7f6243419740 1 -- 172.21.15.37:0/1294991668 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55633d85df40 con 0x55633d4fcc50 2024-09-21T06:04:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.450+0000 7f6239e00640 1 --2- 172.21.15.37:0/1294991668 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55633d4fcc50 0x55633d901cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.451+0000 7f6239e00640 1 --2- 172.21.15.37:0/1294991668 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55633d4fcc50 0x55633d901cc0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf7cd76c5c56302f server_cookie=2c361a8077341b4b in_seq=0 out_seq=0 2024-09-21T06:04:39.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.451+0000 7f6217400640 10 client.25841 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:04:39.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6217400640 1 -- 172.21.15.37:0/1294991668 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55633d85df40 con 0x55633d4fcc50 2024-09-21T06:04:39.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6217400640 10 client.25841 handle_command_reply: tid=0 2024-09-21T06:04:39.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6243419740 1 client.25841 shutdown 2024-09-21T06:04:39.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6243419740 1 -- 172.21.15.37:0/1294991668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 msgr2=0x55633d8efed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6243419740 1 --2- 172.21.15.37:0/1294991668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8efed0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f62240ad4e0 tx=0x7f62240b6df0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6243419740 1 -- 172.21.15.37:0/1294991668 shutdown_connections 2024-09-21T06:04:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6243419740 1 --2- 172.21.15.37:0/1294991668 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55633d4fcc50 0x55633d901cc0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6243419740 1 --2- 172.21.15.37:0/1294991668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8fbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6243419740 1 --2- 172.21.15.37:0/1294991668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8efed0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6243419740 1 --2- 172.21.15.37:0/1294991668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8ef990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6217400640 0 client.25841 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:04:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6243419740 1 -- 172.21.15.37:0/1294991668 >> 172.21.15.37:0/1294991668 conn(0x55633d5326c0 msgr2=0x55633d8e7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:39.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6243419740 1 -- 172.21.15.37:0/1294991668 shutdown_connections 2024-09-21T06:04:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.452+0000 7f6243419740 1 -- 172.21.15.37:0/1294991668 wait complete. 2024-09-21T06:04:39.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.453+0000 7f6243419740 20 client.25841 trim_cache size 0 max 16384 2024-09-21T06:04:39.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.471+0000 7f6243419740 1 Processor -- start 2024-09-21T06:04:39.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.471+0000 7f6243419740 1 -- start start 2024-09-21T06:04:39.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.471+0000 7f6243419740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d515410 0x55633d8f1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.471+0000 7f6243419740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d51d5f0 0x55633d8fbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.471+0000 7f6243419740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d53e2d0 0x55633d8ecb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.471+0000 7f6243419740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f621800dca0 con 0x55633d51d5f0 2024-09-21T06:04:39.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.471+0000 7f6243419740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6218010520 con 0x55633d53e2d0 2024-09-21T06:04:39.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.471+0000 7f6243419740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f621800e310 con 0x55633d515410 2024-09-21T06:04:39.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.472+0000 7f6239400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d51d5f0 0x55633d8fbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.472+0000 7f6239400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d51d5f0 0x55633d8fbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33566/0 (socket says 172.21.15.37:33566) 2024-09-21T06:04:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.472+0000 7f6239400640 1 -- 172.21.15.37:0/4237834999 learned_addr learned my addr 172.21.15.37:0/4237834999 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.472+0000 7f6239e00640 1 --2- 172.21.15.37:0/4237834999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d515410 0x55633d8f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.472+0000 7f623a800640 1 --2- 172.21.15.37:0/4237834999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d53e2d0 0x55633d8ecb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.472+0000 7f6239400640 1 -- 172.21.15.37:0/4237834999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d515410 msgr2=0x55633d8f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.472+0000 7f6239400640 1 --2- 172.21.15.37:0/4237834999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d515410 0x55633d8f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.472+0000 7f6239400640 1 -- 172.21.15.37:0/4237834999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d53e2d0 msgr2=0x55633d8ecb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.472+0000 7f6239400640 1 --2- 172.21.15.37:0/4237834999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d53e2d0 0x55633d8ecb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.472+0000 7f6239400640 1 -- 172.21.15.37:0/4237834999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55633d8ea5c0 con 0x55633d51d5f0 2024-09-21T06:04:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.472+0000 7f6239400640 1 --2- 172.21.15.37:0/4237834999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d51d5f0 0x55633d8fbcc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f62240a9ad0 tx=0x7f62240e79c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa7772d0666b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.473+0000 7f6222600640 1 -- 172.21.15.37:0/4237834999 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62240accc0 con 0x55633d51d5f0 2024-09-21T06:04:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.473+0000 7f6222600640 1 -- 172.21.15.37:0/4237834999 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62240ad060 con 0x55633d51d5f0 2024-09-21T06:04:39.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.473+0000 7f6222600640 1 -- 172.21.15.37:0/4237834999 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62240e74f0 con 0x55633d51d5f0 2024-09-21T06:04:39.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.474+0000 7f6243419740 1 -- 172.21.15.37:0/4237834999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d51d5f0 msgr2=0x55633d8fbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.474+0000 7f6243419740 1 --2- 172.21.15.37:0/4237834999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d51d5f0 0x55633d8fbcc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f62240a9ad0 tx=0x7f62240e79c0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.474+0000 7f6243419740 1 -- 172.21.15.37:0/4237834999 shutdown_connections 2024-09-21T06:04:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.474+0000 7f6243419740 1 --2- 172.21.15.37:0/4237834999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d53e2d0 0x55633d8ecb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.474+0000 7f6243419740 1 --2- 172.21.15.37:0/4237834999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d51d5f0 0x55633d8fbcc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.474+0000 7f6243419740 1 --2- 172.21.15.37:0/4237834999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d515410 0x55633d8f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.474+0000 7f6243419740 1 -- 172.21.15.37:0/4237834999 >> 172.21.15.37:0/4237834999 conn(0x55633d5326c0 msgr2=0x55633d8e52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.474+0000 7f6243419740 1 -- 172.21.15.37:0/4237834999 shutdown_connections 2024-09-21T06:04:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.474+0000 7f6243419740 1 -- 172.21.15.37:0/4237834999 wait complete. 2024-09-21T06:04:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.475+0000 7f6243419740 1 -- start start 2024-09-21T06:04:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.475+0000 7f6243419740 1 Processor -- start 2024-09-21T06:04:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.476+0000 7f6243419740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8f8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.476+0000 7f6243419740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.476+0000 7f6243419740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8f3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.476+0000 7f6243419740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f621800e9e0 con 0x55633d515410 2024-09-21T06:04:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.476+0000 7f6243419740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f621800fe50 con 0x55633d51d5f0 2024-09-21T06:04:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.476+0000 7f6243419740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f621800f0b0 con 0x55633d53e2d0 2024-09-21T06:04:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.476+0000 7f6243419740 10 client.0 _ll_register_callbacks cb 0x7f62240a9c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:04:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.476+0000 7f6239e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.476+0000 7f6239e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8f8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33582/0 (socket says 172.21.15.37:33582) 2024-09-21T06:04:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.476+0000 7f6239e00640 1 -- 172.21.15.37:0/1158666348 learned_addr learned my addr 172.21.15.37:0/1158666348 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.476+0000 7f6239400640 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.476+0000 7f623a800640 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.477+0000 7f6239e00640 1 -- 172.21.15.37:0/1158666348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 msgr2=0x55633d8f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.477+0000 7f6239e00640 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8f3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.477+0000 7f6239e00640 1 -- 172.21.15.37:0/1158666348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 msgr2=0x55633d8f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:04:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.477+0000 7f6239e00640 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8f2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.477+0000 7f6239e00640 1 -- 172.21.15.37:0/1158666348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55633d902080 con 0x55633d515410 2024-09-21T06:04:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.477+0000 7f623a800640 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.477+0000 7f6239400640 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.477+0000 7f6239e00640 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8f8380 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f62280042f0 tx=0x7f6228009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e8cd8c2a7dce7c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.477+0000 7f6217400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T06:04:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.477+0000 7f6217400640 1 -- 172.21.15.37:0/1158666348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6228060060 con 0x55633d515410 2024-09-21T06:04:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.477+0000 7f6217400640 1 -- 172.21.15.37:0/1158666348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f6228004b80 con 0x55633d515410 2024-09-21T06:04:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.477+0000 7f6243419740 1 -- 172.21.15.37:0/1158666348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62240ad060 con 0x55633d515410 2024-09-21T06:04:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.478+0000 7f6217400640 1 -- 172.21.15.37:0/1158666348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6228067050 con 0x55633d515410 2024-09-21T06:04:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.478+0000 7f6243419740 10 client.15798 fetch_fsmap learned FSMap version 21 2024-09-21T06:04:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.478+0000 7f6243419740 1 -- 172.21.15.37:0/1158666348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55633d96d310 con 0x55633d515410 2024-09-21T06:04:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.478+0000 7f6217400640 1 -- 172.21.15.37:0/1158666348 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62240ad060 con 0x55633d515410 2024-09-21T06:04:39.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.478+0000 7f6217400640 1 -- 172.21.15.37:0/1158666348 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f62280324b0 con 0x55633d515410 2024-09-21T06:04:39.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.478+0000 7f6243419740 10 client.15798 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T06:04:39.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.478+0000 7f6243419740 10 client.15798 resolve_mds: validated gid 24731 aka daemon mds.b 2024-09-21T06:04:39.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.478+0000 7f6243419740 20 client.15798 populate_metadata read hostname 'smithi037' 2024-09-21T06:04:39.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.478+0000 7f6243419740 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55633d4d2000 0x55633d96fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:39.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.478+0000 7f6243419740 4 client.15798 mds_command: new command op to 24731 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-21T06:04:39.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.478+0000 7f6243419740 1 -- 172.21.15.37:0/1158666348 --> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55633d8599f0 con 0x55633d4d2000 2024-09-21T06:04:39.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.479+0000 7f6239400640 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55633d4d2000 0x55633d96fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:39.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.480+0000 7f6239400640 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55633d4d2000 0x55633d96fa80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56722d276a1da330 server_cookie=f7a5fead0751f52b in_seq=0 out_seq=0 2024-09-21T06:04:39.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.480+0000 7f6217400640 10 client.15798 ms_handle_connect on v2:172.21.15.67:6838/2815536303 2024-09-21T06:04:39.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.480+0000 7f6217400640 1 -- 172.21.15.37:0/1158666348 <== mds.0 v2:172.21.15.67:6838/2815536303 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55633d8599f0 con 0x55633d4d2000 2024-09-21T06:04:39.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.480+0000 7f6217400640 10 client.15798 handle_command_reply: tid=0 2024-09-21T06:04:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.480+0000 7f6243419740 1 client.15798 shutdown 2024-09-21T06:04:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.480+0000 7f6243419740 1 -- 172.21.15.37:0/1158666348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 msgr2=0x55633d8f8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.480+0000 7f6243419740 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8f8380 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f62280042f0 tx=0x7f6228009260 comp rx=0 tx=0).stop 2024-09-21T06:04:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.481+0000 7f6243419740 1 -- 172.21.15.37:0/1158666348 shutdown_connections 2024-09-21T06:04:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.481+0000 7f6243419740 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.67:6838/2815536303,v1:172.21.15.67:6839/2815536303] conn(0x55633d4d2000 0x55633d96fa80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.481+0000 7f6243419740 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55633d53e2d0 0x55633d8f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.481+0000 7f6243419740 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55633d51d5f0 0x55633d8f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.481+0000 7f6243419740 1 --2- 172.21.15.37:0/1158666348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55633d515410 0x55633d8f8380 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.481+0000 7f6243419740 1 -- 172.21.15.37:0/1158666348 >> 172.21.15.37:0/1158666348 conn(0x55633d5326c0 msgr2=0x55633d8e1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.481+0000 7f6217400640 0 client.15798 ms_handle_reset on v2:172.21.15.67:6838/2815536303 2024-09-21T06:04:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.481+0000 7f6243419740 1 -- 172.21.15.37:0/1158666348 shutdown_connections 2024-09-21T06:04:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.481+0000 7f6243419740 1 -- 172.21.15.37:0/1158666348 wait complete. 2024-09-21T06:04:39.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.481+0000 7f6243419740 20 client.15798 trim_cache size 0 max 16384 2024-09-21T06:04:39.485 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:04:39.485 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-09-21T06:04:39.485 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24731, 2024-09-21T06:04:39.485 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 44, 2024-09-21T06:04:39.485 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": {} 2024-09-21T06:04:39.485 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:04:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.482+0000 7f623c800640 1 -- 172.21.15.37:0/290870699 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f621c0b6590 msgr2=0x7f621c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.482+0000 7f623c800640 1 --2- 172.21.15.37:0/290870699 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f621c0b6590 0x7f621c0b8aa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6228005ab0 tx=0x7f6228005a20 comp rx=0 tx=0).stop 2024-09-21T06:04:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.482+0000 7f623c800640 1 -- 172.21.15.37:0/290870699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341094b0 msgr2=0x7f6234075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.482+0000 7f623c800640 1 --2- 172.21.15.37:0/290870699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341094b0 0x7f6234075c50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f622400e9f0 tx=0x7f622400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.482+0000 7f623c800640 1 -- 172.21.15.37:0/290870699 shutdown_connections 2024-09-21T06:04:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.482+0000 7f623c800640 1 --2- 172.21.15.37:0/290870699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6234109e00 0x7f6234076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.482+0000 7f623c800640 1 --2- 172.21.15.37:0/290870699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341094b0 0x7f6234075c50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.482+0000 7f623c800640 1 --2- 172.21.15.37:0/290870699 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f621c0b6590 0x7f621c0b8aa0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.482+0000 7f623c800640 1 --2- 172.21.15.37:0/290870699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6234103b70 0x7f6234075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.482+0000 7f623c800640 1 -- 172.21.15.37:0/290870699 >> 172.21.15.37:0/290870699 conn(0x7f62340ff5e0 msgr2=0x7f6234101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.482+0000 7f623c800640 1 -- 172.21.15.37:0/290870699 shutdown_connections 2024-09-21T06:04:39.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:39.482+0000 7f623c800640 1 -- 172.21.15.37:0/290870699 wait complete. 2024-09-21T06:04:39.811 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:39 smithi037 ceph-mon[30631]: pgmap v736: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 376 op/s 2024-09-21T06:04:39.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:39 smithi067 ceph-mon[34443]: pgmap v736: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 376 op/s 2024-09-21T06:04:40.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:39 smithi144 ceph-mon[34351]: pgmap v736: 129 pgs: 129 active+clean; 136 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 376 op/s 2024-09-21T06:04:40.527 INFO:tasks.quiescer:done joining Quiescers 2024-09-21T06:04:40.527 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T06:04:40.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:04:40.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.766+0000 7f20dbe00640 1 -- 172.21.15.37:0/2721460021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc1070e0 msgr2=0x7f20dc10da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.766+0000 7f20dbe00640 1 --2- 172.21.15.37:0/2721460021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc1070e0 0x7f20dc10da80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009ca0 tx=0x7f20d402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.766+0000 7f20dbe00640 1 -- 172.21.15.37:0/2721460021 shutdown_connections 2024-09-21T06:04:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.766+0000 7f20dbe00640 1 --2- 172.21.15.37:0/2721460021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc1070e0 0x7f20dc10da80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.766+0000 7f20dbe00640 1 --2- 172.21.15.37:0/2721460021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20dc106740 0x7f20dc106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.766+0000 7f20dbe00640 1 --2- 172.21.15.37:0/2721460021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20dc1056c0 0x7f20dc105b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.766+0000 7f20dbe00640 1 -- 172.21.15.37:0/2721460021 >> 172.21.15.37:0/2721460021 conn(0x7f20dc101000 msgr2=0x7f20dc1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.766+0000 7f20dbe00640 1 -- 172.21.15.37:0/2721460021 shutdown_connections 2024-09-21T06:04:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.766+0000 7f20dbe00640 1 -- 172.21.15.37:0/2721460021 wait complete. 2024-09-21T06:04:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.767+0000 7f20dbe00640 1 Processor -- start 2024-09-21T06:04:40.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.767+0000 7f20dbe00640 1 -- start start 2024-09-21T06:04:40.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.768+0000 7f20dbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc1056c0 0x7f20dc19bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.768+0000 7f20dbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20dc106740 0x7f20dc19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.768+0000 7f20dbe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20dc1070e0 0x7f20dc19d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.768+0000 7f20dbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc111310 con 0x7f20dc1056c0 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.768+0000 7f20dbe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc111190 con 0x7f20dc1070e0 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.768+0000 7f20dbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc111490 con 0x7f20dc106740 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.768+0000 7f20daa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc1056c0 0x7f20dc19bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.768+0000 7f20daa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc1056c0 0x7f20dc19bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33600/0 (socket says 172.21.15.37:33600) 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.768+0000 7f20daa00640 1 -- 172.21.15.37:0/923702257 learned_addr learned my addr 172.21.15.37:0/923702257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.768+0000 7f20db400640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20dc1070e0 0x7f20dc19d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.768+0000 7f20da000640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20dc106740 0x7f20dc19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.769+0000 7f20db400640 1 -- 172.21.15.37:0/923702257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20dc106740 msgr2=0x7f20dc19c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.769+0000 7f20db400640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20dc106740 0x7f20dc19c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.769+0000 7f20db400640 1 -- 172.21.15.37:0/923702257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc1056c0 msgr2=0x7f20dc19bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.769+0000 7f20db400640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc1056c0 0x7f20dc19bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.769+0000 7f20db400640 1 -- 172.21.15.37:0/923702257 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc19d910 con 0x7f20dc1070e0 2024-09-21T06:04:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.769+0000 7f20db400640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20dc1070e0 0x7f20dc19d0f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f20d402ade0 tx=0x7f20d4003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:40.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.769+0000 7f20d3400640 1 -- 172.21.15.37:0/923702257 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d40317e0 con 0x7f20dc1070e0 2024-09-21T06:04:40.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.769+0000 7f20dbe00640 1 -- 172.21.15.37:0/923702257 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20dc19dba0 con 0x7f20dc1070e0 2024-09-21T06:04:40.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.769+0000 7f20d3400640 1 -- 172.21.15.37:0/923702257 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20d402f310 con 0x7f20dc1070e0 2024-09-21T06:04:40.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.769+0000 7f20d3400640 1 -- 172.21.15.37:0/923702257 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d402fa50 con 0x7f20dc1070e0 2024-09-21T06:04:40.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.769+0000 7f20dbe00640 1 -- 172.21.15.37:0/923702257 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20dc1a42f0 con 0x7f20dc1070e0 2024-09-21T06:04:40.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.771+0000 7f20dbe00640 1 -- 172.21.15.37:0/923702257 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20dc10c890 con 0x7f20dc1070e0 2024-09-21T06:04:40.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.773+0000 7f20d3400640 1 -- 172.21.15.37:0/923702257 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f20d4004580 con 0x7f20dc1070e0 2024-09-21T06:04:40.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.774+0000 7f20d3400640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f20c00b6590 0x7f20c00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:40.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.775+0000 7f20d3400640 1 -- 172.21.15.37:0/923702257 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f20d4108a30 con 0x7f20dc1070e0 2024-09-21T06:04:40.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.775+0000 7f20daa00640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f20c00b6590 0x7f20c00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:40.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.775+0000 7f20daa00640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f20c00b6590 0x7f20c00b8aa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009cd0 tx=0x7f20cc005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.777+0000 7f20d3400640 1 -- 172.21.15.37:0/923702257 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20d40cee90 con 0x7f20dc1070e0 2024-09-21T06:04:40.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.980+0000 7f20dbe00640 1 -- 172.21.15.37:0/923702257 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20dc063fc0 con 0x7f20dc1070e0 2024-09-21T06:04:40.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.982+0000 7f20d3400640 1 -- 172.21.15.37:0/923702257 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24836 (secure 0 0 0) 0x7f20d40d3270 con 0x7f20dc1070e0 2024-09-21T06:04:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:04:40.985 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":90,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:52:47.670174+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:50:49.791290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:50:51.877662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:51:01.928796+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:04:40.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.985+0000 7f20dbe00640 1 -- 172.21.15.37:0/923702257 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f20c00b6590 msgr2=0x7f20c00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.985+0000 7f20dbe00640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f20c00b6590 0x7f20c00b8aa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009cd0 tx=0x7f20cc005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:40.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.985+0000 7f20dbe00640 1 -- 172.21.15.37:0/923702257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20dc1070e0 msgr2=0x7f20dc19d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:40.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.985+0000 7f20dbe00640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20dc1070e0 0x7f20dc19d0f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f20d402ade0 tx=0x7f20d4003ba0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.985+0000 7f20dbe00640 1 -- 172.21.15.37:0/923702257 shutdown_connections 2024-09-21T06:04:40.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.985+0000 7f20dbe00640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f20c00b6590 0x7f20c00b8aa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.985+0000 7f20dbe00640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20dc1070e0 0x7f20dc19d0f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.985+0000 7f20dbe00640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20dc106740 0x7f20dc19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.985+0000 7f20dbe00640 1 --2- 172.21.15.37:0/923702257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc1056c0 0x7f20dc19bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:40.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.985+0000 7f20dbe00640 1 -- 172.21.15.37:0/923702257 >> 172.21.15.37:0/923702257 conn(0x7f20dc101000 msgr2=0x7f20dc109a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:40.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.985+0000 7f20dbe00640 1 -- 172.21.15.37:0/923702257 shutdown_connections 2024-09-21T06:04:40.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:40.985+0000 7f20dbe00640 1 -- 172.21.15.37:0/923702257 wait complete. 2024-09-21T06:04:41.011 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T05:45:48.604918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T05:50:49.791290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T05:50:51.877662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T05:51:01.928796+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T06:04:41.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:04:41.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.242+0000 7fc84fe00640 1 -- 172.21.15.37:0/3947085328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc850113be0 msgr2=0x7fc8501160b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.242+0000 7fc84fe00640 1 --2- 172.21.15.37:0/3947085328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc850113be0 0x7fc8501160b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc848009900 tx=0x7fc84802a410 comp rx=0 tx=0).stop 2024-09-21T06:04:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.242+0000 7fc84fe00640 1 -- 172.21.15.37:0/3947085328 shutdown_connections 2024-09-21T06:04:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.242+0000 7fc84fe00640 1 --2- 172.21.15.37:0/3947085328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc850113be0 0x7fc8501160b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.242+0000 7fc84fe00640 1 --2- 172.21.15.37:0/3947085328 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc85010cd20 0x7fc85010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.242+0000 7fc84fe00640 1 --2- 172.21.15.37:0/3947085328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85010a3c0 0x7fc85010c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.242+0000 7fc84fe00640 1 -- 172.21.15.37:0/3947085328 >> 172.21.15.37:0/3947085328 conn(0x7fc850070a10 msgr2=0x7fc850072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.243+0000 7fc84fe00640 1 -- 172.21.15.37:0/3947085328 shutdown_connections 2024-09-21T06:04:41.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.244+0000 7fc84fe00640 1 -- 172.21.15.37:0/3947085328 wait complete. 2024-09-21T06:04:41.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.246+0000 7fc84fe00640 1 Processor -- start 2024-09-21T06:04:41.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.249+0000 7fc84fe00640 1 -- start start 2024-09-21T06:04:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.250+0000 7fc84fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85010a3c0 0x7fc8501a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.250+0000 7fc84fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc85010cd20 0x7fc8501a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.250+0000 7fc84fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc850113be0 0x7fc8501a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.250+0000 7fc84fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc850119ab0 con 0x7fc85010a3c0 2024-09-21T06:04:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.250+0000 7fc84fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc850119930 con 0x7fc85010cd20 2024-09-21T06:04:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.250+0000 7fc84fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc850119c30 con 0x7fc850113be0 2024-09-21T06:04:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.251+0000 7fc84ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85010a3c0 0x7fc8501a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.251+0000 7fc84ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85010a3c0 0x7fc8501a8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44426/0 (socket says 172.21.15.37:44426) 2024-09-21T06:04:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.251+0000 7fc84ea00640 1 -- 172.21.15.37:0/4187347933 learned_addr learned my addr 172.21.15.37:0/4187347933 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.251+0000 7fc84f400640 1 --2- 172.21.15.37:0/4187347933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc850113be0 0x7fc8501a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.253+0000 7fc84f400640 1 -- 172.21.15.37:0/4187347933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc85010cd20 msgr2=0x7fc8501a9100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T06:04:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.254+0000 7fc84f400640 1 --2- 172.21.15.37:0/4187347933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc85010cd20 0x7fc8501a9100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.254+0000 7fc84f400640 1 -- 172.21.15.37:0/4187347933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85010a3c0 msgr2=0x7fc8501a8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.254+0000 7fc84f400640 1 --2- 172.21.15.37:0/4187347933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85010a3c0 0x7fc8501a8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.254+0000 7fc84f400640 1 -- 172.21.15.37:0/4187347933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8501aa4d0 con 0x7fc850113be0 2024-09-21T06:04:41.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.256+0000 7fc84f400640 1 --2- 172.21.15.37:0/4187347933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc850113be0 0x7fc8501a9cb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc848009230 tx=0x7fc848003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:41.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.257+0000 7fc847400640 1 -- 172.21.15.37:0/4187347933 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84803f070 con 0x7fc850113be0 2024-09-21T06:04:41.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.257+0000 7fc84fe00640 1 -- 172.21.15.37:0/4187347933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8501aa760 con 0x7fc850113be0 2024-09-21T06:04:41.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.257+0000 7fc84fe00640 1 -- 172.21.15.37:0/4187347933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8501b0eb0 con 0x7fc850113be0 2024-09-21T06:04:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.257+0000 7fc847400640 1 -- 172.21.15.37:0/4187347933 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc848031c50 con 0x7fc850113be0 2024-09-21T06:04:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.257+0000 7fc847400640 1 -- 172.21.15.37:0/4187347933 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc848035030 con 0x7fc850113be0 2024-09-21T06:04:41.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.262+0000 7fc84fe00640 1 -- 172.21.15.37:0/4187347933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8300052c0 con 0x7fc850113be0 2024-09-21T06:04:41.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.266+0000 7fc847400640 1 -- 172.21.15.37:0/4187347933 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fc848042070 con 0x7fc850113be0 2024-09-21T06:04:41.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.268+0000 7fc847400640 1 --2- 172.21.15.37:0/4187347933 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8340b6650 0x7fc8340b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.268+0000 7fc847400640 1 -- 172.21.15.37:0/4187347933 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fc848108360 con 0x7fc850113be0 2024-09-21T06:04:41.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.268+0000 7fc84ea00640 1 --2- 172.21.15.37:0/4187347933 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8340b6650 0x7fc8340b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.269+0000 7fc84ea00640 1 --2- 172.21.15.37:0/4187347933 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8340b6650 0x7fc8340b8b60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc83c005c40 tx=0x7fc83c009500 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:41.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.272+0000 7fc847400640 1 -- 172.21.15.37:0/4187347933 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8480ce7c0 con 0x7fc850113be0 2024-09-21T06:04:41.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.470+0000 7fc84fe00640 1 -- 172.21.15.37:0/4187347933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc830005dc0 con 0x7fc850113be0 2024-09-21T06:04:41.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.471+0000 7fc847400640 1 -- 172.21.15.37:0/4187347933 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7fc8480d2ba0 con 0x7fc850113be0 2024-09-21T06:04:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-09-21T06:04:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.473+0000 7fc84fe00640 1 -- 172.21.15.37:0/4187347933 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8340b6650 msgr2=0x7fc8340b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.473+0000 7fc84fe00640 1 --2- 172.21.15.37:0/4187347933 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8340b6650 0x7fc8340b8b60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc83c005c40 tx=0x7fc83c009500 comp rx=0 tx=0).stop 2024-09-21T06:04:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.473+0000 7fc84fe00640 1 -- 172.21.15.37:0/4187347933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc850113be0 msgr2=0x7fc8501a9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.473+0000 7fc84fe00640 1 --2- 172.21.15.37:0/4187347933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc850113be0 0x7fc8501a9cb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc848009230 tx=0x7fc848003b90 comp rx=0 tx=0).stop 2024-09-21T06:04:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.473+0000 7fc84fe00640 1 -- 172.21.15.37:0/4187347933 shutdown_connections 2024-09-21T06:04:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.473+0000 7fc84fe00640 1 --2- 172.21.15.37:0/4187347933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc850113be0 0x7fc8501a9cb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.473+0000 7fc84fe00640 1 --2- 172.21.15.37:0/4187347933 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fc8340b6650 0x7fc8340b8b60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.473+0000 7fc84fe00640 1 --2- 172.21.15.37:0/4187347933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc85010cd20 0x7fc8501a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.473+0000 7fc84fe00640 1 --2- 172.21.15.37:0/4187347933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85010a3c0 0x7fc8501a8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.473+0000 7fc84fe00640 1 -- 172.21.15.37:0/4187347933 >> 172.21.15.37:0/4187347933 conn(0x7fc850070a10 msgr2=0x7fc85010b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.473+0000 7fc84fe00640 1 -- 172.21.15.37:0/4187347933 shutdown_connections 2024-09-21T06:04:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.473+0000 7fc84fe00640 1 -- 172.21.15.37:0/4187347933 wait complete. 2024-09-21T06:04:41.518 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T06:04:41.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.743+0000 7f7b1a600640 1 -- 172.21.15.37:0/2298645896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b141058a0 msgr2=0x7f7b14105d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.743+0000 7f7b1a600640 1 --2- 172.21.15.37:0/2298645896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b141058a0 0x7f7b14105d10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009900 tx=0x7f7b0402a410 comp rx=0 tx=0).stop 2024-09-21T06:04:41.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.743+0000 7f7b1a600640 1 -- 172.21.15.37:0/2298645896 shutdown_connections 2024-09-21T06:04:41.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.743+0000 7f7b1a600640 1 --2- 172.21.15.37:0/2298645896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b141072c0 0x7f7b1410dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.743+0000 7f7b1a600640 1 --2- 172.21.15.37:0/2298645896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b14106920 0x7f7b14106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.743+0000 7f7b1a600640 1 --2- 172.21.15.37:0/2298645896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b141058a0 0x7f7b14105d10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.743+0000 7f7b1a600640 1 -- 172.21.15.37:0/2298645896 >> 172.21.15.37:0/2298645896 conn(0x7f7b14101220 msgr2=0x7f7b14103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:41.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.743+0000 7f7b1a600640 1 -- 172.21.15.37:0/2298645896 shutdown_connections 2024-09-21T06:04:41.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.743+0000 7f7b1a600640 1 -- 172.21.15.37:0/2298645896 wait complete. 2024-09-21T06:04:41.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.744+0000 7f7b1a600640 1 Processor -- start 2024-09-21T06:04:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.744+0000 7f7b1a600640 1 -- start start 2024-09-21T06:04:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.744+0000 7f7b1a600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b141058a0 0x7f7b1419c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.744+0000 7f7b1a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b14106920 0x7f7b1419c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b1a600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b141072c0 0x7f7b1419d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b1a600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7b141114e0 con 0x7f7b141058a0 2024-09-21T06:04:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b1a600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7b14111360 con 0x7f7b141072c0 2024-09-21T06:04:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b1a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7b14111660 con 0x7f7b14106920 2024-09-21T06:04:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b13400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b141058a0 0x7f7b1419c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b13400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b141058a0 0x7f7b1419c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44456/0 (socket says 172.21.15.37:44456) 2024-09-21T06:04:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b13400640 1 -- 172.21.15.37:0/651369633 learned_addr learned my addr 172.21.15.37:0/651369633 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b12a00640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b14106920 0x7f7b1419c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b13e00640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b141072c0 0x7f7b1419d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b13400640 1 -- 172.21.15.37:0/651369633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b14106920 msgr2=0x7f7b1419c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b13400640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b14106920 0x7f7b1419c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b13400640 1 -- 172.21.15.37:0/651369633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b141072c0 msgr2=0x7f7b1419d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b13400640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b141072c0 0x7f7b1419d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.745+0000 7f7b13400640 1 -- 172.21.15.37:0/651369633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1419db70 con 0x7f7b141058a0 2024-09-21T06:04:41.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.746+0000 7f7b13400640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b141058a0 0x7f7b1419c130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7b04006010 tx=0x7f7b040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:41.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.746+0000 7f7b0be00640 1 -- 172.21.15.37:0/651369633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0403f030 con 0x7f7b141058a0 2024-09-21T06:04:41.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.746+0000 7f7b1a600640 1 -- 172.21.15.37:0/651369633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1419de00 con 0x7f7b141058a0 2024-09-21T06:04:41.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.746+0000 7f7b0be00640 1 -- 172.21.15.37:0/651369633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b04032e50 con 0x7f7b141058a0 2024-09-21T06:04:41.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.746+0000 7f7b0be00640 1 -- 172.21.15.37:0/651369633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04035070 con 0x7f7b141058a0 2024-09-21T06:04:41.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.746+0000 7f7b1a600640 1 -- 172.21.15.37:0/651369633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1419e110 con 0x7f7b141058a0 2024-09-21T06:04:41.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.747+0000 7f7b1a600640 1 -- 172.21.15.37:0/651369633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1410ca70 con 0x7f7b141058a0 2024-09-21T06:04:41.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.750+0000 7f7b0be00640 1 -- 172.21.15.37:0/651369633 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f7b04042030 con 0x7f7b141058a0 2024-09-21T06:04:41.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.751+0000 7f7b0be00640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7af80b6510 0x7f7af80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:41.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.751+0000 7f7b0be00640 1 -- 172.21.15.37:0/651369633 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f7b04108260 con 0x7f7b141058a0 2024-09-21T06:04:41.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.751+0000 7f7b12a00640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7af80b6510 0x7f7af80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:41.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.752+0000 7f7b12a00640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7af80b6510 0x7f7af80b8a20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009bd0 tx=0x7f7b00005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:41.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.753+0000 7f7b0be00640 1 -- 172.21.15.37:0/651369633 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b040d2aa0 con 0x7f7b141058a0 2024-09-21T06:04:41.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:41 smithi037 ceph-mon[30631]: pgmap v737: 129 pgs: 129 active+clean; 135 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 898 KiB/s wr, 326 op/s 2024-09-21T06:04:41.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:41 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/923702257' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:04:41.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:41 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/4187347933' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:04:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.949+0000 7f7b1a600640 1 -- 172.21.15.37:0/651369633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7b14063fc0 con 0x7f7b141058a0 2024-09-21T06:04:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.950+0000 7f7b0be00640 1 -- 172.21.15.37:0/651369633 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f7b040d5e20 con 0x7f7b141058a0 2024-09-21T06:04:41.952 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-09-21T06:04:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.952+0000 7f7b1a600640 1 -- 172.21.15.37:0/651369633 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7af80b6510 msgr2=0x7f7af80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.952+0000 7f7b1a600640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7af80b6510 0x7f7af80b8a20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009bd0 tx=0x7f7b00005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.952+0000 7f7b1a600640 1 -- 172.21.15.37:0/651369633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b141058a0 msgr2=0x7f7b1419c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.952+0000 7f7b1a600640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b141058a0 0x7f7b1419c130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7b04006010 tx=0x7f7b040042f0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.952+0000 7f7b1a600640 1 -- 172.21.15.37:0/651369633 shutdown_connections 2024-09-21T06:04:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.952+0000 7f7b1a600640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f7af80b6510 0x7f7af80b8a20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.952+0000 7f7b1a600640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b141072c0 0x7f7b1419d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.952+0000 7f7b1a600640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b14106920 0x7f7b1419c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.952+0000 7f7b1a600640 1 --2- 172.21.15.37:0/651369633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b141058a0 0x7f7b1419c130 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.952+0000 7f7b1a600640 1 -- 172.21.15.37:0/651369633 >> 172.21.15.37:0/651369633 conn(0x7f7b14101220 msgr2=0x7f7b14109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.953+0000 7f7b1a600640 1 -- 172.21.15.37:0/651369633 shutdown_connections 2024-09-21T06:04:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:41.953+0000 7f7b1a600640 1 -- 172.21.15.37:0/651369633 wait complete. 2024-09-21T06:04:41.980 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T06:04:41.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:41 smithi067 ceph-mon[34443]: pgmap v737: 129 pgs: 129 active+clean; 135 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 898 KiB/s wr, 326 op/s 2024-09-21T06:04:41.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:41 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/923702257' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:04:41.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:41 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/4187347933' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:04:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:41 smithi144 ceph-mon[34351]: pgmap v737: 129 pgs: 129 active+clean; 135 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 898 KiB/s wr, 326 op/s 2024-09-21T06:04:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:41 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/923702257' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:04:42.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:41 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/4187347933' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.205+0000 7fd85d000640 1 -- 172.21.15.37:0/1215440433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858104710 msgr2=0x7fd858104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.205+0000 7fd85d000640 1 --2- 172.21.15.37:0/1215440433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858104710 0x7fd858104b20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd840009900 tx=0x7fd84002a410 comp rx=0 tx=0).stop 2024-09-21T06:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.205+0000 7fd85d000640 1 -- 172.21.15.37:0/1215440433 shutdown_connections 2024-09-21T06:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.205+0000 7fd85d000640 1 --2- 172.21.15.37:0/1215440433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8581050b0 0x7fd85810ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.205+0000 7fd85d000640 1 --2- 172.21.15.37:0/1215440433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858104710 0x7fd858104b20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.205+0000 7fd85d000640 1 --2- 172.21.15.37:0/1215440433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd858103690 0x7fd858103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.205+0000 7fd85d000640 1 -- 172.21.15.37:0/1215440433 >> 172.21.15.37:0/1215440433 conn(0x7fd8580fefd0 msgr2=0x7fd858101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.205+0000 7fd85d000640 1 -- 172.21.15.37:0/1215440433 shutdown_connections 2024-09-21T06:04:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.205+0000 7fd85d000640 1 -- 172.21.15.37:0/1215440433 wait complete. 2024-09-21T06:04:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.206+0000 7fd85d000640 1 Processor -- start 2024-09-21T06:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.206+0000 7fd85d000640 1 -- start start 2024-09-21T06:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.207+0000 7fd85d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858103690 0x7fd858199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.207+0000 7fd85d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd858104710 0x7fd85819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.207+0000 7fd85d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8581050b0 0x7fd85819b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.207+0000 7fd85d000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd85810f2c0 con 0x7fd858103690 2024-09-21T06:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.207+0000 7fd85d000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd85810f140 con 0x7fd858104710 2024-09-21T06:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.207+0000 7fd85d000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd85810f440 con 0x7fd8581050b0 2024-09-21T06:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.207+0000 7fd855e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858103690 0x7fd858199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.207+0000 7fd855e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858103690 0x7fd858199f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44462/0 (socket says 172.21.15.37:44462) 2024-09-21T06:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.207+0000 7fd855e00640 1 -- 172.21.15.37:0/2567732291 learned_addr learned my addr 172.21.15.37:0/2567732291 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.207+0000 7fd84fe00640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd858104710 0x7fd85819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.207+0000 7fd856800640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8581050b0 0x7fd85819b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.208+0000 7fd855e00640 1 -- 172.21.15.37:0/2567732291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8581050b0 msgr2=0x7fd85819b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.208+0000 7fd855e00640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8581050b0 0x7fd85819b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.208+0000 7fd855e00640 1 -- 172.21.15.37:0/2567732291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd858104710 msgr2=0x7fd85819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.208+0000 7fd855e00640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd858104710 0x7fd85819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.208+0000 7fd855e00640 1 -- 172.21.15.37:0/2567732291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85819b950 con 0x7fd858103690 2024-09-21T06:04:42.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.208+0000 7fd856800640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8581050b0 0x7fd85819b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.208+0000 7fd855e00640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858103690 0x7fd858199f10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd84800e9f0 tx=0x7fd84800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.208+0000 7fd84ea00640 1 -- 172.21.15.37:0/2567732291 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84800cd80 con 0x7fd858103690 2024-09-21T06:04:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.208+0000 7fd84ea00640 1 -- 172.21.15.37:0/2567732291 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8480108e0 con 0x7fd858103690 2024-09-21T06:04:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.208+0000 7fd85d000640 1 -- 172.21.15.37:0/2567732291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85819bc40 con 0x7fd858103690 2024-09-21T06:04:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.208+0000 7fd84ea00640 1 -- 172.21.15.37:0/2567732291 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848018980 con 0x7fd858103690 2024-09-21T06:04:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.208+0000 7fd85d000640 1 -- 172.21.15.37:0/2567732291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8581a2330 con 0x7fd858103690 2024-09-21T06:04:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.209+0000 7fd85d000640 1 -- 172.21.15.37:0/2567732291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85810a860 con 0x7fd858103690 2024-09-21T06:04:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.212+0000 7fd84ea00640 1 -- 172.21.15.37:0/2567732291 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fd848010430 con 0x7fd858103690 2024-09-21T06:04:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.213+0000 7fd84ea00640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd83c0b6590 0x7fd83c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.213+0000 7fd84ea00640 1 -- 172.21.15.37:0/2567732291 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fd8480e7e50 con 0x7fd858103690 2024-09-21T06:04:42.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.214+0000 7fd84fe00640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd83c0b6590 0x7fd83c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.214+0000 7fd84fe00640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd83c0b6590 0x7fd83c0b8aa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd840000c00 tx=0x7fd840031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:42.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.215+0000 7fd84ea00640 1 -- 172.21.15.37:0/2567732291 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8480b2690 con 0x7fd858103690 2024-09-21T06:04:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.410+0000 7fd85d000640 1 -- 172.21.15.37:0/2567732291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd858063fc0 con 0x7fd858103690 2024-09-21T06:04:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.411+0000 7fd84ea00640 1 -- 172.21.15.37:0/2567732291 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7fd8480b75d0 con 0x7fd858103690 2024-09-21T06:04:42.413 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-09-21T06:04:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.413+0000 7fd85d000640 1 -- 172.21.15.37:0/2567732291 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd83c0b6590 msgr2=0x7fd83c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.413+0000 7fd85d000640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd83c0b6590 0x7fd83c0b8aa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd840000c00 tx=0x7fd840031400 comp rx=0 tx=0).stop 2024-09-21T06:04:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.413+0000 7fd85d000640 1 -- 172.21.15.37:0/2567732291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858103690 msgr2=0x7fd858199f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.413+0000 7fd85d000640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858103690 0x7fd858199f10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd84800e9f0 tx=0x7fd84800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.414+0000 7fd85d000640 1 -- 172.21.15.37:0/2567732291 shutdown_connections 2024-09-21T06:04:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.414+0000 7fd85d000640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8581050b0 0x7fd85819b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.414+0000 7fd85d000640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd83c0b6590 0x7fd83c0b8aa0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.414+0000 7fd85d000640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd858104710 0x7fd85819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.414+0000 7fd85d000640 1 --2- 172.21.15.37:0/2567732291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd858103690 0x7fd858199f10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.414+0000 7fd85d000640 1 -- 172.21.15.37:0/2567732291 >> 172.21.15.37:0/2567732291 conn(0x7fd8580fefd0 msgr2=0x7fd858107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.414+0000 7fd85d000640 1 -- 172.21.15.37:0/2567732291 shutdown_connections 2024-09-21T06:04:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.414+0000 7fd85d000640 1 -- 172.21.15.37:0/2567732291 wait complete. 2024-09-21T06:04:42.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T06:04:42.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.667+0000 7fd1d3c00640 1 -- 172.21.15.37:0/3394145146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc103680 msgr2=0x7fd1cc103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.667+0000 7fd1d3c00640 1 --2- 172.21.15.37:0/3394145146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc103680 0x7fd1cc103af0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009900 tx=0x7fd1c002a410 comp rx=0 tx=0).stop 2024-09-21T06:04:42.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.667+0000 7fd1d3c00640 1 -- 172.21.15.37:0/3394145146 shutdown_connections 2024-09-21T06:04:42.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.667+0000 7fd1d3c00640 1 --2- 172.21.15.37:0/3394145146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1cc1050a0 0x7fd1cc10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.667+0000 7fd1d3c00640 1 --2- 172.21.15.37:0/3394145146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1cc104700 0x7fd1cc104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.667+0000 7fd1d3c00640 1 --2- 172.21.15.37:0/3394145146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc103680 0x7fd1cc103af0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.667+0000 7fd1d3c00640 1 -- 172.21.15.37:0/3394145146 >> 172.21.15.37:0/3394145146 conn(0x7fd1cc0fefe0 msgr2=0x7fd1cc101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:42.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.667+0000 7fd1d3c00640 1 -- 172.21.15.37:0/3394145146 shutdown_connections 2024-09-21T06:04:42.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.667+0000 7fd1d3c00640 1 -- 172.21.15.37:0/3394145146 wait complete. 2024-09-21T06:04:42.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.668+0000 7fd1d3c00640 1 Processor -- start 2024-09-21T06:04:42.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.668+0000 7fd1d3c00640 1 -- start start 2024-09-21T06:04:42.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.668+0000 7fd1d3c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1cc103680 0x7fd1cc076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.668+0000 7fd1d3c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc104700 0x7fd1cc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1d3c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1cc1050a0 0x7fd1cc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1d3c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc10f2f0 con 0x7fd1cc104700 2024-09-21T06:04:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1d3c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc10f170 con 0x7fd1cc103680 2024-09-21T06:04:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1d3c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc10f470 con 0x7fd1cc1050a0 2024-09-21T06:04:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1cbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc104700 0x7fd1cc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1cbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc104700 0x7fd1cc075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44488/0 (socket says 172.21.15.37:44488) 2024-09-21T06:04:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1cbe00640 1 -- 172.21.15.37:0/2039903634 learned_addr learned my addr 172.21.15.37:0/2039903634 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1d1200640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1cc103680 0x7fd1cc076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1d1c00640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1cc1050a0 0x7fd1cc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1cbe00640 1 -- 172.21.15.37:0/2039903634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1cc1050a0 msgr2=0x7fd1cc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1cbe00640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1cc1050a0 0x7fd1cc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1cbe00640 1 -- 172.21.15.37:0/2039903634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1cc103680 msgr2=0x7fd1cc076e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1cbe00640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1cc103680 0x7fd1cc076e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.669+0000 7fd1cbe00640 1 -- 172.21.15.37:0/2039903634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1cc076380 con 0x7fd1cc104700 2024-09-21T06:04:42.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.670+0000 7fd1cbe00640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc104700 0x7fd1cc075710 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800d950 tx=0x7fd1b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:42.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.670+0000 7fd1c9600640 1 -- 172.21.15.37:0/2039903634 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8017070 con 0x7fd1cc104700 2024-09-21T06:04:42.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.670+0000 7fd1c9600640 1 -- 172.21.15.37:0/2039903634 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1b8009c30 con 0x7fd1cc104700 2024-09-21T06:04:42.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.670+0000 7fd1c9600640 1 -- 172.21.15.37:0/2039903634 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800f620 con 0x7fd1cc104700 2024-09-21T06:04:42.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.670+0000 7fd1d3c00640 1 -- 172.21.15.37:0/2039903634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1cc1a3f90 con 0x7fd1cc104700 2024-09-21T06:04:42.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.670+0000 7fd1d3c00640 1 -- 172.21.15.37:0/2039903634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1cc1a43a0 con 0x7fd1cc104700 2024-09-21T06:04:42.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.671+0000 7fd1d3c00640 1 -- 172.21.15.37:0/2039903634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1cc10a850 con 0x7fd1cc104700 2024-09-21T06:04:42.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.673+0000 7fd1c9600640 1 -- 172.21.15.37:0/2039903634 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fd1b8010460 con 0x7fd1cc104700 2024-09-21T06:04:42.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.676+0000 7fd1c9600640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd1b40b6590 0x7fd1b40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.676+0000 7fd1c9600640 1 -- 172.21.15.37:0/2039903634 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fd1b80e7240 con 0x7fd1cc104700 2024-09-21T06:04:42.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.676+0000 7fd1d1200640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd1b40b6590 0x7fd1b40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.677+0000 7fd1d1200640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd1b40b6590 0x7fd1b40b8aa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0004770 tx=0x7fd1c00314a0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:42.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.680+0000 7fd1c9600640 1 -- 172.21.15.37:0/2039903634 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd1b8009de0 con 0x7fd1cc104700 2024-09-21T06:04:42.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.883+0000 7fd1d3c00640 1 -- 172.21.15.37:0/2039903634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd1cc063fc0 con 0x7fd1cc104700 2024-09-21T06:04:42.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.884+0000 7fd1c9600640 1 -- 172.21.15.37:0/2039903634 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7fd1b80b1a80 con 0x7fd1cc104700 2024-09-21T06:04:42.886 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-09-21T06:04:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.886+0000 7fd1d3c00640 1 -- 172.21.15.37:0/2039903634 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd1b40b6590 msgr2=0x7fd1b40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.886+0000 7fd1d3c00640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd1b40b6590 0x7fd1b40b8aa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0004770 tx=0x7fd1c00314a0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.886+0000 7fd1d3c00640 1 -- 172.21.15.37:0/2039903634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc104700 msgr2=0x7fd1cc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.886+0000 7fd1d3c00640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc104700 0x7fd1cc075710 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800d950 tx=0x7fd1b800de10 comp rx=0 tx=0).stop 2024-09-21T06:04:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.887+0000 7fd1d3c00640 1 -- 172.21.15.37:0/2039903634 shutdown_connections 2024-09-21T06:04:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.887+0000 7fd1d3c00640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1cc1050a0 0x7fd1cc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.887+0000 7fd1d3c00640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc104700 0x7fd1cc075710 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.887+0000 7fd1d3c00640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fd1b40b6590 0x7fd1b40b8aa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.887+0000 7fd1d3c00640 1 --2- 172.21.15.37:0/2039903634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1cc103680 0x7fd1cc076e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.887+0000 7fd1d3c00640 1 -- 172.21.15.37:0/2039903634 >> 172.21.15.37:0/2039903634 conn(0x7fd1cc0fefe0 msgr2=0x7fd1cc107a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.887+0000 7fd1d3c00640 1 -- 172.21.15.37:0/2039903634 shutdown_connections 2024-09-21T06:04:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:42.887+0000 7fd1d3c00640 1 -- 172.21.15.37:0/2039903634 wait complete. 2024-09-21T06:04:42.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T06:04:42.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:42 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/651369633' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:04:42.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:42 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2567732291' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:04:43.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:42 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/651369633' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:04:43.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:42 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2567732291' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:04:43.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.138+0000 7f4eadc00640 1 -- 172.21.15.37:0/1090583676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea81046f0 msgr2=0x7f4ea8104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:43.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.138+0000 7f4eadc00640 1 --2- 172.21.15.37:0/1090583676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea81046f0 0x7f4ea8104b00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009900 tx=0x7f4e9402a410 comp rx=0 tx=0).stop 2024-09-21T06:04:43.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.138+0000 7f4eadc00640 1 -- 172.21.15.37:0/1090583676 shutdown_connections 2024-09-21T06:04:43.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.138+0000 7f4eadc00640 1 --2- 172.21.15.37:0/1090583676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ea8105090 0x7f4ea810ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.138+0000 7f4eadc00640 1 --2- 172.21.15.37:0/1090583676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea81046f0 0x7f4ea8104b00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.138+0000 7f4eadc00640 1 --2- 172.21.15.37:0/1090583676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea8103670 0x7f4ea8103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.138+0000 7f4eadc00640 1 -- 172.21.15.37:0/1090583676 >> 172.21.15.37:0/1090583676 conn(0x7f4ea80fefd0 msgr2=0x7f4ea8101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:43.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.138+0000 7f4eadc00640 1 -- 172.21.15.37:0/1090583676 shutdown_connections 2024-09-21T06:04:43.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.138+0000 7f4eadc00640 1 -- 172.21.15.37:0/1090583676 wait complete. 2024-09-21T06:04:43.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.139+0000 7f4eadc00640 1 Processor -- start 2024-09-21T06:04:43.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.139+0000 7f4eadc00640 1 -- start start 2024-09-21T06:04:43.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4eadc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea8103670 0x7f4ea8199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:43.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4eadc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ea81046f0 0x7f4ea819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:43.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4eadc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea8105090 0x7f4ea819b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:43.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4eadc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea810f2f0 con 0x7f4ea8105090 2024-09-21T06:04:43.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4eadc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea810f170 con 0x7f4ea81046f0 2024-09-21T06:04:43.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4eadc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea810f470 con 0x7f4ea8103670 2024-09-21T06:04:43.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4ea7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea8105090 0x7f4ea819b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:43.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4ea7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea8105090 0x7f4ea819b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44514/0 (socket says 172.21.15.37:44514) 2024-09-21T06:04:43.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4ea7400640 1 -- 172.21.15.37:0/2901232794 learned_addr learned my addr 172.21.15.37:0/2901232794 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:04:43.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4ea6a00640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea8103670 0x7f4ea8199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:43.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4ea6000640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ea81046f0 0x7f4ea819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4ea7400640 1 -- 172.21.15.37:0/2901232794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea8103670 msgr2=0x7f4ea8199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4ea7400640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea8103670 0x7f4ea8199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4ea7400640 1 -- 172.21.15.37:0/2901232794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ea81046f0 msgr2=0x7f4ea819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4ea7400640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ea81046f0 0x7f4ea819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.140+0000 7f4ea7400640 1 -- 172.21.15.37:0/2901232794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea819b950 con 0x7f4ea8105090 2024-09-21T06:04:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.141+0000 7f4ea7400640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea8105090 0x7f4ea819b130 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000eb10 tx=0x7f4ea000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.141+0000 7f4e9f400640 1 -- 172.21.15.37:0/2901232794 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0004b20 con 0x7f4ea8105090 2024-09-21T06:04:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.141+0000 7f4e9f400640 1 -- 172.21.15.37:0/2901232794 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ea0004cc0 con 0x7f4ea8105090 2024-09-21T06:04:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.141+0000 7f4eadc00640 1 -- 172.21.15.37:0/2901232794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea819bc40 con 0x7f4ea8105090 2024-09-21T06:04:43.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.141+0000 7f4e9f400640 1 -- 172.21.15.37:0/2901232794 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0010670 con 0x7f4ea8105090 2024-09-21T06:04:43.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.141+0000 7f4eadc00640 1 -- 172.21.15.37:0/2901232794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea81a2330 con 0x7f4ea8105090 2024-09-21T06:04:43.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.142+0000 7f4eadc00640 1 -- 172.21.15.37:0/2901232794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea810a820 con 0x7f4ea8105090 2024-09-21T06:04:43.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.147+0000 7f4e9f400640 1 -- 172.21.15.37:0/2901232794 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f4ea0005000 con 0x7f4ea8105090 2024-09-21T06:04:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.148+0000 7f4e9f400640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4e8c0b6590 0x7f4e8c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.148+0000 7f4e9f400640 1 -- 172.21.15.37:0/2901232794 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f4ea00e7e60 con 0x7f4ea8105090 2024-09-21T06:04:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.148+0000 7f4ea6a00640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4e8c0b6590 0x7f4e8c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:43.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.149+0000 7f4ea6a00640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4e8c0b6590 0x7f4e8c0b8aa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009bd0 tx=0x7f4e98005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:43.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.150+0000 7f4e9f400640 1 -- 172.21.15.37:0/2901232794 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ea0056710 con 0x7f4ea8105090 2024-09-21T06:04:43.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:42 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/651369633' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:04:43.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:42 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2567732291' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:04:43.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.397+0000 7f4eadc00640 1 -- 172.21.15.37:0/2901232794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f4ea8063fc0 con 0x7f4ea8105090 2024-09-21T06:04:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.408+0000 7f4e9f400640 1 -- 172.21.15.37:0/2901232794 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v19) ==== 81+0+833522 (secure 0 0 0) 0x7f4ea00ae2c0 con 0x7f4ea8105090 2024-09-21T06:04:43.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 19, 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "active_gid": 14154, 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "active_name": "x", 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addrs": { 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6800", 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3016662141 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.421 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6801", 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3016662141 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addr": "172.21.15.37:6801/3016662141", 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "active_change": "2024-09-21T05:42:46.114555+0000", 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "standbys": [ 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24118, 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "z", 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:04:43.422 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:04:43.423 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.424 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.425 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.426 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.427 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.428 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.429 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-09-21T06:04:43.430 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.431 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.432 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.433 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.434 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.435 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.436 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.437 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-09-21T06:04:43.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-09-21T06:04:43.439 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:43.440 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.442 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-09-21T06:04:43.443 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-21T06:04:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.445 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.446 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.446 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.446 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.446 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.446 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.446 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.446 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.446 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.446 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.446 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.446 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.446 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.447 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.448 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-09-21T06:04:43.451 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.452 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:04:43.453 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:04:43.455 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.456 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-21T06:04:43.457 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-09-21T06:04:43.458 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-09-21T06:04:43.459 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.460 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.461 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.462 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.463 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.465 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.466 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:04:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-09-21T06:04:43.469 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.471 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.472 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.473 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.474 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.475 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nginx": { 2024-09-21T06:04:43.476 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nginx", 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nginx container image", 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.477 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.478 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.479 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.481 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.482 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba_metrics": { 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.483 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.484 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:04:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.486 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.487 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.490 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.491 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:04:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:04:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.494 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.495 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.496 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.497 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.498 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.499 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:04:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:04:43.501 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.502 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.503 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.504 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-09-21T06:04:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.506 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.507 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.508 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.509 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:04:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-09-21T06:04:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-09-21T06:04:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.511 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.512 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.513 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.514 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.514 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:04:43.514 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.514 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.514 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.514 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.514 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.514 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.514 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.514 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.514 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.514 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.514 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.515 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-21T06:04:43.516 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_keepalive_interval": { 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-21T06:04:43.517 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.518 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.518 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.518 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:04:43.518 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.518 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.518 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.518 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.518 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-09-21T06:04:43.518 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-09-21T06:04:43.518 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.518 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.518 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.518 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.519 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.519 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.519 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.519 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:04:43.519 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.519 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.519 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.519 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.519 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-09-21T06:04:43.519 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-09-21T06:04:43.519 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.519 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.519 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.521 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.522 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.523 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.524 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.525 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.526 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.527 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.528 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.528 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.528 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.528 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.528 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.528 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.528 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.528 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.528 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.528 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.528 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-09-21T06:04:43.528 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-09-21T06:04:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.531 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.533 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.534 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:04:43.536 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.537 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.538 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.539 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.540 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.541 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.542 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.543 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.544 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.545 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.546 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:04:43.547 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.548 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.550 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.551 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.552 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.553 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.553 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.553 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.553 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.553 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.553 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.553 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:04:43.553 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:04:43.553 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.553 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.553 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.553 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-09-21T06:04:43.554 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.554 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.554 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.554 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.554 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.554 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.554 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.554 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.554 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:04:43.554 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:04:43.554 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.554 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.554 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.555 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.556 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.557 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:04:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:04:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.558 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.559 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.560 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.561 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.562 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.564 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:04:43.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:04:43.568 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.570 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.571 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.573 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.574 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-09-21T06:04:43.575 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-09-21T06:04:43.576 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-09-21T06:04:43.577 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.578 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.580 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.581 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.581 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.581 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.581 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.581 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.581 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.581 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.581 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.581 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.581 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.581 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.581 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.581 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.582 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.583 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.583 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.583 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.583 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.583 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.583 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.583 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.583 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.583 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.583 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.583 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.583 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.586 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.587 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.588 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.588 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.588 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.588 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.588 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.588 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.588 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.588 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.588 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.588 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.588 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.588 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.588 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.590 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "sso_oauth2": { 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sso_oauth2", 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.591 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.592 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.593 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.594 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.595 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-09-21T06:04:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.603 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.604 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.605 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.606 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:04:43.607 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.608 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.609 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.610 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.611 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.612 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.613 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.614 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.616 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.617 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:04:43.618 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.619 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.620 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.621 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.622 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.623 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.624 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.625 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-09-21T06:04:43.626 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.627 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.627 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.627 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.627 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.627 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.627 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.627 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.627 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.627 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.627 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.627 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.627 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.627 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.628 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.629 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.631 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.632 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.633 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.634 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.635 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.636 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.637 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.638 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.639 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.640 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.641 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.643 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.644 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.645 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.646 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.646 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.646 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.646 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.646 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.646 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.646 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.646 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.646 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.646 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.646 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.646 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.646 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.648 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.649 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.650 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-09-21T06:04:43.651 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.652 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.653 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.654 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.655 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-09-21T06:04:43.656 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.657 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.658 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.659 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.660 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.661 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.662 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.663 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.664 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.666 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.667 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.668 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.673 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.674 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.676 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.678 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.679 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.680 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.681 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.682 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.683 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.684 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.685 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.686 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-09-21T06:04:43.687 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.689 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.690 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.691 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.692 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.693 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.694 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.695 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.697 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.698 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.699 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.700 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.701 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.702 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.702 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.702 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.702 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.702 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.702 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.702 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.702 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.702 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.702 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.702 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.702 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.702 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.703 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.704 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.705 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.706 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-09-21T06:04:43.707 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-09-21T06:04:43.707 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:43.707 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.707 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.707 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-21T06:04:43.707 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-09-21T06:04:43.707 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.707 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.707 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-09-21T06:04:43.707 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:04:43.707 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.707 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.707 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.708 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.709 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.710 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.711 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.711 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.711 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.711 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.711 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.711 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.711 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.711 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.711 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.711 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.711 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.711 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.711 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.712 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.714 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.715 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-09-21T06:04:43.715 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-09-21T06:04:43.715 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.715 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.715 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.715 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-09-21T06:04:43.715 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.715 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.715 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.715 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:04:43.715 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.716 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.717 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.718 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.719 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.720 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.721 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.722 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.723 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.724 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.724 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.724 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.724 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.724 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.724 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.724 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.724 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.724 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.725 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.725 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.725 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.725 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.725 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.725 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.726 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-09-21T06:04:43.726 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-09-21T06:04:43.726 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.726 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.726 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.726 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.726 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.726 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.726 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.726 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.726 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.727 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.727 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.727 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.727 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:04:43.727 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:04:43.727 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.727 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.727 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.727 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-09-21T06:04:43.727 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.727 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.727 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.727 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-09-21T06:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-09-21T06:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-09-21T06:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.728 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.729 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.729 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.729 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.729 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.729 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T06:04:43.729 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T06:04:43.729 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.729 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.730 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.730 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-21T06:04:43.730 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.730 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.730 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.730 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:04:43.730 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.730 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.730 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.730 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T06:04:43.730 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T06:04:43.731 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.731 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.731 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.731 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-09-21T06:04:43.731 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.731 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.731 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.731 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:04:43.731 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.731 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.731 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.731 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.732 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.732 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.732 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.732 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.732 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.732 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.732 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.732 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.732 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.732 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.732 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.732 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.732 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.733 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.733 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-09-21T06:04:43.733 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-09-21T06:04:43.733 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.733 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.733 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.733 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-09-21T06:04:43.733 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.733 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.733 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.733 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.733 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.734 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.734 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.734 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.734 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-21T06:04:43.734 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-21T06:04:43.734 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.734 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.734 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.734 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-09-21T06:04:43.734 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.734 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.734 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.735 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-09-21T06:04:43.735 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-09-21T06:04:43.735 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.735 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.735 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.735 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.735 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.735 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.735 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-21T06:04:43.735 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-21T06:04:43.735 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.735 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.735 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.736 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T06:04:43.736 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-21T06:04:43.736 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-21T06:04:43.736 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.736 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.736 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.736 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.736 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.736 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.736 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.736 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.736 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.737 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-21T06:04:43.737 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.737 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.737 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.737 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.737 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.737 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.737 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.737 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.737 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.737 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.737 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.737 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.738 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.738 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.738 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.738 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.738 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.738 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.738 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.738 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.738 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.738 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.738 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.738 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.740 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.740 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.740 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.740 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.740 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.740 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.740 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.740 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.740 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.740 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.740 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.740 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.742 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.742 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.742 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.742 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.742 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.742 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.742 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.742 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.742 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.742 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.742 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-09-21T06:04:43.743 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:04:43.743 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.743 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.743 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.743 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:43.743 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.743 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.743 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.743 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.743 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.743 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.743 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.744 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.744 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:04:43.744 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:04:43.744 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.744 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.744 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.744 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.744 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.744 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.744 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.744 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.744 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.745 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.745 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.745 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.745 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.745 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.745 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.745 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.745 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.745 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.745 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.745 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.745 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.746 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.746 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.746 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.746 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.746 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-09-21T06:04:43.746 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-09-21T06:04:43.746 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.746 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.746 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.746 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.747 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.747 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.747 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.747 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.747 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.747 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.747 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.747 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.747 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.747 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.747 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.747 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-09-21T06:04:43.748 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.748 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.748 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.748 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-09-21T06:04:43.748 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-09-21T06:04:43.748 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.748 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.748 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.748 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.748 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.748 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.748 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.749 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.749 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.749 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.749 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.749 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.749 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-21T06:04:43.749 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-21T06:04:43.749 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.749 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.749 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.749 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.750 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.750 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.750 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.750 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.750 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.750 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.750 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.750 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.750 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.750 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.751 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.751 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.751 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.751 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.751 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.751 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.751 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.751 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.751 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.751 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.751 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.751 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.751 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.752 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.752 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.752 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.752 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.752 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.752 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.752 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.752 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.752 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.752 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.753 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.753 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.753 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.753 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.753 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.753 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.753 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.753 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.753 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.753 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.753 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.753 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.754 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.754 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.754 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.754 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.754 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.754 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.754 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.754 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.754 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.754 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.754 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.755 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.755 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.755 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.755 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.755 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.755 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.755 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.755 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.755 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.755 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.756 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.756 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.756 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.756 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.756 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.756 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max_requests": { 2024-09-21T06:04:43.756 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_requests", 2024-09-21T06:04:43.756 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.756 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.756 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.756 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T06:04:43.757 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.757 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.757 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.757 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:04:43.757 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.757 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.757 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.757 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.757 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T06:04:43.757 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T06:04:43.757 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.757 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.757 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.758 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.758 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.758 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.758 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.758 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.758 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.758 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.758 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.758 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T06:04:43.758 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T06:04:43.758 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.759 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.759 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.759 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.759 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.759 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.759 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.759 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.759 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.759 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.759 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.759 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.759 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.760 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.760 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.760 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.760 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.760 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.760 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.760 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.760 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.760 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.760 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.760 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-09-21T06:04:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:04:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:04:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.769 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.770 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.771 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.771 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.771 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.771 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.771 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.771 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.771 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.771 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.771 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.771 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.771 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.771 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.772 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.773 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.773 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.773 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.773 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.773 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.773 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.773 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.773 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.773 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.773 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.773 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.774 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.774 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.774 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.774 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.774 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.774 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.774 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.774 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.774 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.774 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.774 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.774 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.774 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.775 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.775 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.775 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.775 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.775 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.775 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.775 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.775 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.775 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.775 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.775 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.775 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.776 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.776 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.776 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.776 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.776 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.776 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.776 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.776 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.776 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.776 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.776 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.777 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.777 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.777 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.777 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.777 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-09-21T06:04:43.777 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-09-21T06:04:43.777 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.777 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.777 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.777 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-09-21T06:04:43.777 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.777 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.777 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:04:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-09-21T06:04:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.779 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.779 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.779 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.779 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.779 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.779 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.779 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.779 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.779 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.779 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.779 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.780 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.781 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.781 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.781 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.781 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.781 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.781 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.781 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.781 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.781 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.781 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.781 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.782 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.782 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.782 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.782 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.782 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.782 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.782 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.782 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.782 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.782 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.782 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.782 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.783 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.783 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.783 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.783 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.783 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.783 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.783 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.783 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.783 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.783 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.783 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.783 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.784 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.784 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.784 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.784 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.784 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.784 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.784 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.784 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.784 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.784 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.784 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.784 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-09-21T06:04:43.785 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-09-21T06:04:43.785 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.785 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.785 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.785 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.785 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.785 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.785 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.785 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.785 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.785 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.785 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.786 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.786 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-09-21T06:04:43.786 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-09-21T06:04:43.786 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.786 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.786 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.786 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-09-21T06:04:43.786 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.786 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.786 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.786 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-09-21T06:04:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-09-21T06:04:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.788 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.788 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.788 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.788 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.788 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.788 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.788 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-09-21T06:04:43.788 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-09-21T06:04:43.788 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.788 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.788 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.788 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.789 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.789 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.789 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.789 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.789 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.789 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.789 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.789 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-09-21T06:04:43.789 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-09-21T06:04:43.789 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:43.789 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.790 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.790 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.790 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.790 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.790 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.790 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.790 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.790 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.790 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.790 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.790 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-09-21T06:04:43.791 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-09-21T06:04:43.791 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.791 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.791 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.791 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.791 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.791 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.791 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.791 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.791 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.791 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.791 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.792 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.792 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-09-21T06:04:43.792 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-09-21T06:04:43.792 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.792 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.792 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.792 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.792 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.792 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.792 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.792 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.792 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.792 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.793 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.793 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.793 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-09-21T06:04:43.793 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-09-21T06:04:43.793 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.793 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.793 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.793 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.793 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.793 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.793 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.794 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.794 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.794 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.794 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.794 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.794 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-09-21T06:04:43.794 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-09-21T06:04:43.794 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.794 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.794 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.794 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.795 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T06:04:43.795 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-09-21T06:04:43.795 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.795 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.795 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.795 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.795 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.795 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.795 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.795 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.795 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.795 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.796 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.796 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.796 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.796 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.796 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.796 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.796 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.796 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.796 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.796 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.796 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-09-21T06:04:43.797 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-09-21T06:04:43.797 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.797 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.797 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.797 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.797 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.797 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.797 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.797 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.797 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.797 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.797 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.797 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.798 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-09-21T06:04:43.798 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-09-21T06:04:43.798 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.798 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.798 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.798 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.798 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.798 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.798 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.798 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.798 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.799 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.799 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.799 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.799 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-09-21T06:04:43.799 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-09-21T06:04:43.799 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.799 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.799 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.799 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.799 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.799 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.799 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.800 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.800 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.800 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.800 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.800 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.800 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.800 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.800 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.800 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-09-21T06:04:43.800 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.801 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.801 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.801 INFO:teuthology.orchestra.run.smithi037.stdout: "internal_store_backend": { 2024-09-21T06:04:43.801 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "internal_store_backend", 2024-09-21T06:04:43.801 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.801 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.801 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.801 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.801 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.801 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.801 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.801 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:04:43.801 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.802 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.802 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.802 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.802 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.802 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.802 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.802 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.802 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.802 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.802 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.802 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.802 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.803 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.803 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.803 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.803 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.803 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.803 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.803 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.803 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.803 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.803 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.803 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.803 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.804 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.804 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.804 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.804 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.804 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.804 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.804 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.804 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.804 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.804 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.804 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.804 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.804 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.805 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.805 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.805 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.805 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.805 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.805 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.805 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.805 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.805 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.805 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.805 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.805 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.805 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.806 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.806 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.806 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.806 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.806 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.806 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.806 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.806 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.806 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.806 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.806 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.807 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.807 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.807 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.807 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.807 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.807 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.807 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.807 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.807 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.807 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.807 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.807 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.808 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.808 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.808 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.808 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.808 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.808 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.808 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.808 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.808 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.808 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.808 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.808 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.808 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.809 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-09-21T06:04:43.809 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-09-21T06:04:43.809 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.809 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.809 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.809 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.809 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.809 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.809 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.809 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:04:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-09-21T06:04:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-09-21T06:04:43.811 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-09-21T06:04:43.811 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.811 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.811 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.811 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.811 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.811 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.811 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.811 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:04:43.811 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.811 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.811 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.811 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.812 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-09-21T06:04:43.812 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-09-21T06:04:43.812 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.812 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.812 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.812 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.812 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.812 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.812 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.812 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:04:43.812 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.813 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.813 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.813 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.813 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.813 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.813 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.813 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.813 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.813 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.813 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.813 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.813 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.813 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.814 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.814 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.814 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.814 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.814 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.814 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.814 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.814 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.814 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.814 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.814 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.814 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.815 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.815 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.815 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.815 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.815 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.815 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.815 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.815 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.815 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.815 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.815 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.815 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.816 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.816 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.816 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.816 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.816 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.816 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.816 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.816 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.816 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.816 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.816 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.816 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.816 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.817 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.817 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.817 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.817 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.817 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.817 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.817 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.817 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.817 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.817 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.817 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.817 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.818 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.818 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.818 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.818 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.818 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.818 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.818 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.818 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.818 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.818 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.818 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.819 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.819 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.819 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.819 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.819 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.819 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.819 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.819 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.819 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.819 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.819 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.819 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.819 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-09-21T06:04:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.821 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.821 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.821 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.821 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.821 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.821 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.821 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.821 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.821 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.821 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.821 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.821 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.822 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.822 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.822 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.822 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.822 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.822 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.822 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.822 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.822 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.822 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.822 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.823 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.823 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.823 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.823 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.823 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.823 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.823 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.823 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.823 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.823 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.823 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.823 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.823 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.824 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.824 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.824 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.824 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.824 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.824 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.824 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.824 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.824 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.824 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.824 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.824 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.825 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.825 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.825 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.825 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.825 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.825 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.825 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.825 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.825 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.825 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.825 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.825 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.826 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.826 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.826 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.826 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.826 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.826 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.826 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.826 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.826 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.826 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.826 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.827 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.827 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.827 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.827 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.827 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.827 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.827 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.827 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-09-21T06:04:43.827 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.827 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.827 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.828 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.828 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.828 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.828 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.828 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.828 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.828 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.828 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.828 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.828 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.828 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.828 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.829 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.829 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.829 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.829 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.829 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.829 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.829 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.829 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.829 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.829 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.829 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.830 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.830 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.830 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.830 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.830 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.830 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.830 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.830 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.830 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.830 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.830 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.831 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.831 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.831 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.831 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.831 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.831 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.831 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.831 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.831 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.831 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.831 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.831 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.832 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.832 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.832 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.832 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.832 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.832 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.832 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.832 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.832 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.832 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.832 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.832 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.835 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.835 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-09-21T06:04:43.835 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.835 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.835 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.835 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-09-21T06:04:43.835 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-09-21T06:04:43.835 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.835 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.835 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.835 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:04:43.835 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.835 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.836 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.836 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.836 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.836 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.836 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.836 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.836 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:43.836 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:43.836 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.836 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.836 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.836 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-09-21T06:04:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.838 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.838 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.838 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.838 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.838 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.838 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.838 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.838 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.838 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.838 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.838 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.838 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.839 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.839 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.839 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.839 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.839 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.839 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.839 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.839 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.839 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.839 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.839 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.840 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.840 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.840 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.840 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.840 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.840 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.840 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.840 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.840 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.840 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.840 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.840 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.841 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.841 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.841 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.841 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.841 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.841 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.841 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.841 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.841 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.841 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.841 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.842 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.842 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.842 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.842 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.842 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.842 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.842 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.842 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.842 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.842 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.842 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.842 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.843 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.843 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.843 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.843 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.843 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.843 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.843 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.843 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.843 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.843 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.843 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.843 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.843 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.844 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.844 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.844 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.844 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.844 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.844 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.844 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.844 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-09-21T06:04:43.844 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.844 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.845 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.845 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-09-21T06:04:43.845 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-09-21T06:04:43.845 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.845 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.845 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.845 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.845 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.845 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.845 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.845 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:04:43.845 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.846 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.846 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.846 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-09-21T06:04:43.846 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-09-21T06:04:43.846 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.846 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.846 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.846 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.846 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.846 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.847 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.847 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:04:43.847 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.847 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.847 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.847 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.847 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-09-21T06:04:43.847 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-09-21T06:04:43.847 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.847 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.847 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.847 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.848 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.848 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.848 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.848 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:04:43.848 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.848 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.848 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.848 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.848 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-09-21T06:04:43.848 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-09-21T06:04:43.848 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.848 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.848 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.849 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.849 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.849 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.849 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.849 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:04:43.849 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.849 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.849 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.849 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-09-21T06:04:43.849 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-09-21T06:04:43.849 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.849 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.850 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.850 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.850 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.850 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.850 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.850 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:04:43.850 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.850 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.850 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.850 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-09-21T06:04:43.850 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-09-21T06:04:43.851 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.851 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.851 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.851 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.851 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.851 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.851 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.851 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.851 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.851 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.851 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.851 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-09-21T06:04:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-09-21T06:04:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.853 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.853 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-09-21T06:04:43.853 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-09-21T06:04:43.853 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.853 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.853 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.853 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:04:43.853 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.853 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.853 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.853 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.853 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.854 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.854 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.854 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.854 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-21T06:04:43.854 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-21T06:04:43.854 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.854 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.854 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.854 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.854 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.854 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.854 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.854 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.855 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.855 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.855 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.855 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.855 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:43.855 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:43.855 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.855 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.855 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.855 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-09-21T06:04:43.855 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-09-21T06:04:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-09-21T06:04:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-09-21T06:04:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-09-21T06:04:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-09-21T06:04:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-09-21T06:04:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.859 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.859 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-09-21T06:04:43.859 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-09-21T06:04:43.859 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.859 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.859 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.859 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.859 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.859 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.859 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.859 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.859 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.860 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.860 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.860 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.860 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.860 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.860 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.860 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.860 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.860 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.860 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.860 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.860 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.861 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.861 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.861 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.861 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.861 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.861 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.861 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.861 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.861 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.861 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.861 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.861 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.861 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.862 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.862 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.862 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.862 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.862 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.862 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.862 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.862 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.862 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.862 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.862 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.863 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.863 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.863 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.863 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.863 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.863 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.863 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.863 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.863 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.863 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.863 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.863 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.863 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.864 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.864 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.864 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.864 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.864 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.864 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.864 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.864 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.864 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.864 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.864 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.864 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.865 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.865 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.865 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.865 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.865 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.865 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.865 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.865 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.865 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.865 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.865 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.865 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.866 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-09-21T06:04:43.866 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-09-21T06:04:43.866 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.866 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.866 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.866 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.866 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.866 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.866 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.866 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.866 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.866 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.867 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.867 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-09-21T06:04:43.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-09-21T06:04:43.867 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.867 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.867 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.867 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.867 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.867 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.867 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.867 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.869 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.869 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.869 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.869 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.869 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-09-21T06:04:43.869 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-09-21T06:04:43.869 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.869 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.869 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.869 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:04:43.869 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.869 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.870 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.870 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.870 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.870 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.870 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.870 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.870 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.870 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.870 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-09-21T06:04:43.870 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.870 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.871 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.871 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.871 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.871 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.871 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.871 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.871 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.871 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.871 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.871 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.871 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.871 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.872 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.872 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.872 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.872 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.872 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.872 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.872 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.872 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.872 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.872 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.872 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.872 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.873 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.873 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.873 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.873 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.873 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.873 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.873 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.873 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.873 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.873 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.873 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.873 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.874 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.874 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.874 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.874 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.874 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.874 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.874 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.874 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.874 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.874 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.874 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.875 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.875 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.875 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.875 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.875 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.875 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.875 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.875 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.875 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.875 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.875 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.875 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.875 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.876 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.876 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.876 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.876 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.876 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.876 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.876 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.876 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.876 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.876 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.876 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.877 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.877 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.877 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.877 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.877 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.877 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.877 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.877 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.877 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.877 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.877 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.877 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.878 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.878 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.878 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.878 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.878 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-21T06:04:43.878 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.878 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.878 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.878 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.878 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.878 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.878 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.879 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.879 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.879 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.879 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.879 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.879 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.879 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.879 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.879 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.879 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.879 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.879 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.879 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.880 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.880 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.880 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.880 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.880 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.880 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.880 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.880 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.880 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.880 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.880 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.880 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.881 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.881 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.881 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.881 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.881 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.881 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.881 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.881 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.881 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.881 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.881 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.881 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.882 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.882 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.882 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.882 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.882 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.882 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.882 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.882 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.882 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.882 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.882 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.882 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.883 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.883 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.883 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.883 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.883 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.883 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.883 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.883 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.883 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.883 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.883 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.883 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.883 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-09-21T06:04:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-09-21T06:04:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-09-21T06:04:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.884 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:04:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-09-21T06:04:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-09-21T06:04:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.886 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.886 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-09-21T06:04:43.886 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.886 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.886 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.886 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-09-21T06:04:43.886 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:04:43.886 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.886 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.886 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.887 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.887 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.887 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.887 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.958 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:04:43.958 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.958 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.958 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.958 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.958 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:04:43.958 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:04:43.958 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.958 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.958 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.959 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.960 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.961 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-09-21T06:04:43.961 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-09-21T06:04:43.961 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:43.961 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.961 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.961 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-09-21T06:04:43.961 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.961 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.961 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.961 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.961 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.961 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.962 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.962 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.962 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-09-21T06:04:43.962 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-09-21T06:04:43.962 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.962 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.962 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.962 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.962 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.962 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.963 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.963 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.963 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.963 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.963 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.963 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.963 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:43.963 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:43.963 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.963 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.963 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.963 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:43.963 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.964 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.964 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.964 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.964 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.964 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.964 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.964 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.964 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.964 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.965 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.966 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.966 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.966 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.966 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.966 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.966 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.966 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.966 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.966 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.967 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.967 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.967 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.967 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.967 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.967 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.967 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.967 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.967 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.967 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.967 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.967 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.967 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.971 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.971 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.971 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.971 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.971 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.971 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.971 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.971 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.971 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.971 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.972 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.972 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.972 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.972 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.972 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.972 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-09-21T06:04:43.972 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-09-21T06:04:43.972 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.972 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.972 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.972 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-09-21T06:04:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-09-21T06:04:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.973 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:43.974 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:04:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T06:04:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24146, 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "y", 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.977 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.978 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.978 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.978 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.978 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.978 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.978 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.978 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.978 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.978 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.978 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.978 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.978 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.978 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.979 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:43.981 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.982 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.983 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.984 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-09-21T06:04:43.985 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-09-21T06:04:43.986 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:04:43.987 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:04:43.988 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-09-21T06:04:43.989 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.990 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.990 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.990 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.990 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:43.990 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:43.990 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:43.990 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:43.990 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.990 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.990 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.990 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.990 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.990 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:43.991 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.992 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.993 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.996 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.997 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.998 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:43.999 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.000 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.000 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.000 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.000 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.000 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.000 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.000 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.000 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.000 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.000 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.000 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.000 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.001 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.002 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.002 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.002 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.002 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.002 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.002 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.002 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.002 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.002 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.002 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.002 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.002 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.002 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.003 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.004 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.005 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.006 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.007 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.008 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-09-21T06:04:44.009 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:04:44.010 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.011 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:04:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.013 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.014 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:04:44.015 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.016 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.017 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:04:44.018 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.019 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.021 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.022 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:04:44.023 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-09-21T06:04:44.024 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.025 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.025 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.025 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:04:44.025 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.025 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.025 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.025 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:44.025 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.025 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.025 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.025 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.025 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-09-21T06:04:44.025 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-09-21T06:04:44.026 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:04:44.027 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:04:44.028 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-09-21T06:04:44.029 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.030 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nginx": { 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nginx", 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.031 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nginx container image", 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.032 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:04:44.034 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.035 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.036 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba_metrics": { 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.038 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.039 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:04:44.040 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.040 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.040 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.040 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.040 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-09-21T06:04:44.040 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-09-21T06:04:44.040 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.040 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.040 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.040 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.040 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.040 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.040 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.041 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.042 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.043 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:04:44.044 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.046 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.048 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.048 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.048 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-09-21T06:04:44.048 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-09-21T06:04:44.048 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.048 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.048 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.048 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:44.048 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.048 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.048 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.048 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:04:44.048 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:04:44.049 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.050 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.050 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.050 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.050 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-09-21T06:04:44.050 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-09-21T06:04:44.050 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.050 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.050 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.050 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.050 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.050 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.050 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.050 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.051 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.052 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.052 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.052 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.052 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.052 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.052 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.052 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.052 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.052 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.052 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.052 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.052 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-09-21T06:04:44.052 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.054 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.055 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.056 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.057 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.058 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:04:44.058 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.058 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.058 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.058 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:04:44.058 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:04:44.058 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.058 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.058 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.058 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-09-21T06:04:44.058 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.058 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.059 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.060 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:04:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-09-21T06:04:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-09-21T06:04:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.061 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.062 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.063 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.064 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.066 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.067 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.068 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.071 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.073 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_keepalive_interval": { 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.074 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.075 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.076 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:04:44.077 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.078 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.079 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.080 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.081 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.082 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.082 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.082 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.082 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.082 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.082 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.082 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.082 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.082 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.082 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.082 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.082 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.082 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.083 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.084 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:04:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.086 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.087 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.088 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.092 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.093 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.093 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:04:44.093 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:04:44.093 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.093 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.093 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.093 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.093 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.093 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.093 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.093 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.093 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.094 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.095 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.096 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.097 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:04:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:04:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.099 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.100 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.102 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.103 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.104 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.107 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.109 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.110 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.111 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:04:44.111 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:04:44.111 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.111 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.111 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.111 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-09-21T06:04:44.111 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.111 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.111 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.111 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.111 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.111 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.111 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.112 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.112 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:04:44.112 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:04:44.112 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.112 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.112 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.112 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.112 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.112 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.112 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.112 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.112 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.112 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.113 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.114 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.114 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:04:44.114 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:04:44.114 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.114 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.114 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.114 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.114 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.114 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.114 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.114 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.114 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.115 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.116 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.116 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.116 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.116 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:04:44.116 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:04:44.116 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.116 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.116 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.116 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.116 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.116 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.116 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.116 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.117 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.118 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.120 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.121 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.122 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.123 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.124 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.125 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.126 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:04:44.126 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:04:44.126 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.126 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.126 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.126 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.126 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.126 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.126 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.126 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.126 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.126 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.126 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.127 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.129 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.130 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.131 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:04:44.132 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-09-21T06:04:44.133 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-09-21T06:04:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.134 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.135 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-09-21T06:04:44.136 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-21T06:04:44.137 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.138 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.139 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.140 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.141 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.142 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.143 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.144 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.145 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.146 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.147 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.148 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.149 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.150 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.150 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.150 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.150 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.150 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.150 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.150 INFO:teuthology.orchestra.run.smithi037.stdout: "sso_oauth2": { 2024-09-21T06:04:44.150 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sso_oauth2", 2024-09-21T06:04:44.150 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.150 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.151 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-21T06:04:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-09-21T06:04:44.153 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.154 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-09-21T06:04:44.155 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.156 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.157 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.158 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.162 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.163 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.164 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.165 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.167 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.168 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.169 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.170 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.171 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.172 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.173 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.174 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.176 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.177 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-09-21T06:04:44.178 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-09-21T06:04:44.179 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-09-21T06:04:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.182 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.183 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.184 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.185 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.186 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.188 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.189 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.190 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.191 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.192 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.194 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.195 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.196 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.197 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.198 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.204 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.205 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-09-21T06:04:44.206 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-09-21T06:04:44.207 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.208 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.209 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.210 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.211 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.212 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.213 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-09-21T06:04:44.214 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:04:44.215 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.216 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.217 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.218 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.219 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.220 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-09-21T06:04:44.221 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-09-21T06:04:44.222 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-09-21T06:04:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.224 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-09-21T06:04:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.227 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.228 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.229 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.230 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.230 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.230 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.230 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.230 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.230 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.230 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.230 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.230 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.230 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.230 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.230 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.230 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.231 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.232 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.233 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.237 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.239 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.242 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.243 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.244 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-21T06:04:44.245 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.246 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.247 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.247 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.247 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.247 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.247 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.247 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.247 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.247 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.247 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.247 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.247 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.247 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.247 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.248 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.249 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.250 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.252 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.253 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.254 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.255 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.256 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.257 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.258 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.259 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.259 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.259 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.259 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.259 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.259 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.259 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.259 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.259 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.259 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.259 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.259 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.259 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.260 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.262 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.263 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.264 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.265 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-09-21T06:04:44.266 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.267 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.269 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.270 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.271 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.272 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.273 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.274 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.275 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.276 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.277 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.278 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.279 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.281 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.282 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.283 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.284 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-09-21T06:04:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-09-21T06:04:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-09-21T06:04:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-09-21T06:04:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-09-21T06:04:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.286 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.287 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.288 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.289 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.289 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.289 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.289 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.289 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.289 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.289 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.289 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.289 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.289 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.289 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.289 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.289 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.290 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.291 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.292 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.295 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.295 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T06:04:44.295 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T06:04:44.295 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.295 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.295 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.295 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-21T06:04:44.295 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.295 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.295 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.295 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:04:44.295 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.295 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.296 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.297 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.297 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.297 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.297 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.297 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.297 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.297 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.297 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.297 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.297 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.297 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.297 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.297 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.298 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-09-21T06:04:44.299 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-09-21T06:04:44.300 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.300 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.300 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.300 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.300 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.300 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.300 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-21T06:04:44.300 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-21T06:04:44.300 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.300 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.300 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.300 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T06:04:44.300 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.301 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.302 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.303 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.304 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.305 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.306 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.306 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.306 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.306 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.306 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.306 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.306 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.306 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.306 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.306 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.306 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.306 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.306 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:04:44.307 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.308 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-09-21T06:04:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.310 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.313 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.314 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.315 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.316 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.317 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "max_requests": { 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_requests", 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.318 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.319 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.320 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.321 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.323 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.323 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.323 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.323 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.323 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.323 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.323 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.323 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.323 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.323 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.323 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.323 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.323 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.324 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.325 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.326 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.327 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:04:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.328 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.329 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.330 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.331 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.332 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.334 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.335 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.336 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-09-21T06:04:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.337 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.338 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.339 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.340 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.341 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.342 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-09-21T06:04:44.343 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.344 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-09-21T06:04:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-09-21T06:04:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T06:04:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-09-21T06:04:44.351 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.351 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.351 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.351 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.351 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.351 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.351 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.351 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.351 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.351 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.351 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.351 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.351 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.352 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.353 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.354 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: "internal_store_backend": { 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "internal_store_backend", 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.359 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.360 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.361 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.362 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.362 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.362 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.362 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.362 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.362 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.362 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.362 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.362 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.362 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.362 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.362 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.362 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.363 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-09-21T06:04:44.363 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-09-21T06:04:44.363 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.363 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.363 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.363 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.363 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.363 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.363 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.363 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:04:44.363 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.363 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.363 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.364 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.365 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.365 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.365 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:04:44.365 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.365 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.365 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.365 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-09-21T06:04:44.365 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-09-21T06:04:44.365 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.365 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.365 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.365 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.366 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.367 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.369 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.370 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.371 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.372 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.373 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.374 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.374 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.374 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.374 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.374 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.374 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.374 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.374 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.374 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.374 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.374 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.374 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.374 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.375 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.376 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.377 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.377 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.377 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.377 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.377 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.377 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.377 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.377 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.377 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.377 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.377 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.377 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.378 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.380 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.380 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.380 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.380 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.380 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.380 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.380 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.380 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.380 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.380 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.380 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.380 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.380 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.381 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.382 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.383 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.383 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.383 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.383 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.383 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.383 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.383 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.383 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.383 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.383 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.383 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.384 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-09-21T06:04:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:44.386 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.387 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.388 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.390 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.391 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.391 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.391 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.391 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.391 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.391 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.391 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.391 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.391 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.391 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.391 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.391 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.391 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.392 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.393 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:04:44.394 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.395 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.395 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.395 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.395 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-09-21T06:04:44.395 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-09-21T06:04:44.395 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.395 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.395 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.395 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.395 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.395 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.395 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.395 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.396 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:04:44.397 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.398 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-09-21T06:04:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-09-21T06:04:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.399 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.400 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.401 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.402 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.404 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.405 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.406 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.406 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.406 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-09-21T06:04:44.406 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-09-21T06:04:44.406 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.406 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.406 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.406 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.406 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.406 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.406 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.406 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.406 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.407 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.408 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.411 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.411 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.411 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.411 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.411 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.411 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.411 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.411 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.411 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.411 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.411 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.411 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.411 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.413 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.414 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.415 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.416 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.417 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.418 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.418 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.418 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.418 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.418 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.418 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.418 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.418 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.418 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.418 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.418 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.418 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.419 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.419 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.419 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.419 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.419 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.419 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.419 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.419 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.419 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.419 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.419 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.419 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.419 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.420 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.420 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.420 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.420 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.420 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.420 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.420 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.420 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.420 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.420 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.420 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.420 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.422 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.422 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.422 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.422 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.422 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.422 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.422 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.422 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.422 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.422 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.422 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.422 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.423 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.423 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.423 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-21T06:04:44.423 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.423 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.423 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.423 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.423 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.423 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.423 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.423 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.423 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.424 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.424 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.424 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.424 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.424 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.424 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.424 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.424 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.424 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.424 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.424 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.424 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.425 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.427 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-09-21T06:04:44.428 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.430 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.431 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.432 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.432 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.432 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.432 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.432 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.432 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:04:44.432 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.432 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.432 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.432 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.432 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.432 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.432 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.433 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.434 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.435 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.436 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.437 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.437 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.437 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.437 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.437 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.437 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.437 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.437 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.437 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.437 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.437 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.437 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.438 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.439 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.440 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.442 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.443 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.444 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.445 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.446 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.446 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.446 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.446 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.446 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T06:04:44.446 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.446 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.446 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-09-21T06:04:44.446 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-21T06:04:44.446 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard", 2024-09-21T06:04:44.446 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-09-21T06:04:44.446 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-09-21T06:04:44.446 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-09-21T06:04:44.447 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.447 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-09-21T06:04:44.447 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.447 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-09-21T06:04:44.447 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.447 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.447 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.447 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:44.447 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:44.447 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.447 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.447 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.448 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:44.448 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.448 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.448 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.448 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:04:44.448 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.448 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.448 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.448 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.448 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.448 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.448 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.453 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.454 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.457 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.458 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.459 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.460 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.461 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.463 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.464 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-09-21T06:04:44.464 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.464 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.464 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.464 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:04:44.464 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:04:44.464 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.464 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.464 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-09-21T06:04:44.464 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-09-21T06:04:44.464 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:44.464 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.465 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.466 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-09-21T06:04:44.466 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T06:04:44.466 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-09-21T06:04:44.466 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.466 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:04:44.466 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.466 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.466 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.466 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.466 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-09-21T06:04:44.466 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-09-21T06:04:44.466 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.466 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:44.467 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.468 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.469 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.471 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.472 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.472 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.472 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.472 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.472 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.472 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.472 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.472 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.472 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.472 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.472 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.472 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.472 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.473 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.474 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.475 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.476 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-09-21T06:04:44.477 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-09-21T06:04:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:04:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.480 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-09-21T06:04:44.481 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.484 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:04:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:04:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-09-21T06:04:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-09-21T06:04:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-09-21T06:04:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:04:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-09-21T06:04:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-09-21T06:04:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:04:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:04:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-09-21T06:04:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:04:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:04:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-09-21T06:04:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-09-21T06:04:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-09-21T06:04:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nginx": { 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nginx", 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nginx container image", 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:04:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-09-21T06:04:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:04:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:04:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:04:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:04:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-09-21T06:04:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-09-21T06:04:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba_metrics": { 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-09-21T06:04:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:04:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-09-21T06:04:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-09-21T06:04:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:04:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:04:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:04:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:04:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-09-21T06:04:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-09-21T06:04:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-09-21T06:04:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-09-21T06:04:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-09-21T06:04:44.535 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-09-21T06:04:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:04:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.538 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-09-21T06:04:44.539 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-09-21T06:04:44.539 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.539 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.539 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.539 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.539 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.539 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.539 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.539 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:04:44.539 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.539 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.539 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.540 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.541 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.542 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.543 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.544 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_keepalive_interval": { 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.545 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.546 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-09-21T06:04:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:04:44.548 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.549 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.549 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.549 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.549 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.549 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.549 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.549 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:04:44.549 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.549 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.549 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.549 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.549 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-09-21T06:04:44.549 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.550 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.551 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.552 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.553 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.553 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.553 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.553 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.553 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.553 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.553 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.553 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.553 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.553 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.553 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.553 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.553 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.554 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.555 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.556 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.557 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.558 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.559 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.560 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.561 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.562 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:04:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:04:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.565 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.566 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.566 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.566 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.566 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.566 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.566 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.566 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.566 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.566 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.566 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:04:44.566 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:04:44.566 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.566 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.567 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.567 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.567 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.567 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.567 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.567 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.567 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.567 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.567 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.567 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.567 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:04:44.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:04:44.567 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:04:44.568 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.571 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.572 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.573 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.574 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.575 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.576 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.577 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.578 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.579 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.581 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.582 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.582 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.582 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.582 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.582 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.582 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.582 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:04:44.582 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:04:44.582 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.582 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.582 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.582 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-09-21T06:04:44.582 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.585 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.586 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.586 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.586 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.586 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.586 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.586 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.586 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.586 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:04:44.586 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:04:44.586 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.586 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.586 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.586 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.587 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.587 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.587 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.587 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.587 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.587 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.587 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.587 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.587 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:04:44.587 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:04:44.587 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.587 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.588 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.589 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.590 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.591 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.592 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.593 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.594 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-09-21T06:04:44.595 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-09-21T06:04:44.596 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.597 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.598 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.598 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.598 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.598 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.598 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.598 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.598 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:04:44.598 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:04:44.598 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.598 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.598 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.598 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T06:04:44.598 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.599 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.600 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.601 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.602 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.603 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.604 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.605 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.606 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.606 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.606 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.606 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.606 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.606 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-09-21T06:04:44.606 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-09-21T06:04:44.606 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.606 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.606 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.606 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.606 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.606 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.607 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.608 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.609 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.610 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.611 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.612 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.613 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.614 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.616 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.617 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.618 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-21T06:04:44.619 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "sso_oauth2": { 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sso_oauth2", 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.622 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T06:04:44.623 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.624 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-09-21T06:04:44.625 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.627 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.628 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.629 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.632 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.633 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-09-21T06:04:44.634 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.634 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.634 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.634 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:04:44.634 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.634 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.634 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.634 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.634 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-09-21T06:04:44.634 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-09-21T06:04:44.634 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.634 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.634 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.635 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.636 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.637 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-09-21T06:04:44.638 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.639 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.640 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.641 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.642 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.643 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-09-21T06:04:44.644 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-09-21T06:04:44.645 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:44.646 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.647 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.648 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.649 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.650 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.651 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.653 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.655 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.656 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-09-21T06:04:44.657 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-09-21T06:04:44.658 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.659 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.660 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.660 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.660 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.660 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.660 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.660 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.660 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.660 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.660 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.660 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.660 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.660 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-21T06:04:44.660 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-09-21T06:04:44.661 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-09-21T06:04:44.662 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-09-21T06:04:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.665 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.666 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.666 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.666 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.666 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.666 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.666 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.666 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.666 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.666 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.666 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.666 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.666 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.666 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.667 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.668 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.669 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.670 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.671 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.672 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.674 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.675 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.676 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.677 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.677 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.677 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.677 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.677 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.677 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.677 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-09-21T06:04:44.677 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.677 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.677 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.677 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-09-21T06:04:44.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:04:44.678 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.678 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.678 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.678 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-21T06:04:44.678 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.678 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.678 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.678 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:04:44.678 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.678 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.678 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.678 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.678 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.679 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.680 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.681 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.682 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.683 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.684 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-09-21T06:04:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.686 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.687 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.688 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.689 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.689 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.689 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.689 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.689 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.689 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.689 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.689 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.689 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.689 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.689 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.689 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.689 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.690 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.691 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.692 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.692 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:04:44.692 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:04:44.692 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.692 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.692 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.692 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-09-21T06:04:44.692 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-09-21T06:04:44.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.692 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.692 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.692 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-21T06:04:44.692 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-09-21T06:04:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.694 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.694 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:04:44.694 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.694 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.694 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.694 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-09-21T06:04:44.694 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-09-21T06:04:44.694 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.694 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.694 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.694 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.696 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.697 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.698 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.699 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.700 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.702 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.703 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.704 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.705 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.706 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.707 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.708 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.709 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.710 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.710 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.710 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.710 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.710 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.710 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.710 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.710 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.710 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-09-21T06:04:44.710 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.710 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.710 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.711 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.712 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.713 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.714 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.715 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.716 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.717 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.718 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.719 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.720 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.722 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.722 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.722 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.722 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.722 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.722 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.722 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.722 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.722 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.722 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.722 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.722 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.722 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-09-21T06:04:44.723 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.724 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.725 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.726 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.727 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.727 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.727 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.727 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.727 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.727 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.727 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.727 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.727 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.727 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.727 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.727 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.727 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.728 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.729 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.730 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-09-21T06:04:44.731 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.732 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.733 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.734 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.735 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.736 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.737 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.740 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.741 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.742 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.742 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.742 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.742 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.742 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.742 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.742 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.742 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.742 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.742 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.742 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.742 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.744 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.744 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.744 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.744 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.744 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.745 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.745 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.745 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.745 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.745 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-09-21T06:04:44.746 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.747 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-21T06:04:44.748 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.749 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.750 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.751 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.752 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.753 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-09-21T06:04:44.754 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:04:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T06:04:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T06:04:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.757 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.759 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.760 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.762 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.765 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.766 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T06:04:44.767 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T06:04:44.768 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.769 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-09-21T06:04:44.770 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.771 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.774 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.775 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.776 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.777 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.778 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.779 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.780 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.781 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.782 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.783 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.786 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.787 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.788 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.789 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: "max_requests": { 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_requests", 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T06:04:44.790 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.791 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.792 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.794 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.795 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.796 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.798 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.799 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.800 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.801 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.802 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.803 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.804 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.805 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.806 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.807 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.808 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.809 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.810 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.811 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.812 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.814 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.816 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.817 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.818 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-09-21T06:04:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-09-21T06:04:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.820 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.821 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T06:04:44.822 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.823 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.824 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-09-21T06:04:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-09-21T06:04:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: "internal_store_backend": { 2024-09-21T06:04:44.827 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "internal_store_backend", 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.828 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.829 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.830 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.831 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.832 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.833 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-09-21T06:04:44.834 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.835 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.836 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.837 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.838 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.840 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.841 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.843 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.846 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.847 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.848 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.849 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.850 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.852 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.853 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.854 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.855 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.856 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.857 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.858 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.859 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.861 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.862 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.863 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.864 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.864 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.864 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.864 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.864 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.864 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.864 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.864 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.864 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.864 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.864 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.864 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.864 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.865 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.866 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.867 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.868 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.869 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.870 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.870 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.870 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.870 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.870 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:04:44.870 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.870 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.870 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.870 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-09-21T06:04:44.870 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-09-21T06:04:44.870 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-09-21T06:04:44.871 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-09-21T06:04:44.872 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.873 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.874 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.875 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.876 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.877 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.878 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.879 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.880 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.881 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.882 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.883 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.886 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.886 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.886 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.886 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.886 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-09-21T06:04:44.886 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-09-21T06:04:44.886 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.886 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.886 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.886 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:04:44.886 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.886 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.887 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.888 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.889 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.890 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.891 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.892 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.893 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.894 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.895 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.897 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-09-21T06:04:44.898 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-09-21T06:04:44.899 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:04:44.900 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.901 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.902 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T06:04:44.902 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.902 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.902 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.902 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:04:44.902 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.902 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.902 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.902 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.902 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.902 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.902 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.902 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-09-21T06:04:44.903 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.904 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.905 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.906 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.907 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.908 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T06:04:44.909 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.910 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.910 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T06:04:44.910 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T06:04:44.910 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T06:04:44.910 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T06:04:44.910 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T06:04:44.910 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T06:04:44.910 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T06:04:44.910 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.910 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.910 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.910 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.911 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.912 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.913 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.914 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.915 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard": "https://172.21.15.37:8443/" 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: "always_on_modules": { 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: "octopus": [ 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-21T06:04:44.916 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "pacific": [ 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-21T06:04:44.917 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: "quincy": [ 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.918 INFO:teuthology.orchestra.run.smithi037.stdout: "reef": [ 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "squid": [ 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-21T06:04:44.919 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: "last_failure_osd_epoch": 3, 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: "active_clients": [ 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-21T06:04:44.920 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2776606190 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "libcephsqlite", 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 883826775 2024-09-21T06:04:44.921 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2833364856 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-21T06:04:44.922 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-21T06:04:44.923 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T06:04:44.923 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-21T06:04:44.923 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-21T06:04:44.923 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1745596359 2024-09-21T06:04:44.923 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.923 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T06:04:44.923 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:44.923 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T06:04:44.923 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:04:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.416+0000 7f4eadc00640 1 -- 172.21.15.37:0/2901232794 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4e8c0b6590 msgr2=0x7f4e8c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.416+0000 7f4eadc00640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4e8c0b6590 0x7f4e8c0b8aa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009bd0 tx=0x7f4e98005f90 comp rx=0 tx=0).stop 2024-09-21T06:04:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.416+0000 7f4eadc00640 1 -- 172.21.15.37:0/2901232794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea8105090 msgr2=0x7f4ea819b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.416+0000 7f4eadc00640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea8105090 0x7f4ea819b130 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000eb10 tx=0x7f4ea000c2d0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.416+0000 7f4eadc00640 1 -- 172.21.15.37:0/2901232794 shutdown_connections 2024-09-21T06:04:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.416+0000 7f4eadc00640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea8105090 0x7f4ea819b130 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.416+0000 7f4eadc00640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f4e8c0b6590 0x7f4e8c0b8aa0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.416+0000 7f4eadc00640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ea81046f0 0x7f4ea819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.416+0000 7f4eadc00640 1 --2- 172.21.15.37:0/2901232794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea8103670 0x7f4ea8199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.416+0000 7f4eadc00640 1 -- 172.21.15.37:0/2901232794 >> 172.21.15.37:0/2901232794 conn(0x7f4ea80fefd0 msgr2=0x7f4ea81079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.417+0000 7f4eadc00640 1 -- 172.21.15.37:0/2901232794 shutdown_connections 2024-09-21T06:04:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:04:43.417+0000 7f4eadc00640 1 -- 172.21.15.37:0/2901232794 wait complete. 2024-09-21T06:04:44.975 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T06:04:44.975 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T06:04:44.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:43 smithi037 ceph-mon[30631]: pgmap v738: 129 pgs: 129 active+clean; 127 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 558 KiB/s wr, 246 op/s 2024-09-21T06:04:44.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:43 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2039903634' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T06:04:44.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:43 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/2901232794' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:04:44.977 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:43 smithi144 ceph-mon[34351]: pgmap v738: 129 pgs: 129 active+clean; 127 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 558 KiB/s wr, 246 op/s 2024-09-21T06:04:44.977 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:43 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2039903634' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T06:04:44.977 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:43 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/2901232794' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:04:44.977 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:43 smithi067 ceph-mon[34443]: pgmap v738: 129 pgs: 129 active+clean; 127 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 558 KiB/s wr, 246 op/s 2024-09-21T06:04:44.977 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:43 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2039903634' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T06:04:44.977 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:43 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/2901232794' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:04:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:45.901 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:45 smithi037 ceph-mon[30631]: pgmap v739: 129 pgs: 129 active+clean; 123 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 421 KiB/s wr, 161 op/s 2024-09-21T06:04:45.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:45 smithi067 ceph-mon[34443]: pgmap v739: 129 pgs: 129 active+clean; 123 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 421 KiB/s wr, 161 op/s 2024-09-21T06:04:46.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:45 smithi144 ceph-mon[34351]: pgmap v739: 129 pgs: 129 active+clean; 123 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 421 KiB/s wr, 161 op/s 2024-09-21T06:04:46.196 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:04:46.196 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:46.196 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-09-21T06:04:46.196 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-09-21T06:04:46.196 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:04:46.196 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-09-21T06:04:46.196 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.004035896, 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000819463, 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 5, 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 175, 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 3104, 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 111088, 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.028914095, 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.022653551, 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.004143031, 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 174, 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.018940216, 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000108851 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 111088 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 230, 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 227, 2024-09-21T06:04:46.199 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 531152, 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 140064, 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.050217376, 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.028385150, 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.027151782, 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 226, 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.017337202, 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000076713 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:46.200 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 531152, 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 140064 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:46.201 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148984, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 30, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:46.203 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 968, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 231, 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 498652, 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 231, 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 231, 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 498652, 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T06:04:46.205 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:46.206 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:46.206 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:46.206 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:46.206 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:46.206 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:04:46.974 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-21T06:04:46.974 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T06:04:46.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T06:04:47.355 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:47.834 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:47 smithi037 ceph-mon[30631]: pgmap v740: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 406 KiB/s wr, 144 op/s 2024-09-21T06:04:47.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:47 smithi067 ceph-mon[34443]: pgmap v740: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 406 KiB/s wr, 144 op/s 2024-09-21T06:04:48.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:47 smithi144 ceph-mon[34351]: pgmap v740: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 406 KiB/s wr, 144 op/s 2024-09-21T06:04:48.125 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:04:48.125 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:48.125 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 4, 2024-09-21T06:04:48.125 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 4, 2024-09-21T06:04:48.125 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 2944, 2024-09-21T06:04:48.125 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 448, 2024-09-21T06:04:48.126 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:48.126 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-09-21T06:04:48.126 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.006197966, 2024-09-21T06:04:48.126 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000067481, 2024-09-21T06:04:48.126 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.003479487, 2024-09-21T06:04:48.126 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:48.126 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:48.126 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3, 2024-09-21T06:04:48.126 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.005815023, 2024-09-21T06:04:48.126 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.001938341 2024-09-21T06:04:48.126 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:48.126 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:48.126 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1, 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 178, 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 111520, 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:48.127 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.024149985, 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.020023443, 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.001770317, 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 176, 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.013234995, 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000075198 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:48.128 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 111520 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 236, 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 233, 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 532784, 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 143904, 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.049990406, 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.027565742, 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.027470609, 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 232, 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.017384662, 2024-09-21T06:04:48.129 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000074933 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 532784, 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 143904 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:48.130 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:48.131 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:48.132 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 29, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:48.133 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 968, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:48.134 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:48.135 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T06:04:48.135 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-21T06:04:48.135 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T06:04:48.135 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 237, 2024-09-21T06:04:48.135 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 499432, 2024-09-21T06:04:48.135 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:48.135 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 237, 2024-09-21T06:04:48.135 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-21T06:04:48.135 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-21T06:04:48.135 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 237, 2024-09-21T06:04:48.135 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 499432, 2024-09-21T06:04:48.135 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T06:04:48.135 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:48.136 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:48.136 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:48.136 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:48.136 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:48.136 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:04:48.896 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-21T06:04:48.896 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T06:04:48.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T06:04:49.276 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:49.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:49 smithi067 ceph-mon[34443]: pgmap v741: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 41 op/s 2024-09-21T06:04:50.090 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:49 smithi037 ceph-mon[30631]: pgmap v741: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 41 op/s 2024-09-21T06:04:50.091 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:04:50.091 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:50.091 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-09-21T06:04:50.091 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-09-21T06:04:50.092 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:04:50.092 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-09-21T06:04:50.092 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:50.092 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-09-21T06:04:50.092 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.003786990, 2024-09-21T06:04:50.092 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:04:50.092 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000689242, 2024-09-21T06:04:50.092 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:50.093 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:50.093 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:50.093 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:50.093 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:50.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:50.093 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:50.093 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:50.093 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:50.094 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:50.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:50.094 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:04:50.094 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:04:50.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:50.094 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:50.094 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1, 2024-09-21T06:04:50.094 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 175, 2024-09-21T06:04:50.095 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:04:50.095 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 110992, 2024-09-21T06:04:50.095 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:50.095 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:50.095 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.022173479, 2024-09-21T06:04:50.095 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.018093635, 2024-09-21T06:04:50.095 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.001785989, 2024-09-21T06:04:50.096 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:50.096 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:50.096 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 173, 2024-09-21T06:04:50.096 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.011344035, 2024-09-21T06:04:50.096 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000065572 2024-09-21T06:04:50.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:50.096 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:50.096 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:50.096 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:50.096 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:50.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:50.097 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:50.097 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 110992 2024-09-21T06:04:50.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:50.097 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:50.097 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 236, 2024-09-21T06:04:50.097 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 231, 2024-09-21T06:04:50.097 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 534640, 2024-09-21T06:04:50.098 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 141792, 2024-09-21T06:04:50.098 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-09-21T06:04:50.098 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:50.098 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.051283003, 2024-09-21T06:04:50.098 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.026632610, 2024-09-21T06:04:50.098 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.030404113, 2024-09-21T06:04:50.098 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:50.098 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:50.098 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 231, 2024-09-21T06:04:50.098 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.024479237, 2024-09-21T06:04:50.098 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000105970 2024-09-21T06:04:50.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:50.099 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:50.099 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:50.099 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:50.099 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:50.099 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:50.099 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 534640, 2024-09-21T06:04:50.099 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 141792 2024-09-21T06:04:50.099 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:50.099 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-09-21T06:04:50.099 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-09-21T06:04:50.100 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-09-21T06:04:50.100 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:50.100 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-09-21T06:04:50.100 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:50.100 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:50.100 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:50.100 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:50.100 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:50.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:50.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:50.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:50.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:50.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:50.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:50.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:50.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:50.101 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:50.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:50.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:50.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:50.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:50.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:50.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:50.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:50.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:50.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:50.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:50.102 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:50.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:50.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:50.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:50.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:50.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:50.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:50.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-09-21T06:04:50.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:50.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:50.103 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:50.104 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:50.104 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:04:50.104 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 29, 2024-09-21T06:04:50.104 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:50.104 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:50.104 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-09-21T06:04:50.104 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-09-21T06:04:50.104 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:50.104 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:50.104 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:50.104 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:50.104 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-09-21T06:04:50.105 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-09-21T06:04:50.105 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:50.105 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:50.105 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:50.105 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-09-21T06:04:50.105 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 968, 2024-09-21T06:04:50.105 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-09-21T06:04:50.105 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:50.105 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-09-21T06:04:50.105 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:50.106 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-09-21T06:04:50.106 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:50.106 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:50.106 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T06:04:50.106 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-21T06:04:50.106 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T06:04:50.106 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 233, 2024-09-21T06:04:50.106 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 498912, 2024-09-21T06:04:50.106 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:50.106 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 233, 2024-09-21T06:04:50.106 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-21T06:04:50.107 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-21T06:04:50.107 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 233, 2024-09-21T06:04:50.107 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 498912, 2024-09-21T06:04:50.107 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T06:04:50.107 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:50.107 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:50.107 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:50.107 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:50.107 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:50.107 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:04:50.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:49 smithi144 ceph-mon[34351]: pgmap v741: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 41 op/s 2024-09-21T06:04:50.879 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-21T06:04:50.879 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T06:04:50.879 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T06:04:51.258 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:51.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:51 smithi067 ceph-mon[34443]: pgmap v742: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-21T06:04:52.056 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:51 smithi037 ceph-mon[30631]: pgmap v742: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-21T06:04:52.057 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T06:04:52.058 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:52.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 241, 2024-09-21T06:04:52.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 236, 2024-09-21T06:04:52.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 536000, 2024-09-21T06:04:52.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 144992, 2024-09-21T06:04:52.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:52.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-09-21T06:04:52.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.058150904, 2024-09-21T06:04:52.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.029709927, 2024-09-21T06:04:52.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.031060362, 2024-09-21T06:04:52.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:52.058 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 236, 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.025105123, 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000106377 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 536000, 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 144992 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1, 2024-09-21T06:04:52.059 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 179, 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 111696, 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.022927963, 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.018647812, 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.001843938, 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 177, 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.011708461, 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000066149 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:52.060 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 111696 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.000867291, 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:04:52.061 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000713391, 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:52.063 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:52.064 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 29, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-09-21T06:04:52.065 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 968, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:52.066 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 238, 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 499562, 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 238, 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 238, 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 499562, 2024-09-21T06:04:52.067 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T06:04:52.068 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T06:04:52.068 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T06:04:52.068 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T06:04:52.068 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:52.068 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T06:04:52.068 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T06:04:52.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:51 smithi144 ceph-mon[34351]: pgmap v742: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-21T06:04:52.999 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-21T06:04:52.999 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T06:04:52.999 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T06:04:53.266 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:04:53.823 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-21T06:04:53.824 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:53.824 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 36820, 2024-09-21T06:04:53.824 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 36822, 2024-09-21T06:04:53.824 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 9233464, 2024-09-21T06:04:53.824 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 67611504, 2024-09-21T06:04:53.824 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 11, 2024-09-21T06:04:53.824 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-21T06:04:53.824 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 3.054821430, 2024-09-21T06:04:53.824 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 1.256328214, 2024-09-21T06:04:53.824 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.665431113, 2024-09-21T06:04:53.824 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.960323270, 2024-09-21T06:04:53.824 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:53.825 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 36820, 2024-09-21T06:04:53.825 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 2.346043297, 2024-09-21T06:04:53.825 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000063716 2024-09-21T06:04:53.825 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.825 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:53.825 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2, 2024-09-21T06:04:53.825 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000173, 2024-09-21T06:04:53.825 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000086 2024-09-21T06:04:53.825 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.825 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:04:53.825 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:04:53.825 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.826 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:53.826 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 29186, 2024-09-21T06:04:53.826 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 29359, 2024-09-21T06:04:53.826 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 8104545, 2024-09-21T06:04:53.826 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 57689234, 2024-09-21T06:04:53.826 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 55, 2024-09-21T06:04:53.826 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 8, 2024-09-21T06:04:53.826 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 2.430175837, 2024-09-21T06:04:53.826 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 1.046354992, 2024-09-21T06:04:53.826 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.534940582, 2024-09-21T06:04:53.826 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.706591057, 2024-09-21T06:04:53.826 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:53.826 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 29357, 2024-09-21T06:04:53.827 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 1.881546769, 2024-09-21T06:04:53.827 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000064091 2024-09-21T06:04:53.827 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.827 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:53.827 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 48, 2024-09-21T06:04:53.827 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000006261, 2024-09-21T06:04:53.827 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000130 2024-09-21T06:04:53.827 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.827 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:53.827 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 399984 2024-09-21T06:04:53.827 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.827 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:53.827 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 63095, 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 126049, 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 20640519, 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 56708348, 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 12, 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 5, 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 5.736166072, 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 3.401790395, 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 2.242725297, 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.405784565, 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 126049, 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 3.883158319, 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000030806 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.828 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 90101, 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.025741208, 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000285 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 623536, 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 181312 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 1, 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-MDSRank": { 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-21T06:04:53.829 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-21T06:04:53.830 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 92663, 2024-09-21T06:04:53.830 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 34.294544751, 2024-09-21T06:04:53.830 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000370099 2024-09-21T06:04:53.830 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:53.830 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.830 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-PurgeQueue": { 2024-09-21T06:04:53.830 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-21T06:04:53.830 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-21T06:04:53.830 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 9936, 2024-09-21T06:04:53.830 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 3.154703571, 2024-09-21T06:04:53.830 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000317502 2024-09-21T06:04:53.830 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:53.830 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "request": 25223, 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "reply": 25223, 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "reply_latency": { 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 25223, 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 264.342556133, 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.010480218 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_reply": 0, 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "forward": 0, 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_complete": 0, 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_keys": 0, 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_commit": 212, 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_split": 24, 2024-09-21T06:04:53.831 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_merge": 2, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes": 487, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_top": 322, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_bottom": 165, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pin_tail": 0, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pinned": 26, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_expired": 0, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_with_caps": 3, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": 3, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "subtrees": 2, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse": 27270, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_hit": 26689, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_forward": 0, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_discover": 0, 2024-09-21T06:04:53.832 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_remote_ino": 0, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_lock": 3, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "load_cent": 0, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "q": 0, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "exported": 0, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "exported_inodes": 0, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "imported": 0, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "imported_inodes": 0, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_dir_fetch": 0, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_peer_discover": 0, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rfiles": 4, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rbytes": 234, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rsnaps": 0, 2024-09-21T06:04:53.833 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_set_tag": 0, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_file_inodes": 0, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_revoke": 16217, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_grant": 24214, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_trunc": 7863, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:04:53.834 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps": 22735, 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps_dirty": 14530, 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_cap_release": 225, 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: "process_request_cap_release": 16821 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_cache": { 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update": 0, 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update_receipt": 0, 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_try_discover": 0, 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_send_discover": 0, 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_handle_discover": 0, 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays": 0, 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_delayed": 0, 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:04:53.835 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_created": 7279, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_enqueued": 7276, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_reintegrated": 3, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_migrated": 0, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_processing": 0, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_started": 0, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_completed": 0, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_quiesce_path": 11, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_quiesce_inode": 41283, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_exportdir": 0, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_flush": 0, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragmentdir": 26, 2024-09-21T06:04:53.836 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragstats": 0, 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_inodestats": 0, 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_succeeded": 0, 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_write_failed": 0 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_log": { 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "evlrg": 0, 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "evadd": 58867, 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "evex": 0, 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "evtrm": 0, 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "ev": 58867, 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "evexg": 0, 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "evexd": 0, 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "segadd": 69, 2024-09-21T06:04:53.837 INFO:teuthology.orchestra.run.smithi067.stdout: "segex": 0, 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: "segtrm": 0, 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: "seg": 69, 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: "segmjr": 6, 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: "segexg": 0, 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: "segexd": 0, 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: "expos": 4194304, 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: "wrpos": 127916522, 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: "rdpos": 0, 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: "jlat": { 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 27616, 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 74.824182988, 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.002709450 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: "replayed": 0 2024-09-21T06:04:53.838 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.839 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_mem": { 2024-09-21T06:04:53.839 INFO:teuthology.orchestra.run.smithi067.stdout: "ino": 23, 2024-09-21T06:04:53.839 INFO:teuthology.orchestra.run.smithi067.stdout: "ino+": 7299, 2024-09-21T06:04:53.839 INFO:teuthology.orchestra.run.smithi067.stdout: "ino-": 7276, 2024-09-21T06:04:53.839 INFO:teuthology.orchestra.run.smithi067.stdout: "dir": 18, 2024-09-21T06:04:53.839 INFO:teuthology.orchestra.run.smithi067.stdout: "dir+": 279, 2024-09-21T06:04:53.839 INFO:teuthology.orchestra.run.smithi067.stdout: "dir-": 261, 2024-09-21T06:04:53.839 INFO:teuthology.orchestra.run.smithi067.stdout: "dn": 487, 2024-09-21T06:04:53.839 INFO:teuthology.orchestra.run.smithi067.stdout: "dn+": 12523, 2024-09-21T06:04:53.839 INFO:teuthology.orchestra.run.smithi067.stdout: "dn-": 12036, 2024-09-21T06:04:53.839 INFO:teuthology.orchestra.run.smithi067.stdout: "cap": 3, 2024-09-21T06:04:53.839 INFO:teuthology.orchestra.run.smithi067.stdout: "cap+": 16161, 2024-09-21T06:04:53.839 INFO:teuthology.orchestra.run.smithi067.stdout: "cap-": 16158, 2024-09-21T06:04:53.840 INFO:teuthology.orchestra.run.smithi067.stdout: "rss": 169024, 2024-09-21T06:04:53.840 INFO:teuthology.orchestra.run.smithi067.stdout: "heap": 417210368 2024-09-21T06:04:53.840 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.840 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_server": { 2024-09-21T06:04:53.840 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_client_request": 43895, 2024-09-21T06:04:53.840 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_server_request": 0, 2024-09-21T06:04:53.840 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_request": 25223, 2024-09-21T06:04:53.840 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_session": 21, 2024-09-21T06:04:53.840 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_peer_request": 0, 2024-09-21T06:04:53.840 INFO:teuthology.orchestra.run.smithi067.stdout: "req_create_latency": { 2024-09-21T06:04:53.840 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 7207, 2024-09-21T06:04:53.840 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 50.972681588, 2024-09-21T06:04:53.840 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.007072662 2024-09-21T06:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getattr_latency": { 2024-09-21T06:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 36, 2024-09-21T06:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 3.851315095, 2024-09-21T06:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.106980974 2024-09-21T06:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getfilelock_latency": { 2024-09-21T06:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout: "req_link_latency": { 2024-09-21T06:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3, 2024-09-21T06:04:53.842 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.009116424, 2024-09-21T06:04:53.842 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.003038808 2024-09-21T06:04:53.842 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.842 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookup_latency": { 2024-09-21T06:04:53.842 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 795, 2024-09-21T06:04:53.842 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.641189739, 2024-09-21T06:04:53.842 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000806527 2024-09-21T06:04:53.842 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.842 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookuphash_latency": { 2024-09-21T06:04:53.842 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.842 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.842 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.842 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupino_latency": { 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2, 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000360962, 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000180481 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupname_latency": { 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupparent_latency": { 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.843 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.844 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupsnap_latency": { 2024-09-21T06:04:53.844 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.844 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.844 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.844 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.844 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lssnap_latency": { 2024-09-21T06:04:53.845 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.845 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.845 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.845 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.845 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mkdir_latency": { 2024-09-21T06:04:53.845 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 73, 2024-09-21T06:04:53.845 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 13.495982459, 2024-09-21T06:04:53.845 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.184876472 2024-09-21T06:04:53.845 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.845 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mknod_latency": { 2024-09-21T06:04:53.845 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.846 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.846 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.846 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.846 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mksnap_latency": { 2024-09-21T06:04:53.846 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.846 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.846 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.846 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.846 INFO:teuthology.orchestra.run.smithi067.stdout: "req_open_latency": { 2024-09-21T06:04:53.846 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 429, 2024-09-21T06:04:53.846 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.090761068, 2024-09-21T06:04:53.846 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000211564 2024-09-21T06:04:53.846 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.847 INFO:teuthology.orchestra.run.smithi067.stdout: "req_readdir_latency": { 2024-09-21T06:04:53.847 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 481, 2024-09-21T06:04:53.847 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.955829598, 2024-09-21T06:04:53.847 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001987171 2024-09-21T06:04:53.847 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.847 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rename_latency": { 2024-09-21T06:04:53.847 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 94, 2024-09-21T06:04:53.847 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.164540620, 2024-09-21T06:04:53.847 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001750432 2024-09-21T06:04:53.847 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.847 INFO:teuthology.orchestra.run.smithi067.stdout: "req_renamesnap_latency": { 2024-09-21T06:04:53.847 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: "req_snapdiff_latency": { 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmdir_latency": { 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 73, 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 3.505891006, 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.048025904 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.848 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmsnap_latency": { 2024-09-21T06:04:53.849 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.849 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.849 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.849 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.849 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmxattr_latency": { 2024-09-21T06:04:53.849 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.849 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.849 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.849 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.849 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setattr_latency": { 2024-09-21T06:04:53.849 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 8855, 2024-09-21T06:04:53.849 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 153.529695420, 2024-09-21T06:04:53.849 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.017338192 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setdirlayout_latency": { 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setfilelock_latency": { 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 8, 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.003541033, 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000442629 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setlayout_latency": { 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.850 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setxattr_latency": { 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 10, 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.025582097, 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.002558209 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: "req_symlink_latency": { 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 6, 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.003789017, 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000631502 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: "req_unlink_latency": { 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 7151, 2024-09-21T06:04:53.851 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 37.092280007, 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.005187006 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getvxattr_latency": { 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_sessions": { 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: "session_count": 1, 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: "session_add": 3, 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: "session_remove": 2, 2024-09-21T06:04:53.852 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_open": 1, 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_stale": 0, 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "total_load": 5888, 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "average_load": 5888, 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "avg_session_uptime": 675, 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "mdthresh_evicted": 0 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:53.853 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:53.854 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 287011, 2024-09-21T06:04:53.855 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 99, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 88, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 1, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 9048, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 170, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-21T06:04:53.856 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 435706, 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 5761, 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "objecter": { 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "op_active": 0, 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "op_laggy": 0, 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send": 80209, 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send_bytes": 127955979, 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "op_resend": 32, 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "op_reply": 80209, 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "op_latency": { 2024-09-21T06:04:53.857 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 80209, 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 639.302675173, 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.007970460 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: "op_inflight": 0, 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: "oplen_avg": { 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 80209, 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 80597 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: "op": 80209, 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: "op_r": 82, 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: "op_w": 80127, 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: "op_rmw": 0, 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: "op_pg": 0, 2024-09-21T06:04:53.858 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_stat": 0, 2024-09-21T06:04:53.859 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_create": 11, 2024-09-21T06:04:53.859 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_read": 82, 2024-09-21T06:04:53.859 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_write": 27698, 2024-09-21T06:04:53.859 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writefull": 85, 2024-09-21T06:04:53.859 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writesame": 0, 2024-09-21T06:04:53.859 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_append": 0, 2024-09-21T06:04:53.859 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_zero": 0, 2024-09-21T06:04:53.859 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_truncate": 8, 2024-09-21T06:04:53.859 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_delete": 15242, 2024-09-21T06:04:53.859 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_mapext": 0, 2024-09-21T06:04:53.859 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_sparse_read": 0, 2024-09-21T06:04:53.859 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_clonerange": 0, 2024-09-21T06:04:53.859 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_getxattr": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_setxattr": 22, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_rmxattr": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_call": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_watch": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_notify": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_other": 36717, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_active": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_send": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_resend": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_ping": 0, 2024-09-21T06:04:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_active": 0, 2024-09-21T06:04:53.861 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_send": 0, 2024-09-21T06:04:53.861 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_resend": 0, 2024-09-21T06:04:53.861 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_active": 0, 2024-09-21T06:04:53.861 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_send": 0, 2024-09-21T06:04:53.861 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_resend": 0, 2024-09-21T06:04:53.861 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_active": 0, 2024-09-21T06:04:53.861 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_send": 0, 2024-09-21T06:04:53.861 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_resend": 0, 2024-09-21T06:04:53.861 INFO:teuthology.orchestra.run.smithi067.stdout: "command_active": 0, 2024-09-21T06:04:53.861 INFO:teuthology.orchestra.run.smithi067.stdout: "command_send": 0, 2024-09-21T06:04:53.861 INFO:teuthology.orchestra.run.smithi067.stdout: "command_resend": 0, 2024-09-21T06:04:53.861 INFO:teuthology.orchestra.run.smithi067.stdout: "map_epoch": 90, 2024-09-21T06:04:53.861 INFO:teuthology.orchestra.run.smithi067.stdout: "map_full": 0, 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: "map_inc": 11, 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_sessions": 12, 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_open": 12, 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_close": 0, 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_laggy": 0, 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_wr": 662, 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_rd": 0, 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_del": 70 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: "oft": { 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_objs": 1, 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_updates": 0, 2024-09-21T06:04:53.862 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_removes": 0 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: "purge_queue": { 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops": 0, 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops_high_water": 111, 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing": 0, 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_high_water": 31, 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed_ops": 14669, 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed": 7276, 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_item_in_journal": 0 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-21T06:04:53.863 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 129097, 2024-09-21T06:04:53.864 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 27110502, 2024-09-21T06:04:53.864 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:53.864 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 129097, 2024-09-21T06:04:53.864 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-21T06:04:53.864 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-21T06:04:53.864 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 129097, 2024-09-21T06:04:53.864 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 27110502, 2024-09-21T06:04:53.864 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-21T06:04:53.864 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.864 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.864 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.864 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:53.864 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_bytes": { 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 80209, 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 128748527, 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 80209, 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 128748527, 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-21T06:04:53.865 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_ops": { 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 1024, 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 80209, 2024-09-21T06:04:53.866 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 80209, 2024-09-21T06:04:53.867 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 80209, 2024-09-21T06:04:53.867 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 80209, 2024-09-21T06:04:53.867 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-21T06:04:53.867 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.867 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.867 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.867 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:53.867 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.867 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:04:53.867 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-21T06:04:53.867 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-21T06:04:53.867 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-21T06:04:53.867 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 7276, 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 792548, 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 7276, 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 82, 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 792548, 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle-0x5611b162b450": { 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-21T06:04:53.868 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 58867, 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 123722218, 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 58867, 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 27616, 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 123722218, 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:53.869 INFO:teuthology.orchestra.run.smithi067.stdout: "trackedop": { 2024-09-21T06:04:53.870 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_ops_count": 36666 2024-09-21T06:04:53.870 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:53.870 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-21T06:04:53.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:53 smithi067 ceph-mon[34443]: pgmap v743: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2024-09-21T06:04:54.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:53 smithi144 ceph-mon[34351]: pgmap v743: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2024-09-21T06:04:54.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:53 smithi037 ceph-mon[30631]: pgmap v743: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2024-09-21T06:04:54.826 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=24 2024-09-21T06:04:54.826 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T06:04:54.826 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T06:04:55.080 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:04:55.649 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-21T06:04:55.649 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:55.649 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 4, 2024-09-21T06:04:55.649 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 4, 2024-09-21T06:04:55.649 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 2944, 2024-09-21T06:04:55.649 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 448, 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 0, 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.002977741, 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.000036993, 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.002127625, 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3, 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.003841719, 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001280573 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:55.650 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 237, 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 234, 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 533056, 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 144544, 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 2, 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.038016869, 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.018595644, 2024-09-21T06:04:55.651 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.024889219, 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 233, 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.012181348, 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000052280 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 533056, 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 144544 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:55.652 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:55.653 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 1, 2024-09-21T06:04:55.653 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 179, 2024-09-21T06:04:55.653 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:04:55.653 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 111696, 2024-09-21T06:04:55.653 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:55.653 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:55.653 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.013896815, 2024-09-21T06:04:55.653 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.011045823, 2024-09-21T06:04:55.653 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.000896206, 2024-09-21T06:04:55.653 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:55.653 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:55.653 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 177, 2024-09-21T06:04:55.653 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.009120438, 2024-09-21T06:04:55.654 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000051527 2024-09-21T06:04:55.654 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:55.654 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:55.654 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:55.654 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:55.654 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:55.654 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:55.654 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:55.654 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 111696 2024-09-21T06:04:55.654 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:55.654 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-21T06:04:55.654 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 0, 2024-09-21T06:04:55.655 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-21T06:04:55.655 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:55.655 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-21T06:04:55.655 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:55.655 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:55.655 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:55.655 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:55.655 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:55.655 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:55.655 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:55.655 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:55.655 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:55.655 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:55.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 29, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:55.657 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 0, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 0, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 968, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 2, 2024-09-21T06:04:55.658 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 238, 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 499562, 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 238, 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-21T06:04:55.659 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 238, 2024-09-21T06:04:55.660 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 499562, 2024-09-21T06:04:55.660 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-21T06:04:55.660 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:55.660 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:55.660 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:55.660 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:55.660 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:55.660 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-21T06:04:55.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:55 smithi067 ceph-mon[34443]: pgmap v744: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-21T06:04:56.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:55 smithi144 ceph-mon[34351]: pgmap v744: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-21T06:04:56.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:55 smithi037 ceph-mon[30631]: pgmap v744: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-21T06:04:56.443 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.e 2024-09-21T06:04:56.443 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T06:04:56.443 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T06:04:56.695 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:04:57.262 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-21T06:04:57.262 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:57.263 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 239, 2024-09-21T06:04:57.263 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 234, 2024-09-21T06:04:57.263 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 535456, 2024-09-21T06:04:57.263 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 143712, 2024-09-21T06:04:57.263 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:57.263 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 0, 2024-09-21T06:04:57.263 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.040119357, 2024-09-21T06:04:57.263 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.018354293, 2024-09-21T06:04:57.263 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.027478074, 2024-09-21T06:04:57.263 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:57.263 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:57.263 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 234, 2024-09-21T06:04:57.263 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.016131753, 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000068939 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 535456, 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 143712 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 1, 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 177, 2024-09-21T06:04:57.264 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 111344, 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.014095095, 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.011292542, 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.000912491, 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 175, 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.010616520, 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000060665 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:57.265 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:57.266 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:57.266 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:57.266 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:57.266 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:04:57.266 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 111344 2024-09-21T06:04:57.266 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:57.266 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:57.266 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 0, 2024-09-21T06:04:57.266 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 2, 2024-09-21T06:04:57.266 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:04:57.266 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 0, 2024-09-21T06:04:57.266 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 2, 2024-09-21T06:04:57.266 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.000313051, 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.000200610, 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:57.267 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 0, 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:57.268 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:57.269 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:57.270 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:57.270 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:57.270 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:57.270 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:57.270 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:57.270 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:57.270 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:57.270 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:57.270 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:57.270 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:57.270 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-21T06:04:57.270 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:57.270 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 148984, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 30, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 0, 2024-09-21T06:04:57.271 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 0, 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 968, 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 2, 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-21T06:04:57.272 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 236, 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 499302, 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 236, 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 236, 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 499302, 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:57.273 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-21T06:04:57.986 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.h 2024-09-21T06:04:57.986 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T06:04:57.986 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T06:04:57.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:57 smithi067 ceph-mon[34443]: pgmap v745: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-21T06:04:58.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:57 smithi144 ceph-mon[34351]: pgmap v745: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-21T06:04:58.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:57 smithi037 ceph-mon[30631]: pgmap v745: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-21T06:04:58.237 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:04:58.799 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-21T06:04:58.799 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:04:58.799 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 240, 2024-09-21T06:04:58.799 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 237, 2024-09-21T06:04:58.799 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 533872, 2024-09-21T06:04:58.799 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 146464, 2024-09-21T06:04:58.799 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 4, 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 0, 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.039756344, 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.019684921, 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.025772332, 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 236, 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.012482461, 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000052891 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:58.800 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 533872, 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 146464 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 5, 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 183, 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 3104, 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 112496, 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 3, 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 2, 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.015778499, 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.011392641, 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.002629084, 2024-09-21T06:04:58.801 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 182, 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.012937530, 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000071085 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 112496 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:04:58.802 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 0, 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 2, 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 0, 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 2, 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 1, 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.000344450, 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.000273942, 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:04:58.803 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 0, 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-21T06:04:58.804 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:04:58.805 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-21T06:04:58.806 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:04:58.806 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:04:58.806 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:04:58.806 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:04:58.806 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:04:58.806 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:04:58.806 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:04:58.806 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-21T06:04:58.806 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:04:58.806 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:04:58.806 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:04:58.806 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-21T06:04:58.806 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 148962, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 30, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:04:58.807 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-21T06:04:58.808 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 0, 2024-09-21T06:04:58.808 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 0, 2024-09-21T06:04:58.808 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:04:58.808 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:04:58.808 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-21T06:04:58.808 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-21T06:04:58.808 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 968, 2024-09-21T06:04:58.808 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 2, 2024-09-21T06:04:58.808 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-21T06:04:58.808 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-21T06:04:58.808 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-21T06:04:58.808 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-21T06:04:58.808 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 241, 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 499952, 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 241, 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 241, 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 499952, 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-21T06:04:58.809 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-21T06:04:58.810 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-21T06:04:58.810 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:58.810 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-21T06:04:58.810 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-21T06:04:59.437 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-21T06:04:59.438 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T06:04:59.438 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T06:04:59.698 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:05:00.008 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:04:59 smithi144 ceph-mon[34351]: pgmap v746: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-21T06:05:00.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:04:59 smithi037 ceph-mon[30631]: pgmap v746: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-21T06:05:00.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:04:59 smithi067 ceph-mon[34443]: pgmap v746: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-21T06:05:00.280 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T06:05:00.280 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:05:00.280 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 0, 2024-09-21T06:05:00.280 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 2, 2024-09-21T06:05:00.280 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:05:00.280 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 0, 2024-09-21T06:05:00.280 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 4, 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 0, 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.001243383, 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.000323288, 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:00.281 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 241, 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 236, 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 536000, 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 144992, 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 2, 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 1, 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.041491566, 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.020477121, 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.027278822, 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:05:00.282 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 236, 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.016115648, 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000068286 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 536000, 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 144992 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:05:00.283 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1, 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 179, 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 111696, 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 3, 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 2, 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.013454977, 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.010753351, 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.000874311, 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 177, 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.009622381, 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000054363 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:05:00.284 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 111696 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 0, 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:05:00.285 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-21T06:05:00.286 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:05:00.287 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 148985, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 30, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:05:00.288 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 968, 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 2, 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 238, 2024-09-21T06:05:00.289 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 499562, 2024-09-21T06:05:00.290 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:05:00.290 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 238, 2024-09-21T06:05:00.290 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:05:00.290 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:05:00.290 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 238, 2024-09-21T06:05:00.290 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 499562, 2024-09-21T06:05:00.290 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:05:00.290 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:00.290 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:00.290 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:00.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:00.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:00.290 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T06:05:01.109 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.c 2024-09-21T06:05:01.109 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T06:05:01.109 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T06:05:01.354 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:05:01.916 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T06:05:01.916 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:05:01.916 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 0, 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 2, 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 0, 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 4, 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 0, 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.001006067, 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.000159194, 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:01.917 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 5, 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 182, 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 3104, 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 112320, 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 3, 2024-09-21T06:05:01.918 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 2, 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.016381829, 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.011924584, 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.002584528, 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 181, 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.014529420, 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000080273 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:05:01.919 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 112320 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 238, 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 235, 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 533328, 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 145184, 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 2, 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 1, 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.039581032, 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.020818022, 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.023221306, 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 234, 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.013795273, 2024-09-21T06:05:01.920 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000058954 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 533328, 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 145184 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 0, 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:05:01.921 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:05:01.922 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-21T06:05:01.923 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 29, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 0, 2024-09-21T06:05:01.924 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 0, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 968, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 2, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:05:01.925 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 239, 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 499692, 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 239, 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 239, 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 499692, 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:01.926 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T06:05:02.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:01 smithi144 ceph-mon[34351]: pgmap v747: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-21T06:05:02.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:01 smithi037 ceph-mon[30631]: pgmap v747: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-21T06:05:02.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:01 smithi067 ceph-mon[34443]: pgmap v747: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-21T06:05:02.651 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.f 2024-09-21T06:05:02.651 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T06:05:02.652 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T06:05:02.898 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:05:03.423 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T06:05:03.423 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:05:03.423 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1794, 2024-09-21T06:05:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1790, 2024-09-21T06:05:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 36653169, 2024-09-21T06:05:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 637834, 2024-09-21T06:05:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 7, 2024-09-21T06:05:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2024-09-21T06:05:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.250963746, 2024-09-21T06:05:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.101001044, 2024-09-21T06:05:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.088648024, 2024-09-21T06:05:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.052156817, 2024-09-21T06:05:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:05:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1789, 2024-09-21T06:05:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.076385456, 2024-09-21T06:05:03.424 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000042697 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 547584, 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 145248 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 607, 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 784, 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 50491840, 2024-09-21T06:05:03.425 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 575974, 2024-09-21T06:05:03.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2024-09-21T06:05:03.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 5, 2024-09-21T06:05:03.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.091216153, 2024-09-21T06:05:03.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.033985270, 2024-09-21T06:05:03.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.038105130, 2024-09-21T06:05:03.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.013771043, 2024-09-21T06:05:03.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:05:03.426 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 782, 2024-09-21T06:05:03.426 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.035912987, 2024-09-21T06:05:03.426 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000045924 2024-09-21T06:05:03.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.426 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:05:03.426 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.427 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.427 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.427 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:05:03.427 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 383200 2024-09-21T06:05:03.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.427 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:05:03.427 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 712, 2024-09-21T06:05:03.427 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 712, 2024-09-21T06:05:03.427 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 37930130, 2024-09-21T06:05:03.427 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 225599, 2024-09-21T06:05:03.427 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2024-09-21T06:05:03.427 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 5, 2024-09-21T06:05:03.428 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.090063834, 2024-09-21T06:05:03.428 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.033263344, 2024-09-21T06:05:03.428 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.033365509, 2024-09-21T06:05:03.428 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.018271021, 2024-09-21T06:05:03.428 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:05:03.428 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 711, 2024-09-21T06:05:03.428 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.031749963, 2024-09-21T06:05:03.428 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000044655 2024-09-21T06:05:03.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.428 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:05:03.428 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.428 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.428 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 4760, 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.128144203, 2024-09-21T06:05:03.429 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000026921 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 0, 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 0, 2024-09-21T06:05:03.430 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 0, 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 7302, 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 0, 2024-09-21T06:05:03.431 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 7302, 2024-09-21T06:05:03.432 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-21T06:05:03.432 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 7302, 2024-09-21T06:05:03.432 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-21T06:05:03.432 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2024-09-21T06:05:03.432 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2024-09-21T06:05:03.432 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 2, 2024-09-21T06:05:03.432 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 0, 2024-09-21T06:05:03.432 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 0, 2024-09-21T06:05:03.432 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-21T06:05:03.432 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2024-09-21T06:05:03.432 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:05:03.432 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-21T06:05:03.432 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2024-09-21T06:05:03.433 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-21T06:05:03.433 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-21T06:05:03.433 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-21T06:05:03.433 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-21T06:05:03.433 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-21T06:05:03.433 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-21T06:05:03.433 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-21T06:05:03.433 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:05:03.433 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-21T06:05:03.433 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 4, 2024-09-21T06:05:03.433 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 234, 2024-09-21T06:05:03.433 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-21T06:05:03.433 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:05:03.434 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-21T06:05:03.434 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:05:03.434 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:05:03.434 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:05:03.434 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:05:03.434 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:05:03.434 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-21T06:05:03.434 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:05:03.435 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:05:03.435 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:05:03.435 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:05:03.435 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:05:03.435 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:05:03.435 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2024-09-21T06:05:03.435 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:05:03.435 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2024-09-21T06:05:03.435 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 0 2024-09-21T06:05:03.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.435 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-21T06:05:03.435 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-21T06:05:03.435 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-21T06:05:03.436 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-21T06:05:03.436 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2024-09-21T06:05:03.436 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-21T06:05:03.436 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-21T06:05:03.436 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-21T06:05:03.436 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:05:03.436 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2024-09-21T06:05:03.436 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2024-09-21T06:05:03.436 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2024-09-21T06:05:03.436 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-21T06:05:03.437 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0, 2024-09-21T06:05:03.438 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_started": 0, 2024-09-21T06:05:03.438 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_succeeded": 0, 2024-09-21T06:05:03.438 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_write_failed": 0 2024-09-21T06:05:03.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.438 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-21T06:05:03.438 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-21T06:05:03.438 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 0, 2024-09-21T06:05:03.438 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-21T06:05:03.438 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-21T06:05:03.439 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 58867, 2024-09-21T06:05:03.439 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-21T06:05:03.439 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-21T06:05:03.439 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 0, 2024-09-21T06:05:03.439 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-21T06:05:03.439 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-21T06:05:03.439 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 69, 2024-09-21T06:05:03.439 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 6, 2024-09-21T06:05:03.439 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-21T06:05:03.439 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-21T06:05:03.439 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-21T06:05:03.439 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 127916522, 2024-09-21T06:05:03.439 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 127915384, 2024-09-21T06:05:03.440 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-21T06:05:03.440 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.440 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.440 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.440 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 58867 2024-09-21T06:05:03.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.440 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-21T06:05:03.440 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 23, 2024-09-21T06:05:03.440 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 7299, 2024-09-21T06:05:03.440 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 7276, 2024-09-21T06:05:03.440 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 18, 2024-09-21T06:05:03.441 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 279, 2024-09-21T06:05:03.441 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 261, 2024-09-21T06:05:03.441 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 7302, 2024-09-21T06:05:03.441 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 12093, 2024-09-21T06:05:03.441 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 4791, 2024-09-21T06:05:03.441 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2024-09-21T06:05:03.441 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 0, 2024-09-21T06:05:03.441 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2024-09-21T06:05:03.441 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 138216, 2024-09-21T06:05:03.441 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 350633984 2024-09-21T06:05:03.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.441 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-21T06:05:03.442 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 0, 2024-09-21T06:05:03.442 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-21T06:05:03.442 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 0, 2024-09-21T06:05:03.442 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 0, 2024-09-21T06:05:03.442 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-21T06:05:03.442 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-21T06:05:03.442 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.442 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.442 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.443 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-21T06:05:03.443 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.443 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.443 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.443 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-21T06:05:03.443 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.443 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.443 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.444 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-21T06:05:03.444 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.444 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.444 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.444 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-21T06:05:03.444 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.445 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.445 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.445 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-21T06:05:03.445 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.445 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.445 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.445 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-21T06:05:03.446 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.446 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.446 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.446 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-21T06:05:03.446 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.446 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.446 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.446 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-21T06:05:03.446 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.446 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.447 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.447 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-21T06:05:03.447 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.447 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.447 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.447 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.451 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.452 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.453 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.454 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 1, 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 3, 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 2, 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 1, 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 0, 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 0, 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 2155, 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-21T06:05:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:05:03.456 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-21T06:05:03.457 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 231408, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 76, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 9048, 2024-09-21T06:05:03.458 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 170, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 5041314, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 29561, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 2863, 2024-09-21T06:05:03.459 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 26, 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 4, 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 2863, 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2863, 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.930968800, 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000674456 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2863, 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 2864 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 2863, 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 2863, 2024-09-21T06:05:03.460 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 0, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 1642, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 0, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 1218, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 0, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 0, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 0, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-21T06:05:03.461 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-21T06:05:03.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 2, 2024-09-21T06:05:03.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 0, 2024-09-21T06:05:03.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:05:03.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-21T06:05:03.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:05:03.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-21T06:05:03.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-21T06:05:03.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-21T06:05:03.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:05:03.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-21T06:05:03.462 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-21T06:05:03.463 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 90, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 2, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 10, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 10, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 0, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 2, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 0 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.464 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 0, 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 0, 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.465 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:05:03.466 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:05:03.466 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T06:05:03.466 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:05:03.466 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 3109, 2024-09-21T06:05:03.466 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 124779775, 2024-09-21T06:05:03.466 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:05:03.466 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 3109, 2024-09-21T06:05:03.466 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:05:03.466 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:05:03.466 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 3109, 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 124779775, 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:05:03.467 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:05:03.468 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 2863, 2024-09-21T06:05:03.468 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 123730931, 2024-09-21T06:05:03.468 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2863, 2024-09-21T06:05:03.468 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 123730931, 2024-09-21T06:05:03.468 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:05:03.468 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.468 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.468 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:03.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.468 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-21T06:05:03.468 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:05:03.468 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-21T06:05:03.469 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:05:03.469 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:05:03.469 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:05:03.469 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:05:03.469 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:05:03.469 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 2863, 2024-09-21T06:05:03.469 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 2863, 2024-09-21T06:05:03.469 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2863, 2024-09-21T06:05:03.469 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 2863, 2024-09-21T06:05:03.469 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:05:03.469 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.469 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.470 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:03.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.470 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:05:03.470 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:05:03.470 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T06:05:03.470 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:05:03.470 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:05:03.470 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:05:03.470 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:05:03.470 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:05:03.470 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x55e75e50d520": { 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:05:03.471 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:03.472 INFO:teuthology.orchestra.run.smithi144.stdout: "trackedop": { 2024-09-21T06:05:03.473 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-21T06:05:03.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:03.473 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T06:05:04.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:03 smithi144 ceph-mon[34351]: pgmap v748: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-21T06:05:04.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:03 smithi037 ceph-mon[30631]: pgmap v748: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-21T06:05:04.236 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-09-21T06:05:04.236 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T06:05:04.236 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T06:05:04.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:03 smithi067 ceph-mon[34443]: pgmap v748: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-21T06:05:04.482 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:05:04.993 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T06:05:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:05:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 242, 2024-09-21T06:05:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 239, 2024-09-21T06:05:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 534416, 2024-09-21T06:05:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 147744, 2024-09-21T06:05:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 4, 2024-09-21T06:05:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 0, 2024-09-21T06:05:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.039538935, 2024-09-21T06:05:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.019591357, 2024-09-21T06:05:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.025311460, 2024-09-21T06:05:04.993 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:05:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:05:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 238, 2024-09-21T06:05:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.013717469, 2024-09-21T06:05:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000057636 2024-09-21T06:05:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:05:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 534416, 2024-09-21T06:05:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 147744 2024-09-21T06:05:04.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1, 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 183, 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 112400, 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 3, 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 2, 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.014702412, 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.011722012, 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.000930011, 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 181, 2024-09-21T06:05:04.995 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.010513825, 2024-09-21T06:05:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000058087 2024-09-21T06:05:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:05:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:05:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 112400 2024-09-21T06:05:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:05:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 4, 2024-09-21T06:05:04.996 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 4, 2024-09-21T06:05:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 2944, 2024-09-21T06:05:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 448, 2024-09-21T06:05:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 2, 2024-09-21T06:05:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 1, 2024-09-21T06:05:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.002099384, 2024-09-21T06:05:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.000040413, 2024-09-21T06:05:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.002044164, 2024-09-21T06:05:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:05:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:05:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 3, 2024-09-21T06:05:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.003830945, 2024-09-21T06:05:04.997 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.001276981 2024-09-21T06:05:04.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:04.998 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:05:04.998 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:04.998 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:04.998 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:04.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:04.998 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T06:05:04.998 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:05:04.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:04.998 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-21T06:05:04.998 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 0, 2024-09-21T06:05:04.998 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-21T06:05:04.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:05:04.999 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:05:05.000 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:05:05.000 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-21T06:05:05.000 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:05:05.000 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-21T06:05:05.000 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:05:05.000 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:05:05.000 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:05:05.000 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:05:05.000 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:05:05.000 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:05:05.000 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:05:05.000 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-21T06:05:05.000 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:05:05.001 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:05:05.001 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:05:05.001 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-21T06:05:05.001 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-21T06:05:05.001 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-21T06:05:05.001 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:05:05.001 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:05:05.001 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:05:05.001 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:05:05.001 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 148945, 2024-09-21T06:05:05.002 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 29, 2024-09-21T06:05:05.002 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:05:05.002 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-21T06:05:05.002 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-21T06:05:05.002 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-21T06:05:05.002 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:05:05.002 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-21T06:05:05.002 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:05:05.002 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-21T06:05:05.002 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 0, 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 0, 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 968, 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 2, 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:05:05.003 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 243, 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 500212, 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 243, 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 243, 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 500212, 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:05.004 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:05:05.005 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T06:05:05.745 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-21T06:05:05.745 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T06:05:05.754 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T06:05:05.755 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T06:05:05.755 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:05.796 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T06:05:05.796 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:05:05.876 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T06:05:06.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:05 smithi144 ceph-mon[34351]: pgmap v749: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T06:05:06.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:05 smithi037 ceph-mon[30631]: pgmap v749: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T06:05:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:05 smithi067 ceph-mon[34443]: pgmap v749: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T06:05:06.301 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:05:06.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.949+0000 7f20aa800640 1 -- 172.21.15.37:0/238735406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20a40757b0 msgr2=0x7f20a4075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:06.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.949+0000 7f20aa800640 1 --2- 172.21.15.37:0/238735406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20a40757b0 0x7f20a4075bc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2098009900 tx=0x7f209802a410 comp rx=0 tx=0).stop 2024-09-21T06:05:06.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.950+0000 7f20aa800640 1 -- 172.21.15.37:0/238735406 shutdown_connections 2024-09-21T06:05:06.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.950+0000 7f20aa800640 1 --2- 172.21.15.37:0/238735406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a410ff10 0x7f20a4112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.950+0000 7f20aa800640 1 --2- 172.21.15.37:0/238735406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a4076100 0x7f20a410f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.950+0000 7f20aa800640 1 --2- 172.21.15.37:0/238735406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20a40757b0 0x7f20a4075bc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.950+0000 7f20aa800640 1 -- 172.21.15.37:0/238735406 >> 172.21.15.37:0/238735406 conn(0x7f20a40ff440 msgr2=0x7f20a4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:06.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.950+0000 7f20aa800640 1 -- 172.21.15.37:0/238735406 shutdown_connections 2024-09-21T06:05:06.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.950+0000 7f20aa800640 1 -- 172.21.15.37:0/238735406 wait complete. 2024-09-21T06:05:06.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.951+0000 7f20aa800640 1 Processor -- start 2024-09-21T06:05:06.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.951+0000 7f20aa800640 1 -- start start 2024-09-21T06:05:06.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.952+0000 7f20aa800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20a40757b0 0x7f20a419c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:06.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.952+0000 7f20aa800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a4076100 0x7f20a419cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:06.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.952+0000 7f20aa800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a410ff10 0x7f20a41a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:06.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.952+0000 7f20aa800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20a4115b10 con 0x7f20a40757b0 2024-09-21T06:05:06.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.952+0000 7f20aa800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f20a4115990 con 0x7f20a410ff10 2024-09-21T06:05:06.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.952+0000 7f20aa800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20a4115c90 con 0x7f20a4076100 2024-09-21T06:05:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.952+0000 7f20a9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20a40757b0 0x7f20a419c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.952+0000 7f20a9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20a40757b0 0x7f20a419c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40750/0 (socket says 172.21.15.37:40750) 2024-09-21T06:05:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.952+0000 7f20a9400640 1 -- 172.21.15.37:0/3991702715 learned_addr learned my addr 172.21.15.37:0/3991702715 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:05:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.952+0000 7f20a9e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a410ff10 0x7f20a41a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.952+0000 7f20a8a00640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a4076100 0x7f20a419cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.953+0000 7f20a9e00640 1 -- 172.21.15.37:0/3991702715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a4076100 msgr2=0x7f20a419cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.953+0000 7f20a9e00640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a4076100 0x7f20a419cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.953+0000 7f20a9e00640 1 -- 172.21.15.37:0/3991702715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20a40757b0 msgr2=0x7f20a419c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.953+0000 7f20a9e00640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20a40757b0 0x7f20a419c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.953+0000 7f20a9e00640 1 -- 172.21.15.37:0/3991702715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a41a2490 con 0x7f20a410ff10 2024-09-21T06:05:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.953+0000 7f20a9400640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20a40757b0 0x7f20a419c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:05:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.953+0000 7f20a9e00640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a410ff10 0x7f20a41a1d60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f209c009fd0 tx=0x7f209c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.953+0000 7f20a2000640 1 -- 172.21.15.37:0/3991702715 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c00ce20 con 0x7f20a410ff10 2024-09-21T06:05:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.953+0000 7f20a2000640 1 -- 172.21.15.37:0/3991702715 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f209c005020 con 0x7f20a410ff10 2024-09-21T06:05:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.953+0000 7f20aa800640 1 -- 172.21.15.37:0/3991702715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a41a2780 con 0x7f20a410ff10 2024-09-21T06:05:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.953+0000 7f20a2000640 1 -- 172.21.15.37:0/3991702715 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c010690 con 0x7f20a410ff10 2024-09-21T06:05:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.954+0000 7f20aa800640 1 -- 172.21.15.37:0/3991702715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a41a8ee0 con 0x7f20a410ff10 2024-09-21T06:05:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.955+0000 7f20aa800640 1 -- 172.21.15.37:0/3991702715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a4075bc0 con 0x7f20a410ff10 2024-09-21T06:05:06.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.957+0000 7f20a2000640 1 -- 172.21.15.37:0/3991702715 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f209c0054d0 con 0x7f20a410ff10 2024-09-21T06:05:06.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.958+0000 7f20a2000640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f208c0b6510 0x7f208c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:06.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.959+0000 7f20a2000640 1 -- 172.21.15.37:0/3991702715 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f209c0e7d10 con 0x7f20a410ff10 2024-09-21T06:05:06.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.959+0000 7f20a9400640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f208c0b6510 0x7f208c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:06.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.959+0000 7f20a9400640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f208c0b6510 0x7f208c0b8a20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f20980096c0 tx=0x7f2098005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:06.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:06.960+0000 7f20a2000640 1 -- 172.21.15.37:0/3991702715 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f209c0ae170 con 0x7f20a410ff10 2024-09-21T06:05:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.170+0000 7f20aa800640 1 -- 172.21.15.37:0/3991702715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f20a419d650 con 0x7f20a410ff10 2024-09-21T06:05:07.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.171+0000 7f20a2000640 1 -- 172.21.15.37:0/3991702715 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+590 (secure 0 0 0) 0x7f209c0b2550 con 0x7f20a410ff10 2024-09-21T06:05:07.173 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3445479674 2024-09-22T05:42:46.114425+0000 2024-09-21T06:05:07.173 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3127564274 2024-09-22T05:42:46.114425+0000 2024-09-21T06:05:07.173 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3632867796 2024-09-22T05:42:46.114425+0000 2024-09-21T06:05:07.173 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/802100173 2024-09-22T05:42:16.118181+0000 2024-09-21T06:05:07.173 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1221065954 2024-09-22T05:42:46.114425+0000 2024-09-21T06:05:07.173 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3632867796 2024-09-22T05:42:46.114425+0000 2024-09-21T06:05:07.174 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/831572416 2024-09-22T05:42:16.118181+0000 2024-09-21T06:05:07.174 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3921659116 2024-09-22T05:42:16.118181+0000 2024-09-21T06:05:07.174 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/1872213512 2024-09-22T05:42:16.118181+0000 2024-09-21T06:05:07.174 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/1872213512 2024-09-22T05:42:16.118181+0000 2024-09-21T06:05:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-09-21T06:05:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.173+0000 7f20aa800640 1 -- 172.21.15.37:0/3991702715 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f208c0b6510 msgr2=0x7f208c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.173+0000 7f20aa800640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f208c0b6510 0x7f208c0b8a20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f20980096c0 tx=0x7f2098005a20 comp rx=0 tx=0).stop 2024-09-21T06:05:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.173+0000 7f20aa800640 1 -- 172.21.15.37:0/3991702715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a410ff10 msgr2=0x7f20a41a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.173+0000 7f20aa800640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a410ff10 0x7f20a41a1d60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f209c009fd0 tx=0x7f209c00ef10 comp rx=0 tx=0).stop 2024-09-21T06:05:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.173+0000 7f20aa800640 1 -- 172.21.15.37:0/3991702715 shutdown_connections 2024-09-21T06:05:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.173+0000 7f20aa800640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f208c0b6510 0x7f208c0b8a20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.173+0000 7f20aa800640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a410ff10 0x7f20a41a1d60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.173+0000 7f20aa800640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20a4076100 0x7f20a419cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.173+0000 7f20aa800640 1 --2- 172.21.15.37:0/3991702715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20a40757b0 0x7f20a419c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.173+0000 7f20aa800640 1 -- 172.21.15.37:0/3991702715 >> 172.21.15.37:0/3991702715 conn(0x7f20a40ff440 msgr2=0x7f20a4109a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.174+0000 7f20aa800640 1 -- 172.21.15.37:0/3991702715 shutdown_connections 2024-09-21T06:05:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:07.174+0000 7f20aa800640 1 -- 172.21.15.37:0/3991702715 wait complete. 2024-09-21T06:05:07.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:07 smithi037 ceph-mon[30631]: pgmap v750: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-21T06:05:07.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:07 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3991702715' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:05:08.026 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:05:08.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:08.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:05:08.116 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T06:05:08.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:08.116 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:05:08.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:07 smithi144 ceph-mon[34351]: pgmap v750: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-21T06:05:08.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:07 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3991702715' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:05:08.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:08.196 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-21T06:05:08.231 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:05:08.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:08.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:05:08.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:07 smithi067 ceph-mon[34443]: pgmap v750: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-21T06:05:08.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:07 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3991702715' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:05:08.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:05:08.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-09-21T06:05:08.677 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T06:05:08.689 INFO:tasks.cephadm:Teardown begin 2024-09-21T06:05:08.689 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:05:08.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:05:09.074 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:05:09.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.746+0000 7f9047200640 1 -- 172.21.15.37:0/2095879512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9048077380 msgr2=0x7f90480757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.746+0000 7f9047200640 1 --2- 172.21.15.37:0/2095879512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9048077380 0x7f90480757b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9038009900 tx=0x7f903802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.746+0000 7f9047200640 1 -- 172.21.15.37:0/2095879512 shutdown_connections 2024-09-21T06:05:09.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.746+0000 7f9047200640 1 --2- 172.21.15.37:0/2095879512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9048114280 0x7f9048116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.746+0000 7f9047200640 1 --2- 172.21.15.37:0/2095879512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9048075dd0 0x7f90480761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.746+0000 7f9047200640 1 --2- 172.21.15.37:0/2095879512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9048077380 0x7f90480757b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.746+0000 7f9047200640 1 -- 172.21.15.37:0/2095879512 >> 172.21.15.37:0/2095879512 conn(0x7f90480ff440 msgr2=0x7f9048101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:09.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.747+0000 7f9047200640 1 -- 172.21.15.37:0/2095879512 shutdown_connections 2024-09-21T06:05:09.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.747+0000 7f9047200640 1 -- 172.21.15.37:0/2095879512 wait complete. 2024-09-21T06:05:09.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.748+0000 7f9047200640 1 Processor -- start 2024-09-21T06:05:09.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.748+0000 7f9047200640 1 -- start start 2024-09-21T06:05:09.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.748+0000 7f9047200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9048075dd0 0x7f90481a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:09.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.748+0000 7f9047200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9048077380 0x7f90481a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:09.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.748+0000 7f9047200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9048114280 0x7f90481a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:09.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.748+0000 7f9047200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9048119f10 con 0x7f9048075dd0 2024-09-21T06:05:09.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.748+0000 7f9047200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9048119d90 con 0x7f9048114280 2024-09-21T06:05:09.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.749+0000 7f9047200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f904811a090 con 0x7f9048077380 2024-09-21T06:05:09.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.749+0000 7f9045e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9048075dd0 0x7f90481a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:09.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.749+0000 7f9045400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9048077380 0x7f90481a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:09.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.749+0000 7f9045e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9048075dd0 0x7f90481a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40782/0 (socket says 172.21.15.37:40782) 2024-09-21T06:05:09.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.749+0000 7f9045e00640 1 -- 172.21.15.37:0/3511287099 learned_addr learned my addr 172.21.15.37:0/3511287099 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:05:09.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.749+0000 7f9046800640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9048114280 0x7f90481a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:09.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.749+0000 7f9045400640 1 -- 172.21.15.37:0/3511287099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9048114280 msgr2=0x7f90481a6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.749+0000 7f9045400640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9048114280 0x7f90481a6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.749+0000 7f9045400640 1 -- 172.21.15.37:0/3511287099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9048075dd0 msgr2=0x7f90481a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:09.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.749+0000 7f9045400640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9048075dd0 0x7f90481a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:09.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.749+0000 7f9045400640 1 -- 172.21.15.37:0/3511287099 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90481a68b0 con 0x7f9048077380 2024-09-21T06:05:09.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.749+0000 7f9045e00640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9048075dd0 0x7f90481a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:05:09.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.750+0000 7f9045400640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9048077380 0x7f90481a0ee0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f903400e9c0 tx=0x7f903400edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:09.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.750+0000 7f903ea00640 1 -- 172.21.15.37:0/3511287099 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903400ccc0 con 0x7f9048077380 2024-09-21T06:05:09.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.750+0000 7f903ea00640 1 -- 172.21.15.37:0/3511287099 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9034005020 con 0x7f9048077380 2024-09-21T06:05:09.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.750+0000 7f9047200640 1 -- 172.21.15.37:0/3511287099 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90481a6ba0 con 0x7f9048077380 2024-09-21T06:05:09.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.750+0000 7f903ea00640 1 -- 172.21.15.37:0/3511287099 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903400ce60 con 0x7f9048077380 2024-09-21T06:05:09.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.750+0000 7f9047200640 1 -- 172.21.15.37:0/3511287099 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90481ad300 con 0x7f9048077380 2024-09-21T06:05:09.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.752+0000 7f9047200640 1 -- 172.21.15.37:0/3511287099 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90480761e0 con 0x7f9048077380 2024-09-21T06:05:09.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.754+0000 7f903ea00640 1 -- 172.21.15.37:0/3511287099 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f90340051d0 con 0x7f9048077380 2024-09-21T06:05:09.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.756+0000 7f903ea00640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f902c0b6510 0x7f902c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:09.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.756+0000 7f903ea00640 1 -- 172.21.15.37:0/3511287099 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f90340e7900 con 0x7f9048077380 2024-09-21T06:05:09.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.756+0000 7f9045e00640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f902c0b6510 0x7f902c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:09.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.757+0000 7f9045e00640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f902c0b6510 0x7f902c0b8a20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f90380096c0 tx=0x7f9038005a20 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:09.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:09.758+0000 7f903ea00640 1 -- 172.21.15.37:0/3511287099 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90340addc0 con 0x7f9048077380 2024-09-21T06:05:09.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:09 smithi037 ceph-mon[30631]: pgmap v751: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T06:05:09.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:09 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:10.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.015+0000 7f9047200640 1 -- 172.21.15.37:0/3511287099 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90481a1a70 con 0x7f9048077380 2024-09-21T06:05:10.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.015+0000 7f903ea00640 1 -- 172.21.15.37:0/3511287099 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f90481a1a70 con 0x7f9048077380 2024-09-21T06:05:10.018 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:05:10.018 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T06:05:10.019 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T06:05:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.018+0000 7f9047200640 1 -- 172.21.15.37:0/3511287099 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f902c0b6510 msgr2=0x7f902c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.018+0000 7f9047200640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f902c0b6510 0x7f902c0b8a20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f90380096c0 tx=0x7f9038005a20 comp rx=0 tx=0).stop 2024-09-21T06:05:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.018+0000 7f9047200640 1 -- 172.21.15.37:0/3511287099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9048077380 msgr2=0x7f90481a0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.018+0000 7f9047200640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9048077380 0x7f90481a0ee0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f903400e9c0 tx=0x7f903400edc0 comp rx=0 tx=0).stop 2024-09-21T06:05:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.019+0000 7f9047200640 1 -- 172.21.15.37:0/3511287099 shutdown_connections 2024-09-21T06:05:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.019+0000 7f9047200640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f902c0b6510 0x7f902c0b8a20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.019+0000 7f9047200640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9048114280 0x7f90481a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.019+0000 7f9047200640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9048077380 0x7f90481a0ee0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:10.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.019+0000 7f9047200640 1 --2- 172.21.15.37:0/3511287099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9048075dd0 0x7f90481a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:10.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.019+0000 7f9047200640 1 -- 172.21.15.37:0/3511287099 >> 172.21.15.37:0/3511287099 conn(0x7f90480ff440 msgr2=0x7f9048110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:10.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.020+0000 7f9047200640 1 -- 172.21.15.37:0/3511287099 shutdown_connections 2024-09-21T06:05:10.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:10.020+0000 7f9047200640 1 -- 172.21.15.37:0/3511287099 wait complete. 2024-09-21T06:05:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:09 smithi144 ceph-mon[34351]: pgmap v751: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T06:05:10.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:09 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:10.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:09 smithi067 ceph-mon[34443]: pgmap v751: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T06:05:10.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:09 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:10.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:05:11.024 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:10 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3511287099' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:05:11.024 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:11.024 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:11.024 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:10 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:05:11.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:10 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3511287099' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:05:11.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:11.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:11.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:10 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:05:11.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:10 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3511287099' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:05:11.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:11.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:11.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:10 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' 2024-09-21T06:05:11.259 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:05:11.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.946+0000 7f19b2a00640 1 -- 172.21.15.37:0/2556804619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19ac103990 msgr2=0x7f19ac103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.946+0000 7f19b2a00640 1 --2- 172.21.15.37:0/2556804619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19ac103990 0x7f19ac103da0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009900 tx=0x7f19a002a410 comp rx=0 tx=0).stop 2024-09-21T06:05:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.947+0000 7f19b2a00640 1 -- 172.21.15.37:0/2556804619 shutdown_connections 2024-09-21T06:05:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.947+0000 7f19b2a00640 1 --2- 172.21.15.37:0/2556804619 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19ac109c20 0x7f19ac110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.947+0000 7f19b2a00640 1 --2- 172.21.15.37:0/2556804619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ac1092d0 0x7f19ac1096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.947+0000 7f19b2a00640 1 --2- 172.21.15.37:0/2556804619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19ac103990 0x7f19ac103da0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.947+0000 7f19b2a00640 1 -- 172.21.15.37:0/2556804619 >> 172.21.15.37:0/2556804619 conn(0x7f19ac0ff3e0 msgr2=0x7f19ac101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.947+0000 7f19b2a00640 1 -- 172.21.15.37:0/2556804619 shutdown_connections 2024-09-21T06:05:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.947+0000 7f19b2a00640 1 -- 172.21.15.37:0/2556804619 wait complete. 2024-09-21T06:05:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.948+0000 7f19b2a00640 1 Processor -- start 2024-09-21T06:05:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.948+0000 7f19b2a00640 1 -- start start 2024-09-21T06:05:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.948+0000 7f19b2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ac103990 0x7f19ac19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.948+0000 7f19b2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19ac1092d0 0x7f19ac19cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19ac109c20 0x7f19ac1a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b2a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac113930 con 0x7f19ac109c20 2024-09-21T06:05:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b2a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac1137b0 con 0x7f19ac1092d0 2024-09-21T06:05:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac113ab0 con 0x7f19ac103990 2024-09-21T06:05:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ac103990 0x7f19ac19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ac103990 0x7f19ac19c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:56980/0 (socket says 172.21.15.37:56980) 2024-09-21T06:05:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b1600640 1 -- 172.21.15.37:0/897720176 learned_addr learned my addr 172.21.15.37:0/897720176 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:05:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b0c00640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19ac1092d0 0x7f19ac19cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b2000640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19ac109c20 0x7f19ac1a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b1600640 1 -- 172.21.15.37:0/897720176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19ac1092d0 msgr2=0x7f19ac19cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b1600640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19ac1092d0 0x7f19ac19cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b1600640 1 -- 172.21.15.37:0/897720176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19ac109c20 msgr2=0x7f19ac1a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b1600640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19ac109c20 0x7f19ac1a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.949+0000 7f19b1600640 1 -- 172.21.15.37:0/897720176 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac1a24b0 con 0x7f19ac103990 2024-09-21T06:05:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.950+0000 7f19b1600640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ac103990 0x7f19ac19c540 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f19a0005ab0 tx=0x7f19a0003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.950+0000 7f19aa000640 1 -- 172.21.15.37:0/897720176 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a003f070 con 0x7f19ac103990 2024-09-21T06:05:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.950+0000 7f19aa000640 1 -- 172.21.15.37:0/897720176 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19a0031d60 con 0x7f19ac103990 2024-09-21T06:05:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.950+0000 7f19b2a00640 1 -- 172.21.15.37:0/897720176 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ac1a2740 con 0x7f19ac103990 2024-09-21T06:05:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.950+0000 7f19aa000640 1 -- 172.21.15.37:0/897720176 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0035030 con 0x7f19ac103990 2024-09-21T06:05:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.950+0000 7f19b2a00640 1 -- 172.21.15.37:0/897720176 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ac1a8f00 con 0x7f19ac103990 2024-09-21T06:05:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.951+0000 7f19b2a00640 1 -- 172.21.15.37:0/897720176 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ac104c10 con 0x7f19ac103990 2024-09-21T06:05:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.954+0000 7f19aa000640 1 -- 172.21.15.37:0/897720176 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f19a0042070 con 0x7f19ac103990 2024-09-21T06:05:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.955+0000 7f19aa000640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f19940b6590 0x7f19940b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.955+0000 7f19aa000640 1 -- 172.21.15.37:0/897720176 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f19a0108410 con 0x7f19ac103990 2024-09-21T06:05:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.955+0000 7f19b0c00640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f19940b6590 0x7f19940b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:11.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.956+0000 7f19b0c00640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f19940b6590 0x7f19940b8aa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f19ac105a90 tx=0x7f1998005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:11.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:11.957+0000 7f19aa000640 1 -- 172.21.15.37:0/897720176 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19a00d2cb0 con 0x7f19ac103990 2024-09-21T06:05:12.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:11 smithi144 ceph-mon[34351]: pgmap v752: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T06:05:12.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:11 smithi037 ceph-mon[30631]: pgmap v752: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T06:05:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.200+0000 7f19b2a00640 1 -- 172.21.15.37:0/897720176 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19ac103da0 con 0x7f19ac103990 2024-09-21T06:05:12.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.201+0000 7f19aa000640 1 -- 172.21.15.37:0/897720176 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11854 (secure 0 0 0) 0x7f19ac103da0 con 0x7f19ac103990 2024-09-21T06:05:12.203 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:05:12.204 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"btime":"2024-09-21T05:51:50:445515+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2170500784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2170500784},{"type":"v1","addr":"172.21.15.37:6835","nonce":2170500784}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2573014939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2573014939},{"type":"v1","addr":"172.21.15.37:6837","nonce":2573014939}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/2136415371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":2136415371},{"type":"v1","addr":"172.21.15.37:6839","nonce":2136415371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/1236048708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":1236048708},{"type":"v1","addr":"172.21.15.37:6841","nonce":1236048708}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24631,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/3966820038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3966820038},{"type":"v1","addr":"172.21.15.144:6833","nonce":3966820038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/2950882558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2950882558},{"type":"v1","addr":"172.21.15.67:6833","nonce":2950882558}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24668,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/2708261252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":2708261252},{"type":"v1","addr":"172.21.15.67:6835","nonce":2708261252}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24679,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3872897790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3872897790},{"type":"v1","addr":"172.21.15.144:6835","nonce":3872897790}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1687841256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1687841256},{"type":"v1","addr":"172.21.15.144:6837","nonce":1687841256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2398426210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2398426210},{"type":"v1","addr":"172.21.15.67:6837","nonce":2398426210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T05:50:54.973656+0000","modified":"2024-09-21T05:51:49.877112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24706":{"gid":24706,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6839/2186109815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2186109815},{"type":"v1","addr":"172.21.15.144:6839","nonce":2186109815}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24731":{"gid":24731,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.67:6839/2815536303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2815536303},{"type":"v1","addr":"172.21.15.67:6839","nonce":2815536303}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24731,"qdb_cluster":[24731]},"id":1}]} 2024-09-21T06:05:12.204 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-09-21T06:05:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.203+0000 7f19b2a00640 1 -- 172.21.15.37:0/897720176 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f19940b6590 msgr2=0x7f19940b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.203+0000 7f19b2a00640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f19940b6590 0x7f19940b8aa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f19ac105a90 tx=0x7f1998005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.203+0000 7f19b2a00640 1 -- 172.21.15.37:0/897720176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ac103990 msgr2=0x7f19ac19c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.203+0000 7f19b2a00640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ac103990 0x7f19ac19c540 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f19a0005ab0 tx=0x7f19a0003c80 comp rx=0 tx=0).stop 2024-09-21T06:05:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.203+0000 7f19b2a00640 1 -- 172.21.15.37:0/897720176 shutdown_connections 2024-09-21T06:05:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.203+0000 7f19b2a00640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19ac109c20 0x7f19ac1a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.203+0000 7f19b2a00640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f19940b6590 0x7f19940b8aa0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.203+0000 7f19b2a00640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19ac1092d0 0x7f19ac19cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.203+0000 7f19b2a00640 1 --2- 172.21.15.37:0/897720176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ac103990 0x7f19ac19c540 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.203+0000 7f19b2a00640 1 -- 172.21.15.37:0/897720176 >> 172.21.15.37:0/897720176 conn(0x7f19ac0ff3e0 msgr2=0x7f19ac1089a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.203+0000 7f19b2a00640 1 -- 172.21.15.37:0/897720176 shutdown_connections 2024-09-21T06:05:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:12.204+0000 7f19b2a00640 1 -- 172.21.15.37:0/897720176 wait complete. 2024-09-21T06:05:12.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:11 smithi067 ceph-mon[34443]: pgmap v752: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T06:05:12.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:05:13.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:12 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/897720176' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:05:13.147 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:12 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/897720176' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:05:13.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:12 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/897720176' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:05:13.309 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:05:13.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.908+0000 7f0d7ea00640 1 -- 172.21.15.37:0/2260150977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d7810b6c0 msgr2=0x7f0d7810bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:13.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.908+0000 7f0d7ea00640 1 --2- 172.21.15.37:0/2260150977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d7810b6c0 0x7f0d7810bad0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009900 tx=0x7f0d6002a410 comp rx=0 tx=0).stop 2024-09-21T06:05:13.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.908+0000 7f0d7ea00640 1 -- 172.21.15.37:0/2260150977 shutdown_connections 2024-09-21T06:05:13.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.908+0000 7f0d7ea00640 1 --2- 172.21.15.37:0/2260150977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d7810c010 0x7f0d78112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.908+0000 7f0d7ea00640 1 --2- 172.21.15.37:0/2260150977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d7810b6c0 0x7f0d7810bad0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.908+0000 7f0d7ea00640 1 --2- 172.21.15.37:0/2260150977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d78105d80 0x7f0d78106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.908+0000 7f0d7ea00640 1 -- 172.21.15.37:0/2260150977 >> 172.21.15.37:0/2260150977 conn(0x7f0d78101810 msgr2=0x7f0d78103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:13.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.908+0000 7f0d7ea00640 1 -- 172.21.15.37:0/2260150977 shutdown_connections 2024-09-21T06:05:13.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.908+0000 7f0d7ea00640 1 -- 172.21.15.37:0/2260150977 wait complete. 2024-09-21T06:05:13.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.909+0000 7f0d7ea00640 1 Processor -- start 2024-09-21T06:05:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.909+0000 7f0d7ea00640 1 -- start start 2024-09-21T06:05:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d7ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d78105d80 0x7f0d7819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d7ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d7810b6c0 0x7f0d7819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d7ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d7810c010 0x7f0d781a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d7ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78115cf0 con 0x7f0d78105d80 2024-09-21T06:05:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d7ea00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78115b70 con 0x7f0d7810c010 2024-09-21T06:05:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d7ea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78115e70 con 0x7f0d7810b6c0 2024-09-21T06:05:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d77e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d78105d80 0x7f0d7819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d77e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d78105d80 0x7f0d7819c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51680/0 (socket says 172.21.15.37:51680) 2024-09-21T06:05:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d77e00640 1 -- 172.21.15.37:0/3499219193 learned_addr learned my addr 172.21.15.37:0/3499219193 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:05:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d7ca00640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d7810c010 0x7f0d781a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:13.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d6f400640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d7810b6c0 0x7f0d7819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:13.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d77e00640 1 -- 172.21.15.37:0/3499219193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d7810b6c0 msgr2=0x7f0d7819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:13.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d77e00640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d7810b6c0 0x7f0d7819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d77e00640 1 -- 172.21.15.37:0/3499219193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d7810c010 msgr2=0x7f0d781a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:13.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d77e00640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d7810c010 0x7f0d781a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:13.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.910+0000 7f0d77e00640 1 -- 172.21.15.37:0/3499219193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d781a2670 con 0x7f0d78105d80 2024-09-21T06:05:13.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.911+0000 7f0d77e00640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d78105d80 0x7f0d7819c700 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800e9f0 tx=0x7f0d6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:13.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.911+0000 7f0d75600640 1 -- 172.21.15.37:0/3499219193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6800cd80 con 0x7f0d78105d80 2024-09-21T06:05:13.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.911+0000 7f0d75600640 1 -- 172.21.15.37:0/3499219193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d680108e0 con 0x7f0d78105d80 2024-09-21T06:05:13.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.911+0000 7f0d75600640 1 -- 172.21.15.37:0/3499219193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68018980 con 0x7f0d78105d80 2024-09-21T06:05:13.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.911+0000 7f0d7ea00640 1 -- 172.21.15.37:0/3499219193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d781a2960 con 0x7f0d78105d80 2024-09-21T06:05:13.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.911+0000 7f0d7ea00640 1 -- 172.21.15.37:0/3499219193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d781a90c0 con 0x7f0d78105d80 2024-09-21T06:05:13.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.912+0000 7f0d7ea00640 1 -- 172.21.15.37:0/3499219193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d78106190 con 0x7f0d78105d80 2024-09-21T06:05:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.915+0000 7f0d75600640 1 -- 172.21.15.37:0/3499219193 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f0d68010430 con 0x7f0d78105d80 2024-09-21T06:05:13.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.916+0000 7f0d75600640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0d5c0b6590 0x7f0d5c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.916+0000 7f0d75600640 1 -- 172.21.15.37:0/3499219193 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7f0d680e7e50 con 0x7f0d78105d80 2024-09-21T06:05:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.917+0000 7f0d6f400640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0d5c0b6590 0x7f0d5c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.917+0000 7f0d6f400640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0d5c0b6590 0x7f0d5c0b8aa0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009230 tx=0x7f0d60031400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:13.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:13.918+0000 7f0d75600640 1 -- 172.21.15.37:0/3499219193 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d680b2690 con 0x7f0d78105d80 2024-09-21T06:05:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.118+0000 7f0d7ea00640 1 -- 172.21.15.37:0/3499219193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d7802e640 con 0x7f0d78105d80 2024-09-21T06:05:14.121 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:13 smithi037 ceph-mon[30631]: pgmap v753: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T06:05:14.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:13 smithi144 ceph-mon[34351]: pgmap v753: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T06:05:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.121+0000 7f0d75600640 1 -- 172.21.15.37:0/3499219193 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24836 (secure 0 0 0) 0x7f0d680b75d0 con 0x7f0d78105d80 2024-09-21T06:05:14.123 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T06:05:14.124 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":90,"fsid":"0c10cdda-77dc-11ef-baf5-efdc52797490","created":"2024-09-21T05:41:47.035307+0000","modified":"2024-09-21T05:52:47.670174+0000","last_up_change":"2024-09-21T05:49:55.892925+0000","last_in_change":"2024-09-21T05:49:33.534588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T05:45:48.604918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T05:50:49.791290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T05:50:51.877662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T05:51:01.928796+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"99c3eca3-ee08-45d9-b6d0-65e4035e1d7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6803","nonce":2521687946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6805","nonce":2521687946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6809","nonce":2521687946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2521687946},{"type":"v1","addr":"172.21.15.37:6807","nonce":2521687946}]},"public_addr":"172.21.15.37:6803/2521687946","cluster_addr":"172.21.15.37:6805/2521687946","heartbeat_back_addr":"172.21.15.37:6809/2521687946","heartbeat_front_addr":"172.21.15.37:6807/2521687946","state":["exists","up"]},{"osd":1,"uuid":"15d6817e-4cde-4448-9263-3b3fad8c6d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6801","nonce":2228599458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6803","nonce":2228599458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6807","nonce":2228599458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2228599458},{"type":"v1","addr":"172.21.15.67:6805","nonce":2228599458}]},"public_addr":"172.21.15.67:6801/2228599458","cluster_addr":"172.21.15.67:6803/2228599458","heartbeat_back_addr":"172.21.15.67:6807/2228599458","heartbeat_front_addr":"172.21.15.67:6805/2228599458","state":["exists","up"]},{"osd":2,"uuid":"091d2006-39ee-41d2-9bfd-dd13cb6bb4a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6801","nonce":289727060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6803","nonce":289727060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6807","nonce":289727060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":289727060},{"type":"v1","addr":"172.21.15.144:6805","nonce":289727060}]},"public_addr":"172.21.15.144:6801/289727060","cluster_addr":"172.21.15.144:6803/289727060","heartbeat_back_addr":"172.21.15.144:6807/289727060","heartbeat_front_addr":"172.21.15.144:6805/289727060","state":["exists","up"]},{"osd":3,"uuid":"1a7cd518-9d45-43e5-8605-4948d7bda060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6811","nonce":2990917769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6813","nonce":2990917769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6817","nonce":2990917769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2990917769},{"type":"v1","addr":"172.21.15.37:6815","nonce":2990917769}]},"public_addr":"172.21.15.37:6811/2990917769","cluster_addr":"172.21.15.37:6813/2990917769","heartbeat_back_addr":"172.21.15.37:6817/2990917769","heartbeat_front_addr":"172.21.15.37:6815/2990917769","state":["exists","up"]},{"osd":4,"uuid":"d0d79b65-1a85-43bf-92f6-ed3061c53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6809","nonce":2545409743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6811","nonce":2545409743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6815","nonce":2545409743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2545409743},{"type":"v1","addr":"172.21.15.67:6813","nonce":2545409743}]},"public_addr":"172.21.15.67:6809/2545409743","cluster_addr":"172.21.15.67:6811/2545409743","heartbeat_back_addr":"172.21.15.67:6815/2545409743","heartbeat_front_addr":"172.21.15.67:6813/2545409743","state":["exists","up"]},{"osd":5,"uuid":"c3aabba3-6ac9-451e-b445-1573f10856ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6809","nonce":2813200791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6811","nonce":2813200791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6815","nonce":2813200791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2813200791},{"type":"v1","addr":"172.21.15.144:6813","nonce":2813200791}]},"public_addr":"172.21.15.144:6809/2813200791","cluster_addr":"172.21.15.144:6811/2813200791","heartbeat_back_addr":"172.21.15.144:6815/2813200791","heartbeat_front_addr":"172.21.15.144:6813/2813200791","state":["exists","up"]},{"osd":6,"uuid":"2e6451b5-b06c-4998-aebb-7fa806f2e4dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6819","nonce":3607526668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6821","nonce":3607526668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6825","nonce":3607526668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3607526668},{"type":"v1","addr":"172.21.15.37:6823","nonce":3607526668}]},"public_addr":"172.21.15.37:6819/3607526668","cluster_addr":"172.21.15.37:6821/3607526668","heartbeat_back_addr":"172.21.15.37:6825/3607526668","heartbeat_front_addr":"172.21.15.37:6823/3607526668","state":["exists","up"]},{"osd":7,"uuid":"edac908f-40fe-42ee-a1ea-52f413776785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6817","nonce":286051723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6819","nonce":286051723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6823","nonce":286051723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":286051723},{"type":"v1","addr":"172.21.15.67:6821","nonce":286051723}]},"public_addr":"172.21.15.67:6817/286051723","cluster_addr":"172.21.15.67:6819/286051723","heartbeat_back_addr":"172.21.15.67:6823/286051723","heartbeat_front_addr":"172.21.15.67:6821/286051723","state":["exists","up"]},{"osd":8,"uuid":"85372a82-dd7e-4de9-a3d5-bf000d2dd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6817","nonce":335694551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6819","nonce":335694551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6823","nonce":335694551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":335694551},{"type":"v1","addr":"172.21.15.144:6821","nonce":335694551}]},"public_addr":"172.21.15.144:6817/335694551","cluster_addr":"172.21.15.144:6819/335694551","heartbeat_back_addr":"172.21.15.144:6823/335694551","heartbeat_front_addr":"172.21.15.144:6821/335694551","state":["exists","up"]},{"osd":9,"uuid":"996af6b7-e17f-4a58-94f5-1a7bfec6f702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6827","nonce":2945950355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6829","nonce":2945950355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6833","nonce":2945950355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2945950355},{"type":"v1","addr":"172.21.15.37:6831","nonce":2945950355}]},"public_addr":"172.21.15.37:6827/2945950355","cluster_addr":"172.21.15.37:6829/2945950355","heartbeat_back_addr":"172.21.15.37:6833/2945950355","heartbeat_front_addr":"172.21.15.37:6831/2945950355","state":["exists","up"]},{"osd":10,"uuid":"9a37f19e-3ade-4852-b887-426e26953433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6825","nonce":3613225854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6827","nonce":3613225854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6831","nonce":3613225854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3613225854},{"type":"v1","addr":"172.21.15.67:6829","nonce":3613225854}]},"public_addr":"172.21.15.67:6825/3613225854","cluster_addr":"172.21.15.67:6827/3613225854","heartbeat_back_addr":"172.21.15.67:6831/3613225854","heartbeat_front_addr":"172.21.15.67:6829/3613225854","state":["exists","up"]},{"osd":11,"uuid":"b3f23e60-4d29-4b07-aec5-1d497ee617cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6825","nonce":2555236890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6827","nonce":2555236890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6831","nonce":2555236890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":2555236890},{"type":"v1","addr":"172.21.15.144:6829","nonce":2555236890}]},"public_addr":"172.21.15.144:6825/2555236890","cluster_addr":"172.21.15.144:6827/2555236890","heartbeat_back_addr":"172.21.15.144:6831/2555236890","heartbeat_front_addr":"172.21.15.144:6829/2555236890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:44:52.493445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:19.690987+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:45:44.986049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:14.972947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:46:42.666202+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:07.985982+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:47:39.909491+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:06.692341+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:48:32.825962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:02.796192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:29.736031+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T05:49:54.746860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/3445479674":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/3127564274":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6800/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/802100173":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/1221065954":"2024-09-22T05:42:46.114425+0000","172.21.15.37:6801/3632867796":"2024-09-22T05:42:46.114425+0000","172.21.15.37:0/831572416":"2024-09-22T05:42:16.118181+0000","172.21.15.37:0/3921659116":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6801/1872213512":"2024-09-22T05:42:16.118181+0000","172.21.15.37:6800/1872213512":"2024-09-22T05:42:16.118181+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:05:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.123+0000 7f0d7ea00640 1 -- 172.21.15.37:0/3499219193 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0d5c0b6590 msgr2=0x7f0d5c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.123+0000 7f0d7ea00640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0d5c0b6590 0x7f0d5c0b8aa0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009230 tx=0x7f0d60031400 comp rx=0 tx=0).stop 2024-09-21T06:05:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.123+0000 7f0d7ea00640 1 -- 172.21.15.37:0/3499219193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d78105d80 msgr2=0x7f0d7819c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.123+0000 7f0d7ea00640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d78105d80 0x7f0d7819c700 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800e9f0 tx=0x7f0d6800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.124+0000 7f0d7ea00640 1 -- 172.21.15.37:0/3499219193 shutdown_connections 2024-09-21T06:05:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.124+0000 7f0d7ea00640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f0d5c0b6590 0x7f0d5c0b8aa0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.124+0000 7f0d7ea00640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d7810c010 0x7f0d781a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.124+0000 7f0d7ea00640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d7810b6c0 0x7f0d7819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.124+0000 7f0d7ea00640 1 --2- 172.21.15.37:0/3499219193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d78105d80 0x7f0d7819c700 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.124+0000 7f0d7ea00640 1 -- 172.21.15.37:0/3499219193 >> 172.21.15.37:0/3499219193 conn(0x7f0d78101810 msgr2=0x7f0d78103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.124+0000 7f0d7ea00640 1 -- 172.21.15.37:0/3499219193 shutdown_connections 2024-09-21T06:05:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:14.124+0000 7f0d7ea00640 1 -- 172.21.15.37:0/3499219193 wait complete. 2024-09-21T06:05:14.159 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:13 smithi067 ceph-mon[34443]: pgmap v753: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T06:05:14.889 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T06:05:15.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:14 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3499219193' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:05:15.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:14 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3499219193' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:05:15.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:14 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3499219193' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:05:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:05:15.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.897+0000 7fe3c9800640 1 -- 172.21.15.37:0/1929382556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3c41092d0 msgr2=0x7fe3c41096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:15.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.897+0000 7fe3c9800640 1 --2- 172.21.15.37:0/1929382556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3c41092d0 0x7fe3c41096e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009860 tx=0x7fe3ac02a340 comp rx=0 tx=0).stop 2024-09-21T06:05:15.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.897+0000 7fe3c9800640 1 -- 172.21.15.37:0/1929382556 shutdown_connections 2024-09-21T06:05:15.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.897+0000 7fe3c9800640 1 --2- 172.21.15.37:0/1929382556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3c4109c20 0x7fe3c4110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:15.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.897+0000 7fe3c9800640 1 --2- 172.21.15.37:0/1929382556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3c41092d0 0x7fe3c41096e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:15.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.897+0000 7fe3c9800640 1 --2- 172.21.15.37:0/1929382556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3c4103990 0x7fe3c4103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:15.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.897+0000 7fe3c9800640 1 -- 172.21.15.37:0/1929382556 >> 172.21.15.37:0/1929382556 conn(0x7fe3c40ff440 msgr2=0x7fe3c4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:15.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.897+0000 7fe3c9800640 1 -- 172.21.15.37:0/1929382556 shutdown_connections 2024-09-21T06:05:15.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.898+0000 7fe3c9800640 1 -- 172.21.15.37:0/1929382556 wait complete. 2024-09-21T06:05:15.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.899+0000 7fe3c9800640 1 Processor -- start 2024-09-21T06:05:15.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.899+0000 7fe3c9800640 1 -- start start 2024-09-21T06:05:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3c4103990 0x7fe3c4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3c41092d0 0x7fe3c4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3c4109c20 0x7fe3c4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c9800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c41138e0 con 0x7fe3c4103990 2024-09-21T06:05:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c9800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c4113760 con 0x7fe3c4109c20 2024-09-21T06:05:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c9800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c4113a60 con 0x7fe3c41092d0 2024-09-21T06:05:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3c4103990 0x7fe3c4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c8e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3c4109c20 0x7fe3c4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3c4103990 0x7fe3c4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51706/0 (socket says 172.21.15.37:51706) 2024-09-21T06:05:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c3e00640 1 -- 172.21.15.37:0/709152383 learned_addr learned my addr 172.21.15.37:0/709152383 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:05:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3bbe00640 1 --2- 172.21.15.37:0/709152383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3c41092d0 0x7fe3c4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c8e00640 1 -- 172.21.15.37:0/709152383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3c41092d0 msgr2=0x7fe3c4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c8e00640 1 --2- 172.21.15.37:0/709152383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3c41092d0 0x7fe3c4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c8e00640 1 -- 172.21.15.37:0/709152383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3c4103990 msgr2=0x7fe3c4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c8e00640 1 --2- 172.21.15.37:0/709152383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3c4103990 0x7fe3c4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.900+0000 7fe3c8e00640 1 -- 172.21.15.37:0/709152383 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c41a8550 con 0x7fe3c4109c20 2024-09-21T06:05:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.901+0000 7fe3c8e00640 1 --2- 172.21.15.37:0/709152383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3c4109c20 0x7fe3c4076190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00ef00 tx=0x7fe3bc00c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.901+0000 7fe3c1600640 1 -- 172.21.15.37:0/709152383 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc004b20 con 0x7fe3c4109c20 2024-09-21T06:05:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.901+0000 7fe3c1600640 1 -- 172.21.15.37:0/709152383 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3bc003e20 con 0x7fe3c4109c20 2024-09-21T06:05:15.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.901+0000 7fe3c9800640 1 -- 172.21.15.37:0/709152383 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c41a8840 con 0x7fe3c4109c20 2024-09-21T06:05:15.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.901+0000 7fe3c1600640 1 -- 172.21.15.37:0/709152383 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00b570 con 0x7fe3c4109c20 2024-09-21T06:05:15.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.901+0000 7fe3c9800640 1 -- 172.21.15.37:0/709152383 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c41a8d50 con 0x7fe3c4109c20 2024-09-21T06:05:15.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.902+0000 7fe3c9800640 1 -- 172.21.15.37:0/709152383 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c4103da0 con 0x7fe3c4109c20 2024-09-21T06:05:15.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.904+0000 7fe3c1600640 1 -- 172.21.15.37:0/709152383 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fe3bc01d020 con 0x7fe3c4109c20 2024-09-21T06:05:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.906+0000 7fe3c1600640 1 --2- 172.21.15.37:0/709152383 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe3a80b6590 0x7fe3a80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.906+0000 7fe3c1600640 1 -- 172.21.15.37:0/709152383 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9208+0+0 (secure 0 0 0) 0x7fe3bc0e7520 con 0x7fe3c4109c20 2024-09-21T06:05:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.906+0000 7fe3c3e00640 1 --2- 172.21.15.37:0/709152383 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe3a80b6590 0x7fe3a80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.907+0000 7fe3c3e00640 1 --2- 172.21.15.37:0/709152383 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe3a80b6590 0x7fe3a80b8aa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4077160 tx=0x7fe3b4005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:15.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:15.910+0000 7fe3c1600640 1 -- 172.21.15.37:0/709152383 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe3bc054710 con 0x7fe3c4109c20 2024-09-21T06:05:16.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:15 smithi144 ceph-mon[34351]: pgmap v754: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T06:05:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.148+0000 7fe3c9800640 1 -- 172.21.15.37:0/709152383 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe3c402e640 con 0x7fe3c4109c20 2024-09-21T06:05:16.151 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:15 smithi037 ceph-mon[30631]: pgmap v754: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T06:05:16.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.159+0000 7fe3c1600640 1 -- 172.21.15.37:0/709152383 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7fe3bc004cc0 con 0x7fe3c4109c20 2024-09-21T06:05:16.161 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:05:16.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.162+0000 7fe3c9800640 1 -- 172.21.15.37:0/709152383 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe3a80b6590 msgr2=0x7fe3a80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:16.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.162+0000 7fe3c9800640 1 --2- 172.21.15.37:0/709152383 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe3a80b6590 0x7fe3a80b8aa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4077160 tx=0x7fe3b4005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.162+0000 7fe3c9800640 1 -- 172.21.15.37:0/709152383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3c4109c20 msgr2=0x7fe3c4076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.162+0000 7fe3c9800640 1 --2- 172.21.15.37:0/709152383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3c4109c20 0x7fe3c4076190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00ef00 tx=0x7fe3bc00c740 comp rx=0 tx=0).stop 2024-09-21T06:05:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.162+0000 7fe3c9800640 1 -- 172.21.15.37:0/709152383 shutdown_connections 2024-09-21T06:05:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.162+0000 7fe3c9800640 1 --2- 172.21.15.37:0/709152383 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fe3a80b6590 0x7fe3a80b8aa0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.162+0000 7fe3c9800640 1 --2- 172.21.15.37:0/709152383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3c4109c20 0x7fe3c4076190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.162+0000 7fe3c9800640 1 --2- 172.21.15.37:0/709152383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3c41092d0 0x7fe3c4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.162+0000 7fe3c9800640 1 --2- 172.21.15.37:0/709152383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3c4103990 0x7fe3c4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.162+0000 7fe3c9800640 1 -- 172.21.15.37:0/709152383 >> 172.21.15.37:0/709152383 conn(0x7fe3c40ff440 msgr2=0x7fe3c4101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.162+0000 7fe3c9800640 1 -- 172.21.15.37:0/709152383 shutdown_connections 2024-09-21T06:05:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:16.162+0000 7fe3c9800640 1 -- 172.21.15.37:0/709152383 wait complete. 2024-09-21T06:05:16.221 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:15 smithi067 ceph-mon[34443]: pgmap v754: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T06:05:16.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:16 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a[30627]: 2024-09-21T06:05:16.150+0000 7f4b14200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:05:16.496 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 06:05:16 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-b[62795]: ignoring --setuser ceph since I am not root 2024-09-21T06:05:16.496 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 06:05:16 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-b[62795]: ignoring --setgroup ceph since I am not root 2024-09-21T06:05:16.496 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 06:05:16 smithi067 ceph-mds[62799]: -- 172.21.15.67:0/413284679 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564875e7d860 con 0x56487a025a80 2024-09-21T06:05:16.496 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 06:05:16 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-b[62795]: starting mds.b at 2024-09-21T06:05:16.623 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:05:16 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-i[62783]: ignoring --setuser ceph since I am not root 2024-09-21T06:05:16.625 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:05:16 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-i[62783]: ignoring --setgroup ceph since I am not root 2024-09-21T06:05:16.625 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:05:16 smithi144 ceph-mds[62787]: -- 172.21.15.144:0/239461916 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555629247860 con 0x55562d3ef180 2024-09-21T06:05:16.626 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:05:16 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-i[62783]: starting mds.i at 2024-09-21T06:05:16.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:16 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/709152383' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:05:16.901 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:16 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:05:16.901 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:16 smithi037 ceph-mon[30631]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:05:16.901 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:16 smithi037 ceph-mon[30631]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:05:16.901 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:16 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:05:16.901 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:16 smithi037 ceph-mon[30631]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T06:05:16.901 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:16 smithi037 ceph-mon[30631]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T06:05:16.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:05:17.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:16 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/709152383' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:05:17.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:16 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:05:17.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:16 smithi144 ceph-mon[34351]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:05:17.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:16 smithi144 ceph-mon[34351]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:05:17.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:16 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:05:17.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:16 smithi144 ceph-mon[34351]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T06:05:17.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:16 smithi144 ceph-mon[34351]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T06:05:17.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:16 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/709152383' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:05:17.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:16 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:05:17.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:16 smithi067 ceph-mon[34443]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:05:17.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:16 smithi067 ceph-mon[34443]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:05:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:16 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:05:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:16 smithi067 ceph-mon[34443]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T06:05:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:16 smithi067 ceph-mon[34443]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T06:05:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:05:17.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.952+0000 7f9c06000640 1 -- 172.21.15.37:0/1829487329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c00077380 msgr2=0x7f9c000757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:17.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.952+0000 7f9c06000640 1 --2- 172.21.15.37:0/1829487329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c00077380 0x7f9c000757b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009900 tx=0x7f9bf002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.953+0000 7f9c06000640 1 -- 172.21.15.37:0/1829487329 shutdown_connections 2024-09-21T06:05:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.953+0000 7f9c06000640 1 --2- 172.21.15.37:0/1829487329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c00114450 0x7f9c00116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.953+0000 7f9c06000640 1 --2- 172.21.15.37:0/1829487329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c00075dd0 0x7f9c000761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.953+0000 7f9c06000640 1 --2- 172.21.15.37:0/1829487329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c00077380 0x7f9c000757b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.953+0000 7f9c06000640 1 -- 172.21.15.37:0/1829487329 >> 172.21.15.37:0/1829487329 conn(0x7f9c000ff610 msgr2=0x7f9c00101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.953+0000 7f9c06000640 1 -- 172.21.15.37:0/1829487329 shutdown_connections 2024-09-21T06:05:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.953+0000 7f9c06000640 1 -- 172.21.15.37:0/1829487329 wait complete. 2024-09-21T06:05:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.954+0000 7f9c06000640 1 Processor -- start 2024-09-21T06:05:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.954+0000 7f9c06000640 1 -- start start 2024-09-21T06:05:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.954+0000 7f9c06000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c00075dd0 0x7f9c001a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.954+0000 7f9c06000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c00077380 0x7f9c001a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.954+0000 7f9c06000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c00114450 0x7f9c001a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.954+0000 7f9c06000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0011a080 con 0x7f9c00075dd0 2024-09-21T06:05:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.954+0000 7f9c06000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c00119f00 con 0x7f9c00114450 2024-09-21T06:05:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.954+0000 7f9c06000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0011a200 con 0x7f9c00077380 2024-09-21T06:05:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.955+0000 7f9bfea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c00077380 0x7f9c001a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.955+0000 7f9bfea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c00077380 0x7f9c001a10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:57024/0 (socket says 172.21.15.37:57024) 2024-09-21T06:05:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.955+0000 7f9bfea00640 1 -- 172.21.15.37:0/792673190 learned_addr learned my addr 172.21.15.37:0/792673190 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:05:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.955+0000 7f9bff400640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c00075dd0 0x7f9c001a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.955+0000 7f9bffe00640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c00114450 0x7f9c001a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.955+0000 7f9bfea00640 1 -- 172.21.15.37:0/792673190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c00114450 msgr2=0x7f9c001a6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.955+0000 7f9bfea00640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c00114450 0x7f9c001a6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.955+0000 7f9bfea00640 1 -- 172.21.15.37:0/792673190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c00075dd0 msgr2=0x7f9c001a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.955+0000 7f9bfea00640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c00075dd0 0x7f9c001a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.955+0000 7f9bfea00640 1 -- 172.21.15.37:0/792673190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c001a6ac0 con 0x7f9c00077380 2024-09-21T06:05:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.956+0000 7f9bfea00640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c00077380 0x7f9c001a10f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00e9a0 tx=0x7f9bec00eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.956+0000 7f9bf7e00640 1 -- 172.21.15.37:0/792673190 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec00cd80 con 0x7f9c00077380 2024-09-21T06:05:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.956+0000 7f9bf7e00640 1 -- 172.21.15.37:0/792673190 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bec0035f0 con 0x7f9c00077380 2024-09-21T06:05:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.956+0000 7f9bf7e00640 1 -- 172.21.15.37:0/792673190 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec010690 con 0x7f9c00077380 2024-09-21T06:05:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.956+0000 7f9c06000640 1 -- 172.21.15.37:0/792673190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c001a6db0 con 0x7f9c00077380 2024-09-21T06:05:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.956+0000 7f9c06000640 1 -- 172.21.15.37:0/792673190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c001ad510 con 0x7f9c00077380 2024-09-21T06:05:17.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.957+0000 7f9c06000640 1 -- 172.21.15.37:0/792673190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c00076cc0 con 0x7f9c00077380 2024-09-21T06:05:17.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.961+0000 7f9bf7e00640 1 -- 172.21.15.37:0/792673190 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f9bec003aa0 con 0x7f9c00077380 2024-09-21T06:05:17.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.962+0000 7f9bf7e00640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9be40b6510 0x7f9be40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:17.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.962+0000 7f9bf7e00640 1 -- 172.21.15.37:0/792673190 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9294+0+0 (secure 0 0 0) 0x7f9bec0e7dc0 con 0x7f9c00077380 2024-09-21T06:05:17.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.962+0000 7f9bff400640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9be40b6510 0x7f9be40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:17.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.963+0000 7f9bff400640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9be40b6510 0x7f9be40b8a20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0031440 tx=0x7f9bf0009560 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:17.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:17.964+0000 7f9bf7e00640 1 -- 172.21.15.37:0/792673190 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9bec0ae1d0 con 0x7f9c00077380 2024-09-21T06:05:18.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:17 smithi144 ceph-mon[34351]: pgmap v756: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T06:05:18.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:17 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.67:6838/549840155,v1:172.21.15.67:6839/549840155] up:boot 2024-09-21T06:05:18.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:17 smithi144 ceph-mon[34351]: mds.? [v2:172.21.15.144:6838/1975637047,v1:172.21.15.144:6839/1975637047] up:boot 2024-09-21T06:05:18.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:17 smithi144 ceph-mon[34351]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T06:05:18.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:17 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:05:18.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:17 smithi144 ceph-mon[34351]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:05:18.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:17 smithi037 ceph-mon[30631]: pgmap v756: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T06:05:18.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:17 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.67:6838/549840155,v1:172.21.15.67:6839/549840155] up:boot 2024-09-21T06:05:18.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:17 smithi037 ceph-mon[30631]: mds.? [v2:172.21.15.144:6838/1975637047,v1:172.21.15.144:6839/1975637047] up:boot 2024-09-21T06:05:18.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:17 smithi037 ceph-mon[30631]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T06:05:18.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:17 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:05:18.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:17 smithi037 ceph-mon[30631]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:05:18.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.207+0000 7f9c06000640 1 -- 172.21.15.37:0/792673190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9c0002e640 con 0x7f9c00077380 2024-09-21T06:05:18.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:17 smithi067 ceph-mon[34443]: pgmap v756: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T06:05:18.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:17 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.67:6838/549840155,v1:172.21.15.67:6839/549840155] up:boot 2024-09-21T06:05:18.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:17 smithi067 ceph-mon[34443]: mds.? [v2:172.21.15.144:6838/1975637047,v1:172.21.15.144:6839/1975637047] up:boot 2024-09-21T06:05:18.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:17 smithi067 ceph-mon[34443]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T06:05:18.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:17 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:05:18.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:17 smithi067 ceph-mon[34443]: from='mgr.14154 172.21.15.37:0/1856016539' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:05:18.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.802+0000 7f9bf7e00640 1 -- 172.21.15.37:0/792673190 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f9bec0b25b0 con 0x7f9c00077380 2024-09-21T06:05:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.805+0000 7f9c06000640 1 -- 172.21.15.37:0/792673190 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9be40b6510 msgr2=0x7f9be40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.805+0000 7f9c06000640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9be40b6510 0x7f9be40b8a20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0031440 tx=0x7f9bf0009560 comp rx=0 tx=0).stop 2024-09-21T06:05:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.805+0000 7f9c06000640 1 -- 172.21.15.37:0/792673190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c00077380 msgr2=0x7f9c001a10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.805+0000 7f9c06000640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c00077380 0x7f9c001a10f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00e9a0 tx=0x7f9bec00eda0 comp rx=0 tx=0).stop 2024-09-21T06:05:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.805+0000 7f9c06000640 1 -- 172.21.15.37:0/792673190 shutdown_connections 2024-09-21T06:05:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.805+0000 7f9c06000640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f9be40b6510 0x7f9be40b8a20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.805+0000 7f9c06000640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c00114450 0x7f9c001a6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:18.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.805+0000 7f9c06000640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c00077380 0x7f9c001a10f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:18.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.805+0000 7f9c06000640 1 --2- 172.21.15.37:0/792673190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c00075dd0 0x7f9c001a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:18.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.805+0000 7f9c06000640 1 -- 172.21.15.37:0/792673190 >> 172.21.15.37:0/792673190 conn(0x7f9c000ff610 msgr2=0x7f9c00110350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:18.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.805+0000 7f9c06000640 1 -- 172.21.15.37:0/792673190 shutdown_connections 2024-09-21T06:05:18.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:18.805+0000 7f9c06000640 1 -- 172.21.15.37:0/792673190 wait complete. 2024-09-21T06:05:19.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:18 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/792673190' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:05:19.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:18 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:05:19.159 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:18 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/792673190' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:05:19.159 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:18 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:05:19.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:18 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/792673190' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:05:19.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:18 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:05:19.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:05:19.915 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:05:20.054 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:19 smithi037 ceph-mon[30631]: pgmap v757: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T06:05:20.054 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:19 smithi037 ceph-mon[30631]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:05:20.054 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:19 smithi037 ceph-mon[30631]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:05:20.054 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:19 smithi037 ceph-mon[30631]: Cluster is now healthy 2024-09-21T06:05:20.054 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:19 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:05:20.055 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:19 smithi037 ceph-mon[30631]: fsmap 12 up:standby 2024-09-21T06:05:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:19 smithi144 ceph-mon[34351]: pgmap v757: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T06:05:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:19 smithi144 ceph-mon[34351]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:05:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:19 smithi144 ceph-mon[34351]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:05:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:19 smithi144 ceph-mon[34351]: Cluster is now healthy 2024-09-21T06:05:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:19 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:05:20.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:19 smithi144 ceph-mon[34351]: fsmap 12 up:standby 2024-09-21T06:05:20.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:19 smithi067 ceph-mon[34443]: pgmap v757: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T06:05:20.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:19 smithi067 ceph-mon[34443]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:05:20.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:19 smithi067 ceph-mon[34443]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:05:20.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:19 smithi067 ceph-mon[34443]: Cluster is now healthy 2024-09-21T06:05:20.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:19 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:05:20.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:19 smithi067 ceph-mon[34443]: fsmap 12 up:standby 2024-09-21T06:05:20.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.560+0000 7ffb93e00640 1 -- 172.21.15.37:0/1493736143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c10de30 msgr2=0x7ffb8c110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:20.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.560+0000 7ffb93e00640 1 --2- 172.21.15.37:0/1493736143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c10de30 0x7ffb8c110320 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009ca0 tx=0x7ffb8402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.560+0000 7ffb93e00640 1 -- 172.21.15.37:0/1493736143 shutdown_connections 2024-09-21T06:05:20.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.560+0000 7ffb93e00640 1 --2- 172.21.15.37:0/1493736143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c10de30 0x7ffb8c110320 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.560+0000 7ffb93e00640 1 --2- 172.21.15.37:0/1493736143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c105320 0x7ffb8c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.560+0000 7ffb93e00640 1 --2- 172.21.15.37:0/1493736143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c1049d0 0x7ffb8c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.560+0000 7ffb93e00640 1 -- 172.21.15.37:0/1493736143 >> 172.21.15.37:0/1493736143 conn(0x7ffb8c079740 msgr2=0x7ffb8c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:20.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.560+0000 7ffb93e00640 1 -- 172.21.15.37:0/1493736143 shutdown_connections 2024-09-21T06:05:20.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.561+0000 7ffb93e00640 1 -- 172.21.15.37:0/1493736143 wait complete. 2024-09-21T06:05:20.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.562+0000 7ffb93e00640 1 Processor -- start 2024-09-21T06:05:20.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.562+0000 7ffb93e00640 1 -- start start 2024-09-21T06:05:20.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.562+0000 7ffb93e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c1049d0 0x7ffb8c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:20.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.562+0000 7ffb93e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c105320 0x7ffb8c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:20.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.562+0000 7ffb93e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c10de30 0x7ffb8c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:20.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.562+0000 7ffb93e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c113a90 con 0x7ffb8c105320 2024-09-21T06:05:20.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.562+0000 7ffb93e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c113910 con 0x7ffb8c1049d0 2024-09-21T06:05:20.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.562+0000 7ffb93e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c113c10 con 0x7ffb8c10de30 2024-09-21T06:05:20.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.563+0000 7ffb91400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c1049d0 0x7ffb8c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:20.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.563+0000 7ffb90a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c105320 0x7ffb8c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:20.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.563+0000 7ffb91400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c1049d0 0x7ffb8c19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.37:39454/0 (socket says 172.21.15.37:39454) 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.563+0000 7ffb91400640 1 -- 172.21.15.37:0/107004831 learned_addr learned my addr 172.21.15.37:0/107004831 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.563+0000 7ffb91e00640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c10de30 0x7ffb8c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.563+0000 7ffb90a00640 1 -- 172.21.15.37:0/107004831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c10de30 msgr2=0x7ffb8c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.563+0000 7ffb90a00640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c10de30 0x7ffb8c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.563+0000 7ffb90a00640 1 -- 172.21.15.37:0/107004831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c1049d0 msgr2=0x7ffb8c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.563+0000 7ffb90a00640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c1049d0 0x7ffb8c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.563+0000 7ffb90a00640 1 -- 172.21.15.37:0/107004831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8c1a0450 con 0x7ffb8c105320 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.563+0000 7ffb91400640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c1049d0 0x7ffb8c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.563+0000 7ffb90a00640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c105320 0x7ffb8c19aa80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c06b950 tx=0x7ffb7800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.564+0000 7ffb8a000640 1 -- 172.21.15.37:0/107004831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800cd00 con 0x7ffb8c105320 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.564+0000 7ffb8a000640 1 -- 172.21.15.37:0/107004831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb780035f0 con 0x7ffb8c105320 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.564+0000 7ffb93e00640 1 -- 172.21.15.37:0/107004831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8c1a0740 con 0x7ffb8c105320 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.564+0000 7ffb8a000640 1 -- 172.21.15.37:0/107004831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78010690 con 0x7ffb8c105320 2024-09-21T06:05:20.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.564+0000 7ffb93e00640 1 -- 172.21.15.37:0/107004831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb8c1a6ea0 con 0x7ffb8c105320 2024-09-21T06:05:20.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.565+0000 7ffb93e00640 1 -- 172.21.15.37:0/107004831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb8c06c240 con 0x7ffb8c105320 2024-09-21T06:05:20.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.567+0000 7ffb8a000640 1 -- 172.21.15.37:0/107004831 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7ffb780037a0 con 0x7ffb8c105320 2024-09-21T06:05:20.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.569+0000 7ffb8a000640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ffb740b6510 0x7ffb740b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:20.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.569+0000 7ffb8a000640 1 -- 172.21.15.37:0/107004831 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9294+0+0 (secure 0 0 0) 0x7ffb780e7af0 con 0x7ffb8c105320 2024-09-21T06:05:20.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.569+0000 7ffb91400640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ffb740b6510 0x7ffb740b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:20.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.570+0000 7ffb91400640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ffb740b6510 0x7ffb740b8a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffb800058c0 tx=0x7ffb80005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:20.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.571+0000 7ffb8a000640 1 -- 172.21.15.37:0/107004831 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffb78056710 con 0x7ffb8c105320 2024-09-21T06:05:20.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.771+0000 7ffb93e00640 1 -- 172.21.15.37:0/107004831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ffb8c104de0 con 0x7ffb8c105320 2024-09-21T06:05:20.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.803+0000 7ffb8a000640 1 -- 172.21.15.37:0/107004831 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) ==== 181+0+0 (secure 0 0 0) 0x7ffb780adf00 con 0x7ffb8c105320 2024-09-21T06:05:20.806 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:05:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.805+0000 7ffb93e00640 1 -- 172.21.15.37:0/107004831 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ffb740b6510 msgr2=0x7ffb740b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.805+0000 7ffb93e00640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ffb740b6510 0x7ffb740b8a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffb800058c0 tx=0x7ffb80005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.805+0000 7ffb93e00640 1 -- 172.21.15.37:0/107004831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c105320 msgr2=0x7ffb8c19aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.805+0000 7ffb93e00640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c105320 0x7ffb8c19aa80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c06b950 tx=0x7ffb7800ee50 comp rx=0 tx=0).stop 2024-09-21T06:05:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.805+0000 7ffb93e00640 1 -- 172.21.15.37:0/107004831 shutdown_connections 2024-09-21T06:05:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.805+0000 7ffb93e00640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c10de30 0x7ffb8c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.805+0000 7ffb93e00640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c105320 0x7ffb8c19aa80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.806+0000 7ffb93e00640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7ffb740b6510 0x7ffb740b8a20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.806+0000 7ffb93e00640 1 --2- 172.21.15.37:0/107004831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb8c1049d0 0x7ffb8c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.806+0000 7ffb93e00640 1 -- 172.21.15.37:0/107004831 >> 172.21.15.37:0/107004831 conn(0x7ffb8c079740 msgr2=0x7ffb8c106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.806+0000 7ffb93e00640 1 -- 172.21.15.37:0/107004831 shutdown_connections 2024-09-21T06:05:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:20.806+0000 7ffb93e00640 1 -- 172.21.15.37:0/107004831 wait complete. 2024-09-21T06:05:21.122 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:20 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/107004831' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:05:21.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:20 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/107004831' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:05:21.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:20 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/107004831' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:05:21.611 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:05:21.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:21 smithi037 ceph-mon[30631]: pgmap v758: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T06:05:21.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:21 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/107004831' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:05:21.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:21 smithi037 ceph-mon[30631]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T06:05:21.994 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:05:22.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:21 smithi144 ceph-mon[34351]: pgmap v758: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T06:05:22.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:21 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/107004831' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:05:22.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:21 smithi144 ceph-mon[34351]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T06:05:22.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:21 smithi067 ceph-mon[34443]: pgmap v758: 129 pgs: 129 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T06:05:22.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:21 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/107004831' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:05:22.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:21 smithi067 ceph-mon[34443]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T06:05:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.644+0000 7f8ba8400640 1 -- 172.21.15.37:0/588208668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba0103b80 msgr2=0x7f8ba0103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.644+0000 7f8ba8400640 1 --2- 172.21.15.37:0/588208668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba0103b80 0x7f8ba0103f90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009900 tx=0x7f8b9402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.644+0000 7f8ba8400640 1 -- 172.21.15.37:0/588208668 shutdown_connections 2024-09-21T06:05:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.644+0000 7f8ba8400640 1 --2- 172.21.15.37:0/588208668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ba0109e10 0x7f8ba0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.644+0000 7f8ba8400640 1 --2- 172.21.15.37:0/588208668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ba01094c0 0x7f8ba01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.644+0000 7f8ba8400640 1 --2- 172.21.15.37:0/588208668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba0103b80 0x7f8ba0103f90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.644+0000 7f8ba8400640 1 -- 172.21.15.37:0/588208668 >> 172.21.15.37:0/588208668 conn(0x7f8ba00ff610 msgr2=0x7f8ba0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.644+0000 7f8ba8400640 1 -- 172.21.15.37:0/588208668 shutdown_connections 2024-09-21T06:05:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.644+0000 7f8ba8400640 1 -- 172.21.15.37:0/588208668 wait complete. 2024-09-21T06:05:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.645+0000 7f8ba8400640 1 Processor -- start 2024-09-21T06:05:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.646+0000 7f8ba8400640 1 -- start start 2024-09-21T06:05:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.646+0000 7f8ba8400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ba0103b80 0x7f8ba019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.646+0000 7f8ba8400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba01094c0 0x7f8ba019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.646+0000 7f8ba8400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ba0109e10 0x7f8ba019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.646+0000 7f8ba8400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba0113ad0 con 0x7f8ba01094c0 2024-09-21T06:05:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.646+0000 7f8ba8400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba0113950 con 0x7f8ba0109e10 2024-09-21T06:05:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.646+0000 7f8ba8400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba0113c50 con 0x7f8ba0103b80 2024-09-21T06:05:22.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.646+0000 7f8ba5000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba01094c0 0x7f8ba019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.646+0000 7f8ba5000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba01094c0 0x7f8ba019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40446/0 (socket says 172.21.15.37:40446) 2024-09-21T06:05:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.646+0000 7f8ba5000640 1 -- 172.21.15.37:0/3464987425 learned_addr learned my addr 172.21.15.37:0/3464987425 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:05:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.646+0000 7f8ba5a00640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ba0103b80 0x7f8ba019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.646+0000 7f8ba6400640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ba0109e10 0x7f8ba019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.647+0000 7f8ba5000640 1 -- 172.21.15.37:0/3464987425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ba0103b80 msgr2=0x7f8ba019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.647+0000 7f8ba5000640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ba0103b80 0x7f8ba019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.647+0000 7f8ba5000640 1 -- 172.21.15.37:0/3464987425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ba0109e10 msgr2=0x7f8ba019fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.647+0000 7f8ba5000640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ba0109e10 0x7f8ba019fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.647+0000 7f8ba5000640 1 -- 172.21.15.37:0/3464987425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba01a03f0 con 0x7f8ba01094c0 2024-09-21T06:05:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.647+0000 7f8ba5000640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba01094c0 0x7f8ba019aa20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00e9f0 tx=0x7f8b8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.647+0000 7f8b9e000640 1 -- 172.21.15.37:0/3464987425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00ccc0 con 0x7f8ba01094c0 2024-09-21T06:05:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.647+0000 7f8b9e000640 1 -- 172.21.15.37:0/3464987425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b8c0108e0 con 0x7f8ba01094c0 2024-09-21T06:05:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.647+0000 7f8b9e000640 1 -- 172.21.15.37:0/3464987425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c018860 con 0x7f8ba01094c0 2024-09-21T06:05:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.648+0000 7f8ba8400640 1 -- 172.21.15.37:0/3464987425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba01a06e0 con 0x7f8ba01094c0 2024-09-21T06:05:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.648+0000 7f8ba8400640 1 -- 172.21.15.37:0/3464987425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba01a6e40 con 0x7f8ba01094c0 2024-09-21T06:05:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.649+0000 7f8ba8400640 1 -- 172.21.15.37:0/3464987425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba0104e00 con 0x7f8ba01094c0 2024-09-21T06:05:22.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.651+0000 7f8b9e000640 1 -- 172.21.15.37:0/3464987425 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7f8b8c010430 con 0x7f8ba01094c0 2024-09-21T06:05:22.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.653+0000 7f8b9e000640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b880b6590 0x7f8b880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:22.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.653+0000 7f8b9e000640 1 -- 172.21.15.37:0/3464987425 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8740+0+0 (secure 0 0 0) 0x7f8b8c0e7730 con 0x7f8ba01094c0 2024-09-21T06:05:22.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.653+0000 7f8ba5a00640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b880b6590 0x7f8b880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:22.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.654+0000 7f8ba5a00640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b880b6590 0x7f8b880b8aa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8b94031440 tx=0x7f8b94009560 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:22.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.657+0000 7f8b9e000640 1 -- 172.21.15.37:0/3464987425 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b8c0b2140 con 0x7f8ba01094c0 2024-09-21T06:05:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:22.860+0000 7f8ba8400640 1 -- 172.21.15.37:0/3464987425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8ba010bc10 con 0x7f8ba01094c0 2024-09-21T06:05:23.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:23.814+0000 7f8b9e000640 1 -- 172.21.15.37:0/3464987425 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) ==== 169+0+0 (secure 0 0 0) 0x7f8b8c0b7080 con 0x7f8ba01094c0 2024-09-21T06:05:23.816 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-09-21T06:05:23.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:23.819+0000 7f8ba8400640 1 -- 172.21.15.37:0/3464987425 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b880b6590 msgr2=0x7f8b880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:23.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:23.819+0000 7f8ba8400640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b880b6590 0x7f8b880b8aa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8b94031440 tx=0x7f8b94009560 comp rx=0 tx=0).stop 2024-09-21T06:05:23.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:23.819+0000 7f8ba8400640 1 -- 172.21.15.37:0/3464987425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba01094c0 msgr2=0x7f8ba019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:23.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:23.819+0000 7f8ba8400640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba01094c0 0x7f8ba019aa20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00e9f0 tx=0x7f8b8c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:23.819+0000 7f8ba8400640 1 -- 172.21.15.37:0/3464987425 shutdown_connections 2024-09-21T06:05:23.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:23.819+0000 7f8ba8400640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7f8b880b6590 0x7f8b880b8aa0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:23.819+0000 7f8ba8400640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ba0109e10 0x7f8ba019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:23.819+0000 7f8ba8400640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba01094c0 0x7f8ba019aa20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:23.819+0000 7f8ba8400640 1 --2- 172.21.15.37:0/3464987425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ba0103b80 0x7f8ba019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:23.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:23.819+0000 7f8ba8400640 1 -- 172.21.15.37:0/3464987425 >> 172.21.15.37:0/3464987425 conn(0x7f8ba00ff610 msgr2=0x7f8ba0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:23.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:23.820+0000 7f8ba8400640 1 -- 172.21.15.37:0/3464987425 shutdown_connections 2024-09-21T06:05:23.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:23.821+0000 7f8ba8400640 1 -- 172.21.15.37:0/3464987425 wait complete. 2024-09-21T06:05:24.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:23 smithi144 ceph-mon[34351]: pgmap v760: 97 pgs: 97 active+clean; 577 KiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:05:24.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:23 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3464987425' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:05:24.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:23 smithi037 ceph-mon[30631]: pgmap v760: 97 pgs: 97 active+clean; 577 KiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:05:24.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:23 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3464987425' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:05:24.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:23 smithi067 ceph-mon[34443]: pgmap v760: 97 pgs: 97 active+clean; 577 KiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:05:24.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:23 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3464987425' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:05:24.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T06:05:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:05:25.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:24 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3464987425' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:05:25.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:24 smithi144 ceph-mon[34351]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T06:05:25.125 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:24 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3464987425' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:05:25.125 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:24 smithi037 ceph-mon[30631]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T06:05:25.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:24 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3464987425' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:05:25.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:24 smithi067 ceph-mon[34443]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T06:05:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.594+0000 7fddd7600640 1 -- 172.21.15.37:0/3776616689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0110140 msgr2=0x7fddd0112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.594+0000 7fddd7600640 1 --2- 172.21.15.37:0/3776616689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0110140 0x7fddd0112560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009be0 tx=0x7fddc802a6c0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.594+0000 7fddd7600640 1 -- 172.21.15.37:0/3776616689 shutdown_connections 2024-09-21T06:05:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.594+0000 7fddd7600640 1 --2- 172.21.15.37:0/3776616689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0110140 0x7fddd0112560 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.594+0000 7fddd7600640 1 --2- 172.21.15.37:0/3776616689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddd0076080 0x7fddd010fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.594+0000 7fddd7600640 1 --2- 172.21.15.37:0/3776616689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0075730 0x7fddd0075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.594+0000 7fddd7600640 1 -- 172.21.15.37:0/3776616689 >> 172.21.15.37:0/3776616689 conn(0x7fddd007b850 msgr2=0x7fddd007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.594+0000 7fddd7600640 1 -- 172.21.15.37:0/3776616689 shutdown_connections 2024-09-21T06:05:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.595+0000 7fddd7600640 1 -- 172.21.15.37:0/3776616689 wait complete. 2024-09-21T06:05:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.596+0000 7fddd7600640 1 Processor -- start 2024-09-21T06:05:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.596+0000 7fddd7600640 1 -- start start 2024-09-21T06:05:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.596+0000 7fddd7600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0075730 0x7fddd019c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.596+0000 7fddd7600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0076080 0x7fddd019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.596+0000 7fddd7600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddd0110140 0x7fddd01a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.596+0000 7fddd7600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0115c80 con 0x7fddd0075730 2024-09-21T06:05:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.596+0000 7fddd7600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0115b00 con 0x7fddd0110140 2024-09-21T06:05:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.596+0000 7fddd7600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0115e00 con 0x7fddd0076080 2024-09-21T06:05:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.597+0000 7fddd4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0075730 0x7fddd019c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.597+0000 7fddd4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0075730 0x7fddd019c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40464/0 (socket says 172.21.15.37:40464) 2024-09-21T06:05:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.597+0000 7fddd5600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddd0110140 0x7fddd01a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.597+0000 7fddd4c00640 1 -- 172.21.15.37:0/3790104131 learned_addr learned my addr 172.21.15.37:0/3790104131 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T06:05:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.597+0000 7fddcfe00640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0076080 0x7fddd019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.597+0000 7fddd5600640 1 -- 172.21.15.37:0/3790104131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0076080 msgr2=0x7fddd019cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.597+0000 7fddd5600640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0076080 0x7fddd019cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.597+0000 7fddd5600640 1 -- 172.21.15.37:0/3790104131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0075730 msgr2=0x7fddd019c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.597+0000 7fddd5600640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0075730 0x7fddd019c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.597+0000 7fddd5600640 1 -- 172.21.15.37:0/3790104131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd01a2540 con 0x7fddd0110140 2024-09-21T06:05:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.597+0000 7fddcfe00640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0076080 0x7fddd019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:05:25.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.598+0000 7fddd5600640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddd0110140 0x7fddd01a1e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fddc802abe0 tx=0x7fddc8003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:25.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.598+0000 7fddcd600640 1 -- 172.21.15.37:0/3790104131 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8041020 con 0x7fddd0110140 2024-09-21T06:05:25.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.598+0000 7fddd7600640 1 -- 172.21.15.37:0/3790104131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd01a27d0 con 0x7fddd0110140 2024-09-21T06:05:25.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.598+0000 7fddcd600640 1 -- 172.21.15.37:0/3790104131 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc8003e10 con 0x7fddd0110140 2024-09-21T06:05:25.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.598+0000 7fddcd600640 1 -- 172.21.15.37:0/3790104131 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8036040 con 0x7fddd0110140 2024-09-21T06:05:25.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.598+0000 7fddd7600640 1 -- 172.21.15.37:0/3790104131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd01a8f90 con 0x7fddd0110140 2024-09-21T06:05:25.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.599+0000 7fddd7600640 1 -- 172.21.15.37:0/3790104131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd0076c40 con 0x7fddd0110140 2024-09-21T06:05:25.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.602+0000 7fddcd600640 1 -- 172.21.15.37:0/3790104131 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 154512+0+0 (secure 0 0 0) 0x7fddc8044020 con 0x7fddd0110140 2024-09-21T06:05:25.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.603+0000 7fddcd600640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fddb80b6510 0x7fddb80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:25.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.603+0000 7fddcd600640 1 -- 172.21.15.37:0/3790104131 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8152+0+0 (secure 0 0 0) 0x7fddc81081a0 con 0x7fddd0110140 2024-09-21T06:05:25.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.603+0000 7fddd4c00640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fddb80b6510 0x7fddb80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:25.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.604+0000 7fddd4c00640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fddb80b6510 0x7fddb80b8a20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009c90 tx=0x7fddc4005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.605+0000 7fddcd600640 1 -- 172.21.15.37:0/3790104131 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fddc804b020 con 0x7fddd0110140 2024-09-21T06:05:25.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.809+0000 7fddd7600640 1 -- 172.21.15.37:0/3790104131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fddd01a9160 con 0x7fddd0110140 2024-09-21T06:05:25.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.828+0000 7fddcd600640 1 -- 172.21.15.37:0/3790104131 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v94) ==== 178+0+0 (secure 0 0 0) 0x7fddc80cea30 con 0x7fddd0110140 2024-09-21T06:05:25.831 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' removed 2024-09-21T06:05:25.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.831+0000 7fddd7600640 1 -- 172.21.15.37:0/3790104131 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fddb80b6510 msgr2=0x7fddb80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:25.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.831+0000 7fddd7600640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fddb80b6510 0x7fddb80b8a20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009c90 tx=0x7fddc4005f90 comp rx=0 tx=0).stop 2024-09-21T06:05:25.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.831+0000 7fddd7600640 1 -- 172.21.15.37:0/3790104131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddd0110140 msgr2=0x7fddd01a1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:25.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.831+0000 7fddd7600640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddd0110140 0x7fddd01a1e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fddc802abe0 tx=0x7fddc8003c20 comp rx=0 tx=0).stop 2024-09-21T06:05:25.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.832+0000 7fddd7600640 1 -- 172.21.15.37:0/3790104131 shutdown_connections 2024-09-21T06:05:25.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.832+0000 7fddd7600640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.37:6800/3016662141,v1:172.21.15.37:6801/3016662141] conn(0x7fddb80b6510 0x7fddb80b8a20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.832+0000 7fddd7600640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddd0110140 0x7fddd01a1e10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.832+0000 7fddd7600640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0076080 0x7fddd019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.832+0000 7fddd7600640 1 --2- 172.21.15.37:0/3790104131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddd0075730 0x7fddd019c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:25.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.832+0000 7fddd7600640 1 -- 172.21.15.37:0/3790104131 >> 172.21.15.37:0/3790104131 conn(0x7fddd007b850 msgr2=0x7fddd0101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:25.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.832+0000 7fddd7600640 1 -- 172.21.15.37:0/3790104131 shutdown_connections 2024-09-21T06:05:25.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T06:05:25.833+0000 7fddd7600640 1 -- 172.21.15.37:0/3790104131 wait complete. 2024-09-21T06:05:26.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:25 smithi144 ceph-mon[34351]: pgmap v762: 33 pgs: 33 active+clean; 577 KiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:05:26.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:25 smithi144 ceph-mon[34351]: from='client.? 172.21.15.37:0/3790104131' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:05:26.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:25 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:05:26.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:25 smithi037 ceph-mon[30631]: pgmap v762: 33 pgs: 33 active+clean; 577 KiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:05:26.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:25 smithi037 ceph-mon[30631]: from='client.? 172.21.15.37:0/3790104131' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:05:26.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:25 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:05:26.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:25 smithi067 ceph-mon[34443]: pgmap v762: 33 pgs: 33 active+clean; 577 KiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:05:26.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:25 smithi067 ceph-mon[34443]: from='client.? 172.21.15.37:0/3790104131' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:05:26.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:25 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:05:26.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:05:26.667 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:05:26.702 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:05:26.736 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T06:05:26.737 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:05:26.772 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:05:26.789 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:05:26.808 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T06:05:26.808 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T06:05:26.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:05:26.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:26 smithi067 ceph-mon[34443]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:05:26.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:26 smithi067 ceph-mon[34443]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T06:05:27.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:26 smithi144 ceph-mon[34351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:05:27.123 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:26 smithi144 ceph-mon[34351]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T06:05:27.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:26 smithi037 ceph-mon[30631]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:05:27.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:26 smithi037 ceph-mon[30631]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T06:05:27.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:26 smithi037 systemd[1]: Stopping Ceph mon.a for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:27.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:27 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a[30627]: 2024-09-21T06:05:27.259+0000 7f4b1b000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:27.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:27 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a[30627]: 2024-09-21T06:05:27.259+0000 7f4b1b000640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T06:05:27.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:27 smithi037 podman[111121]: 2024-09-21 06:05:27.474919887 +0000 UTC m=+0.361462562 container died c8ccf76dc4293257961473b10b93834ca60733a548f0473e7aec00a5c31588ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T06:05:28.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:27 smithi037 podman[111121]: 2024-09-21 06:05:27.898765669 +0000 UTC m=+0.785308328 container cleanup c8ccf76dc4293257961473b10b93834ca60733a548f0473e7aec00a5c31588ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T06:05:28.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:27 smithi037 bash[111121]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:05:28.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 06:05:28 smithi037 podman[111132]: 2024-09-21 06:05:28.158770279 +0000 UTC m=+0.673080169 container remove c8ccf76dc4293257961473b10b93834ca60733a548f0473e7aec00a5c31588ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T06:05:28.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T06:05:28.555 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:28.555 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T06:05:28.555 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T06:05:28.555 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.b 2024-09-21T06:05:28.888 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:28 smithi067 systemd[1]: Stopping Ceph mon.b for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:29.153 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:28 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-b[34439]: 2024-09-21T06:05:28.884+0000 7f74d40d5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:29.153 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:28 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-b[34439]: 2024-09-21T06:05:28.884+0000 7f74d40d5640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:05:29.489 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:29 smithi067 podman[66255]: 2024-09-21 06:05:29.151866084 +0000 UTC m=+0.392390552 container died 149ddd59da5c6b5473e46356f73c5ec4a587df7733f7414fa57fd516f76c1bcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T06:05:29.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:29 smithi067 podman[66255]: 2024-09-21 06:05:29.586877424 +0000 UTC m=+0.827401891 container cleanup 149ddd59da5c6b5473e46356f73c5ec4a587df7733f7414fa57fd516f76c1bcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:05:29.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:29 smithi067 bash[66255]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-b 2024-09-21T06:05:30.061 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 21 06:05:29 smithi067 podman[66267]: 2024-09-21 06:05:29.805211649 +0000 UTC m=+0.651044318 container remove 149ddd59da5c6b5473e46356f73c5ec4a587df7733f7414fa57fd516f76c1bcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T06:05:30.065 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T06:05:30.112 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:30.112 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T06:05:30.112 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T06:05:30.113 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.c 2024-09-21T06:05:30.448 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:30 smithi144 systemd[1]: Stopping Ceph mon.c for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:30.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:30 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-c[34329]: 2024-09-21T06:05:30.445+0000 7fbdf625f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:30.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:30 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-c[34329]: 2024-09-21T06:05:30.445+0000 7fbdf625f640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:05:30.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:30 smithi144 podman[66596]: 2024-09-21 06:05:30.650600164 +0000 UTC m=+0.342396398 container died 7790fe3a62aff156a5ff8c2dc5a0733b76f068a50b4de1d5b58ae8de0f7674c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-c, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:05:31.308 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:31 smithi144 podman[66596]: 2024-09-21 06:05:31.046767997 +0000 UTC m=+0.738564221 container cleanup 7790fe3a62aff156a5ff8c2dc5a0733b76f068a50b4de1d5b58ae8de0f7674c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T06:05:31.308 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:05:31 smithi144 bash[66596]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mon-c 2024-09-21T06:05:31.470 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T06:05:31.523 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:31.523 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T06:05:31.523 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T06:05:31.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:05:31.914 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 06:05:31 smithi037 systemd[1]: Stopping Ceph mgr.x for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:32.348 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 06:05:31 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: 2024-09-21T06:05:31.947+0000 7fcb76800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:32.349 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 06:05:31 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x[30862]: 2024-09-21T06:05:31.947+0000 7fcb76800640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T06:05:32.349 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 06:05:32 smithi037 podman[111235]: 2024-09-21 06:05:32.04158888 +0000 UTC m=+0.226633573 container died 1ffbce206b29ac564c7b49aedf68d8b3dcebbe6dcb53b950f942d28c10d853fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:05:32.664 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 06:05:32 smithi037 podman[111235]: 2024-09-21 06:05:32.503731959 +0000 UTC m=+0.688776659 container cleanup 1ffbce206b29ac564c7b49aedf68d8b3dcebbe6dcb53b950f942d28c10d853fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T06:05:32.664 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 06:05:32 smithi037 bash[111235]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x 2024-09-21T06:05:33.080 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 06:05:32 smithi037 podman[111246]: 2024-09-21 06:05:32.822966772 +0000 UTC m=+0.773261826 container remove 1ffbce206b29ac564c7b49aedf68d8b3dcebbe6dcb53b950f942d28c10d853fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-x, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:05:33.107 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T06:05:33.182 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:33.182 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T06:05:33.182 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T06:05:33.182 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.y 2024-09-21T06:05:33.496 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 06:05:33 smithi067 systemd[1]: Stopping Ceph mgr.y for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:33.827 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 06:05:33 smithi067 podman[66377]: 2024-09-21 06:05:33.554353726 +0000 UTC m=+0.176130616 container died 36b1bb4f4b85789ed617eb99fbc50bfaa35432b670095f68c3d4d73dbaa03dfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T06:05:34.246 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 06:05:33 smithi067 podman[66377]: 2024-09-21 06:05:33.900592271 +0000 UTC m=+0.522369159 container cleanup 36b1bb4f4b85789ed617eb99fbc50bfaa35432b670095f68c3d4d73dbaa03dfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-y, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:05:34.246 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 06:05:33 smithi067 bash[66377]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-y 2024-09-21T06:05:34.492 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T06:05:34.513 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 06:05:34 smithi067 podman[66390]: 2024-09-21 06:05:34.261014819 +0000 UTC m=+0.701453082 container remove 36b1bb4f4b85789ed617eb99fbc50bfaa35432b670095f68c3d4d73dbaa03dfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T06:05:34.514 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 06:05:34 smithi067 systemd[1]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-21T06:05:34.514 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 06:05:34 smithi067 systemd[1]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.y.service: Failed with result 'exit-code'. 2024-09-21T06:05:34.514 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 06:05:34 smithi067 systemd[1]: Stopped Ceph mgr.y for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T06:05:34.514 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 21 06:05:34 smithi067 systemd[1]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.y.service: Consumed 7.524s CPU time. 2024-09-21T06:05:34.526 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:34.526 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T06:05:34.526 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T06:05:34.526 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.z 2024-09-21T06:05:34.867 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:05:34 smithi144 systemd[1]: Stopping Ceph mgr.z for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:35.123 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:05:34 smithi144 podman[66722]: 2024-09-21 06:05:34.866190226 +0000 UTC m=+0.152341529 container died 5e62b2b9b8e15acee5c60b9a6dfd8d6c475404156a0965f3959387c9ed29b8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-z, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T06:05:35.513 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:05:35 smithi144 podman[66722]: 2024-09-21 06:05:35.260812935 +0000 UTC m=+0.546964251 container cleanup 5e62b2b9b8e15acee5c60b9a6dfd8d6c475404156a0965f3959387c9ed29b8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T06:05:35.513 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:05:35 smithi144 bash[66722]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mgr-z 2024-09-21T06:05:35.695 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T06:05:35.730 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:35.730 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T06:05:35.730 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T06:05:35.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.0 2024-09-21T06:05:36.163 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:35 smithi037 systemd[1]: Stopping Ceph osd.0 for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:36.414 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:36 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0[44028]: 2024-09-21T06:05:36.161+0000 7f479f800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:36.414 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:36 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0[44028]: 2024-09-21T06:05:36.161+0000 7f479f800640 -1 osd.0 94 *** Got signal Terminated *** 2024-09-21T06:05:36.414 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:36 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0[44028]: 2024-09-21T06:05:36.161+0000 7f479f800640 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:05:42.021 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:41 smithi037 podman[111355]: 2024-09-21 06:05:41.708608518 +0000 UTC m=+5.686573915 container died a438eb8e1385cc8362371024cc16908526be172354ef0db760540d3ee2d99438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T06:05:42.379 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:42 smithi037 podman[111355]: 2024-09-21 06:05:42.14284989 +0000 UTC m=+6.120815287 container cleanup a438eb8e1385cc8362371024cc16908526be172354ef0db760540d3ee2d99438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T06:05:42.379 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:42 smithi037 bash[111355]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0 2024-09-21T06:05:42.664 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:42 smithi037 podman[111371]: 2024-09-21 06:05:42.378015718 +0000 UTC m=+0.665995741 container remove a438eb8e1385cc8362371024cc16908526be172354ef0db760540d3ee2d99438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T06:05:43.171 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:42 smithi037 podman[111460]: 2024-09-21 06:05:42.824133635 +0000 UTC m=+0.028482696 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:05:43.171 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:43 smithi037 podman[111460]: 2024-09-21 06:05:43.029155078 +0000 UTC m=+0.233504134 container create 558cb014a9d964e1da35cf8b87f901d084cd3d390291a42cfe657ca840f8abe0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T06:05:43.547 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:43 smithi037 podman[111460]: 2024-09-21 06:05:43.2821221 +0000 UTC m=+0.486471149 container init 558cb014a9d964e1da35cf8b87f901d084cd3d390291a42cfe657ca840f8abe0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T06:05:43.547 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:43 smithi037 podman[111460]: 2024-09-21 06:05:43.288999839 +0000 UTC m=+0.493348895 container start 558cb014a9d964e1da35cf8b87f901d084cd3d390291a42cfe657ca840f8abe0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T06:05:43.547 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:43 smithi037 podman[111460]: 2024-09-21 06:05:43.423717087 +0000 UTC m=+0.628066147 container attach 558cb014a9d964e1da35cf8b87f901d084cd3d390291a42cfe657ca840f8abe0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T06:05:43.809 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 06:05:43 smithi037 podman[111460]: 2024-09-21 06:05:43.54633902 +0000 UTC m=+0.750688076 container died 558cb014a9d964e1da35cf8b87f901d084cd3d390291a42cfe657ca840f8abe0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T06:05:44.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T06:05:44.362 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:44.362 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T06:05:44.362 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T06:05:44.362 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.1 2024-09-21T06:05:44.683 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:44 smithi067 systemd[1]: Stopping Ceph osd.1 for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:44.996 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:44 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1[38431]: 2024-09-21T06:05:44.680+0000 7f423f4ea640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:44.996 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:44 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1[38431]: 2024-09-21T06:05:44.680+0000 7f423f4ea640 -1 osd.1 94 *** Got signal Terminated *** 2024-09-21T06:05:44.996 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:44 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1[38431]: 2024-09-21T06:05:44.680+0000 7f423f4ea640 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:05:50.367 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:50 smithi067 podman[66507]: 2024-09-21 06:05:50.071177657 +0000 UTC m=+5.508273703 container died b1a8d61ca3e2db64c1000372db0f2c0f8e70391e369a430d8e714c84cb2c6346 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T06:05:50.746 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:50 smithi067 podman[66507]: 2024-09-21 06:05:50.57325456 +0000 UTC m=+6.010350608 container cleanup b1a8d61ca3e2db64c1000372db0f2c0f8e70391e369a430d8e714c84cb2c6346 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T06:05:50.747 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:50 smithi067 bash[66507]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1 2024-09-21T06:05:51.196 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:50 smithi067 podman[66533]: 2024-09-21 06:05:50.849887616 +0000 UTC m=+0.774560260 container remove b1a8d61ca3e2db64c1000372db0f2c0f8e70391e369a430d8e714c84cb2c6346 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:05:51.455 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:51 smithi067 podman[66625]: 2024-09-21 06:05:51.097270444 +0000 UTC m=+0.015998874 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:05:51.455 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:51 smithi067 podman[66625]: 2024-09-21 06:05:51.226088551 +0000 UTC m=+0.144816969 container create 30e4cfbdb0ae8ee25966de9f0b689242c9d4dd3155185cd6336a97fd6b87f39a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T06:05:51.456 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:51 smithi067 podman[66625]: 2024-09-21 06:05:51.4538706 +0000 UTC m=+0.372599017 container init 30e4cfbdb0ae8ee25966de9f0b689242c9d4dd3155185cd6336a97fd6b87f39a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:05:51.747 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:51 smithi067 podman[66625]: 2024-09-21 06:05:51.457380567 +0000 UTC m=+0.376108985 container start 30e4cfbdb0ae8ee25966de9f0b689242c9d4dd3155185cd6336a97fd6b87f39a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T06:05:51.747 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:51 smithi067 podman[66625]: 2024-09-21 06:05:51.553890826 +0000 UTC m=+0.472619254 container attach 30e4cfbdb0ae8ee25966de9f0b689242c9d4dd3155185cd6336a97fd6b87f39a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T06:05:51.747 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 21 06:05:51 smithi067 podman[66625]: 2024-09-21 06:05:51.646807217 +0000 UTC m=+0.565535647 container died 30e4cfbdb0ae8ee25966de9f0b689242c9d4dd3155185cd6336a97fd6b87f39a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T06:05:52.411 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T06:05:52.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:05:52.454 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T06:05:52.454 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T06:05:52.454 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.2 2024-09-21T06:05:52.750 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:52 smithi144 systemd[1]: Stopping Ceph osd.2 for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:05:53.123 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:52 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2[38659]: 2024-09-21T06:05:52.748+0000 7f2697f3c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:05:53.123 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:52 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2[38659]: 2024-09-21T06:05:52.748+0000 7f2697f3c640 -1 osd.2 94 *** Got signal Terminated *** 2024-09-21T06:05:53.123 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:52 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2[38659]: 2024-09-21T06:05:52.748+0000 7f2697f3c640 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:05:58.623 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:58 smithi144 podman[66859]: 2024-09-21 06:05:58.318935229 +0000 UTC m=+5.670486766 container died 6c5b5c10b018066c1fdfcffc6b4522d397d2a79538f11cf4089a4fc25c42443c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:05:58.977 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:58 smithi144 podman[66859]: 2024-09-21 06:05:58.723616009 +0000 UTC m=+6.075167554 container cleanup 6c5b5c10b018066c1fdfcffc6b4522d397d2a79538f11cf4089a4fc25c42443c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T06:05:58.977 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:58 smithi144 bash[66859]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2 2024-09-21T06:05:59.285 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:58 smithi144 podman[66874]: 2024-09-21 06:05:58.975088137 +0000 UTC m=+0.652524709 container remove 6c5b5c10b018066c1fdfcffc6b4522d397d2a79538f11cf4089a4fc25c42443c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T06:05:59.546 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:59 smithi144 podman[66962]: 2024-09-21 06:05:59.188042887 +0000 UTC m=+0.016056955 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:05:59.546 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:59 smithi144 podman[66962]: 2024-09-21 06:05:59.434670327 +0000 UTC m=+0.262684379 container create 9c5ba7c47665a74be319e7ac6cb598681bc8f8321e4cdd2672b57b0a4ae5af57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T06:05:59.873 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:59 smithi144 podman[66962]: 2024-09-21 06:05:59.678822051 +0000 UTC m=+0.506836102 container init 9c5ba7c47665a74be319e7ac6cb598681bc8f8321e4cdd2672b57b0a4ae5af57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:05:59.873 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:59 smithi144 podman[66962]: 2024-09-21 06:05:59.682091365 +0000 UTC m=+0.510105416 container start 9c5ba7c47665a74be319e7ac6cb598681bc8f8321e4cdd2672b57b0a4ae5af57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:05:59.873 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:59 smithi144 podman[66962]: 2024-09-21 06:05:59.779081944 +0000 UTC m=+0.607095998 container attach 9c5ba7c47665a74be319e7ac6cb598681bc8f8321e4cdd2672b57b0a4ae5af57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T06:06:00.169 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:05:59 smithi144 podman[66962]: 2024-09-21 06:05:59.876384474 +0000 UTC m=+0.704398539 container died 9c5ba7c47665a74be319e7ac6cb598681bc8f8321e4cdd2672b57b0a4ae5af57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T06:06:00.530 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T06:06:00.568 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:00.569 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T06:06:00.569 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T06:06:00.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.3 2024-09-21T06:06:00.914 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:00 smithi037 systemd[1]: Stopping Ceph osd.3 for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:01.414 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:01 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3[50460]: 2024-09-21T06:06:01.008+0000 7f78db400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:01.414 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:01 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3[50460]: 2024-09-21T06:06:01.008+0000 7f78db400640 -1 osd.3 94 *** Got signal Terminated *** 2024-09-21T06:06:01.414 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:01 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3[50460]: 2024-09-21T06:06:01.008+0000 7f78db400640 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:06:03.123 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:02.732+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:03.164 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:02 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3[50460]: 2024-09-21T06:06:02.900+0000 7f78d1e00640 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.845674+0000 front 2024-09-21T06:05:36.845708+0000 (oldest deadline 2024-09-21T06:06:02.745844+0000) 2024-09-21T06:06:03.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:03 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:03.384+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:04.123 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:03 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:03.723+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:04.164 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:03 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3[50460]: 2024-09-21T06:06:03.868+0000 7f78d1e00640 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.845674+0000 front 2024-09-21T06:05:36.845708+0000 (oldest deadline 2024-09-21T06:06:02.745844+0000) 2024-09-21T06:06:04.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:04.197+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:04.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:04 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:04.434+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:05.123 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:04.695+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:05.164 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:04 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3[50460]: 2024-09-21T06:06:04.828+0000 7f78d1e00640 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.845674+0000 front 2024-09-21T06:05:36.845708+0000 (oldest deadline 2024-09-21T06:06:02.745844+0000) 2024-09-21T06:06:05.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:05 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:05.168+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:05.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:05 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:05.417+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:06.122 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:05 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:05.698+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:06.164 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:05 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3[50460]: 2024-09-21T06:06:05.845+0000 7f78d1e00640 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.845674+0000 front 2024-09-21T06:05:36.845708+0000 (oldest deadline 2024-09-21T06:06:02.745844+0000) 2024-09-21T06:06:06.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:06.207+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:06.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:06 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:06.438+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:06.817 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:06 smithi037 podman[111572]: 2024-09-21 06:06:06.470517459 +0000 UTC m=+5.595382574 container died c0bc85baf402f4e91bc90eb9c421ab9e912e6aab2fa7dadfb8888b7eb69873b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T06:06:07.122 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:06.701+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:07.151 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:06 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:06.858+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:07.151 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:06 smithi037 podman[111572]: 2024-09-21 06:06:06.947842252 +0000 UTC m=+6.072707367 container cleanup c0bc85baf402f4e91bc90eb9c421ab9e912e6aab2fa7dadfb8888b7eb69873b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T06:06:07.151 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:06 smithi037 bash[111572]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3 2024-09-21T06:06:07.414 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:07 smithi037 podman[111589]: 2024-09-21 06:06:07.149569493 +0000 UTC m=+0.670859625 container remove c0bc85baf402f4e91bc90eb9c421ab9e912e6aab2fa7dadfb8888b7eb69873b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T06:06:07.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:07 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:07.197+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:07.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:07 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:07.416+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:07.996 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:07 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:07.865+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:07.996 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:07 smithi037 podman[111674]: 2024-09-21 06:06:07.623216068 +0000 UTC m=+0.027875745 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:06:07.996 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:07 smithi037 podman[111674]: 2024-09-21 06:06:07.733641887 +0000 UTC m=+0.138301562 container create 34d5a20666f075c327267272587f27293ff5ec73f2b244fb481cf6e97e9d0d2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T06:06:07.996 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:07 smithi037 podman[111674]: 2024-09-21 06:06:07.995043558 +0000 UTC m=+0.399703235 container init 34d5a20666f075c327267272587f27293ff5ec73f2b244fb481cf6e97e9d0d2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T06:06:08.122 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:07 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:07.750+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:08.268 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:08 smithi037 podman[111674]: 2024-09-21 06:06:08.001963084 +0000 UTC m=+0.406622760 container start 34d5a20666f075c327267272587f27293ff5ec73f2b244fb481cf6e97e9d0d2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T06:06:08.268 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:08 smithi037 podman[111674]: 2024-09-21 06:06:08.094748247 +0000 UTC m=+0.499407957 container attach 34d5a20666f075c327267272587f27293ff5ec73f2b244fb481cf6e97e9d0d2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T06:06:08.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:08 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:08.151+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:08.624 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 06:06:08 smithi037 podman[111674]: 2024-09-21 06:06:08.266692329 +0000 UTC m=+0.671352005 container died 34d5a20666f075c327267272587f27293ff5ec73f2b244fb481cf6e97e9d0d2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:06:08.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:08 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:08.453+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:08.914 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:08 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:08.863+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:08.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T06:06:09.069 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:09.069 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T06:06:09.069 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T06:06:09.069 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.4 2024-09-21T06:06:09.122 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:08 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:08.710+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:09.396 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:09 smithi067 systemd[1]: Stopping Ceph osd.4 for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:09.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:09 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:09.157+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:09.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:09 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:09.492+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:09.747 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:09 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4[44587]: 2024-09-21T06:06:09.394+0000 7fe46c811640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:09.747 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:09 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4[44587]: 2024-09-21T06:06:09.394+0000 7fe46c811640 -1 osd.4 94 *** Got signal Terminated *** 2024-09-21T06:06:09.747 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:09 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4[44587]: 2024-09-21T06:06:09.394+0000 7fe46c811640 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:06:10.122 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:09 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:09.701+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:10.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:09 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:09.889+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:10.622 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:10 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:10.134+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:10.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:10 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:10.469+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:11.123 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:10 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:10.697+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:11.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:10 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:10.907+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:11.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:10 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:10.907+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:11.173 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:10 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:10.871+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:11.448 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:11 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4[44587]: 2024-09-21T06:06:11.171+0000 7fe468dfc640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:44.969834+0000 front 2024-09-21T06:05:44.969931+0000 (oldest deadline 2024-09-21T06:06:10.870020+0000) 2024-09-21T06:06:11.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:11 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:11.163+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:11.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:11 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:11.446+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:11.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:11 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:11.574+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:12.122 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:11 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:11.738+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:12.246 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:12 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4[44587]: 2024-09-21T06:06:12.124+0000 7fe468dfc640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:44.969834+0000 front 2024-09-21T06:05:44.969931+0000 (oldest deadline 2024-09-21T06:06:10.870020+0000) 2024-09-21T06:06:12.247 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:11 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:11.906+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:12.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:11 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:11.915+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:12.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:11 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:11.915+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:12.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:12 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:12.202+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:12.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:12 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:12.441+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:12.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:12 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:12.441+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:12.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:12 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:12.573+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:13.122 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:12 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:12.696+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:13.173 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:12 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:12.877+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:13.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:12 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:12.914+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:13.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:12 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:12.914+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:13.435 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:13 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4[44587]: 2024-09-21T06:06:13.170+0000 7fe468dfc640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:44.969834+0000 front 2024-09-21T06:05:44.969931+0000 (oldest deadline 2024-09-21T06:06:10.870020+0000) 2024-09-21T06:06:13.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:13 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:13.169+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:13.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:13 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:13.432+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:13.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:13 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:13.432+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:13.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:13 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:13.582+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:14.123 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:13 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:13.675+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:14.123 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:13 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:13.638+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:14.174 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:13 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:13.887+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:14.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:13 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:13.955+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:14.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:13 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:13.955+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:14.498 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:14 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4[44587]: 2024-09-21T06:06:14.172+0000 7fe468dfc640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:44.969834+0000 front 2024-09-21T06:05:44.969931+0000 (oldest deadline 2024-09-21T06:06:10.870020+0000) 2024-09-21T06:06:14.498 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:14 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:14.411+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:14.498 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:14 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:14.411+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:14.616 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:14 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:14.173+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:14.872 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:14 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:14.614+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:14.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:14 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:14.704+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:14.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:14 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:14.704+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.259885+0000 front 2024-09-21T06:05:49.259719+0000 (oldest deadline 2024-09-21T06:06:13.959673+0000) 2024-09-21T06:06:14.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:14 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:14.597+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:15.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:14 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:14.862+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:15.246 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:14 smithi067 podman[66727]: 2024-09-21 06:06:14.973700672 +0000 UTC m=+5.712421265 container died 4a98621b4bf958420ed56a770b16d0be3c3fe1e385b982e38ea0a3b4616c4175 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T06:06:15.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:14 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:14.979+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:15.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:14 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:14.979+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:15.598 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:15 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:15.136+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:15.598 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:15 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:15.136+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:15.722 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:15 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:15.405+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:15.722 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:15 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:15.405+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:15.723 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:15 smithi067 podman[66727]: 2024-09-21 06:06:15.478092803 +0000 UTC m=+6.216813395 container cleanup 4a98621b4bf958420ed56a770b16d0be3c3fe1e385b982e38ea0a3b4616c4175 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T06:06:15.723 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:15 smithi067 bash[66727]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4 2024-09-21T06:06:15.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:15 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:15.595+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:15.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:15 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:15.705+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:15.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:15 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:15.705+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.259885+0000 front 2024-09-21T06:05:49.259719+0000 (oldest deadline 2024-09-21T06:06:13.959673+0000) 2024-09-21T06:06:15.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:15 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:15.645+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:15.996 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:15 smithi067 podman[66743]: 2024-09-21 06:06:15.721326511 +0000 UTC m=+0.748755670 container remove 4a98621b4bf958420ed56a770b16d0be3c3fe1e385b982e38ea0a3b4616c4175 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T06:06:15.996 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:15 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:15.850+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:16.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:15 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:15.938+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:16.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:15 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:15.938+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:16.456 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:16 smithi067 podman[66831]: 2024-09-21 06:06:15.944411804 +0000 UTC m=+0.015731920 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:06:16.456 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:16 smithi067 podman[66831]: 2024-09-21 06:06:16.063954494 +0000 UTC m=+0.135274639 container create 0fac5f7dc8909d88fbe65748631a21236923c9aa1bee76e0c78643478f873a6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T06:06:16.619 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:16 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:16.160+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:16.620 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:16 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:16.160+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:16.746 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:16 smithi067 podman[66831]: 2024-09-21 06:06:16.458190656 +0000 UTC m=+0.529510759 container init 0fac5f7dc8909d88fbe65748631a21236923c9aa1bee76e0c78643478f873a6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T06:06:16.747 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:16 smithi067 podman[66831]: 2024-09-21 06:06:16.461640561 +0000 UTC m=+0.532960668 container start 0fac5f7dc8909d88fbe65748631a21236923c9aa1bee76e0c78643478f873a6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:06:16.747 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:16 smithi067 podman[66831]: 2024-09-21 06:06:16.566781107 +0000 UTC m=+0.638101211 container attach 0fac5f7dc8909d88fbe65748631a21236923c9aa1bee76e0c78643478f873a6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T06:06:16.747 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 21 06:06:16 smithi067 podman[66831]: 2024-09-21 06:06:16.657232846 +0000 UTC m=+0.728552958 container died 0fac5f7dc8909d88fbe65748631a21236923c9aa1bee76e0c78643478f873a6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T06:06:16.747 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:16 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:16.453+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:16.747 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:16 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:16.453+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:16.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:16 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:16.618+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:16.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:16 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:16.745+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:16.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:16 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:16.745+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.259885+0000 front 2024-09-21T06:05:49.259719+0000 (oldest deadline 2024-09-21T06:06:13.959673+0000) 2024-09-21T06:06:16.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:16 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:16.598+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:17.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:16 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:16.882+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:17.364 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T06:06:17.406 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:17.407 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T06:06:17.407 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T06:06:17.407 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.5 2024-09-21T06:06:17.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:16 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:16.961+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:17.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:16 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:16.961+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:17.435 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:17 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:17.167+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:17.435 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:17 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:17.167+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:17.729 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:17 smithi144 systemd[1]: Stopping Ceph osd.5 for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:17.729 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:17 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:17.600+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:17.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:17 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:17.494+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:17.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:17 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:17.494+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:17.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:17 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:17.643+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:18.123 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:17 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:17.727+0000 7f1d09769640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:18.123 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:17 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:17.727+0000 7f1d09769640 -1 osd.5 94 *** Got signal Terminated *** 2024-09-21T06:06:18.123 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:17 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:17.727+0000 7f1d09769640 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:06:18.123 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:17 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:17.738+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:18.123 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:17 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:17.738+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.259885+0000 front 2024-09-21T06:05:49.259719+0000 (oldest deadline 2024-09-21T06:06:13.959673+0000) 2024-09-21T06:06:18.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:17 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:17.878+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:18.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:17 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:17.953+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:18.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:17 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:17.953+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:18.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:18 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:18.153+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:18.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:18 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:18.153+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:18.917 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:18 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:18.510+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:18.917 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:18 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:18.510+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:19.123 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:18 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:18.747+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:19.123 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:18 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:18.747+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.259885+0000 front 2024-09-21T06:05:49.259719+0000 (oldest deadline 2024-09-21T06:06:13.959673+0000) 2024-09-21T06:06:19.123 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:18 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:18.629+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:19.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:18 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:18.907+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:19.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:18 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:18.907+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:19.164 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:18 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:18.666+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:19.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:18 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:18.915+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:19.590 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:19 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:19.193+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:19.590 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:19 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:19.193+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:19.590 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:19 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:19.588+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:19.868 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:19 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:19.534+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:19.868 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:19 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:19.534+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:19.872 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:19 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:19.772+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:19.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:19 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:19.772+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.259885+0000 front 2024-09-21T06:05:49.259719+0000 (oldest deadline 2024-09-21T06:06:13.959673+0000) 2024-09-21T06:06:19.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:19.640+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:19.915 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:19.640+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.279661+0000 front 2024-09-21T06:05:55.279853+0000 (oldest deadline 2024-09-21T06:06:18.779675+0000) 2024-09-21T06:06:20.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:19 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:19.866+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:20.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:19.948+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:20.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:19.948+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:20.590 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:20 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:20.224+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:20.590 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:20 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:20.224+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:20.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:20 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:20.765+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:20.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:20 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:20.765+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.259885+0000 front 2024-09-21T06:05:49.259719+0000 (oldest deadline 2024-09-21T06:06:13.959673+0000) 2024-09-21T06:06:20.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:20 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:20.588+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:20.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:20 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:20.588+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:20.900 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:20 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:20.543+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:20.900 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:20 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:20.543+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:20.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:20 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:20.626+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:20.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:20 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:20.626+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.279661+0000 front 2024-09-21T06:05:55.279853+0000 (oldest deadline 2024-09-21T06:06:18.779675+0000) 2024-09-21T06:06:21.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:20 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:20.898+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:21.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:20 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:20.980+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:21.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:20 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:20.980+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:21.619 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:21 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:21.219+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:21.619 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:21 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:21.219+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:21.619 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:21 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:21.219+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:21.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:21 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:21.719+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.056161+0000 front 2024-09-21T06:05:39.055996+0000 (oldest deadline 2024-09-21T06:06:01.956152+0000) 2024-09-21T06:06:21.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:21 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5[44795]: 2024-09-21T06:06:21.719+0000 7f1d01d4c640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.259885+0000 front 2024-09-21T06:05:49.259719+0000 (oldest deadline 2024-09-21T06:06:13.959673+0000) 2024-09-21T06:06:21.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:21 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:21.617+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:21.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:21 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:21.617+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:21.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:21 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:21.622+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:21.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:21 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:21.622+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.279661+0000 front 2024-09-21T06:05:55.279853+0000 (oldest deadline 2024-09-21T06:06:18.779675+0000) 2024-09-21T06:06:21.925 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:21 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:21.513+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:21.925 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:21 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:21.513+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:21.925 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:21 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:21.513+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:22.249 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:21 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:21.923+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:22.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:22 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:22.014+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:22.416 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:22 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:22.014+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:22.595 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:22 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:22.242+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:22.595 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:22 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:22.242+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:22.596 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:22 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:22.242+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:22.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:22 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:22.592+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:22.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:22 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:22.592+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:22.921 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:22 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:22.580+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:22.921 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:22 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:22.580+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.279661+0000 front 2024-09-21T06:05:55.279853+0000 (oldest deadline 2024-09-21T06:06:18.779675+0000) 2024-09-21T06:06:22.939 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:22 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:22.523+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:22.940 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:22 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:22.523+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:22.940 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:22 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:22.523+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:23.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:22 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:22.932+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:23.373 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:23 smithi144 podman[67080]: 2024-09-21 06:06:23.077605379 +0000 UTC m=+5.471973813 container died 6eb2ab0b7dc94041a8eca184a5204efaaf935708648126b869bb7a4a6a11e1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T06:06:23.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:23 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:23.279+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:23.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:23 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:23.279+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:23.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:23 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:23.279+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:23.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:22 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:22.995+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:23.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:22 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:22.995+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:23.730 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:23 smithi144 podman[67080]: 2024-09-21 06:06:23.494109652 +0000 UTC m=+5.888478085 container cleanup 6eb2ab0b7dc94041a8eca184a5204efaaf935708648126b869bb7a4a6a11e1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:06:23.730 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:23 smithi144 bash[67080]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5 2024-09-21T06:06:23.730 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:23 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:23.548+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:23.730 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:23 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:23.548+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:23.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:23.543+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:23.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:23.543+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.279661+0000 front 2024-09-21T06:05:55.279853+0000 (oldest deadline 2024-09-21T06:06:18.779675+0000) 2024-09-21T06:06:23.962 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:23 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:23.567+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:23.963 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:23 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:23.567+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:23.963 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:23 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:23.567+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:24.122 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:23 smithi144 podman[67095]: 2024-09-21 06:06:23.728855896 +0000 UTC m=+0.653009486 container remove 6eb2ab0b7dc94041a8eca184a5204efaaf935708648126b869bb7a4a6a11e1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T06:06:24.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:23 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:23.960+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:24.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:23 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:23.960+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:24.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:23.958+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:24.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:23.958+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:24.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:23 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:23.958+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:24.444 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:24 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:24.242+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:24.444 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:24 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:24.242+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:24.444 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:24 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:24.242+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:24.444 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:24 smithi144 podman[67185]: 2024-09-21 06:06:24.060926441 +0000 UTC m=+0.015762131 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:06:24.444 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:24 smithi144 podman[67185]: 2024-09-21 06:06:24.179882675 +0000 UTC m=+0.134718405 container create 5c5c7ee575541e0e23ee797096e2693948214d9d5f009400746ae045ead5f55f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:06:24.445 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:24 smithi144 podman[67185]: 2024-09-21 06:06:24.44307873 +0000 UTC m=+0.397914419 container init 5c5c7ee575541e0e23ee797096e2693948214d9d5f009400746ae045ead5f55f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T06:06:24.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:24 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:24.572+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:24.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:24 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:24.572+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:24.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:24 smithi144 podman[67185]: 2024-09-21 06:06:24.446368945 +0000 UTC m=+0.401204634 container start 5c5c7ee575541e0e23ee797096e2693948214d9d5f009400746ae045ead5f55f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T06:06:24.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:24 smithi144 podman[67185]: 2024-09-21 06:06:24.543045238 +0000 UTC m=+0.497880927 container attach 5c5c7ee575541e0e23ee797096e2693948214d9d5f009400746ae045ead5f55f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T06:06:24.873 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:06:24 smithi144 podman[67185]: 2024-09-21 06:06:24.639756458 +0000 UTC m=+0.594592161 container died 5c5c7ee575541e0e23ee797096e2693948214d9d5f009400746ae045ead5f55f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-21T06:06:24.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:24 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:24.566+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:24.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:24 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:24.566+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.279661+0000 front 2024-09-21T06:05:55.279853+0000 (oldest deadline 2024-09-21T06:06:18.779675+0000) 2024-09-21T06:06:24.948 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:24 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:24.538+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:24.948 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:24 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:24.538+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:24.948 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:24 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:24.538+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:25.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:24 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:24.946+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:25.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:24 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:24.946+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:25.356 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:25 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:25.260+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:25.356 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:25 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:25.260+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:25.356 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:25 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:25.260+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:25.382 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T06:06:25.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:24 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:24.923+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:25.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:24 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:24.923+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:25.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:24 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:24.923+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:25.459 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:25.460 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T06:06:25.460 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T06:06:25.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.6 2024-09-21T06:06:25.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:25 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:25.551+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:25.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:25 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:25.551+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:25.783 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:25 smithi037 systemd[1]: Stopping Ceph osd.6 for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:25.783 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:25 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:25.584+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:25.783 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:25 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:25.584+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.279661+0000 front 2024-09-21T06:05:55.279853+0000 (oldest deadline 2024-09-21T06:06:18.779675+0000) 2024-09-21T06:06:25.978 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:25 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:25.560+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:25.978 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:25 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:25.560+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:25.979 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:25 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:25.560+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:26.092 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:25 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:25.871+0000 7f2a95200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:26.092 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:25 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:25.871+0000 7f2a95200640 -1 osd.6 94 *** Got signal Terminated *** 2024-09-21T06:06:26.093 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:25 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:25.871+0000 7f2a95200640 -1 osd.6 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:06:26.093 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:25 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:25.896+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:26.093 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:25 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:25.896+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:26.093 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:25 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:25.896+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:26.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:25 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:25.976+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:26.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:25 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:25.976+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:26.526 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:26 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:26.256+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:26.526 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:26 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:26.256+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:26.526 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:26 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:26.256+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:26.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:26 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:26.523+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:26.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:26 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:26.523+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:26.883 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:26 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:26.562+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:26.883 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:26 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:26.562+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.279661+0000 front 2024-09-21T06:05:55.279853+0000 (oldest deadline 2024-09-21T06:06:18.779675+0000) 2024-09-21T06:06:26.977 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:26 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:26.571+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:26.977 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:26 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:26.571+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:26.977 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:26 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:26.571+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:27.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:26 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:26.880+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:27.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:26 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:26.880+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:27.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:26 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:26.880+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:27.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:26 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:26.975+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:27.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:26 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:26.975+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:27.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:26 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:26.975+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.407404+0000 front 2024-09-21T06:06:05.407451+0000 (oldest deadline 2024-09-21T06:06:26.507426+0000) 2024-09-21T06:06:27.545 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:27 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:27.232+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:27.545 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:27 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:27.232+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:27.545 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:27 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:27.232+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:27.872 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:27 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:27.543+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:27.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:27 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:27.543+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:27.887 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:27 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:27.561+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:27.887 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:27 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:27.561+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.279661+0000 front 2024-09-21T06:05:55.279853+0000 (oldest deadline 2024-09-21T06:06:18.779675+0000) 2024-09-21T06:06:27.887 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:27 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:27.561+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.981833+0000 front 2024-09-21T06:06:03.982056+0000 (oldest deadline 2024-09-21T06:06:27.482023+0000) 2024-09-21T06:06:27.935 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:27 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:27.585+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:27.935 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:27 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:27.585+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:27.935 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:27 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:27.585+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:28.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:27 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:27.885+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:28.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:27 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:27.885+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:28.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:27 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:27.885+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:28.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:27 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:27.933+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:28.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:27 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:27.933+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:28.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:27 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:27.933+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.407404+0000 front 2024-09-21T06:06:05.407451+0000 (oldest deadline 2024-09-21T06:06:26.507426+0000) 2024-09-21T06:06:28.550 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:28 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:28.273+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:28.550 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:28 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:28.273+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:28.550 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:28 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:28.273+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:28.872 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:28 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:28.549+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:28.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:28 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:28.549+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:28.908 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:28 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:28.623+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:28.908 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:28 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:28.623+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:28.909 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:28 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:28.623+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:28.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:28 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:28.565+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:28.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:28 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:28.565+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.279661+0000 front 2024-09-21T06:05:55.279853+0000 (oldest deadline 2024-09-21T06:06:18.779675+0000) 2024-09-21T06:06:28.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:28 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:28.565+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.981833+0000 front 2024-09-21T06:06:03.982056+0000 (oldest deadline 2024-09-21T06:06:27.482023+0000) 2024-09-21T06:06:29.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:28 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:28.906+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:29.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:28 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:28.906+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:29.247 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:28 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:28.906+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.407404+0000 front 2024-09-21T06:06:05.407451+0000 (oldest deadline 2024-09-21T06:06:26.507426+0000) 2024-09-21T06:06:29.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:28 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:28.933+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:29.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:28 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:28.933+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:29.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:28 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:28.933+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:29.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:29 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:29.503+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:29.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:29 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:29.503+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:29.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:29 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:29.283+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:29.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:29 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:29.283+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:29.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:29 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:29.283+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:29.879 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:29 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:29.609+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:29.879 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:29 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:29.609+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:29.879 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:29 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:29.609+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:29.879 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:29 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:29.609+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:29.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:29 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:29.594+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:29.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:29 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:29.594+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.279661+0000 front 2024-09-21T06:05:55.279853+0000 (oldest deadline 2024-09-21T06:06:18.779675+0000) 2024-09-21T06:06:29.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:29 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:29.594+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.981833+0000 front 2024-09-21T06:06:03.982056+0000 (oldest deadline 2024-09-21T06:06:27.482023+0000) 2024-09-21T06:06:30.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:29 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:29.877+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:30.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:29 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:29.877+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:30.247 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:29 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:29.877+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.407404+0000 front 2024-09-21T06:06:05.407451+0000 (oldest deadline 2024-09-21T06:06:26.507426+0000) 2024-09-21T06:06:30.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:29 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:29.959+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:30.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:29 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:29.959+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:30.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:29 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:29.959+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:30.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:29 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:29.959+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:30.529 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:30 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:30.254+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:30.529 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:30 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:30.254+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:30.529 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:30 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:30.254+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:30.844 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:30 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:30.589+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:30.844 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:30 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:30.589+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:30.844 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:30 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:30.589+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:30.844 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:30 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:30.589+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:30.872 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:30 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:30.527+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:30.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:30 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:30.527+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:30.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:30 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:30.527+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:30.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:30 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:30.591+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.076269+0000 front 2024-09-21T06:05:49.076357+0000 (oldest deadline 2024-09-21T06:06:10.776458+0000) 2024-09-21T06:06:30.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:30 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:30.591+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.279661+0000 front 2024-09-21T06:05:55.279853+0000 (oldest deadline 2024-09-21T06:06:18.779675+0000) 2024-09-21T06:06:30.914 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:30 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6[57090]: 2024-09-21T06:06:30.591+0000 7f2a90c00640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.981833+0000 front 2024-09-21T06:06:03.982056+0000 (oldest deadline 2024-09-21T06:06:27.482023+0000) 2024-09-21T06:06:31.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:30 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:30.842+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:31.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:30 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:30.842+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:31.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:30 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:30.842+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.407404+0000 front 2024-09-21T06:06:05.407451+0000 (oldest deadline 2024-09-21T06:06:26.507426+0000) 2024-09-21T06:06:31.400 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:30 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:30.966+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:31.400 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:30 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:30.966+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:31.400 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:30 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:30.966+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:31.400 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:30 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:30.966+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:31.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:31 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:31.496+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:31.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:31 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:31.496+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:31.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:31 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:31.496+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:31.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:31 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:31.269+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:31.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:31 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:31.269+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:31.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:31 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:31.269+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:31.664 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:31 smithi037 podman[111775]: 2024-09-21 06:06:31.398751381 +0000 UTC m=+5.647495891 container died fd466fcee6a8e6c8c48e99234569cb6824a2f289bb756709e9fe38860b26237f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:06:31.812 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:31 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:31.548+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:31.812 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:31 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:31.548+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:31.812 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:31 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:31.548+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:31.812 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:31 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:31.548+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:32.007 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:31 smithi037 podman[111775]: 2024-09-21 06:06:31.953981599 +0000 UTC m=+6.202726109 container cleanup fd466fcee6a8e6c8c48e99234569cb6824a2f289bb756709e9fe38860b26237f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T06:06:32.007 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:31 smithi037 bash[111775]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6 2024-09-21T06:06:32.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:31 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:31.810+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:32.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:31 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:31.810+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:32.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:31 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:31.810+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.407404+0000 front 2024-09-21T06:06:05.407451+0000 (oldest deadline 2024-09-21T06:06:26.507426+0000) 2024-09-21T06:06:32.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:32 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:32.004+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:32.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:32 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:32.004+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:32.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:32 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:32.004+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:32.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:32 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:32.004+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:32.415 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:32 smithi037 podman[111803]: 2024-09-21 06:06:32.13937136 +0000 UTC m=+0.731060120 container remove fd466fcee6a8e6c8c48e99234569cb6824a2f289bb756709e9fe38860b26237f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T06:06:32.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:32 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:32.533+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:32.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:32 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:32.533+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:32.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:32 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:32.533+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:32.624 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:32 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:32.310+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:32.624 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:32 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:32.310+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:32.624 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:32 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:32.310+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:32.849 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:32 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:32.595+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:32.849 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:32 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:32.595+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:32.849 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:32 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:32.595+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:32.849 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:32 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:32.595+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:32.960 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:32 smithi037 podman[111890]: 2024-09-21 06:06:32.582277084 +0000 UTC m=+0.028374935 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:06:32.960 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:32 smithi037 podman[111890]: 2024-09-21 06:06:32.723472019 +0000 UTC m=+0.169569857 container create cb31984f59bf91946cac859d28356d55d3f5f9edb903b8557face6bc929dd2bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:06:32.961 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:32 smithi037 podman[111890]: 2024-09-21 06:06:32.959317809 +0000 UTC m=+0.405415650 container init cb31984f59bf91946cac859d28356d55d3f5f9edb903b8557face6bc929dd2bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T06:06:33.234 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:32 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:32.990+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:33.234 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:32 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:32.990+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:33.234 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:32 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:32.990+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:33.234 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:32 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:32.990+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:33.234 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:32 smithi037 podman[111890]: 2024-09-21 06:06:32.966314029 +0000 UTC m=+0.412411873 container start cb31984f59bf91946cac859d28356d55d3f5f9edb903b8557face6bc929dd2bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6-deactivate, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T06:06:33.234 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:33 smithi037 podman[111890]: 2024-09-21 06:06:33.07613333 +0000 UTC m=+0.522231179 container attach cb31984f59bf91946cac859d28356d55d3f5f9edb903b8557face6bc929dd2bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T06:06:33.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:32 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:32.847+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:33.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:32 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:32.847+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:33.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:32 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:32.847+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.407404+0000 front 2024-09-21T06:06:05.407451+0000 (oldest deadline 2024-09-21T06:06:26.507426+0000) 2024-09-21T06:06:33.589 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 06:06:33 smithi037 podman[111890]: 2024-09-21 06:06:33.232970653 +0000 UTC m=+0.679068497 container died cb31984f59bf91946cac859d28356d55d3f5f9edb903b8557face6bc929dd2bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-6-deactivate, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T06:06:33.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:33 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:33.506+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:33.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:33 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:33.506+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:33.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:33 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:33.506+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:33.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:33 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:33.275+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:33.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:33 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:33.275+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:33.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:33 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:33.275+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:33.888 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:33 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:33.612+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:33.888 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:33 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:33.612+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:33.888 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:33 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:33.612+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:33.888 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:33 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:33.612+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:33.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T06:06:34.015 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:34.016 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T06:06:34.016 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T06:06:34.016 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.7 2024-09-21T06:06:34.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:33 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:33.998+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:34.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:33 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:33.998+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:34.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:33 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:33.998+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:34.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:33 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:33.998+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:34.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:33 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:33.886+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:34.247 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:33 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:33.886+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:34.247 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:33 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:33.886+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.407404+0000 front 2024-09-21T06:06:05.407451+0000 (oldest deadline 2024-09-21T06:06:26.507426+0000) 2024-09-21T06:06:34.247 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:34 smithi067 systemd[1]: Stopping Ceph osd.7 for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:34.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:34 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:34.472+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:34.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:34 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:34.472+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:34.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:34 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:34.472+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:34.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:34 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:34.243+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:34.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:34 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:34.243+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:34.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:34 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:34.243+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:34.747 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:34 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:34.339+0000 7f8bf03de640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:34.747 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:34 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:34.339+0000 7f8bf03de640 -1 osd.7 94 *** Got signal Terminated *** 2024-09-21T06:06:34.747 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:34 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:34.339+0000 7f8bf03de640 -1 osd.7 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:06:34.747 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:34 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:34.576+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:34.747 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:34 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:34.576+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:34.747 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:34 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:34.576+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:34.747 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:34 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:34.576+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:35.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:34 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:34.864+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:35.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:34 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:34.864+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:35.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:34 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:34.864+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.407404+0000 front 2024-09-21T06:06:05.407451+0000 (oldest deadline 2024-09-21T06:06:26.507426+0000) 2024-09-21T06:06:35.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:35 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:35.001+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:35.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:35 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:35.001+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:35.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:35 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:35.001+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:35.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:35 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:35.001+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:35.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:35 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:35.439+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:35.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:35 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:35.439+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:35.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:35 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:35.439+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:35.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:35 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:35.224+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:35.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:35 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:35.224+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:35.623 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:35 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:35.224+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:35.820 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:35 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:35.540+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:35.820 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:35 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:35.540+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:35.820 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:35 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:35.540+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:35.820 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:35 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:35.540+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:36.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:35 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:35.818+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:36.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:35 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:35.818+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:36.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:35 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:35.818+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.407404+0000 front 2024-09-21T06:06:05.407451+0000 (oldest deadline 2024-09-21T06:06:26.507426+0000) 2024-09-21T06:06:36.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:35 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:35.988+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:36.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:35 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:35.988+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:36.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:35 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:35.988+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:36.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:35 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:35.988+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:36.450 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:36 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:36.177+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:36.451 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:36 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:36.177+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:36.451 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:36 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:36.177+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:36.770 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:36 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:36.507+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:36.771 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:36 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:36.507+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:36.771 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:36 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:36.507+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:36.771 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:36 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:36.507+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:36.872 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:36 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:36.449+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:36.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:36 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:36.449+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:36.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:36 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:36.449+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:37.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:36 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:36.768+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:37.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:36 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:36.768+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:37.247 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:36 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:36.768+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.407404+0000 front 2024-09-21T06:06:05.407451+0000 (oldest deadline 2024-09-21T06:06:26.507426+0000) 2024-09-21T06:06:37.247 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:36 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:36.768+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.208357+0000 front 2024-09-21T06:06:11.208411+0000 (oldest deadline 2024-09-21T06:06:36.508338+0000) 2024-09-21T06:06:37.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:36 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:36.943+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:37.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:36 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:36.943+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:37.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:36 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:36.943+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:37.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:36 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:36.943+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:37.474 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:37 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:37.164+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:37.474 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:37 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:37.164+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:37.474 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:37 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:37.164+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:37.474 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:37 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:37.164+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:37.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:37 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:37.476+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:37.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:37 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:37.476+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:37.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:37 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:37.476+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:37.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:37 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:37.476+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:37.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:37 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:37.476+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:37.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:37 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:37.472+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:37.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:37 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:37.472+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:37.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:37 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:37.472+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:38.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:37 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:37.808+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:38.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:37 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:37.808+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:38.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:37 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:37.808+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.407404+0000 front 2024-09-21T06:06:05.407451+0000 (oldest deadline 2024-09-21T06:06:26.507426+0000) 2024-09-21T06:06:38.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:37 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:37.808+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.208357+0000 front 2024-09-21T06:06:11.208411+0000 (oldest deadline 2024-09-21T06:06:36.508338+0000) 2024-09-21T06:06:38.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:37 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:37.936+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:38.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:37 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:37.936+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:38.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:37 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:37.936+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:38.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:37 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:37.936+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:38.496 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:38 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:38.178+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:38.496 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:38 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:38.178+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:38.496 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:38 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:38.178+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:38.496 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:38 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:38.178+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:38.783 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:38 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:38.500+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:38.783 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:38 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:38.500+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:38.783 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:38 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:38.500+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:38.783 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:38 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:38.500+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:38.783 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:38 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:38.500+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:38.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:38 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:38.495+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:38.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:38 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:38.495+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:38.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:38 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:38.495+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:38.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:38 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:38.495+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:12.736329+0000 front 2024-09-21T06:06:12.736401+0000 (oldest deadline 2024-09-21T06:06:38.036415+0000) 2024-09-21T06:06:39.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:38 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:38.781+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:45.504488+0000 front 2024-09-21T06:05:45.504433+0000 (oldest deadline 2024-09-21T06:06:10.804595+0000) 2024-09-21T06:06:39.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:38 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:38.781+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.505608+0000 front 2024-09-21T06:05:55.505651+0000 (oldest deadline 2024-09-21T06:06:23.706372+0000) 2024-09-21T06:06:39.246 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:38 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:38.781+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.407404+0000 front 2024-09-21T06:06:05.407451+0000 (oldest deadline 2024-09-21T06:06:26.507426+0000) 2024-09-21T06:06:39.247 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:38 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7[50943]: 2024-09-21T06:06:38.781+0000 7f8be89c1640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.208357+0000 front 2024-09-21T06:06:11.208411+0000 (oldest deadline 2024-09-21T06:06:36.508338+0000) 2024-09-21T06:06:39.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:38 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:38.946+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:39.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:38 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:38.946+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:39.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:38 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:38.946+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:39.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:38 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:38.946+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:39.466 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:39 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:39.157+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:39.466 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:39 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:39.157+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:39.466 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:39 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:39.157+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:39.466 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:39 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:39.157+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:39.812 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:39 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:39.537+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:39.812 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:39 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:39.537+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:39.813 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:39 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:39.537+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:39.813 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:39 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:39.537+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:39.813 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:39 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:39.537+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:39.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:39 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:39.464+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:39.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:39 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:39.464+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:39.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:39 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:39.464+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:39.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:39 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:39.464+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:12.736329+0000 front 2024-09-21T06:06:12.736401+0000 (oldest deadline 2024-09-21T06:06:38.036415+0000) 2024-09-21T06:06:40.108 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:39 smithi067 podman[66934]: 2024-09-21 06:06:39.811175448 +0000 UTC m=+5.589779540 container died 817a4017e49fb518a76f6276623f15991a30191e4c976bdc6b794debc6735696 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T06:06:40.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:39 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:39.949+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:40.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:39 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:39.949+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:40.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:39 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:39.949+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:40.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:39 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:39.949+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:40.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:39 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:39.949+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:40.437 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:40 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:40.142+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:40.437 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:40 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:40.142+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:40.437 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:40 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:40.142+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:40.437 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:40 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:40.142+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:40.467 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:40 smithi067 podman[66934]: 2024-09-21 06:06:40.206760275 +0000 UTC m=+5.985364357 container cleanup 817a4017e49fb518a76f6276623f15991a30191e4c976bdc6b794debc6735696 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:06:40.467 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:40 smithi067 bash[66934]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7 2024-09-21T06:06:40.746 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:40 smithi067 podman[66950]: 2024-09-21 06:06:40.466143616 +0000 UTC m=+0.657737492 container remove 817a4017e49fb518a76f6276623f15991a30191e4c976bdc6b794debc6735696 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T06:06:40.746 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:40 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:40.526+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:40.747 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:40 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:40.526+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:40.747 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:40 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:40.526+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:40.747 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:40 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:40.526+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:40.747 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:40 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:40.526+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:40.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:40 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:40.435+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:40.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:40 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:40.435+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:40.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:40 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:40.435+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:40.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:40 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:40.435+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:12.736329+0000 front 2024-09-21T06:06:12.736401+0000 (oldest deadline 2024-09-21T06:06:38.036415+0000) 2024-09-21T06:06:41.079 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:40 smithi067 podman[67038]: 2024-09-21 06:06:40.679590935 +0000 UTC m=+0.015532323 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:06:41.079 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:40 smithi067 podman[67038]: 2024-09-21 06:06:40.808913502 +0000 UTC m=+0.144854885 container create 2b9ec731bcf68f0c5a240bd84fc0d52bc076b78f552409e93a8ec067d824c8e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:06:41.406 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:41 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:41.129+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:41.406 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:41 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:41.129+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:41.406 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:41 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:41.129+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:41.406 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:41 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:41.129+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:41.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:40 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:40.979+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:41.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:40 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:40.979+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:41.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:40 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:40.979+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:41.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:40 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:40.979+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:41.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:40 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:40.979+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:41.496 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:41 smithi067 podman[67038]: 2024-09-21 06:06:41.077936577 +0000 UTC m=+0.413877961 container init 2b9ec731bcf68f0c5a240bd84fc0d52bc076b78f552409e93a8ec067d824c8e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-09-21T06:06:41.496 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:41 smithi067 podman[67038]: 2024-09-21 06:06:41.081331494 +0000 UTC m=+0.417272872 container start 2b9ec731bcf68f0c5a240bd84fc0d52bc076b78f552409e93a8ec067d824c8e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T06:06:41.496 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:41 smithi067 podman[67038]: 2024-09-21 06:06:41.186496429 +0000 UTC m=+0.522437816 container attach 2b9ec731bcf68f0c5a240bd84fc0d52bc076b78f552409e93a8ec067d824c8e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T06:06:41.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 21 06:06:41 smithi067 podman[67038]: 2024-09-21 06:06:41.274759606 +0000 UTC m=+0.610700984 container died 2b9ec731bcf68f0c5a240bd84fc0d52bc076b78f552409e93a8ec067d824c8e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-7-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T06:06:41.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:41 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:41.404+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:41.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:41 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:41.404+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:41.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:41 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:41.404+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:41.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:41 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:41.404+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:12.736329+0000 front 2024-09-21T06:06:12.736401+0000 (oldest deadline 2024-09-21T06:06:38.036415+0000) 2024-09-21T06:06:41.908 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:41 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:41.534+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:41.909 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:41 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:41.534+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:41.909 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:41 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:41.534+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:41.909 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:41 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:41.534+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:41.909 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:41 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:41.534+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:41.936 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T06:06:41.972 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:41.973 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T06:06:41.973 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T06:06:41.973 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.8 2024-09-21T06:06:42.359 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:42 smithi144 systemd[1]: Stopping Ceph osd.8 for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:42.359 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:42 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:42.108+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:42.360 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:42 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:42.108+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:42.360 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:42 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:42.108+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:42.360 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:42 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:42.108+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:42.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:41 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:41.978+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:42.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:41 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:41.978+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:42.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:41 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:41.978+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:42.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:41 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:41.978+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:42.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:41 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:41.978+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:42.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:42 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:42.357+0000 7efe0ea20640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:42.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:42 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:42.357+0000 7efe0ea20640 -1 osd.8 94 *** Got signal Terminated *** 2024-09-21T06:06:42.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:42 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:42.357+0000 7efe0ea20640 -1 osd.8 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:06:42.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:42 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:42.395+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:42.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:42 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:42.395+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:42.624 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:42 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:42.395+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:42.624 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:42 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:42.395+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:12.736329+0000 front 2024-09-21T06:06:12.736401+0000 (oldest deadline 2024-09-21T06:06:38.036415+0000) 2024-09-21T06:06:42.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:42 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:42.559+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:42.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:42 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:42.559+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:42.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:42 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:42.559+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:42.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:42 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:42.559+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:42.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:42 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:42.559+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:43.313 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:43 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:43.008+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:43.313 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:43 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:43.008+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:43.313 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:43 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:43.008+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:43.313 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:43 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:43.008+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:43.313 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:43 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:43.008+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:43.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:43 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:43.073+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:43.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:43 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:43.073+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:43.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:43 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:43.073+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:43.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:43 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:43.073+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:43.635 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:43 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:43.434+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:43.636 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:43 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:43.434+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:43.636 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:43 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:43.434+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:43.636 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:43 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:43.434+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:12.736329+0000 front 2024-09-21T06:06:12.736401+0000 (oldest deadline 2024-09-21T06:06:38.036415+0000) 2024-09-21T06:06:43.636 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:43 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:43.434+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:19.037443+0000 front 2024-09-21T06:06:19.037496+0000 (oldest deadline 2024-09-21T06:06:43.137538+0000) 2024-09-21T06:06:43.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:43 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:43.574+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:43.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:43 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:43.574+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:43.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:43 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:43.574+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:43.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:43 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:43.574+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:43.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:43 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:43.574+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:44.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:44 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:44.056+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:44.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:44 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:44.056+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:44.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:44 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:44.056+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:44.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:44 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:44.056+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:44.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:44 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:44.056+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:44.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:43 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:43.968+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:44.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:43 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:43.968+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:44.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:43 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:43.968+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:44.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:43 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:43.968+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:44.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:43 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:43.968+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:44.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:44 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:44.439+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:44.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:44 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:44.439+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:44.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:44 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:44.439+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:44.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:44 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:44.439+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:12.736329+0000 front 2024-09-21T06:06:12.736401+0000 (oldest deadline 2024-09-21T06:06:38.036415+0000) 2024-09-21T06:06:44.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:44 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:44.439+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:19.037443+0000 front 2024-09-21T06:06:19.037496+0000 (oldest deadline 2024-09-21T06:06:43.137538+0000) 2024-09-21T06:06:44.898 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:44 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:44.612+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:44.898 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:44 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:44.612+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:44.898 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:44 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:44.612+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:44.898 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:44 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:44.612+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:44.898 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:44 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:44.612+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:45.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:45 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:45.036+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:45.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:45 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:45.036+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:45.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:45 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:45.036+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:45.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:45 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:45.036+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:45.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:45 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:45.036+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:45.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:44 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:44.992+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:45.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:44 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:44.992+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:45.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:44 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:44.992+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:45.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:44 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:44.992+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:45.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:44 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:44.992+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:45.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:45 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:45.409+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:45.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:45 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:45.409+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:45.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:45 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:45.409+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:45.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:45 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:45.409+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:12.736329+0000 front 2024-09-21T06:06:12.736401+0000 (oldest deadline 2024-09-21T06:06:38.036415+0000) 2024-09-21T06:06:45.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:45 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:45.409+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:19.037443+0000 front 2024-09-21T06:06:19.037496+0000 (oldest deadline 2024-09-21T06:06:43.137538+0000) 2024-09-21T06:06:45.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:45 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:45.579+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:45.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:45 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:45.579+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:45.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:45 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:45.579+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:45.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:45 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:45.579+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:45.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:45 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:45.579+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:46.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:46.017+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:46.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:46.017+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:46.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:46.017+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:46.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:46.017+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:46.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:46.017+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:46.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:46 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:46.034+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:46.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:46 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:46.034+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:46.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:46 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:46.034+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:46.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:46 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:46.034+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:46.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:46 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:46.034+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:46.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:46 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:46.034+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.952513+0000 front 2024-09-21T06:06:21.952564+0000 (oldest deadline 2024-09-21T06:06:45.452119+0000) 2024-09-21T06:06:46.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:46.458+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:47.632145+0000 front 2024-09-21T06:05:47.632167+0000 (oldest deadline 2024-09-21T06:06:12.932234+0000) 2024-09-21T06:06:46.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:46.458+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:57.633202+0000 front 2024-09-21T06:05:57.633225+0000 (oldest deadline 2024-09-21T06:06:19.834031+0000) 2024-09-21T06:06:46.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:46.458+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.735269+0000 front 2024-09-21T06:06:05.735415+0000 (oldest deadline 2024-09-21T06:06:29.835282+0000) 2024-09-21T06:06:46.874 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:46.458+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:12.736329+0000 front 2024-09-21T06:06:12.736401+0000 (oldest deadline 2024-09-21T06:06:38.036415+0000) 2024-09-21T06:06:46.874 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8[51419]: 2024-09-21T06:06:46.458+0000 7efe07003640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:19.037443+0000 front 2024-09-21T06:06:19.037496+0000 (oldest deadline 2024-09-21T06:06:43.137538+0000) 2024-09-21T06:06:46.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:46 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:46.606+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:46.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:46 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:46.606+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:46.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:46 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:46.606+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:46.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:46 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:46.606+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:46.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:46 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:46.606+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:47.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:46.973+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:47.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:46.973+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:47.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:46.973+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:47.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:46.973+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:47.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:46 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:46.973+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:47.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:47 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:47.071+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:47.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:47 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:47.071+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:47.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:47 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:47.071+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:47.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:47 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:47.071+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:47.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:47 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:47.071+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:47.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:47 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:47.071+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.952513+0000 front 2024-09-21T06:06:21.952564+0000 (oldest deadline 2024-09-21T06:06:45.452119+0000) 2024-09-21T06:06:47.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:47 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:47.654+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:47.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:47 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:47.654+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:47.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:47 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:47.654+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:47.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:47 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:47.654+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:47.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:47 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:47.654+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:47.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:47 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:47.654+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:06:48.177 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:47 smithi144 podman[67287]: 2024-09-21 06:06:47.876827821 +0000 UTC m=+5.711220088 container died af8a4901297ea5d1f7c798cb9fcdacf48a3b0f87a5b044340a5933325ea08e61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T06:06:48.177 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:47 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:47.938+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:48.177 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:47 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:47.938+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:48.177 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:47 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:47.938+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:48.177 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:47 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:47.938+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:48.177 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:47 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:47.938+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:48.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:48.115+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:48.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:48.115+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:48.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:48.115+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:48.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:48.115+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:48.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:48.115+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:48.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:48 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:48.115+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.952513+0000 front 2024-09-21T06:06:21.952564+0000 (oldest deadline 2024-09-21T06:06:45.452119+0000) 2024-09-21T06:06:48.527 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:48 smithi144 podman[67287]: 2024-09-21 06:06:48.282888877 +0000 UTC m=+6.117281146 container cleanup af8a4901297ea5d1f7c798cb9fcdacf48a3b0f87a5b044340a5933325ea08e61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T06:06:48.527 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:48 smithi144 bash[67287]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8 2024-09-21T06:06:48.872 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:48 smithi144 podman[67317]: 2024-09-21 06:06:48.525983746 +0000 UTC m=+0.645679680 container remove af8a4901297ea5d1f7c798cb9fcdacf48a3b0f87a5b044340a5933325ea08e61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:06:48.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:48 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:48.685+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:48.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:48 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:48.685+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:48.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:48 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:48.685+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:48.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:48 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:48.685+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:48.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:48 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:48.685+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:48.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:48 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:48.685+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:06:49.222 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:48 smithi144 podman[67404]: 2024-09-21 06:06:48.849779387 +0000 UTC m=+0.015555114 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:06:49.223 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:48 smithi144 podman[67404]: 2024-09-21 06:06:48.985087593 +0000 UTC m=+0.150863365 container create 04a368d11cba01febc4b978c21ed584b7c2619b7ecd6e8585e4657cb42e323f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:06:49.223 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:49 smithi144 podman[67404]: 2024-09-21 06:06:49.221208194 +0000 UTC m=+0.386983920 container init 04a368d11cba01febc4b978c21ed584b7c2619b7ecd6e8585e4657cb42e323f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T06:06:49.223 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:48 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:48.935+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:49.223 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:48 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:48.935+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:49.224 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:48 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:48.935+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:49.224 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:48 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:48.935+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:49.224 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:48 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:48.935+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:49.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:49 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:49.103+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:49.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:49 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:49.103+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:49.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:49 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:49.103+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:49.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:49 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:49.103+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:49.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:49 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:49.103+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:49.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:49 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:49.103+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.952513+0000 front 2024-09-21T06:06:21.952564+0000 (oldest deadline 2024-09-21T06:06:45.452119+0000) 2024-09-21T06:06:49.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:49 smithi144 podman[67404]: 2024-09-21 06:06:49.224800115 +0000 UTC m=+0.390575842 container start 04a368d11cba01febc4b978c21ed584b7c2619b7ecd6e8585e4657cb42e323f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T06:06:49.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:49 smithi144 podman[67404]: 2024-09-21 06:06:49.321178619 +0000 UTC m=+0.486954351 container attach 04a368d11cba01febc4b978c21ed584b7c2619b7ecd6e8585e4657cb42e323f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T06:06:49.623 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:06:49 smithi144 podman[67404]: 2024-09-21 06:06:49.413244117 +0000 UTC m=+0.579019851 container died 04a368d11cba01febc4b978c21ed584b7c2619b7ecd6e8585e4657cb42e323f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:06:49.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:49 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:49.714+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:49.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:49 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:49.714+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:49.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:49 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:49.714+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:49.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:49 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:49.714+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:49.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:49 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:49.714+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:49.998 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:49 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:49.714+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:06:50.193 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:49 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:49.981+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:50.193 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:49 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:49.981+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:50.194 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:49 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:49.981+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:50.194 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:49 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:49.981+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:50.194 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:49 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:49.981+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:50.225 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T06:06:50.269 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:50.270 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T06:06:50.270 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T06:06:50.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.9 2024-09-21T06:06:50.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:50 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:50.112+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:50.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:50 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:50.112+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:50.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:50 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:50.112+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:50.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:50 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:50.112+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:50.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:50 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:50.112+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:50.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:50 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:50.112+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.952513+0000 front 2024-09-21T06:06:21.952564+0000 (oldest deadline 2024-09-21T06:06:45.452119+0000) 2024-09-21T06:06:50.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:50 smithi037 systemd[1]: Stopping Ceph osd.9 for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:50.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:50 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:50.679+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:50.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:50 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:50.679+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:50.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:50 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:50.679+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:50.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:50 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:50.679+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:50.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:50 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:50.679+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:50.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:50 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:50.679+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:06:51.116 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:50 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:50.668+0000 7fcd59600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:51.116 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:50 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:50.668+0000 7fcd59600640 -1 osd.9 94 *** Got signal Terminated *** 2024-09-21T06:06:51.116 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:50 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:50.668+0000 7fcd59600640 -1 osd.9 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:06:51.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:50 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:50.946+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:51.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:50 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:50.946+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:51.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:50 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:50.946+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:51.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:50 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:50.946+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:51.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:50 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:50.946+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:51.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:51 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:51.115+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:51.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:51 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:51.115+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:51.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:51 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:51.115+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:51.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:51 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:51.115+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:51.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:51 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:51.115+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:51.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:51 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:51.115+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.952513+0000 front 2024-09-21T06:06:21.952564+0000 (oldest deadline 2024-09-21T06:06:45.452119+0000) 2024-09-21T06:06:51.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:51 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:51.710+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:51.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:51 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:51.710+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:51.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:51 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:51.710+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:51.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:51 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:51.710+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:51.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:51 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:51.710+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:51.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:51 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:51.710+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:06:52.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:51 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:51.990+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:52.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:51 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:51.990+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:52.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:51 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:51.990+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:52.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:51 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:51.990+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:52.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:51 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:51.990+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:52.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:52 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:52.105+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:52.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:52 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:52.105+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:52.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:52 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:52.105+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:52.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:52 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:52.105+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:52.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:52 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:52.105+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:52.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:52 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:52.105+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.952513+0000 front 2024-09-21T06:06:21.952564+0000 (oldest deadline 2024-09-21T06:06:45.452119+0000) 2024-09-21T06:06:52.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:52 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:52.691+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:52.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:52 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:52.691+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:52.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:52 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:52.691+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:52.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:52 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:52.691+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:52.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:52 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:52.691+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:52.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:52 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:52.691+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:06:52.998 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:52 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:52.691+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.762613+0000 front 2024-09-21T06:06:26.762651+0000 (oldest deadline 2024-09-21T06:06:52.062616+0000) 2024-09-21T06:06:53.374 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:53 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:53.000+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:53.375 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:53 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:53.000+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:53.375 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:53 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:53.000+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:53.375 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:53 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:53.000+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:53.375 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:53 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:53.000+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:53.375 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:53 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:53.000+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:06:53.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:53 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:53.118+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:53.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:53 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:53.118+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:53.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:53 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:53.118+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:53.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:53 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:53.118+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:53.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:53 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:53.118+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:53.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:53 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:53.118+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.952513+0000 front 2024-09-21T06:06:21.952564+0000 (oldest deadline 2024-09-21T06:06:45.452119+0000) 2024-09-21T06:06:53.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:53 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:53.700+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:53.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:53 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:53.700+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:53.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:53 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:53.700+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:53.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:53 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:53.700+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:53.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:53 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:53.700+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:53.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:53 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:53.700+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:06:53.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:53 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:53.700+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.762613+0000 front 2024-09-21T06:06:26.762651+0000 (oldest deadline 2024-09-21T06:06:52.062616+0000) 2024-09-21T06:06:54.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:54 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:54.047+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:54.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:54 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:54.047+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:54.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:54 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:54.047+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:54.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:54 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:54.047+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:54.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:54 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:54.047+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:54.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:54 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:54.047+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:06:54.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:54 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:54.103+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:54.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:54 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:54.103+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:54.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:54 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:54.103+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:54.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:54 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:54.103+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:54.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:54 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:54.103+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:54.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:54 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:54.103+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.952513+0000 front 2024-09-21T06:06:21.952564+0000 (oldest deadline 2024-09-21T06:06:45.452119+0000) 2024-09-21T06:06:54.982 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:54 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:54.722+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:54.982 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:54 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:54.722+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:54.982 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:54 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:54.722+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:54.983 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:54 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:54.722+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:54.983 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:54 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:54.722+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:54.983 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:54 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:54.722+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:06:54.983 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:54 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:54.722+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.762613+0000 front 2024-09-21T06:06:26.762651+0000 (oldest deadline 2024-09-21T06:06:52.062616+0000) 2024-09-21T06:06:55.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:55 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:55.020+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:55.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:55 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:55.020+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:55.022 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:55 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:55.020+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:55.372 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:55 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:55.020+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:55.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:55 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:55.020+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:55.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:55 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:55.020+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:06:55.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:55 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:55.054+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:39.246160+0000 front 2024-09-21T06:05:39.246798+0000 (oldest deadline 2024-09-21T06:06:06.846757+0000) 2024-09-21T06:06:55.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:55 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:55.054+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.847613+0000 front 2024-09-21T06:05:46.847383+0000 (oldest deadline 2024-09-21T06:06:10.347288+0000) 2024-09-21T06:06:55.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:55 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:55.054+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:52.549496+0000 front 2024-09-21T06:05:52.549225+0000 (oldest deadline 2024-09-21T06:06:23.749565+0000) 2024-09-21T06:06:55.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:55 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:55.054+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:03.749983+0000 front 2024-09-21T06:06:03.750027+0000 (oldest deadline 2024-09-21T06:06:29.049960+0000) 2024-09-21T06:06:55.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:55 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:55.054+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:13.751035+0000 front 2024-09-21T06:06:13.751058+0000 (oldest deadline 2024-09-21T06:06:39.051191+0000) 2024-09-21T06:06:55.415 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:55 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9[63479]: 2024-09-21T06:06:55.054+0000 7fcd50000640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.952513+0000 front 2024-09-21T06:06:21.952564+0000 (oldest deadline 2024-09-21T06:06:45.452119+0000) 2024-09-21T06:06:56.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:55 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:55.753+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:56.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:55 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:55.753+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:56.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:55 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:55.753+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:56.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:55 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:55.753+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:56.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:55 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:55.753+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:56.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:55 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:55.753+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:06:56.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:55 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:55.753+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.762613+0000 front 2024-09-21T06:06:26.762651+0000 (oldest deadline 2024-09-21T06:06:52.062616+0000) 2024-09-21T06:06:56.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:55 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:55.978+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:56.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:55 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:55.978+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:56.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:55 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:55.978+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:56.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:55 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:55.978+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:56.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:55 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:55.978+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:56.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:55 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:55.978+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:06:56.414 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:56 smithi037 podman[111991]: 2024-09-21 06:06:56.15354997 +0000 UTC m=+5.595866048 container died 0ab81d673621657f18efae38d3b3b4d502d00f47045a16ba8a2513eee1570c2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T06:06:56.902 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:56 smithi037 podman[111991]: 2024-09-21 06:06:56.63241196 +0000 UTC m=+6.074728038 container cleanup 0ab81d673621657f18efae38d3b3b4d502d00f47045a16ba8a2513eee1570c2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T06:06:56.902 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:56 smithi037 bash[111991]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9 2024-09-21T06:06:57.164 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:56 smithi037 podman[112019]: 2024-09-21 06:06:56.900479444 +0000 UTC m=+0.736444474 container remove 0ab81d673621657f18efae38d3b3b4d502d00f47045a16ba8a2513eee1570c2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:06:57.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:56 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:56.757+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:57.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:56 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:56.757+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:57.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:56 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:56.757+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:57.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:56 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:56.757+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:57.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:56 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:56.757+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:57.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:56 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:56.757+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:06:57.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:56 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:56.757+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.762613+0000 front 2024-09-21T06:06:26.762651+0000 (oldest deadline 2024-09-21T06:06:52.062616+0000) 2024-09-21T06:06:57.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:56 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:56.976+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:57.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:56 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:56.976+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:57.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:56 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:56.976+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:57.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:56 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:56.976+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:57.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:56 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:56.976+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:57.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:56 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:56.976+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:06:57.637 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:57 smithi037 podman[112103]: 2024-09-21 06:06:57.260090358 +0000 UTC m=+0.027389026 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:06:57.637 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:57 smithi037 podman[112103]: 2024-09-21 06:06:57.376351892 +0000 UTC m=+0.143650559 container create 4d89b959ac15ecc57fa5f94e3eb2cc84436b33275bed11c5ba927ff2bb8f21a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:06:57.914 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:57 smithi037 podman[112103]: 2024-09-21 06:06:57.762243518 +0000 UTC m=+0.529542185 container init 4d89b959ac15ecc57fa5f94e3eb2cc84436b33275bed11c5ba927ff2bb8f21a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:06:57.914 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:57 smithi037 podman[112103]: 2024-09-21 06:06:57.769225503 +0000 UTC m=+0.536524176 container start 4d89b959ac15ecc57fa5f94e3eb2cc84436b33275bed11c5ba927ff2bb8f21a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T06:06:57.914 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:57 smithi037 podman[112103]: 2024-09-21 06:06:57.845232095 +0000 UTC m=+0.612530772 container attach 4d89b959ac15ecc57fa5f94e3eb2cc84436b33275bed11c5ba927ff2bb8f21a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T06:06:57.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:57 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:57.719+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:57.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:57 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:57.719+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:57.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:57 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:57.719+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:57.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:57 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:57.719+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:57.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:57 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:57.719+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:57.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:57 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:57.719+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:06:57.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:57 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:57.719+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.762613+0000 front 2024-09-21T06:06:26.762651+0000 (oldest deadline 2024-09-21T06:06:52.062616+0000) 2024-09-21T06:06:58.291 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 06:06:58 smithi037 podman[112103]: 2024-09-21 06:06:58.018665548 +0000 UTC m=+0.785964226 container died 4d89b959ac15ecc57fa5f94e3eb2cc84436b33275bed11c5ba927ff2bb8f21a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:06:58.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:57 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:57.975+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:58.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:57 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:57.975+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:58.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:57 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:57.975+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:58.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:57 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:57.975+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:58.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:57 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:57.975+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:58.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:57 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:57.975+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:06:58.704 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T06:06:58.780 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:06:58.781 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T06:06:58.781 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T06:06:58.781 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.10 2024-09-21T06:06:59.070 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:58 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:58.766+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:06:59.070 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:58 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:58.766+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:06:59.070 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:58 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:58.766+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:06:59.070 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:58 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:58.766+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:06:59.070 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:58 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:58.766+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:06:59.070 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:58 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:58.766+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:06:59.070 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:58 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:58.766+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.762613+0000 front 2024-09-21T06:06:26.762651+0000 (oldest deadline 2024-09-21T06:06:52.062616+0000) 2024-09-21T06:06:59.070 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:58 smithi067 systemd[1]: Stopping Ceph osd.10 for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:06:59.070 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:59 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:59.066+0000 7f01643d8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:06:59.070 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:59 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:59.066+0000 7f01643d8640 -1 osd.10 94 *** Got signal Terminated *** 2024-09-21T06:06:59.070 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:59 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:59.066+0000 7f01643d8640 -1 osd.10 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:06:59.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:58 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:58.959+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:06:59.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:58 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:58.959+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:06:59.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:58 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:58.959+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:06:59.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:58 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:58.959+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:06:59.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:58 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:58.959+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:06:59.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:58 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:58.959+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:07:00.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:59 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:59.802+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:07:00.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:59 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:59.802+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:07:00.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:59 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:59.802+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:07:00.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:59 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:59.802+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:07:00.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:59 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:59.802+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:07:00.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:59 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:59.802+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:07:00.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:06:59 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:06:59.802+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.762613+0000 front 2024-09-21T06:06:26.762651+0000 (oldest deadline 2024-09-21T06:06:52.062616+0000) 2024-09-21T06:07:00.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:59 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:59.989+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:07:00.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:59 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:59.989+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:07:00.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:59 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:59.989+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:07:00.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:59 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:59.989+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:07:00.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:59 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:59.989+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:07:00.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:06:59 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:06:59.989+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:07:01.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:00 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:00.815+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:07:01.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:00 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:00.815+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:07:01.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:00 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:00.815+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:07:01.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:00 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:00.815+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:07:01.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:00 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:00.815+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:07:01.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:00 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:00.815+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:07:01.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:00 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:00.815+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.762613+0000 front 2024-09-21T06:06:26.762651+0000 (oldest deadline 2024-09-21T06:06:52.062616+0000) 2024-09-21T06:07:01.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:00 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:00.996+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:07:01.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:00 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:00.996+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:07:01.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:00 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:00.996+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:07:01.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:00 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:00.996+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:07:01.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:00 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:00.996+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:07:01.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:00 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:00.996+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:07:02.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:01 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:01.813+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:07:02.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:01 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:01.813+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:07:02.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:01 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:01.813+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:07:02.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:01 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:01.813+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:07:02.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:01 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:01.813+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:07:02.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:01 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:01.813+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:07:02.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:01 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:01.813+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.762613+0000 front 2024-09-21T06:06:26.762651+0000 (oldest deadline 2024-09-21T06:06:52.062616+0000) 2024-09-21T06:07:02.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.024+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:07:02.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.024+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:07:02.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.024+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:07:02.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.024+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:07:02.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.024+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:07:02.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.024+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:07:02.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.024+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-21T06:06:36.945892+0000 front 2024-09-21T06:06:36.945879+0000 (oldest deadline 2024-09-21T06:07:01.045666+0000) 2024-09-21T06:07:03.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:02 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:02.801+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:07:03.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:02 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:02.801+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:07:03.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:02 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:02.801+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:07:03.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:02 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:02.801+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:07:03.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:02 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:02.801+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:07:03.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:02 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:02.801+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:07:03.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:02 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:02.801+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.762613+0000 front 2024-09-21T06:06:26.762651+0000 (oldest deadline 2024-09-21T06:06:52.062616+0000) 2024-09-21T06:07:03.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:07:03.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:07:03.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:07:03.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:07:03.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:07:03.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:07:03.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:02 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:02.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-21T06:06:36.945892+0000 front 2024-09-21T06:06:36.945879+0000 (oldest deadline 2024-09-21T06:07:01.045666+0000) 2024-09-21T06:07:04.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:03 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:03.762+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:36.055296+0000 front 2024-09-21T06:05:36.055256+0000 (oldest deadline 2024-09-21T06:06:02.455511+0000) 2024-09-21T06:07:04.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:03 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:03.762+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:46.357394+0000 front 2024-09-21T06:05:46.357522+0000 (oldest deadline 2024-09-21T06:06:11.657376+0000) 2024-09-21T06:07:04.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:03 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:03.762+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:55.658817+0000 front 2024-09-21T06:05:55.659035+0000 (oldest deadline 2024-09-21T06:06:20.958893+0000) 2024-09-21T06:07:04.246 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:03 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:03.762+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T06:06:05.060166+0000 front 2024-09-21T06:06:05.060300+0000 (oldest deadline 2024-09-21T06:06:29.159804+0000) 2024-09-21T06:07:04.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:03 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:03.762+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:09.160437+0000 front 2024-09-21T06:06:09.160406+0000 (oldest deadline 2024-09-21T06:06:37.360984+0000) 2024-09-21T06:07:04.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:03 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:03.762+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:22.662181+0000 front 2024-09-21T06:06:22.662118+0000 (oldest deadline 2024-09-21T06:06:46.762018+0000) 2024-09-21T06:07:04.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:03 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10[57468]: 2024-09-21T06:07:03.762+0000 7f01609c3640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.762613+0000 front 2024-09-21T06:06:26.762651+0000 (oldest deadline 2024-09-21T06:06:52.062616+0000) 2024-09-21T06:07:04.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.008+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:07:04.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.008+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:07:04.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.008+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:07:04.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.008+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:07:04.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.008+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:07:04.374 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.008+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:07:04.374 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.008+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-21T06:06:36.945892+0000 front 2024-09-21T06:06:36.945879+0000 (oldest deadline 2024-09-21T06:07:01.045666+0000) 2024-09-21T06:07:04.686 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:04 smithi067 podman[67154]: 2024-09-21 06:07:04.430906556 +0000 UTC m=+5.449452733 container died d940274a7e218e792604cb597ef0394a230597ce83bcae319aa7f3b925adb747 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T06:07:04.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:04 smithi067 podman[67154]: 2024-09-21 06:07:04.784538969 +0000 UTC m=+5.803085184 container cleanup d940274a7e218e792604cb597ef0394a230597ce83bcae319aa7f3b925adb747 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:07:04.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:04 smithi067 bash[67154]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10 2024-09-21T06:07:05.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:07:05.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:07:05.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:07:05.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:07:05.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:07:05.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:07:05.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:04 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:04.984+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-21T06:06:36.945892+0000 front 2024-09-21T06:06:36.945879+0000 (oldest deadline 2024-09-21T06:07:01.045666+0000) 2024-09-21T06:07:05.398 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:05 smithi067 podman[67169]: 2024-09-21 06:07:05.069009505 +0000 UTC m=+0.635759339 container remove d940274a7e218e792604cb597ef0394a230597ce83bcae319aa7f3b925adb747 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:07:05.698 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:05 smithi067 podman[67258]: 2024-09-21 06:07:05.299340962 +0000 UTC m=+0.015716774 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:07:05.698 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:05 smithi067 podman[67258]: 2024-09-21 06:07:05.403091832 +0000 UTC m=+0.119467627 container create 3c13d0c3eb89b885018a5ce4c8105b80cd4cb990abe872fcbd8a2e209ef03f7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T06:07:05.698 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:05 smithi067 podman[67258]: 2024-09-21 06:07:05.622096888 +0000 UTC m=+0.338472707 container init 3c13d0c3eb89b885018a5ce4c8105b80cd4cb990abe872fcbd8a2e209ef03f7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T06:07:05.698 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:05 smithi067 podman[67258]: 2024-09-21 06:07:05.625275941 +0000 UTC m=+0.341651737 container start 3c13d0c3eb89b885018a5ce4c8105b80cd4cb990abe872fcbd8a2e209ef03f7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T06:07:05.699 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:05 smithi067 podman[67258]: 2024-09-21 06:07:05.696982238 +0000 UTC m=+0.413358038 container attach 3c13d0c3eb89b885018a5ce4c8105b80cd4cb990abe872fcbd8a2e209ef03f7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T06:07:05.996 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 21 06:07:05 smithi067 podman[67258]: 2024-09-21 06:07:05.815321356 +0000 UTC m=+0.531697163 container died 3c13d0c3eb89b885018a5ce4c8105b80cd4cb990abe872fcbd8a2e209ef03f7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T06:07:06.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:05 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:05.940+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:07:06.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:05 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:05.940+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:07:06.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:05 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:05.940+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:07:06.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:05 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:05.940+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:07:06.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:05 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:05.940+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:07:06.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:05 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:05.940+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:07:06.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:05 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:05.940+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-21T06:06:36.945892+0000 front 2024-09-21T06:06:36.945879+0000 (oldest deadline 2024-09-21T06:07:01.045666+0000) 2024-09-21T06:07:06.432 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T06:07:06.469 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:06.469 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T06:07:06.469 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T06:07:06.469 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.11 2024-09-21T06:07:06.787 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:06 smithi144 systemd[1]: Stopping Ceph osd.11 for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:06.787 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:06.785+0000 7f8e37e3f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:06.787 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:06.785+0000 7f8e37e3f640 -1 osd.11 94 *** Got signal Terminated *** 2024-09-21T06:07:06.787 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:06.785+0000 7f8e37e3f640 -1 osd.11 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:07:07.123 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:06.901+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:07:07.123 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:06.901+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:07:07.123 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:06.901+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:07:07.123 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:06.901+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:07:07.123 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:06.901+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:07:07.123 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:06.901+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:07:07.123 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:06 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:06.901+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-21T06:06:36.945892+0000 front 2024-09-21T06:06:36.945879+0000 (oldest deadline 2024-09-21T06:07:01.045666+0000) 2024-09-21T06:07:08.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:07 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:07.935+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:07:08.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:07 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:07.935+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:07:08.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:07 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:07.935+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:07:08.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:07 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:07.935+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:07:08.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:07 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:07.935+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:07:08.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:07 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:07.935+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:07:08.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:07 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:07.935+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-21T06:06:36.945892+0000 front 2024-09-21T06:06:36.945879+0000 (oldest deadline 2024-09-21T06:07:01.045666+0000) 2024-09-21T06:07:09.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:08 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:08.974+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:07:09.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:08 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:08.974+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:07:09.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:08 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:08.974+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:07:09.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:08 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:08.974+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:07:09.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:08 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:08.974+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:07:09.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:08 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:08.974+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:07:09.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:08 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:08.974+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-21T06:06:36.945892+0000 front 2024-09-21T06:06:36.945879+0000 (oldest deadline 2024-09-21T06:07:01.045666+0000) 2024-09-21T06:07:10.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:09 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:09.954+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:07:10.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:09 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:09.954+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:07:10.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:09 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:09.954+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:07:10.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:09 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:09.954+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:07:10.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:09 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:09.954+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:07:10.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:09 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:09.954+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:07:10.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:09 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:09.954+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-21T06:06:36.945892+0000 front 2024-09-21T06:06:36.945879+0000 (oldest deadline 2024-09-21T06:07:01.045666+0000) 2024-09-21T06:07:11.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:10 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:10.985+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T06:05:40.838332+0000 front 2024-09-21T06:05:40.838159+0000 (oldest deadline 2024-09-21T06:06:03.738075+0000) 2024-09-21T06:07:11.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:10 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:10.985+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-21T06:05:49.039452+0000 front 2024-09-21T06:05:49.039261+0000 (oldest deadline 2024-09-21T06:06:14.939132+0000) 2024-09-21T06:07:11.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:10 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:10.985+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:05:54.939489+0000 front 2024-09-21T06:05:54.939602+0000 (oldest deadline 2024-09-21T06:06:20.740239+0000) 2024-09-21T06:07:11.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:10 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:10.985+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-21T06:06:11.242407+0000 front 2024-09-21T06:06:11.242381+0000 (oldest deadline 2024-09-21T06:06:36.542211+0000) 2024-09-21T06:07:11.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:10 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:10.985+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:06:21.143752+0000 front 2024-09-21T06:06:21.143811+0000 (oldest deadline 2024-09-21T06:06:43.443934+0000) 2024-09-21T06:07:11.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:10 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:10.985+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T06:06:26.344757+0000 front 2024-09-21T06:06:26.344685+0000 (oldest deadline 2024-09-21T06:06:52.244658+0000) 2024-09-21T06:07:11.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:10 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:10.985+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-21T06:06:36.945892+0000 front 2024-09-21T06:06:36.945879+0000 (oldest deadline 2024-09-21T06:07:01.045666+0000) 2024-09-21T06:07:11.373 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:10 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11[57682]: 2024-09-21T06:07:10.985+0000 7f8e3442a640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.144:6820 osd.8 since back 2024-09-21T06:06:46.847086+0000 front 2024-09-21T06:06:46.847130+0000 (oldest deadline 2024-09-21T06:07:10.947220+0000) 2024-09-21T06:07:12.579 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:12 smithi144 podman[67507]: 2024-09-21 06:07:12.303404896 +0000 UTC m=+5.639779977 container died 6cc9df58bb689f60672c49141ce29992688165e6f89504936be3577457bf3f95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T06:07:12.873 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:12 smithi144 podman[67507]: 2024-09-21 06:07:12.676957431 +0000 UTC m=+6.013332513 container cleanup 6cc9df58bb689f60672c49141ce29992688165e6f89504936be3577457bf3f95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T06:07:12.873 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:12 smithi144 bash[67507]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11 2024-09-21T06:07:13.297 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:12 smithi144 podman[67524]: 2024-09-21 06:07:12.944857144 +0000 UTC m=+0.638682722 container remove 6cc9df58bb689f60672c49141ce29992688165e6f89504936be3577457bf3f95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T06:07:13.551 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:13 smithi144 podman[67615]: 2024-09-21 06:07:13.19946562 +0000 UTC m=+0.015885083 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:07:13.552 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:13 smithi144 podman[67615]: 2024-09-21 06:07:13.303924686 +0000 UTC m=+0.120344212 container create 949b9de79bf7739dc4e6f3ca8e882a58f0b405a0c2285a3aa1c2988167b6e1a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T06:07:13.552 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:13 smithi144 podman[67615]: 2024-09-21 06:07:13.550593999 +0000 UTC m=+0.367013462 container init 949b9de79bf7739dc4e6f3ca8e882a58f0b405a0c2285a3aa1c2988167b6e1a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T06:07:13.873 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:13 smithi144 podman[67615]: 2024-09-21 06:07:13.553823803 +0000 UTC m=+0.370243269 container start 949b9de79bf7739dc4e6f3ca8e882a58f0b405a0c2285a3aa1c2988167b6e1a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:07:13.873 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:13 smithi144 podman[67615]: 2024-09-21 06:07:13.648007363 +0000 UTC m=+0.464426829 container attach 949b9de79bf7739dc4e6f3ca8e882a58f0b405a0c2285a3aa1c2988167b6e1a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T06:07:13.873 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:07:13 smithi144 podman[67615]: 2024-09-21 06:07:13.736089558 +0000 UTC m=+0.552509022 container died 949b9de79bf7739dc4e6f3ca8e882a58f0b405a0c2285a3aa1c2988167b6e1a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:07:14.378 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T06:07:14.418 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:14.418 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T06:07:14.418 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T06:07:14.419 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.a 2024-09-21T06:07:14.831 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 06:07:14 smithi037 systemd[1]: Stopping Ceph mds.a for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:15.164 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 06:07:14 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-a[69934]: 2024-09-21T06:07:14.828+0000 7f8409600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:15.164 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 06:07:14 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-a[69934]: 2024-09-21T06:07:14.828+0000 7f8409600640 -1 mds.a *** got signal Terminated *** 2024-09-21T06:07:18.164 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 06:07:17 smithi037 podman[112207]: 2024-09-21 06:07:17.897019056 +0000 UTC m=+3.180489377 container died f94f9c88a7e9d2e79cd5b45469928340ace9f927f40a701855beb221988a4240 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T06:07:18.628 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 06:07:18 smithi037 podman[112207]: 2024-09-21 06:07:18.358591762 +0000 UTC m=+3.642062079 container cleanup f94f9c88a7e9d2e79cd5b45469928340ace9f927f40a701855beb221988a4240 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:07:18.628 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 06:07:18 smithi037 bash[112207]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-a 2024-09-21T06:07:18.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T06:07:18.878 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:18.878 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T06:07:18.879 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T06:07:18.879 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.d 2024-09-21T06:07:19.309 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 06:07:18 smithi037 systemd[1]: Stopping Ceph mds.d for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:19.664 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 06:07:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-d[68832]: 2024-09-21T06:07:19.307+0000 7fa0e3800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:19.664 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 06:07:19 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-d[68832]: 2024-09-21T06:07:19.307+0000 7fa0e3800640 -1 mds.d *** got signal Terminated *** 2024-09-21T06:07:23.633 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 06:07:23 smithi037 podman[112324]: 2024-09-21 06:07:23.331481779 +0000 UTC m=+4.173649814 container died b11eda651d28d4c8bbc6d23a27bcce89130b35532845f7860f629ff88886bd30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T06:07:23.914 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 06:07:23 smithi037 podman[112324]: 2024-09-21 06:07:23.74605105 +0000 UTC m=+4.588219085 container cleanup b11eda651d28d4c8bbc6d23a27bcce89130b35532845f7860f629ff88886bd30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T06:07:23.983 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 06:07:23 smithi037 bash[112324]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-d 2024-09-21T06:07:24.276 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 06:07:24 smithi037 podman[112350]: 2024-09-21 06:07:24.005806563 +0000 UTC m=+0.664097763 container remove b11eda651d28d4c8bbc6d23a27bcce89130b35532845f7860f629ff88886bd30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:07:24.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T06:07:24.367 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:24.367 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T06:07:24.367 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T06:07:24.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.g 2024-09-21T06:07:24.664 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 06:07:24 smithi037 systemd[1]: Stopping Ceph mds.g for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:25.164 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 06:07:24 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-g[69560]: 2024-09-21T06:07:24.769+0000 7f0785000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:25.164 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 06:07:24 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-g[69560]: 2024-09-21T06:07:24.769+0000 7f0785000640 -1 mds.g *** got signal Terminated *** 2024-09-21T06:07:26.338 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 06:07:26 smithi037 podman[112456]: 2024-09-21 06:07:26.014545314 +0000 UTC m=+1.364213803 container died 171307452f4f41c6a2ac1c67fc83a3e3509f10c6084cc99294a0b6fdb5ad1bda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-g, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:07:26.652 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 06:07:26 smithi037 podman[112456]: 2024-09-21 06:07:26.441604788 +0000 UTC m=+1.791273274 container cleanup 171307452f4f41c6a2ac1c67fc83a3e3509f10c6084cc99294a0b6fdb5ad1bda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T06:07:26.652 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 06:07:26 smithi037 bash[112456]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-g 2024-09-21T06:07:26.914 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 06:07:26 smithi037 podman[112468]: 2024-09-21 06:07:26.65129694 +0000 UTC m=+0.626567187 container remove 171307452f4f41c6a2ac1c67fc83a3e3509f10c6084cc99294a0b6fdb5ad1bda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:07:26.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T06:07:27.009 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:27.010 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T06:07:27.010 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T06:07:27.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.j 2024-09-21T06:07:27.383 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 06:07:27 smithi037 systemd[1]: Stopping Ceph mds.j for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:27.664 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 06:07:27 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-j[68443]: 2024-09-21T06:07:27.381+0000 7f40ebc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:27.664 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 06:07:27 smithi037 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-j[68443]: 2024-09-21T06:07:27.381+0000 7f40ebc00640 -1 mds.j *** got signal Terminated *** 2024-09-21T06:07:31.664 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 06:07:31 smithi037 podman[112574]: 2024-09-21 06:07:31.411997271 +0000 UTC m=+4.132342047 container died 03932e4311853d85da65a19d47e6bb3e2634975f910b4417d4af794b2385ff0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T06:07:32.079 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 06:07:31 smithi037 podman[112574]: 2024-09-21 06:07:31.786949327 +0000 UTC m=+4.507294101 container cleanup 03932e4311853d85da65a19d47e6bb3e2634975f910b4417d4af794b2385ff0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T06:07:32.079 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 06:07:31 smithi037 bash[112574]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-j 2024-09-21T06:07:32.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T06:07:32.308 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:32.308 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T06:07:32.309 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T06:07:32.309 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.b 2024-09-21T06:07:32.612 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 06:07:32 smithi067 systemd[1]: Stopping Ceph mds.b for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:32.884 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 06:07:32 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-b[62795]: 2024-09-21T06:07:32.610+0000 7faf1acdf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:32.884 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 06:07:32 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-b[62795]: 2024-09-21T06:07:32.610+0000 7faf1acdf640 -1 mds.b *** got signal Terminated *** 2024-09-21T06:07:36.511 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 06:07:36 smithi067 podman[67361]: 2024-09-21 06:07:36.250471183 +0000 UTC m=+3.745048604 container died 7ea473fb763d376ceeb5f4bfaaf1393250c0bf90b168e80b42f0ad1c371b4d9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T06:07:36.870 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 06:07:36 smithi067 podman[67361]: 2024-09-21 06:07:36.617686089 +0000 UTC m=+4.112263510 container cleanup 7ea473fb763d376ceeb5f4bfaaf1393250c0bf90b168e80b42f0ad1c371b4d9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-b, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T06:07:36.870 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 21 06:07:36 smithi067 bash[67361]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-b 2024-09-21T06:07:37.002 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T06:07:37.039 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:37.039 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T06:07:37.040 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T06:07:37.040 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.e 2024-09-21T06:07:37.496 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 06:07:37 smithi067 systemd[1]: Stopping Ceph mds.e for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:37.496 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 06:07:37 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-e[62244]: 2024-09-21T06:07:37.362+0000 7f3b056be640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:37.496 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 06:07:37 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-e[62244]: 2024-09-21T06:07:37.362+0000 7f3b056be640 -1 mds.e *** got signal Terminated *** 2024-09-21T06:07:38.996 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 06:07:38 smithi067 podman[67493]: 2024-09-21 06:07:38.650079094 +0000 UTC m=+1.384557828 container died b77f6d6dbd24ff2cdc1f80a47af101374154eceaa639ce601f4fcbc88c71a994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-e, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:07:39.496 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 06:07:39 smithi067 podman[67493]: 2024-09-21 06:07:39.141399802 +0000 UTC m=+1.875878535 container cleanup b77f6d6dbd24ff2cdc1f80a47af101374154eceaa639ce601f4fcbc88c71a994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T06:07:39.496 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 06:07:39 smithi067 bash[67493]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-e 2024-09-21T06:07:39.496 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 21 06:07:39 smithi067 podman[67506]: 2024-09-21 06:07:39.38118318 +0000 UTC m=+0.730588689 container remove b77f6d6dbd24ff2cdc1f80a47af101374154eceaa639ce601f4fcbc88c71a994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T06:07:39.529 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T06:07:39.561 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:39.561 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T06:07:39.561 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T06:07:39.561 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.h 2024-09-21T06:07:39.877 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 06:07:39 smithi067 systemd[1]: Stopping Ceph mds.h for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:40.246 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 06:07:39 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-h[62513]: 2024-09-21T06:07:39.875+0000 7ff25e1f9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:40.246 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 06:07:39 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-h[62513]: 2024-09-21T06:07:39.875+0000 7ff25e1f9640 -1 mds.h *** got signal Terminated *** 2024-09-21T06:07:43.160 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 06:07:42 smithi067 podman[67612]: 2024-09-21 06:07:42.763069285 +0000 UTC m=+2.990600475 container died e4a148a54a25c66c489601a46631fe457fe5920d2910bbdde5f44a577caa4d89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-h, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T06:07:43.494 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 06:07:43 smithi067 podman[67612]: 2024-09-21 06:07:43.233677792 +0000 UTC m=+3.461208977 container cleanup e4a148a54a25c66c489601a46631fe457fe5920d2910bbdde5f44a577caa4d89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-h, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T06:07:43.495 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 21 06:07:43 smithi067 bash[67612]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-h 2024-09-21T06:07:43.627 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T06:07:43.659 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:43.659 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T06:07:43.659 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T06:07:43.660 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.k 2024-09-21T06:07:43.746 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 06:07:43 smithi067 systemd[1]: Stopping Ceph mds.k for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:44.246 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 06:07:44 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-k[61975]: 2024-09-21T06:07:44.027+0000 7fb08f9e5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:44.246 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 06:07:44 smithi067 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-k[61975]: 2024-09-21T06:07:44.027+0000 7fb08f9e5640 -1 mds.k *** got signal Terminated *** 2024-09-21T06:07:48.496 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 06:07:48 smithi067 podman[67734]: 2024-09-21 06:07:48.034813495 +0000 UTC m=+4.163438618 container died 8fc114606522ca7c195593efae6fe9af0fe9992a2ac3e3e64b7e4b033985984b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-k, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T06:07:48.889 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 06:07:48 smithi067 podman[67734]: 2024-09-21 06:07:48.603490365 +0000 UTC m=+4.732115485 container cleanup 8fc114606522ca7c195593efae6fe9af0fe9992a2ac3e3e64b7e4b033985984b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-k, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:07:48.889 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 21 06:07:48 smithi067 bash[67734]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-k 2024-09-21T06:07:49.035 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T06:07:49.067 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:49.067 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T06:07:49.067 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T06:07:49.067 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.c 2024-09-21T06:07:49.373 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:07:49 smithi144 systemd[1]: Stopping Ceph mds.c for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:49.638 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:07:49 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-c[62512]: 2024-09-21T06:07:49.508+0000 7f5bf9139640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:49.639 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:07:49 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-c[62512]: 2024-09-21T06:07:49.508+0000 7f5bf9139640 -1 mds.c *** got signal Terminated *** 2024-09-21T06:07:52.373 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:07:52 smithi144 podman[67730]: 2024-09-21 06:07:52.039749766 +0000 UTC m=+2.773288498 container died 528f81ce7b5263115101268bac42c0e92907da7ccb83fb9961ff861917550c92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:07:53.011 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:07:52 smithi144 podman[67730]: 2024-09-21 06:07:52.708421028 +0000 UTC m=+3.441959760 container cleanup 528f81ce7b5263115101268bac42c0e92907da7ccb83fb9961ff861917550c92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-c, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T06:07:53.011 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:07:52 smithi144 bash[67730]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-c 2024-09-21T06:07:53.139 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T06:07:53.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:53.179 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T06:07:53.179 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T06:07:53.179 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.f 2024-09-21T06:07:53.372 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:07:53 smithi144 systemd[1]: Stopping Ceph mds.f for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:53.873 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:07:53 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-f[62243]: 2024-09-21T06:07:53.486+0000 7fc08f0a4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:53.873 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:07:53 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-f[62243]: 2024-09-21T06:07:53.486+0000 7fc08f0a4640 -1 mds.f *** got signal Terminated *** 2024-09-21T06:07:57.614 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:07:57 smithi144 podman[67863]: 2024-09-21 06:07:57.337753845 +0000 UTC m=+3.948508730 container died fde8f51b11a717f0ba5c3d79e434f59337d641fa51c9bedc3eaece4a1369c17f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T06:07:57.872 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:07:57 smithi144 podman[67863]: 2024-09-21 06:07:57.69593448 +0000 UTC m=+4.306689359 container cleanup fde8f51b11a717f0ba5c3d79e434f59337d641fa51c9bedc3eaece4a1369c17f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-f, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:07:57.873 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:07:57 smithi144 bash[67863]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-f 2024-09-21T06:07:58.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T06:07:58.110 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:07:58.110 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T06:07:58.111 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T06:07:58.111 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.i 2024-09-21T06:07:58.373 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:07:58 smithi144 systemd[1]: Stopping Ceph mds.i for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:07:58.872 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:07:58 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-i[62783]: 2024-09-21T06:07:58.423+0000 7f71d0faf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:07:58.872 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:07:58 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-i[62783]: 2024-09-21T06:07:58.423+0000 7f71d0faf640 -1 mds.i *** got signal Terminated *** 2024-09-21T06:08:00.373 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:08:00 smithi144 podman[67982]: 2024-09-21 06:08:00.25276048 +0000 UTC m=+1.927189815 container died 22dbfef21f1f9d12a654a1c1721590dfe9f41bea8ae4874d19c2bfd7c727cd99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-i, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T06:08:00.873 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:08:00 smithi144 podman[67982]: 2024-09-21 06:08:00.707948384 +0000 UTC m=+2.382377715 container cleanup 22dbfef21f1f9d12a654a1c1721590dfe9f41bea8ae4874d19c2bfd7c727cd99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-i, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T06:08:00.873 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:08:00 smithi144 bash[67982]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-i 2024-09-21T06:08:01.108 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T06:08:01.129 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:08:00 smithi144 podman[67995]: 2024-09-21 06:08:00.875875968 +0000 UTC m=+0.618577458 container remove 22dbfef21f1f9d12a654a1c1721590dfe9f41bea8ae4874d19c2bfd7c727cd99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-i, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:08:01.129 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:08:01 smithi144 systemd[1]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.i.service: Deactivated successfully. 2024-09-21T06:08:01.129 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:08:01 smithi144 systemd[1]: Stopped Ceph mds.i for 0c10cdda-77dc-11ef-baf5-efdc52797490. 2024-09-21T06:08:01.129 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:08:01 smithi144 systemd[1]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.i.service: Consumed 11.022s CPU time. 2024-09-21T06:08:01.139 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:08:01.140 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T06:08:01.140 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T06:08:01.140 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.l 2024-09-21T06:08:01.471 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:08:01 smithi144 systemd[1]: Stopping Ceph mds.l for 0c10cdda-77dc-11ef-baf5-efdc52797490... 2024-09-21T06:08:01.873 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:08:01 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-l[61972]: 2024-09-21T06:08:01.469+0000 7faadf187640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:08:01.873 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:08:01 smithi144 ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-l[61972]: 2024-09-21T06:08:01.469+0000 7faadf187640 -1 mds.l *** got signal Terminated *** 2024-09-21T06:08:05.830 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:08:05 smithi144 podman[68104]: 2024-09-21 06:08:05.484954301 +0000 UTC m=+4.120060088 container died 91a5a2896474d650c078c397888f91c2b05d45951f75157c8bf4011677915d5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-l, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T06:08:06.088 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:08:05 smithi144 podman[68104]: 2024-09-21 06:08:05.928406667 +0000 UTC m=+4.563512453 container cleanup 91a5a2896474d650c078c397888f91c2b05d45951f75157c8bf4011677915d5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T06:08:06.089 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:08:05 smithi144 bash[68104]: ceph-0c10cdda-77dc-11ef-baf5-efdc52797490-mds-l 2024-09-21T06:08:06.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c10cdda-77dc-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T06:08:06.327 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:08:06.327 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T06:08:06.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:08:06.614 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T06:08:10.497 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:08:10.706 INFO:teuthology.orchestra.run.smithi067.stdout:Deleting cluster with fsid: 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T06:08:13.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:08:13.440 INFO:teuthology.orchestra.run.smithi144.stdout:Deleting cluster with fsid: 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T06:08:15.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:08:15.845 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:08:15.877 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:08:15.905 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T06:08:15.907 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913501/remote/smithi037/crash 2024-09-21T06:08:15.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:08:15.992 INFO:teuthology.orchestra.run.smithi037.stderr:tar: /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:08:15.992 INFO:teuthology.orchestra.run.smithi037.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:08:15.995 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913501/remote/smithi067/crash 2024-09-21T06:08:15.996 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:08:16.032 INFO:teuthology.orchestra.run.smithi067.stderr:tar: /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:08:16.032 INFO:teuthology.orchestra.run.smithi067.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:08:16.034 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913501/remote/smithi144/crash 2024-09-21T06:08:16.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:08:16.069 INFO:teuthology.orchestra.run.smithi144.stderr:tar: /var/lib/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:08:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:08:16.070 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T06:08:16.074 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T06:08:16.157 INFO:tasks.cephadm:Compressing logs... 2024-09-21T06:08:16.158 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:08:16.162 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:08:16.164 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:08:16.189 INFO:teuthology.orchestra.run.smithi144.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:08:16.189 INFO:teuthology.orchestra.run.smithi144.stderr:: No such file or directory 2024-09-21T06:08:16.189 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:08:16.190 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T06:08:16.190 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T06:08:16.190 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:08:16.192 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T06:08:16.192 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T06:08:16.192 INFO:teuthology.orchestra.run.smithi144.stderr: 81.9% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:08:16.192 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T06:08:16.192 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:08:16.193 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T06:08:16.193 INFO:teuthology.orchestra.run.smithi144.stderr: 90.4% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:08:16.193 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T06:08:16.194 INFO:teuthology.orchestra.run.smithi067.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T06:08:16.194 INFO:teuthology.orchestra.run.smithi067.stderr:: No such file or directory 2024-09-21T06:08:16.194 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T06:08:16.194 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T06:08:16.194 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:08:16.194 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T06:08:16.196 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.log: /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.l.log: 87.0% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:08:16.197 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T06:08:16.197 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T06:08:16.197 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T06:08:16.197 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:08:16.197 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:08:16.198 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:08:16.198 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T06:08:16.199 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log: 82.0% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:08:16.201 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:08:16.201 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.8.log: 95.0% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T06:08:16.201 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T06:08:16.203 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mgr.y.log: 94.9% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T06:08:16.203 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T06:08:16.203 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mgr.z.log: 90.9% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:08:16.203 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T06:08:16.205 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.log: 87.0% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:08:16.206 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T06:08:16.207 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.h.log: 91.0% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:08:16.209 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T06:08:16.209 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.c.log: 92.7% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T06:08:16.209 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:08:16.210 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mon.b.log: 92.6% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T06:08:16.210 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:08:16.211 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.f.log: 94.9% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T06:08:16.212 INFO:teuthology.orchestra.run.smithi037.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory /var/log/ceph/ceph-client.admin.log 2024-09-21T06:08:16.212 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-21T06:08:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T06:08:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T06:08:16.215 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:08:16.215 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.e.log: 95.0% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T06:08:16.216 INFO:teuthology.orchestra.run.smithi037.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-21T06:08:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:08:16.217 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:08:16.218 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T06:08:16.218 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:08:16.218 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/cephadm.log: 95.0% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T06:08:16.218 INFO:teuthology.orchestra.run.smithi144.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:08:16.219 INFO:teuthology.orchestra.run.smithi067.stderr: 94.9% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T06:08:16.220 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T06:08:16.220 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T06:08:16.220 INFO:teuthology.orchestra.run.smithi037.stderr: 82.1% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:08:16.221 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mon.a.log: 90.2% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:08:16.222 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T06:08:16.223 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:08:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.6.log: /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T06:08:16.227 INFO:teuthology.orchestra.run.smithi037.stderr: 95.1% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T06:08:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.d.log: 95.1% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T06:08:16.231 INFO:teuthology.orchestra.run.smithi037.stderr: 90.8% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:08:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T06:08:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T06:08:16.234 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T06:08:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.j.log: /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.3.log: 87.0% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:08:16.238 INFO:teuthology.orchestra.run.smithi037.stderr: 95.0% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T06:08:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:08:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/cephadm.log: 95.1% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T06:08:16.247 INFO:teuthology.orchestra.run.smithi037.stderr: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:08:16.554 INFO:teuthology.orchestra.run.smithi037.stderr: 90.3% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T06:08:16.686 INFO:teuthology.orchestra.run.smithi144.stderr: 91.7% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T06:08:16.719 INFO:teuthology.orchestra.run.smithi067.stderr: 91.7% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T06:08:17.148 INFO:teuthology.orchestra.run.smithi037.stderr: 90.3% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T06:08:20.035 INFO:teuthology.orchestra.run.smithi144.stderr: 96.0% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T06:08:24.025 INFO:teuthology.orchestra.run.smithi144.stderr: 91.8% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T06:08:28.582 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T06:08:30.141 INFO:teuthology.orchestra.run.smithi067.stderr: 91.6% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T06:08:32.280 INFO:teuthology.orchestra.run.smithi067.stderr: 91.9% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T06:08:33.582 INFO:teuthology.orchestra.run.smithi037.stderr: 92.1% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T06:08:33.790 INFO:teuthology.orchestra.run.smithi067.stderr: 91.6% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T06:08:35.122 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T06:08:37.551 INFO:teuthology.orchestra.run.smithi067.stderr: 91.9% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T06:08:40.617 INFO:teuthology.orchestra.run.smithi037.stderr: 91.4% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T06:08:40.658 INFO:teuthology.orchestra.run.smithi037.stderr: 91.6% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T06:08:41.451 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T06:08:41.452 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-21T06:08:41.452 INFO:teuthology.orchestra.run.smithi144.stderr:real 0m25.274s 2024-09-21T06:08:41.452 INFO:teuthology.orchestra.run.smithi144.stderr:user 1m6.539s 2024-09-21T06:08:41.453 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m2.165s 2024-09-21T06:08:42.213 INFO:teuthology.orchestra.run.smithi037.stderr: 91.7% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T06:08:42.217 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-21T06:08:42.217 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m26.026s 2024-09-21T06:08:42.217 INFO:teuthology.orchestra.run.smithi037.stderr:user 1m26.635s 2024-09-21T06:08:42.217 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m6.925s 2024-09-21T06:09:03.544 INFO:teuthology.orchestra.run.smithi067.stderr: 94.1% -- replaced with /var/log/ceph/0c10cdda-77dc-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T06:09:03.545 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-21T06:09:03.546 INFO:teuthology.orchestra.run.smithi067.stderr:real 0m47.367s 2024-09-21T06:09:03.546 INFO:teuthology.orchestra.run.smithi067.stderr:user 1m53.493s 2024-09-21T06:09:03.546 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m3.229s 2024-09-21T06:09:03.547 INFO:tasks.cephadm:Archiving logs... 2024-09-21T06:09:03.547 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913501/remote/smithi037/log 2024-09-21T06:09:03.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:09:17.172 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913501/remote/smithi067/log 2024-09-21T06:09:17.173 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:09:32.470 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913501/remote/smithi144/log 2024-09-21T06:09:32.471 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:09:42.940 INFO:tasks.cephadm:Removing cluster... 2024-09-21T06:09:42.941 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 --force 2024-09-21T06:09:43.226 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T06:09:44.051 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 --force 2024-09-21T06:09:44.263 INFO:teuthology.orchestra.run.smithi067.stdout:Deleting cluster with fsid: 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T06:09:44.669 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0c10cdda-77dc-11ef-baf5-efdc52797490 --force 2024-09-21T06:09:44.871 INFO:teuthology.orchestra.run.smithi144.stdout:Deleting cluster with fsid: 0c10cdda-77dc-11ef-baf5-efdc52797490 2024-09-21T06:09:45.268 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T06:09:45.268 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:09:45.309 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:09:45.325 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:09:45.342 INFO:tasks.cephadm:Teardown complete 2024-09-21T06:09:45.342 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T06:09:45.352 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T06:09:45.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:09:45.359 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:09:45.370 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:09:45.486 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T06:09:45.496 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T06:09:45.496 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:09:45.501 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:09:45.503 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:09:45.515 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:09:45.518 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:09:45.519 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:09:45.519 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-09-21T06:09:45.519 INFO:teuthology.orchestra.run.smithi067.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 -182us[ -167us] +/- 50ms 2024-09-21T06:09:45.519 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 +471us[ +471us] +/- 57ms 2024-09-21T06:09:45.519 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -234us[ -234us] +/- 60ms 2024-09-21T06:09:45.520 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:09:45.522 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:09:45.522 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-21T06:09:45.522 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 -175us[ -165us] +/- 50ms 2024-09-21T06:09:45.522 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 +465us[ +475us] +/- 57ms 2024-09-21T06:09:45.522 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 -245us[ -235us] +/- 60ms 2024-09-21T06:09:45.523 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:09:45.531 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:09:45.539 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:09:45.539 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-21T06:09:45.539 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 -191us[ -163us] +/- 50ms 2024-09-21T06:09:45.539 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 +478us[ +506us] +/- 57ms 2024-09-21T06:09:45.539 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -251us[ -223us] +/- 60ms 2024-09-21T06:09:45.539 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:09:45.540 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T06:09:45.550 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T06:09:45.551 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T06:09:45.560 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:09:45.710 DEBUG:teuthology.orchestra.run.smithi067:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:09:45.777 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:09:45.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:09:45.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:09:45.905 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:09:45.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:09:45.932 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:09:45.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:09:45.960 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T06:09:45.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T06:09:45.988 INFO:teuthology.task.internal:Duration was 2139.756330 seconds 2024-09-21T06:09:45.988 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T06:09:45.999 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T06:09:45.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:09:46.003 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:09:46.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:09:46.041 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:09:46.044 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:09:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:09:46.536 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T06:09:46.537 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T06:09:46.537 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:09:46.587 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2024-09-21T06:09:46.587 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:09:46.613 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2024-09-21T06:09:46.614 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:09:46.635 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T06:09:46.636 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:09:46.640 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:09:46.656 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:09:46.703 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T06:09:46.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:09:46.707 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:09:46.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:09:47.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T06:09:47.471 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T06:09:47.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:09:47.527 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:09:47.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:09:47.582 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T06:09:47.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:09:47.597 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:09:47.599 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:09:47.621 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2024-09-21T06:09:47.647 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2024-09-21T06:09:47.664 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-09-21T06:09:47.693 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:09:47.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:09:47.727 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:09:47.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:09:47.742 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:09:47.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:09:47.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T06:09:47.769 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T06:09:47.769 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913501/remote/smithi037 2024-09-21T06:09:47.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:09:47.852 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913501/remote/smithi067 2024-09-21T06:09:47.852 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:09:47.888 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913501/remote/smithi144 2024-09-21T06:09:47.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:09:47.924 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T06:09:47.924 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:09:47.929 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:09:47.931 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:09:47.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T06:09:47.994 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T06:09:47.994 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T06:09:48.051 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T06:09:48.052 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:09:48.056 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:09:48.058 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:09:48.071 INFO:teuthology.orchestra.run.smithi067.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:09 /home/ubuntu/cephtest 2024-09-21T06:09:48.076 INFO:teuthology.orchestra.run.smithi144.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:09 /home/ubuntu/cephtest 2024-09-21T06:09:48.086 INFO:teuthology.orchestra.run.smithi037.stdout: 393255 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:09 /home/ubuntu/cephtest 2024-09-21T06:09:48.089 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T06:09:48.100 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T06:09:48.125 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsx}} duration: 2139.7563297748566 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T06:09:48.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:09:48.217 INFO:teuthology.run:pass